LLM & Financial Markets - Internship

il y a 1 semaine


Rue de l'Université Paris France Capital Fund Management Temps plein
ABOUT CFM

Founded in 1991, we are a global quantitative and systematic asset management firm applying a scientific approach to finance to develop alternative investment strategies that create value for our clients.
We value innovation, dedication, collaboration, and the ability to make an impact. Together, we create a stimulating environment for talented and passionate experts in research, technology, and business to explore new ideas and challenge existing assumptions.

LLMs & Financial Markets: Measuring What the Market Didn't Know Yet

Objective

Qualifying novelty in news and textual information is critical for building high-performing and robust quantitative trading strategies. While widely known LLMs show excellent performance in generalist benchmarks, they fail in extremely specific setups, namely for quantitative finance, and exhibit bias due to future information. In this context, the internship will focus on pre-training and post-training of multiple point-in-time financial LLMs on SEC filings (10-K / 8-K) to measure the novelty of information in each document and explore its link with future stock returns [1].

The project focuses on:

(i) building point-in-time (PIT) language models on SEC filings (10-K / 8-K) or other financial datasets,
(ii) quantifying the novelty or surprise of new information in these filings, and
(iii) Evaluate the approach against benchmarks based on forecasting, synthetic data generation and matching with business experts' commentary

Scope of Work

1. Data Processing
a. Explore 10-K / 8-K corporate open-source SEC filings through the BeanCounter dataset [2]
b. Study and compare this data with our internal datasets

2. LLM Training
a. Perform autoregressive model score pre-training and post-training of open-source architectures (DeepSeek, Qwen, LLaMA…) at different scales using state-of-the-art ML engineering methods (DeepSpeed, PEFT) [3]
b. Explore scaling model size and potentially establish domain-specific scaling laws (from millions to billions of parameters) [5]
c. Explore continuous pretraining, online learning and post-training (RLHF, DPO, SFT) to determine the best approaches for scaling

3. Novelty Score
a. Use LLMs to score sentences and isolate new information within each document
b. Reproduce and extend the exploration in the 10 K proposed in the literature [1]

4. Benchmark the LLM-Based Solution
a. Compare LLMs with standard statistical models (e.g., NLTK Maximum Likelihood Estimator)
b. Compare with other generic approaches using embeddings and other state-of-the-art methods (NovaScore for example [4])

5. Assessment of Extraction Quality (Core Component of the internship)
a. Synthetic dataset generation
b. Compare newly detected events with associated commentary from business experts
c. Evaluate the forecasting capability of models that use only information labeled as "new"

References

1. Costello, Anna M., Bradford Levy, and Valeri V. Nikolaev. "Representations of Investor Beliefs." Available at SSRN
2. Wang, Siyan, and Bradford Levy. "BeanCounter: A low-toxicity, large-scale, and open dataset of business-oriented text." Advances in Neural Information Processing Systems :
3. DeepSeek-AI, DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models (2025)
4. Ai, Lin, et al. "Novascore: A new automated metric for evaluating document level novelty." Proceedings of the 31st International Conference on Computational Linguistics. 2025.
5. Hoffmann, Jordan et al. "Training Compute-Optimal Large Language Models", 36th Conference on Neural Information Processing Systems (NeurIPS 2022).


  • Natwest Markets

    il y a 1 jour


    Paris, France NatWest Markets Temps plein

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in France and as such all normal working days must be carried out in France. **Why NatWest Markets Paris?**: At NatWest Markets, we focus on what matters most to our customers,...


  • Paris, Île-de-France RCQ Associates - Financial Markets Specialists Temps plein

    A leading global financial institution with an excellent reputation within financial markets is expanding its Financial Institutions Sales team in Paris. You should expect to double your basic salary with commission.In this role you will be selling their market-leading products to financial institutions including Investment Banks, Commercial Banks, and...

  • NatWest Markets

    il y a 3 jours


    Paris, Île-de-France NatWest Markets Plc Temps plein

    Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive.This role is based in France and as such all normal working days must be carried out in France.Before you applyIt's important we assess you for the programme that really suits your talents. Please only...

  • 3a Product Internship

    il y a 1 semaine


    Paris, France Murex Temps plein

    Murex is a global fintech leader in trading, risk management and processing solutions for capital markets. Operating from our 19 offices, 3 000 Murexians from over 60 different nationalities ensure the development, implementation and support of our platform which is used by banks, asset managers, corporations and utilities, across the world. Join Murex and...


  • Paris, France Kepler Cheuvreux Temps plein

    **Department**:Repo - Debt & Derivatives - **Duration**: 6 months - **Start Date**:Mid-November 2025 - **Location**: Paris - **Salary**:As per Kepler Cheuvreux’ s policy **KEPLER CHEUVREUX**: Kepler Cheuvreux is a leading independent European financial services company that specialises in Research, Execution, Fixed Income and Credit, Structured Solutions,...


  • Paris, France iBanFirst Temps plein

    **Financial & Business Analyst (internship)** We are looking for an intern to join our Finance team in order to support the Financial and FP&A analysts on the reporting and analysis of the company's key financial metrics. - **Location**: Paris, France - **Duration**: 6 months internship - **Starting Date**: April/May 2025 **Missions** - Prepare and...


  • Paris, France Citi Temps plein

    You’re ready to bring your knowledge from the classroom to the boardroom, and Citi wants to help you get there. Whether it’s honing your skills or building your network, we know that success can’t come without growth. Our programs equip you with the knowledge and training you need to play a valuable role on your team, and establish a long-term career...


  • Paris, France JPMorganChase Temps plein

    **JOB DESCRIPTION** Job Profile** **Job Summary** As an Intern in the Markets team, you will spend your time exploring the sophisticated financial solutions we deliver across asset classes. The skills you develop and the professional network you build and support will serve as a solid foundation for your career. Dedicated instructors and JPMorganChase...


  • Rue de l'Université, Paris, France Capital Fund Management Temps plein

    ABOUT CFMFounded in 1991, we are a global quantitative and systematic asset management firm applying a scientific approach to finance to develop alternative investment strategies that create value for our clients.We value innovation, dedication, collaboration, and the ability to make an impact. Together, we create a stimulating environment for talented and...


  • Paris, Île-de-France TapNation Temps plein

    TapNation - Redefining Mobile Gaming Excellence TapNation is a French company founded in 2019, specializing in mobile game publishing. In six years, it has released more than 50 games and achieved over a billion downloads, ranking among the top 15 publishers worldwide thanks to a strategy combining creativity and technological optimization. The company...