Detection of Numerical Bugs with Large Language

il y a 6 jours

Perpignan, France David Defour Temps plein

**Detection of Numerical Bugs with Large Language Model(LLM)**:

- Réf **ABG-126594**
- Stage master 2 / Ingénieur- Durée 6 mois- Salaire net mensuel 630€- 31/10/2024- David Defour- Lieu de travail- Perpignan Occitanie France- Champs scientifiques- Informatique
- Mathématiques
- Mots clés- IEEE754, floating-point computation, LLM-
- 01/02/2025**Établissement recruteur**:
**Site web**:
The University of Perpignan Via Domitia is one of the oldest universities in Europe, located at the center of the Toulouse-Montpellier-Barcelona triangle. It houses the Laboratory for Mathematics, Multidisciplinary Research, and Simulation (LAMPS), which focuses on Mathematical and Numerical Modeling for Mechanics, Physics of Complex Systems, Characterization of Digital and Discrete Systems, as well as Nonlinear Analysis and Optimization.

**Description**:
Introduction:
The advent of LLMs (Large Language Models) is generating a great interest in the research community for their potential to enhance productivity in numerous sciences and engineering. For example, GitHub Copilot, a model trained on natural language and a wide range of programs, helps developers write code faster and more efficiently by using automatic code completion and answering complex directives in natural language (prompt). However, this potential remains to be explored/demonstrated in many challenging areas, such as writing programs that manipulate floating-point numbers due to the specificity of these numbers and the issues related to their use.

The objective of this internship is to assess the usefulness of LLMs for static detection (without executing the program) of numerical bugs during code writing. It is worth noting that this internship is part of a significant project funded for the period 2025-2029 by the National Research Agency (ANR project Floating-Point Transformer 4), bringing together academic and industrial partners (University of Perpignan Via Domitia, University of Versailles - Paris-Saclay, Sorbonne, EDF, CEA, ANEO, Intel). A continuation through a PhD is possible.

Floating-point arithmetic:
The IEEE-754 [6] standard is the cornerstone of floating-point number representation in modern computer systems, ensuring consistency and precision in numerical calculations across various hardware and software platforms. Universally adopted, this standard defines several formats for representing real numbers, the most used being single precision (32 bits) and double precision (64 bits). These numbers are represented by three fields: the sign, which determines whether the number is positive or negative, the biased exponent, which represents the range of possible values, and the mantissa, which represents the fractional part of the number.

Today, these issues can be detected at the end of the process through static or dynamic code analysis. Static analysis involves examining the source code without requiring its execution and focuses on identifying errors or coding standard violations. It allows for early problem detection, reducing development time and costs. However, this type of analysis may generate false positives or false negatives, affecting the quality of the analysis. On the other hand, dynamic analysis requires code execution and evaluates its behavior in real-time on one or more test data sets, but it is often incomplete (examples of tools: CADNA[2], FPCheckerErreur Source du renvoi introuvable., Verificarlo[3], FramaC[5]).

LLM:
Several methods exist to improve the relevance of the results produced by these tools. For example, prompt engineering involves designing precise and relevant textual instructions, fine-tuning adjusts a pre-trained model with new data for a specific domain, and RAG (Retrieval-Augmented Generation) enriches queries with information retrieved from external sources. Each of these solutions has its advantages and disadvantages. Fine-tuning is generally more suitable for stylistic adjustments but has some drawbacks (e.g., susceptibility to forgetting due to overtraining or altering the importance of information located at the core of its context window), while RAG is better suited for knowledge enhancement but comes at the cost of more complex prompts, leading to higher processing costs or scalability issues. Lastly integrating one or multiple Llm in an agentic system, such as langchain, and enabling reflection and reasoning strategies like chain of thought or self-iterating, have proven to bring significant progress in complex task at the expense of time complexity, in math and coding challenges.

Methodology:
- Set up a software infrastructure based on Ollama to evaluate LLMs on these programs, first on a test machine and then on a production machine (e.g., Jean-Zay).
- Make the necessary modifications to InterFLOPBench to automate the analysis of responses (e.g., adding metadata and scripts).
- Propose metrics to evaluate the quality of the LLMs' responses.

Assess the value of different solutions for imp

  • Software Engineer with Strong Technical Skills

    il y a 2 jours

    Perpignan, Occitanie, France Ministère de l-Économie, des Finances et de la Souveraineté industrielle et numérique Temps plein

    About the Role:We are seeking a highly skilled Software Engineer to join our team. As a key member of our development team, you will be responsible for designing, developing, and deploying high-quality software applications.Key Responsibilities:Design and develop software applications using a variety of programming languages and technologies.Collaborate with...

  • Software Developer with Proficiency in Object-Oriented Programming

    il y a 2 jours

    Perpignan, Occitanie, France Groupe Cyrus - Maison Herez Temps plein

    Job Title: Software DeveloperAs a software developer at {company}, you will be responsible for designing, developing, and testing software applications.**Key Responsibilities:*** Design and develop software applications using object-oriented programming languages* Collaborate with cross-functional teams to identify and prioritize software development needs*...

  • Key Team Player

    il y a 2 jours

    Perpignan, Occitanie, France Service Autonomie à Domicile Réséda Temps plein

    As a Senior Software Engineer in our team, you will be responsible for designing, developing, and maintaining large-scale software applications. The ideal candidate will have a strong understanding of computer science fundamentals and software engineering principles.The role involves working closely with cross-functional teams, including product management,...

  • Director of Operations

    Il y a 2 mois

    Perpignan, Occitanie, France Centre Hospitalier de Perpignan Temps plein

    About the RoleWe are seeking a highly experienced and skilled Director of Operations to join our team at Centre Hospitalier de Perpignan. As a key member of our leadership team, you will be responsible for overseeing the operational aspects of our organization, ensuring the smooth delivery of our services and the achievement of our strategic objectives.The...

  • Head of Operations

    il y a 4 semaines

    Perpignan, Occitanie, France Centre Hospitalier de Perpignan Temps plein

    About the RoleWe are seeking a highly skilled and experienced Director of Operations to join our team at Centre Hospitalier de Perpignan. As a key member of our leadership team, you will be responsible for overseeing the operational aspects of our organization, ensuring the smooth delivery of our services and the achievement of our strategic objectives.The...

  • Senior Software Engineer

    il y a 2 jours

    Perpignan, Occitanie, France INTERIM NATION PERPIGNAN Temps plein

    Job SummaryAs a senior software engineer, you will be responsible for designing, developing, and testing large-scale software applications. Your expertise in software development and deployment will be essential in ensuring the success of our team.Key ResponsibilitiesDesign and develop software applications using various programming languages.Test and debug...

  • Software Developer

    il y a 2 jours

    Perpignan, Occitanie, France Loxam Temps plein

    About the RoleWe are seeking a skilled Software Developer to join our team. The successful candidate will be responsible for designing, developing, and testing software solutions. This is a fantastic opportunity to work with a talented group of professionals and contribute to the growth and success of our company.Key Responsibilities* Design and develop...

  • Senior Software Engineer

    il y a 3 jours

    Perpignan, Occitanie, France CEC IMMO By Alcantara Temps plein

    Seeking a cloud computing specialist with expertise in software development and deployment. The successful candidate will have a strong understanding of cloud architecture and be able to design and implement scalable solutions.Experience with cloud platforms such as AWS, Azure, and Google CloudProficiency in programming languages such as Java, Python, and...

  • Software Engineer

    il y a 3 jours

    Perpignan, Occitanie, France Family Sphere perpignan Temps plein

    Job Title: Software EngineerWe are looking for a skilled Software Engineer to join our team at {company}. As a key member of our development team, you will be responsible for designing, developing, and maintaining our software applications.Key Responsibilities:Design and develop software applications using various programming languages.Collaborate with...

  • Software Engineer with expertise in data analysis and problem-solving.

    il y a 2 jours

    Perpignan, Occitanie, France Samsic Emploi Temps plein

    About this role:As a software engineer in our team, you will be responsible for analyzing complex data sets and developing innovative solutions to real-world problems. Your expertise in data analysis and problem-solving will enable you to make a significant impact in our organization.Key Responsibilities:Analyze complex data sets to identify trends and...

  • Account Manager

    Il y a 2 mois

    Perpignan, Occitanie, France ORGADATA France SAS Temps plein

    About UsOrgadata France SAS is a leading software company specializing in the manufacturing of windows, doors, and facades. We are a dynamic and innovative organization with a strong focus on customer satisfaction.Job SummaryWe are seeking a highly motivated and experienced Sales Manager to join our team in the South-West region. As a Sales Manager, you will...

  • Dentist Opportunity in Perpignan

    Il y a 2 mois

    Perpignan, Occitanie, France Emploi Chirurgien Dentiste Perpignan 66000 Temps plein

    Position Overview:We are seeking a skilled Dentist to join our modern dental center in Occitanie, France. As a valued member of our team, you will have the opportunity to work in a high-end environment with state-of-the-art equipment and receive support and training from experienced practitioners.Key Responsibilities:Provide high-quality dental care to...

  • Software Engineer: Building High-Performance Applications

    il y a 2 jours

    Perpignan, Occitanie, France INTERSPORT Temps plein

    Key Responsibilities:Design and develop high-performance software applications.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and implement scalable software solutions to meet business needs.Requirements:5+ years of experience in software development.Proficiency in programming languages such as Java, Python,...

  • "{title}" with an emphasis on responsibilities

    il y a 2 jours

    Perpignan, Occitanie, France FRANCE BATI COURTAGE Temps plein

    About the Role{description}Key Responsibilities• {task}• {task2}What You Will Gain• {benefit}• {benefit2}Requirements• {requirement}• {requirement2}About Us{company} is a leading company in {field} with a strong commitment to {value}. We are seeking a highly skilled {title} to join our team and contribute to our success.As a {title}, you will...

  • Software Developer with expertise in AI and Data Science

    il y a 2 jours

    Perpignan, Occitanie, France Loxam Temps plein

    Job Description:As a Software Developer at our company, you will be responsible for designing, developing, and maintaining software applications using AI and Data Science techniques. Your work will involve working closely with cross-functional teams to ensure that software applications meet the needs of our customers.Key Responsibilities:Design and develop...

  • Senior Software Developer

    il y a 2 jours

    Perpignan, Occitanie, France Centre Hospitalier de Perpignan Temps plein

    About the Job:We are looking for an experienced Software Developer to join our team. As a Full Stack Developer, you will be responsible for designing, developing, and maintaining our software applications.Key Responsibilities:Design and develop software applications using various programming languages and technologiesWork collaboratively with...

  • Marketing Specialist with Excellent Communication Skills

    il y a 2 jours

    Perpignan, Occitanie, France Etchart Temps plein

    Job DescriptionWe are seeking a highly motivated Marketing Specialist to join our dynamic team. The ideal candidate will have excellent communication skills and be able to effectively collaborate with cross-functional teams.Key Responsibilities:Develop and implement marketing strategies to achieve business objectivesCollaborate with the sales team to...

  • Software Developer

    il y a 2 jours

    Perpignan, Occitanie, France CN Amirault Temps plein

    **Job Description:**We are looking for a skilled Software Developer to join our IT Team in an exciting role that will see you working on a range of challenging projects.Main Responsibilities:Design, develop and test software applicationsCollaborate with cross-functional teams to deliver high-quality software solutionsStay up-to-date with the latest...

  • Senior Software Engineer: Design and Develop Scalable Solutions

    il y a 2 jours

    Perpignan, Occitanie, France CASÉO Perpignan Temps plein

    Job Title: {title}Job Summary:As a skilled {title}, you will play a crucial role in the development of our software products. Your primary responsibilities will include designing and developing scalable solutions, collaborating with cross-functional teams, and ensuring the highest quality of deliverables.Key Responsibilities:• Design and develop software...

  • Commercial Representative

    Il y a 2 mois

    Perpignan, Occitanie, France AFTRAL Temps plein

    Job OverviewAFTRAL, a leading provider of professional transport-logistics training, is seeking a highly motivated and experienced Sales Representative to join our team.The ideal candidate will have a strong background in sales, excellent communication skills, and a proven track record of meeting and exceeding sales targets.Key ResponsibilitiesDevelop and...