Novel View Rendering with Dust3r

il y a 2 semaines


Grenoble, France NAVER LABS Europe Temps plein

The most common pipeline for NVS is to first reconstruct the scene and cameras in 3D from a collection of images using SfM and MVS, e.g. COLMAP. However, NVS is extremely dependent on camera parameters estimation, which makes the process constrained and tedious. To this aim, we wish to leverage the recent advances in Foundation Models for 3D vision, such as DUSt3R [A], that started to showcase the superiority of plain Vision Transformer architectures (ViTs) for multi-view geometric tasks [A,B,C,D] with limited to no information about camera parameters. This work will aim at the problem of NVS through a similar scope. The applicants to this internship are required to have strong knowledge of the Structure-from-Motion, MVS and NVS pipelines, e.g. [E,F]. Knowledge about Self-Supervised pretraining of ViTs, and 3D Gaussian Splatting [G] are a plus.
**Supervisors**: Vincent Leroy and Jerome Revaud
References
**[A] DUSt3R**: Geometric 3D Vision Made Easy. arXiv preprint 2312.14132
**[B] CroCo**: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completion, Weinzaepfel et al. NeurIPS 2022
**[C] CroCo v2**: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flow, Weinzaepfel et al. ICCV 2023
**[D] MFOS**: Model-Free & One-Shot Object Pose Estimation, Lee et al. AAAI 2024
**[E] COLMAP**: Structure-from-Motion Revisited, Schonberger et al. CVPR 2016
**[F] COLMAP**: Pixelwise View Selection for Unstructured Multi-View Stereo, Schonberger et al. ECCV 2016
[G] 3D Gaussian Splatting for Real-Time Radiance Field Rendering, SIGGRAPH'23
Application instructions

Please note that applicants must be registered students at a university or other academic institution and that this establishment will need to sign an 'Internship Convention' with NAVER LABS Europe before the student is accepted.

About NAVER LABS

NAVER is the #1 Internet portal in Korea with activities that span a wide range of businesses including search, commerce, content, financial and cloud platforms.

NAVER LABS, co-located in Korea and France, is the organization dedicated to preparing NAVER’s future. NAVER LABS Europe is located in a spectacular setting in Grenoble, in the heart of the French Alps. Scientists at NAVER LABS Europe are empowered to pursue long-term research problems that, if successful, can have significant impact and transform NAVER. We take our ideas as far as research can to create the best technology of its kind. Active participation in the academic community and collaborations with world-class public research groups are, among others, important tools to achieve these goals. Teamwork, focus and persistence are important values for us.

NAVER LABS Europe is an equal opportunity employer.


  • Semantic Dust3r

    il y a 2 semaines


    Grenoble, France NAVER LABS Europe Temps plein

    Dense and Unconstrained Stereo 3D Reconstruction (DUSt3R [1]) is a novel breakthrough approach in 3D reconstruction which, contrary to most existing methods, doesn’t require any camera parameters to perform direct 3D reconstruction from image content. DUSt3R is robust and fast, works on any number of images, even when they do not overlap. It represents a...


  • Grenoble, France NAVER LABS Europe Temps plein

    DUSt3R, a novel paradigm for Dense and Unconstrained Stereo 3D Reconstruction, has shown impressive and encouraging results. It casts the pairwise reconstruction problem as a regression of pointmaps, relaxing the hard constraints of the usual projective camera model. It performs well on static urban or interior scenes, and can predict realistic pointmaps...


  • Grenoble, France CEA - Commissariat à l'Energie Atomique Temps plein

    **Domaine**: Technologies micro et nano **Contrat**: Stage **Intitulé de l'offre**: Stage - Hybrid FeRAM/RRAM synaptic circuit for on-chip learning H/F **Sujet de stage**: Circuit synaptique hybride FeRAM/RRAM permettant l'apprentissage sur puce **Durée du contrat (en mois)**: 6 **Description de l'offre**: **The Technological Research Department...


  • Grenoble, France Edwards SAS Temps plein

    Mission/Purpose of the Job: The prime purpose of this role is to provide best in class technical support to customers for semi conductor products to ensure system and product safety, uptime and availability in support for our Customers productivity to improve their satisfaction. Main Responsibilities: - Provide a fast and professional technical support...


  • Grenoble, France ESRF Temps plein

    Context & Job description Structural Biology is one of the most important family of techniques at the ESRF, both for academic and industrial users, with state-of-the-art instruments including the upgraded ID29 beamline for time-resolved serial crystallography. You will join the team of scientists and software engineers working on the applications and...


  • Grenoble, France ESRF Temps plein

    Context & Job description Structural Biology is one of the most important family of techniques at the ESRF, both for academic and industrial users, with state-of-the-art instruments including the upgraded ID29 beamline for time-resolved serial crystallography. You will join the team of scientists and software engineers working on the applications and...


  • Grenoble, France Verkor Temps plein

    Verkor is a French industrial company aiming to pioneer low-carbon battery manufacturing in France. With the backing of prominent industrial companies such as Renault Group, Plastic Omnium and Schneider Electric, Verkor intends to electrify the future of European mobility. With over 200+ experts from 29 different countries, our endeavor is to unite...


  • Grenoble, France ESRF Temps plein

    Context & Job description Scanning X-ray techniques are among the most widely used at ESRF, notably for spectroscopy applications, providing rich spatial and elemental information on a large variety of samples (cultural heritage, batteries, metallurgy, semi-conductors, etc..). The ESRF ‘Extremely Brilliant Source’ upgrade has led to an increase in...


  • Grenoble, France ESRF Temps plein

    Context & Job description Scanning X-ray techniques are among the most widely used at ESRF, notably for spectroscopy applications, providing rich spatial and elemental information on a large variety of samples (cultural heritage, batteries, metallurgy, semi-conductors, etc..). The ESRF ‘Extremely Brilliant Source’ upgrade has led to an increase in...


  • Grenoble, France Edwards SAS Temps plein

    **Regional Technical Support Engineer - Dry Pump - EMEA (m/w/d)**: - Functional area: Service- Country: France- City: Grenoble- Company name: Edwards SAS- Date of posting: Oct 18, 2023**Technical Support Engineer** Reporting to the Technical Support Manager, the Technical Support Engineer will provide best in class technical support to customers for...

  • Bios Engineer

    Il y a 2 mois


    Grenoble, France IC Resources Temps plein

    BIOS / UEFI Engineer Join a pioneering company specialising in high-performance computing, notably known for developing Rhea, a leading energy-efficient microprocessor. Engineered for seamless collaboration with third-party accelerators like GPU, AI, and quantum technologies, 'Rhea' addresses significant challenges in medical research, artificial...

  • Bios Engineer

    il y a 3 semaines


    Grenoble, France IC Resources Temps plein

    BIOS / UEFI Engineer Join a pioneering company specialising in high-performance computing, notably known for developing Rhea, a leading energy-efficient microprocessor. Engineered for seamless collaboration with third-party accelerators like GPU, AI, and quantum technologies, 'Rhea' addresses significant challenges in medical research, artificial...


  • Grenoble, France ILL Temps plein

    **Apprentice - Laboratory work and environmental monitoring** **Core missions of the Environment group** Do you dream of working in a team responsible for environmental monitoring? Then come and join the ILL's Environment group, comprising 5 technicians and one engineer, responsible for environmental radiation monitoring. Some of your work will be...


  • Grenoble, France McPhy Temps plein

    **Who are we?** As a leading industrial player in **hydrogen production and distribution equipment**, McPhy contributes to the global development of **low-carbon hydrogen as a solution for the energy transition**. By its nature, its business model is based on supporting national and European customers active in industry, mobility, and energy, in their...

  • Internal-external Trainer

    il y a 1 semaine


    Grenoble, France McPhy Temps plein

    **Who are we?** As a leading industrial player in **hydrogen production and distribution equipment**, McPhy contributes to the global development of **low-carbon hydrogen as a solution for the energy transition**. By its nature, its business model is based on supporting national and European customers active in industry, mobility, and energy, in their...

  • Internal-external Trainer

    il y a 2 semaines


    Grenoble, France McPhy Temps plein

    **Who are we?** As a leading industrial player in **hydrogen production and distribution equipment**, McPhy contributes to the global development of **green hydrogen as a solution for the energy transition**. By its nature, its business model is based on supporting national and European customers active in industry, mobility, and energy, in their efforts to...

  • Bios Engineer

    il y a 3 semaines


    Grenoble, Auvergne-Rhône-Alpes, France IC Resources Temps plein

    BIOS / UEFI Engineer Join a pioneering company specialising in high-performance computing, notably known for developing Rhea, a leading energy-efficient microprocessor. Engineered for seamless collaboration with third-party accelerators like GPU, AI, and quantum technologies, 'Rhea' addresses significant challenges in medical research, artificial...

  • Bios Engineer

    Il y a 2 mois


    Grenoble, Auvergne-Rhône-Alpes, France IC Resources Temps plein

    BIOS / UEFI Engineer Join a pioneering company specialising in high-performance computing, notably known for developing Rhea, a leading energy-efficient microprocessor. Engineered for seamless collaboration with third-party accelerators like GPU, AI, and quantum technologies, 'Rhea' addresses significant challenges in medical research, artificial...


  • Grenoble, Auvergne-Rhône-Alpes, France Edwards SAS Temps plein

    Regional Technical Support Engineer - Dry Pump - EMEA (m/w/d):Functional area: ServiceCountry: FranceCity: GrenobleCompany name: Edwards SASDate of posting: Oct 18, 2023Technical Support EngineerReporting to the Technical Support Manager, the Technical Support Engineer will provide best in class technical support to customers for Edwards Semiconductor...

  • ERP Data Integration Leader

    il y a 2 semaines


    Grenoble, France Verkor Temps plein

    Verkor is a French industrial company aiming to pioneer low-carbon battery manufacturing in France. With the backing of prominent industrial companies such as Renault Group, Plastic Omnium and Schneider Electric, Verkor intends to electrify the future of European mobility. With over 350 experts from 38 different countries, our endeavor is to unite...