PhD Position F/M Learning to Translate Freehand Design Drawings into Parametric CAD Programs
Il y a 6 mois
Contexte et atouts du poste
This Ph.D. is funded by a joint ANR-NSF grant, in collaboration with Daniel Ritchie from Brown University
Context and Objective
Computer Aided Design (CAD) is a multi-billion dollar industry responsible for the digital design of almost all manufactured goods. It leverages parametric modeling, which allows dimensions of a design to be changed, facilitating physically-based optimization and design re-mixing by non-experts. But CAD’s potential is diminished by the difficulty of creating parametric models: in addition to mastering design principles, professionals must learn complex CAD software interfaces.
To promote effective modeling strategies and creative flow, design educators advocate freehand drawing as a preliminary step to parametric modeling. Unfortunately, CAD systems do not understand these drawings, so designers must re-create their entire design using complex CAD software. Can we automatically convert freehand drawings to parametric CAD models? Sketch-based modeling techniques do not produce parametric CAD programs [1]; classic CAD reverse-engineering techniques cannot handle drawings as input [2]; the newer field of visual program induction is promising but has been demonstrated only on simple shapes and programs [3]. By leveraging the visual vocabulary shared by drawing and CAD modeling, we will develop a system to translate from the natural language of drawing to the formal language of CAD.
References
[1] Symmetry-driven 3D Reconstruction from Concept Sketches. Felix Hähnlein, Yulia Gryaditskaya, Alla Sheffer, Adrien Bousseau. SIGGRAPH 2022.
[2] InverseCSG: automatic conversion of 3D models to CSG trees. T. Du, J. Inala, Y. Pu, A. Spielberg, A. Schulz, D. Rus, A. Solar-Lezama, W. Matusik. ACM Trans. on Graphics (SIGGRAPH Asia) 2018.
[3] Neurosymbolic Models for Computer Graphics. Daniel Ritchie, Paul Guerrero, R. Kenny Jones, Niloy Mitra, Adriana Schulz, Karl D. D. Willis, and Jiajun Wu. Eurographics 2023 STAR.
Mission confiée
To handle drawings as input, we will treat them as timestamped sequences of strokes, allowing us to cast the problem as one of machine translation from drawing stroke sequences to CAD program token sequences. We observe that drawing strokes are grouped into coherent drawing operations that are correlated with CAD modeling strategies (e.g. first drawing construction lines and simple primitives shapes, then refining). We propose to extract these drawing operations as an intermediate representation, which helps disambiguate between the (potentially infinitely) many programs which can represent a single shape. Performing this extraction and then producing CAD programs are complex search problems; we will leverage novel deep neural networks to guide the search.
Principales activités
We will first create a dataset to study how designers draw parametric shapes. To do this, we will collect existing parametric shapes from public datasets and hire professional designers to draw these shapes. These drawings will be used to test our algorithms.We will then develop a drawing analysis algorithm in order to identify the lines of a drawing which correspond to the same 3D parametric operation, then recognize this operation and deduce its parameters. To do this, we intend to use machine learning algorithms that we will train with synthetic drawings generated from reference parametric 3D shapes.
Finally, we will develop a program synthesis method which will combine all the estimated information (input design, recognized 3D operations, estimated parameters) and which will generate a valid program best reproducing the design while being modifiable in the existing 3D design tools. We plan to use a Transformer learning architecture, originally developed for text translation, to “translate” the drawing sequence into a sequence of 3D instructions.
Compétences
The candidate must have experience in Python programming. Past experience in implementing 3D modeling or 3D analysis algorithms is a plus.
Avantages
Subsidized meals Partial reimbursement of public transport costs Leave: 7 weeks of annual leave + 10 extra days off due to RTT (statutory reduction in working hours) + possibility of exceptional leave (sick children, moving home, etc.) Possibility of teleworking and flexible organization of working hours Professional equipment available (videoconferencing, loan of computer equipment, etc.) Social, cultural and sports events and activities Access to vocational training Social security coverage
Rémunération
Duration: 36 months
Location: Sophia Antipolis, France
Gross Salary per month: 2100€ brut per month (year 1 & 2) and 2190€ brut per month (year 3)
-
Technopole de Sophia Antipolis, France INRIA Temps pleinResearch OpportunityThis PhD position is part of a joint ANR-NSF grant, in collaboration with Daniel Ritchie from Brown University.Context and ObjectiveComputer Aided Design (CAD) is a multi-billion dollar industry responsible for the digital design of almost all manufactured goods. It leverages parametric modeling, which allows dimensions of a design to be...
-
Technopole de Sophia Antipolis, France INRIA Temps pleinContext and Objectives INRIA seeks a highly motivated PhD researcher to lead a project on developing a system to translate freehand design drawings into parametric CAD models. The project aims to bridge the gap between the natural language of drawing and the formal language of CAD, enabling designers to leverage parametric modeling without extensive CAD...
-
Researcher - CAD Modeling and Design
il y a 2 semaines
Technopole de Sophia Antipolis, France INRIA Temps pleinContext and Advantages of the PositionThe CAD industry is a multi-billion dollar market that relies heavily on parametric modeling to design and optimize manufactured goods. However, the complexity of CAD software interfaces hinders the creation of parametric models, making it difficult for professionals to master design principles and software capabilities....
-
Technopole de Sophia Antipolis, France INRIA Temps pleinContext and Benefits of the PositionINRIA is seeking a postdoctoral researcher to contribute to the development of a benchmark for sketch-based modeling in the Computer-Aided Design (CAD) industry. This position offers a unique opportunity to work on a cutting-edge project that aims to convert freehand drawings into parametric CAD models.Research...
-
Technopole de Sophia Antipolis, France INRIA Temps pleinContexte et atouts du poste Computer Aided Design (CAD) is a multi-billion dollar industry responsible for the digital design of almost all manufactured goods. It leverages parametric modeling, which allows dimensions of a design to be changed, facilitating physically-based optimization and design remixing by non-experts. But CAD’s potential is...
-
Postdoctoral Research Visitor: Benchmarking Sketch-Based Modeling
il y a 4 semaines
Technopole de Sophia Antipolis, France INRIA Temps pleinContext and Advantages of the PositionINRIA is seeking a Postdoctoral Research Visitor to contribute to the development of a benchmark for sketch-based modeling. This position offers a unique opportunity to work on a cutting-edge project that aims to convert freehand drawings into parametric CAD models.MissionThe goal of this research is to inform the design...
-
Postdoctoral Researcher
il y a 4 semaines
Technopole de Sophia Antipolis, France INRIA Temps pleinContext and Advantages of the PositionINRIA is seeking a highly skilled Postdoctoral Researcher to contribute to a project focused on building a benchmark for sketch-based modeling. This project aims to convert freehand drawings into parametric CAD models that can be reused in downstream applications.Research ObjectivesThe successful candidate will be...
-
PhD Position in Topology Design for Decentralized Federated Learning
il y a 4 semaines
Technopole de Sophia Antipolis, France INRIA Temps pleinJob DetailsThis PhD research position is part of the INRIA research initiative on Federated Learning, FedMalin. The successful candidate will join the NEO project-team, which is positioned at the intersection of Operations Research and Network Science. The research activity will be supervised by Giovanni Neglia, Aurélien Bellet.Research ObjectivesThe goal...
-
PhD Position in Topology Design for Decentralized Federated Learning
il y a 4 semaines
Technopole de Sophia Antipolis, France INRIA Temps pleinResearch OpportunityThis PhD thesis is part of Inria's research initiative on Federated Learning, FedMalin. The PhD candidate will join the NEO project-team, positioned at the intersection of Operations Research and Network Science.Research ObjectivesThe goal of this PhD is to propose algorithms to design the communication topology for decentralized...
-
Optimization Researcher PhD Position
il y a 2 semaines
Technopole de Sophia Antipolis, France INRIA Temps pleinProject OverviewThe position of PhD researcher in optimization research is part of a collaborative project between INRIA and the ANR SWAG-P project. The project focuses on the development of reduced-order modeling techniques for the robust design of gap plasmon resonators.The successful candidate will work on the development of novel optimization methods for...
-
Phd Position F/m Topology Design for Decentralized
Il y a 5 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria centre at Université Côte d'Azur includes 37 research teams and 8 support services. The centre's staff (about 500 people) is made...
-
Phd Position F/m Robust Federated Learning
il y a 2 semaines
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria center at Université Côte d'Azur includes 42 research teams and 9 support services. The center’s staff (about 500 people) is...
-
Technopole de Sophia Antipolis, France INRIA Temps pleinProject OverviewThe proposed PhD project is part of a collaborative multidisciplinary project between the Atlantis project-team from INRIA Research Center and the Elena team at the Pascal Institute. The project aims to design efficient nanoscale biosensors using plasmonic nano-resonators, which are promising for their high sensitivity and miniaturization...
-
PhD Position F/M PhD Position Computer Vision
Il y a 5 mois
Technopole de Sophia Antipolis, France INRIA Temps pleinContexte et atouts du poste Inria, the French National Institute for computer science and applied mathematics, promotes “scientific excellence for technology transfer and society”. Graduates from the world’s top universities, Inria's 2,700 employees rise to the challenges of digital sciences. With its open, agile model, Inria is able to explore...
-
PhD Researcher in Computer Vision and Deep Learning
il y a 1 mois
Technopole de Sophia Antipolis, France INRIA Temps pleinResearch OpportunityInria, a leading French research institute, is seeking a PhD researcher to join its STARS team. The successful candidate will contribute to cutting-edge research in computer vision and deep learning, focusing on generative models and video generation.Key ResponsibilitiesInvestigate novel model architectures for video generationExplore...
-
Technopole de Sophia Antipolis, France INRIA Temps pleinJob DescriptionContext and Key ResponsibilitiesThe present doctoral project is part of a collaborative research effort between the Atlantis project-team from the Inria Research Center at Université Côte d'Azur and the CNRS-CRHEA laboratory in Sophia Antipolis, France.Atlantis is a joint project-team between Inria and the Jean-Alexandre Dieudonné...
-
Technopole de Sophia Antipolis, France INRIA Temps pleinContexte et atouts du poste TENORS ( T ensor mod E li N g, ge O met R y and optimi S ation) is a Marie Skłodowska-Curie Doctoral Network / Joint Doctorate (2024-2027), offering 15 PhD positions. The objective of TENORS is to conduct advanced research that addresses critical challenges in the fields of tensor modeling and computation , joining...
-
Phd Position F/m Phd Position Computer Vision
Il y a 5 mois
Sophia Antipolis, France Inria Temps pleinLe descriptif de l’offre ci-dessous est en Anglais_ **Type de contrat **:CDD **Niveau de diplôme exigé **:Bac + 5 ou équivalent **Fonction **:Doctorant **A propos du centre ou de la direction fonctionnelle**: The Inria Université Côte d’Azur center counts 36 research teams as well as 7 support departments. The center's staff (about 500 people...
-
Technopole de Sophia Antipolis, France INRIA Temps pleinJob DescriptionWe are seeking a highly motivated postdoctoral researcher to join our team at INRIA to work on distributed machine learning at the network edge. The position is part of the EU-funded project dAIEDGE, which aims to develop distributed, trustworthy, efficient, and scalable AI at the Edge.The successful candidate will work with our team to...
-
PhD Position in Tensor Modelling and Geometry
il y a 1 mois
Technopole de Sophia Antipolis, France INRIA Temps pleinContext and BenefitsTENORS is a Marie Skłodowska-Curie Doctoral Network / Joint Doctorate (2024-2027), offering 15 PhD positions in the field of tensor modelling and computation. The network partners are:Inria, Sophia Antipolis, FranceCNRS/LAAS, Toulouse FranceUniversity of Konstanz, GermanyMax Planck Institute, GermanyThe Arctic University of...