Photorealistic image simulation and synthetic datasets are becoming indispensable resources when it comes to machine learning and machine vision. Models are data hungry and precise image annotation is a tedious job. It becomes even more tricky when it comes to the use of models in industrial environments! You need images and they must be annotated by experts. For the model to be robust you need a balanced dataset containing all kinds of unlikely but possible events, but you have no chance of getting this within a reasonable amount of time and money.
In Virtual Inspection Planning research group, we tackle this problem by using synthetic datasets as a point-of-control to develop reliable industrial machine vision models. Procedural computer graphics methods give us the possibility to parameterize dataset generation and create controlled and balanced datasets with arbitrary amount of variation.
What would you be working on?
Development of procedural models for textures and geometry generation:
- Generating manufactured surface (metal and plastic) texture
- Generating surface defect geometry and representation models (oil, scratches, edge chipping…)
- Investigating methods for modelling and applying global patterns to complex objects
- Developing alternative approaches to increase the efficiency or quality of procedural approaches
- Contributing to the open sources rendering engines such as Appleseed or Mitsuba
Technologies you would be working with:
- C++, Python, JavaScript
- Shading languages (e.g., OSL), image processing tools (e.g., OpenCV), mesh processing libraries (e.g., CGAL)
What makes you well-equipped for the position:
- You are currently pursuing or have finished computer science or mathematics studies
- Familiarity with computer graphics concepts (e.g. path-tracing, geometry representation, shading, texturing, etc.)
- Interest in procedural geometry and texture modelling
- Familiarity with the basics of Machine Learning and Computer Vision
- Creative and have an artistic mindset
It is a plus if you:
- Have previous experience and a project to showcase your skills
- Have experience with computer graphics frameworks or libraries (e.g. OpenGL, Vulkan, Blender, UE, Unity3D, Mitsuba, three.js, Shadertoy…)
What do we offer:
- Flexible working hours
- An environment where you can learn, work in a team and suggest your own ideas
- International scientific collaboration
- Support for participating in programs such as Google Summer of Code
- Academic publishing opportunities and conference attendance
- A possibility to see the bigger picture and not just to work on one highly detailed task
- A possibility to discuss task adaptation to your interests and skills
This sounds interesting and you want to apply for an interview?
Send you application to petra.gospodnetic@itwm.fraunhofer.de.
Please attach the following documents to your application:
- CV in English
- Letter of Motivation
- Certificate of enrolment at university
- Latest transcript of records
