Research Scientist, Pretraining, Gemma

Snapshot

Come join our team, focused on advancing the state-of-the-art open-weights large language models (LLMs). You will conduct cutting-edge research, particularly in the multimodal domain (speech, vision, and text), with a direct path to impacting billions of users through Google products.

About Us

At Google DeepMind, we’re a team of scientists, engineers, machine learning experts and more, working together to advance the state of the art in artificial intelligence. We use our technologies for widespread public benefit and scientific discovery, and collaborate with others on critical challenges, ensuring safety and ethics are the highest priority.

This position is based in the Gemma team in Paris. The group works on all aspects of LLM development (e.g., pretraining, posttraining, quantization, data, evaluations, etc), in order to deliver the best in class open-weights models. The Gemma models have landed in multiple products at Google including Pixel, Android and Chrome.

The Role

As a Research Scientist at Google DeepMind in the Gemma Pretraining team, you will:

• Develop and evaluate LLMs: Design, implement, and evaluate the next generation of frontier models at Google DeepMind, with a focus on pretraining.
• Collaborate with a world-class team: Work closely with other research scientists, engineers, and product teams across Google DeepMind, fostering a collaborative and intellectually stimulating environment.
• Contribute to real-world impact: See your work contribute to applications across various domains, directly influencing the future of Google products and services.

About You

You are a passionate and talented researcher with a strong foundation and a proven ability to conduct impactful research in AI. You embrace change and thrive under ambiguity. You have a collaborative mindset and are excited to work as part of a team to tackle ambitious research challenges. You are passionate about seeing your research translated into real-world products that improve the lives of users and are eager to work in an environment where research has a direct path to product impact. 

In order to set you up for success as a Research Scientist at Google DeepMind, we are looking for the following skills and experience:

• Ph.D. (or equivalent research experience) in AI.
• Strong publication record in top-tier AI conferences or journals.
• Solid understanding of deep learning, natural language processing, computer vision, and/or speech processing.
• Experience with relevant ML frameworks such as JAX, TensorFlow, or PyTorch.
• Excellent communication and collaboration skills.  

In addition, the following would be an advantage: 

• Familiarity with VLM/VLA training and deployment.

 

At Google DeepMind, we value diversity of experience, knowledge, backgrounds and perspectives and harness these qualities to create extraordinary impact. We are committed to equal employment opportunity regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, pregnancy, or related condition (including breastfeeding) or any other basis as protected by applicable law. If you have a disability or additional need that requires accommodation, please do not hesitate to let us know.