AI Research Scientist

• Advance the architecture and training of the next generation of foundation models
• Own core elements of the training recipe, including optimizers, schedules, and initialization
• Design PyTorch-based architectural improvements to maximize convergence, stability, and training efficiency
• Develop hyperparameter scaling laws and scale-up methodologies
• Use small-scale proxy experiments to predict multi-thousand-GPU behavior and de-risk training decisions
• Investigate convergence issues such as loss spikes and divergence
• Resolve distributed system failures including communication bottlenecks, race conditions, and synchronization errors
• Partner with Compute Performance, Data, Evaluation, and Post-Training teams on system-model co-design
• Translate mathematical reasoning and empirical observations into principled training decisions
• Produce high-quality production code and influence model quality, run reliability, and model efficiency

Explore Senior AI Researcher – Pre-training at Aleph Alpha. Review requirements and application details.