Aleph Alpha

AI Research Scientist

• Advance the architecture and training of the next generation of foundation models
• Own core elements of the training recipe, including optimizers, schedules, and initialization
• Design PyTorch-based architectural improvements to maximize convergence, stability, and training efficiency
• Develop hyperparameter scaling laws and scale-up methodologies
• Use small-scale proxy experiments to predict multi-thousand-GPU behavior and de-risk training decisions
• Investigate convergence issues such as loss spikes and divergence
• Resolve distributed system failures including communication bottlenecks, race conditions, and synchronization errors
• Partner with Compute Performance, Data, Evaluation, and Post-Training teams on system-model co-design
• Translate mathematical reasoning and empirical observations into principled training decisions
• Produce high-quality production code and influence model quality, run reliability, and model efficiency

Explore Senior AI Researcher – Pre-training at Aleph Alpha. Review requirements and application details.

Senior AI Researcher – Pre-training

Artificial Intelligence

• Build and improve Aleph Alpha’s model training pipeline and infrastructure
• Optimize training-load scheduling on the cluster
• Improve pipeline robustness and performance to accelerate iteration
• Enable large-scale code execution for reinforcement learning
• Improve evaluation code to increase inference throughput
• Design high-quality tooling and infrastructure for long-term productivity
• Identify issues and take initiative to unblock the team
• Collaborate through pair programming, mob programming, and team-based design decisions
• Improve code maintainability through tests, design changes, and architecture changes
• Shape what training infrastructure and tooling gets built

Explore Senior AI R&D Engineer – Model Training at Aleph Alpha. Review requirements and application details.