Immunai

AI Engineer

• Design, build, and maintain benchmarking suites for foundation models and multimodal AI systems
• Create extensible abstractions and APIs for datasets, tasks, models, metrics, and evaluation workflows
• Implement metrics covering predictive performance, biological relevance, and multimodal alignment
• Collaborate with AI scientists and data scientists to integrate models, adjust architectures, and enable rapid iteration
• Add external and internal models to benchmarks and ensure meaningful comparisons
• Analyze data and results to debug evaluations, understand model behavior, and unblock modeling work
• Ensure evaluations are consistent, versioned, reproducible, and trustworthy

Explore Senior AI Engineer at Immunai. Review requirements and application details.