FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAWSAzureHadoopPySparkPythonPyTorch
About the role
Key responsibilities & impact- Lead R&D in GenAI, Agentic AI, and LLM evaluation and testing
- Lead machine learning scientists validating complex AI models, especially Generative AI, LLM/NLP, and Deep Learning models
- Review, test, evaluate, and challenge AI model developers
- Recommend model approval or corrective actions based on independent validation
- Set performance objectives and provide regular performance feedback
- Communicate group objectives and strategies and align activities with business objectives
- Coach and support direct reports in their development
- Develop standards and procedures for Generative AI, Agentic AI, NLP, and Deep Learning model validation
- Ensure validation practices comply with the Bank’s Model Risk Policy, industry and academic best practices, and regulatory requirements
- Respond to Canadian and U.S. regulator and internal/external audit requests
- Collaborate with model development groups, Audit, and other internal partners
- Identify when new models or techniques are needed as industry standards and regulations evolve
- Provide subject matter expertise to business units and senior management
- Stay current with GenAI publications, LLMs, evaluation metrics, technology stacks, and datasets
- Communicate findings and recommendations to technical and non-technical stakeholders
Requirements
What you’ll need- Advanced quantitative and AI skills with a post-secondary degree in computer science, machine learning/AI, engineering, statistics, mathematics, or a related area
- 4+ years of experience developing or validating Generative AI, LLM, NLP, and other Deep Learning models
- 2+ years of experience leading a small team of machine learning scientists
- In-depth knowledge of Generative AI, Agentic AI, Deep Learning, NLP, RAG, Transformers, and related AI methodologies
- Experience with PyTorch, LangChain, LangGraph, HuggingFace, or similar technology stacks and libraries
- Proficiency in one or more scripting/programming languages such as Python
- Familiarity with Azure, AWS, PySpark, and Hadoop
- Familiarity with data structures, algorithm design, and object-oriented programming
- Knowledge of machine learning explainability/interpretability algorithms
- Excellent verbal and written communication and stakeholder management skills
- Strong critical and analytical thinking skills
- Excellent time/project management and multitasking skills with minimal supervision
- Ability to work independently and collaboratively in a fast-paced, dynamic environment
- For Quebec: proficiency in a language other than French to support or work with employees or colleagues requiring services in another language
Benefits
Comp & perks- Base salary and variable compensation
- Health and well-being benefits
- Savings and retirement programs
- Paid time off
- Banking benefits and discounts
- Career development
- Reward and recognition programs
- Regular development conversations
- Training programs
- Online learning platform
- Mentoring programs
- Training and onboarding sessions
- Interview accommodations, including accessible meeting rooms and captioning for virtual interviews