B

Applied AI Evaluation Engineer

BMO

Toronto, Ontario, Canada Full time March 18, 2026

Opportunity Description

About the Role

As an Engineering & Data Science Specialist in Applied AI Evaluations, you will design, implement, and optimize evaluation frameworks and pipelines that measure the quality, safety, and performance of advanced AI systems at BMO. You’ll work closely with the Product Owner and collaborate with engineering, research, and business teams to translate evaluation standards into robust, scalable solutions.

Your work will directly impact model development, deployment, and continuous improvement cycles—ensuring that evaluation signals are deeply integrated into experimental and production systems. You’ll contribute to the development of reusable tools, agents, and harnesses that support responsible AI practices and regulatory compliance.

Key Responsibilities

  • Develop, implement, and maintain evaluation pipelines and harnesses for AI models, ensuring reliability, reproducibility, and scalability for banking applications.
  • Coll...
  • Full time Computer Occupations

    Interested in this opportunity? Apply now through Expertini.

    Apply for this Position