Senior AI Assurance & Customer Delivery Lead (m/f/d)

About the Job

Calvin Risk is a Swiss-based startup spun out from ETH Zurich helping companies build and manage trustworthy AI that aligns with human values. Our AI assurance software "Calvin" offers deep evaluations and testing of AI systems for quality assurance and risk assessment purposes, and support for building and managing the AI governance process of enterprises. The software delivers quality assurance and governance for predictive Machine Learning and Generative AI systems, as well as agents and agentic workflows. The primary target industries of Calvin Risk are regulated industries such as the financial services sector with various larger banks and insurances as clients. The Calvin team helps customers to measure and test AI quality in a standardized and automated manner, digitalize governance policies, requirements and risk assessments, and ensure compliance with emerging AI safety regulations and best practices.

We are looking for a senior, customer-facing lead who bridges AI governance expertise, technical delivery, and hands-on execution. This is a high-impact role at the core of our business: you will own the successful implementation and application of the Calvin solution with enterprise clients, ensuring meaningful and scalable AI governance setups, and actionable insights the clients’ AI systems quality and improvement recommendations. This is not a policy or legal role. The right candidate has hands-on experience with quantitative model evaluation, understands statistical testing methodology, and is comfortable interpreting metrics such as accuracy, robustness scores, fairness measures, and confidence intervals.

Your Mission

Own Customer Delivery and Implementation:

Lead end-to-end delivery of customer projects from onboarding to full operational rollout of the Calvin solution

Translate customer needs into practical and scalable AI governance and testing setups

Act as the trusted advisor for clients on AI quality, governance, and safety (incl. implementation of new regulations such as the EU AI Act)

Ensure customers not only adopt the Calvin solution, but successfully operationalize it in their organization

Bridge Product, Tech, and Customer Reality:

Configure and adapt Calvin to client environments (data, workflows, governance structures)

Work closely with product and engineering to translate customer feedback into product setups and test execution

Guide customers in integrating Calvin into their existing process and IT governance frameworks

Drive AI Assurance Excellence:

Support customers in defining and implementing AI testing strategies, quality evaluations, risk assessment methodologies, and governance processes.

Ensure setups are aligned with regulatory expectations and best practices

Your Story

Experience and Expertise:

5–10+ years of experience in AI/ML model validation, AI/ML engineering, data science, or AI quality assurance, ideally in regulated industries such as financial services.

Strong understanding of AI/ML lifecycle, testing, and validation, as well as governance frameworks and regulatory landscapes ( EU AI Act, BSI AI Finance Test Catalogue)

Strong quantitative foundation and comfortable with statistical concepts underpinning model evaluation: distribution analysis, hypothesis testing, performance metrics, robustness testing, and uncertainty quantification.

Experience working with enterprise clients (banks, insurance, or similar) is highly preferred

Customer-Centric Operator:

Proven ability to lead complex client engagements and deliver results

Strong stakeholder management skills; comfortable working with both technical teams and senior executives

Ability to translate abstract requirements into concrete solutions

Execution, Ownership, and Communication:

Strong “get-it-done” mentality with attention to detail

Ability to operate in ambiguity and build structure where none exists

Willingness to go beyond role boundaries; especially in a startup environment

Excellent communication skills (English required; German is a plus)

Structured thinker who can simplify complexity

Natural collaborator with a pragmatic, solution-oriented mindset

Why This Role Matters

This role sits at the intersection of product, customer, and operations. It is arguably the most critical leverage point in the company. Your work directly determines whether customers succeed with Calvin, how our product evolves, and how we scale as a company.

Why Calvin Risk

<

p>We follow the REEEEF principle: respect, efficiency, entrepreneurship, excellence, empathy, an j4id10216951a j4it0521a j4iy26a