Job Description
Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation criteria with practitioners.
We are launching a management consulting domain and are seeking former McKinsey, BCG, or Bain consultants to translate real engagement work into end-to-end examples (workstreams and tasks) covering problem structuring, work planning, analysis, synthesis, and client-ready deliverables.
This is a remote individual-contributor project-based role focused on analytical design and evaluation. Participation does not create an employment relationship with Toloka or our clients.
Who We’re Looking For
Consultants with 3+ years of experience at McKinsey & Company, Boston Consulting Group, or Bain & Company.
You should have hands-on project experience:
- Structuring ambiguous client problems
- Building models and synthesized findings
- Producing client-ready deliverables
- Forming recommendations under uncertainty
No deep technical background required, we’ll onboard you on the lightweight tools involved.
What You’ll Do
Build realistic consulting project environments: create detailed project scenarios (industry context, financials, constraints, incomplete information).
Design structured consulting tasks for AI Agents: break projects into tasks that mirror real consulting work such as market sizing, due diligence, cost reduction, growth strategy, or operational diagnosis.
Define evaluation criteria and quality standards: develop a grading approach, evaluation criteria and golden solutions for each task that will be used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.
Skills & Requirements
- 3+ years at McKinsey, BCG, or Bain
- Strong structured problem-solving skills
- Ability to translate vague problems into clear analytical steps
- High attention to logical consistency
- Independent working style
- Clear written English (B2+)
