Job description
Everyone is welcome at Handshake. We know diverse teams build better products and we are committed to creating an inclusive culture built on a foundation of respect for all individuals. We strongly encourage candidates from non-traditional backgrounds, historically marginalized or underrepresented groups to apply.
Your impact
As an AI Tutor, Machine Learning Engineer Specialist, you will contribute to the next generation of AI models by reviewing and refining outputs generated by cutting-edge large language models (LLMs). You’ll apply your expertise in machine learning, data science, and technical domains to ensure model outputs meet high standards of technical accuracy, relevance, and consistency. This role blends analytical thinking with hands-on data quality work and research-grade insight into model evaluation and improvement.
This is a contract remote position with variable time commitments. The services to be provided by the Contractor under this agreement are supplementary and not integral to the Handshake’s primary business operations. The Contractor’s services are distinct and separate from the core business activities of Handshake.
Your role
- Use internal tools to evaluate and critique AI-generated outputs, primarily in technical and scientific domains.
- Review complex model responses and suggest improvements with a focus on clarity, correctness, and domain relevance.
- Contribute to the curation and refinement of datasets used to train and fine-tune AI/ML models.
- Work closely with cross-functional AI teams to identify data patterns, edge cases, and model blind spots.
- Stay up-to-date on model behaviors and guidelines as they evolve, applying judgment to nuanced annotation tasks.
Your experience
- MS or PhD in Computer Science, Machine Learning, Data Science, or a closely related technical field.
- Alternatively, 3+ years of professional experience as a Machine Learning Engineer or Data Scientist at a high-caliber company (e.g., FAANG, leading startups, AI labs).
- Strong grasp of core machine learning concepts, model training workflows, and evaluation strategies.
- Experience with LLMs, NLP systems, or applied ML in production settings is highly desirable.
- Ability to assess complex technical information and provide constructive, detail-oriented feedback.
- Excellent written communication skills—both technical and explanatory writing.
- Ability to operate independently with sound judgment under ambiguous conditions.
- Passion for AI development, data quality, and technological advancement.
Bonus areas of expertise
- Publications in machine learning, AI, or computer science journals/conferences.
- Experience working with human feedback loops in ML systems (e.g., RLHF, data annotation, model alignment).
- Teaching, mentoring, or technical writing experience in ML or related technical domains.
- Exposure to generative AI applications or prompt engineering.
Additional Requirements
- Availability to work evenings and weekends as needed.
- Ability to quickly adapt to new skills and evolving requirements.
- Personal device must support Windows 10 or macOS Big Sur 11.0 or later.
- Reliable access to a smartphone.
Location & Work Expectations
- Fully remote position.
- No visa sponsorship available.
- Not hiring in Wyoming or Illinois at this time.
Compensation range
- $40/hr - $70/hr
For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.
About us
Handshake is building the future of human data for AI.
We partner directly with top AI labs to power large language model (LLM) training and evaluation with high-quality, expert-generated data. As AI models become more sophisticated, the demand for specialized human input continues to grow—and Handshake is uniquely positioned to meet it. We power career platforms at 92% of the top U.S. universities, giving us direct access to verified expert talent across a wide range of domains.
Our AI team is rapidly building a new generation of human data products—from expert annotation platforms to AI interviewers and seamless payout infrastructure—all designed to accelerate research and improve model performance.
We’ve assembled a world-class team from YC, Notion, Scale, Coinbase, Palantir, and more, and we’re working directly with many of the world’s leading AI research labs. This is a unique opportunity to join a fast-growing team shaping the future of AI through better data, better tools, and better systems—for experts, by experts.
Handshake is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or reasonable accommodation, please let your recruiter know during initial communications.
