Principal AI Engineer

🇺🇸 United States - Remote
💻 Software Development🟡 Principal

Job description

Apollo.io is the leading go-to-market solution for revenue teams, trusted by over 500,000 companies and millions of users globally, from rapidly growing startups to some of the world’s largest enterprises. Founded in 2015, the company is one of the fastest growing companies in SaaS, raising approximately $250 million to date and valued at $1.6 billion. Apollo.io provides sales and marketing teams with easy access to verified contact data for over 210 million B2B contacts and 35 million companies worldwide, along with tools to engage and convert these contacts in one unified platform. By helping revenue professionals find the most accurate contact information and automating the outreach process, Apollo.io turns prospects into customers. Apollo raised a series D in 2023 and is backed by top-tier investors, including Sequoia Capital, Bain Capital Ventures, and more, and counts the former President and COO of Hubspot, JD Sherman, among its board members.

About Apollo.io

Apollo.io is the leading go-to-market solution for revenue teams, trusted by over 500,000 companies and millions of users globally, from rapidly growing startups to some of the world’s largest enterprises. Our platform helps sales and marketing teams prospect smarter, automate workflows, and close more deals, all within a unified, AI-native platform.

Backed by world-class investors including Sequoia and Bain Capital, and recently valued at $1.6B following our Series D, Apollo is one of the fastest-growing SaaS companies in the world.


Why This Role Matters

We are entering a new phase of AI-native growth and are looking for a Principal AI Engineer to lead the design and deployment of cutting-edge agentic systems, AI assistants, and LLM-powered features. This role is pivotal to Apollo’s AI roadmap, owning the architecture and productionization of intelligent systems that power the workflows of thousands of GTM teams globally.

You’ll be a technical thought leader on the AI Engineering team and work alongside product, backend, and platform leaders to drive forward Apollo’s competitive edge in applied AI.


What You’ll Own & Deliver

End-to-End Agentic Systems

  • Autonomous AI Agents: Architect and lead the development of multi-agent systems capable of long-horizon planning, reasoning, and API orchestration.
  • Workflow Automation: Build reusable agentic components that integrate deeply into sales and marketing processes.
  • LLM Platformization: Own and evolve our in-house platform for scalable, low-latency, and cost-efficient LLM and agent deployments.

AI Assistants and Search

  • Conversational AI & UI: Lead design of interfaces powered by natural language understanding and retrieval-augmented generation (RAG).
  • Semantic & Personalized Search: Build embedding-based, intent-aware search and personalization systems tuned to business user needs.
  • Email Intelligence: Drive innovation in personalized outreach generation using context-aware generation pipelines.

Production-Grade Applied AI

  • Latency & Cost Optimization: Tune inference pipelines, caching layers, and model selection logic for high-scale, cost-aware performance.
  • Evaluation at Scale: Define and drive robust offline and online testing methodologies (A/B, sandboxing, human evals) across agents and LLM flows.
  • Feedback Loops: Architect human-in-the-loop systems and telemetry to improve accuracy, UX, and explainability over time.

What We’re Looking For

Technical & Production Depth

  • 10+ years of software engineering experience, with at least 3 years in applied LLM or agentic AI systems (2023–present).
  • Proven success in deploying LLM-powered products used by real users at scale, not just prototypes or internal tools.
  • Deep backend & systems engineering expertise with Python, distributed systems, and scalable APIs.
  • Familiarity with LangChain, LlamaIndex, or similar orchestration frameworks.
  • Experience with RAG pipelines, vector DBs, embedding models, and semantic search tuning.
  • Experience managing performance across cloud providers (e.g., AWS Bedrock, OpenAI, Anthropic, etc.).

Agentic Systems & Prompt Engineering

  • Demonstrated experience building multi-step agents, planning workflows, chaining reasoning steps, and integrating APIs with agent memory/state.
  • Comfort with advanced prompting strategies, few-shot and chain-of-thought reasoning, and embedding retrieval setups.

Evaluation, Monitoring & CI for AI

  • Strong understanding of AI system evaluation, human ratings, A/B experimentation, and feedback loop pipelines.
  • Experience designing safety-aware, reliable LLM systems in production environments.
  • Experience owning logging, monitoring, and observability for live AI systems.

Leadership & Strategic Impact

  • Principal-Level Ownership: You thrive in an ambiguous environment, define company wide roadmaps, drive the most important Engineering decisions, and mentor others. You lead from the front.
  • AI-Native Mentality: You leverage AI to ship faster and smarter, and champion automation across engineering workflows.
  • Applied Focus: You prioritize impact over novelty. You’re deeply pragmatic in your application of AI research to product features.

What Makes This Role Different

A Role with Real Autonomy

You’ll own complex systems end-to-end, from LLM prompt design and API orchestration to production deployment and A/B testing at scale. You’re not building demos, you’re shipping critical infrastructure that millions rely on.

A Product-First AI Culture

We believe in AI that moves the needle, and your work will directly impact Apollo’s AI Assistants, scoring models, research agents, and automation flows, products that define our differentiation in the market.

We are AI Native

Apollo.io is an AI-native company built on a culture of continuous improvement. We’re on the front lines of driving productivity for our customers—and we expect the same mindset from our team. If you’re energized by finding smarter, faster ways to get things done using AI and automation, you’ll thrive here.

Why You’ll Love Working at Apollo

At Apollo, we’re driven by a shared mission: to help our customers unlock their full revenue potential. That’s why we take extreme ownership of our work, move with focus and urgency, and learn voraciously to stay ahead.

We invest deeply in your growth, ensuring you have the resources, support, and autonomy to own your role and make a real impact. Collaboration is at our core—we’re all for one, meaning you’ll have a team across departments ready to help you succeed. We encourage bold ideas and courageous action, giving you the freedom to experiment, take smart risks, and drive big wins.

If you’re looking for a place where your work matters, where you can push boundaries, and where your career can thrive—Apollo is the place for you.

Learn more here!

Share this job:
Please let Apollo.io know you found this job on Remote First Jobs 🙏

Benefits of using Remote First Jobs

Discover Hidden Jobs

Unique jobs you won't find on other job boards.

Advanced Filters

Filter by category, benefits, seniority, and more.

Priority Job Alerts

Get timely alerts for new job openings every day.

Manage Your Job Hunt

Save jobs you like and keep a simple list of your applications.

Search remote, work from home, 100% online jobs

We help you connect with top remote-first companies.

Search jobs

Hiring remote talent? Post a job

Frequently Asked Questions

What makes Remote First Jobs different from other job boards?

Unlike other job boards that only show jobs from companies that pay to post, we actively scan over 20,000 companies to find remote positions. This means you get access to thousands more jobs, including ones from companies that don't typically post on traditional job boards. Our platform is dedicated to fully remote positions, focusing on companies that have adopted remote work as their standard practice.

How often are new jobs added?

New jobs are constantly being added as our system checks company websites every day. We process thousands of jobs daily to ensure you have access to the most up-to-date remote job listings. Our algorithms scan over 20,000 different sources daily, adding jobs to the board the moment they appear.

Can I trust the job listings on Remote First Jobs?

Yes! We verify all job listings and companies to ensure they're legitimate. Our system automatically filters out spam, junk, and fake jobs to ensure you only see real remote opportunities.

Can I suggest companies to be added to your search?

Yes! We're always looking to expand our listings and appreciate suggestions from our community. If you know of companies offering remote positions that should be included in our search, please let us know. We actively work to increase our coverage of remote job opportunities.

How do I apply for jobs?

When you find a job you're interested in, simply click the 'Apply Now' button on the job listing. This will take you directly to the company's application page. We kindly ask you to mention that you found the position through Remote First Jobs when applying, as it helps us grow and improve our service 🙏

Apply