Job description
At ASAPP, our mission is simple: deliver the best AI-powered customer experience—faster than anyone else. We are guided by principles that shape how we think, build, and execute, including deep customer obsession, purposeful speed, ownership, and a relentless focus on outcomes. We work in small, highly skilled teams, prioritize clarity over complexity, and continuously evolve through curiosity, data, and craftsmanship.
We’re building a globally diverse team of technologists and problem solvers who thrive in fast-paced environments, value collaboration, and approach every challenge with a Day 1 mindset. With hubs in New York City, Mountain View, Latin America, and India. If you’re driven by continuous learning, rapid iteration, and the challenge of building in a high-growth startup, this is more than a role—it’s a journey.
We are seeking a Senior Staff Systems Engineer to drive the architectural vision for our GenerativeAgent product. In this role, you will design and build a highly scalable, multi-agent platform that powers real-time voice and text customer service experiences across a wide range of industries.
As a Senior Staff Engineer, you will set long-term system direction, tackle the organization’s most complex technical challenges, and partner closely with engineering, product, security, and operations leaders. You will ensure our systems are resilient, scalable, and tightly aligned with both customer needs and business goals, while maintaining a strong hands-on presence and broad organizational impact.
What you’ll do
Technical Leadership & Influence
- Act as a technical authority and advisor across multiple engineering teams
- Develop and drive alignment on system design, technical roadmaps, and best practices
- Design and implement a scalable, multi-tenant deployment architecture that supports easy configuration of agents and business workflows for various customers
- Define the communication, state management, and orchestration patterns for multi-agent systems
- Mentor senior engineers and help raise the bar on systems thinking across the organization
Reliability, Scalability & Security
- Own and define system-level SLOs/SLIs for high-traffic, real-time voice and text services, focusing on latency, cost-efficiency, and fault tolerance across the ecosystem
- Identify systemic risks and proactively design mitigation strategies
- Partner with Security and Compliance teams to ensure systems meet regulatory and security requirements
- Lead post-incident analysis and drive systemic improvements
Cross-Functional Collaboration
- Partner with Product, Customer Engineering, SRE, and TPMs to translate business requirements into system designs
- Work with Research to evaluate and productionize cutting-edge ideas in the ML space
- Drive complex initiatives that span multiple quarters and involve multiple teams
- Communicate complex technical concepts clearly to both technical and non-technical stakeholders
What you’ll need
- 10+ years of experience building large-scale production systems
- Mastery in at least one cloud platform (AWS, GCP, Azure)
- Expertise with container orchestration (Kubernetes)
- Expertise with Python and/or Golang
- Excellent communication, consensus-building, strategic thinking, and mentorship abilities
Deep understanding of:
- Distributed systems design patterns (e.g., service mesh, event-driven architecture, microservices)
- Reliability engineering principles
- System performance and capacity planning
- Ability to lead through influence rather than authority
What we’d like to see
- Expertise with the LLM development lifecycle (e.g. fine-tuning, RAG, deployment, evaluation, monitoring & feedback)
- Strong track record of building multi-agent systems at scale
- Experience with security, compliance, and data privacy requirements (e.g. HIPAA, SOC 2)
$240,000 - $265,000 a year
The compensation includes salary plus performance bonus. The actual salary may be different depending upon non-discriminatory factors such as qualifications, experience, and other factors permitted by law.
ASAPP is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, disability, age, or veteran status. If you have a disability and need assistance with our employment application process, please email us at [email protected] to obtain assistance. #LI-AG1 #LI-Hybrid
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
