Together AI Logo

Junior Technical Program Manager Infrastructure Operations

💰 $150k-$175k

Job Description

About the Role

Together AI runs one of the most demanding GPU fleets in the industry. Keeping that fleet healthy - every node online, every GPU performing, every datacenter transition running on schedule - is operationally complex and genuinely high-stakes. We’re looking for a Junior TPM to own that operational reality.

This is not a coordination or status-reporting role. You will own the end-to-end node lifecycle - from the moment a node goes down through repair, return, and re-integration - and you’ll drive the cross-functional work to close every gap as fast as possible. You’ll manage datacenter bring-ups, hunt down GPU utilization loss, and build the processes and dashboards that make our fleet operations more visible and accountable over time.

The environment moves fast and doesn’t always come with a clear playbook. Much of what you’ll work on is genuinely novel - you’ll be figuring things out alongside engineers who are building at the frontier. If that sounds like an obstacle, this isn’t the right role. If it sounds like the best possible way to learn, keep reading.

Responsibilities

  • Own the end-to-end node lifecycle - from failure through repair, return, and re-integration — across provider ticketing, internal tooling, and the state machine that governs each stage
  • Drive node remediation to resolution with urgency, eliminating gaps in ownership at every handoff
  • Manage project timelines for new datacenter bring-ups, coordinating across internal teams and external providers to keep milestones on track
  • Identify and diagnose GPU utilization loss across the fleet, working with engineering leads to drive resolution
  • Build dashboards and tracking processes that make efficiency gaps visible and ensure they get closed
  • Continuously improve operational workflows through process improvements and lightweight automation
  • Develop and maintain relationships with external datacenter providers

Requirements

  • Some prior experience in a TPM role - we’re open to candidates who came into TPM from engineering, ops, or another technical function, but you should have done the work in practice: owning programs end-to-end, driving cross-functional resolution, managing external dependencies
  • A technical background or demonstrated experience in a highly technical environment - you don’t need to know GPUs on day one, but you need to be able to engage meaningfully with technical problems and earn credibility with infrastructure engineers
  • A genuine bias toward action - you see a problem and start moving, even when the path forward isn’t fully clear
  • Resilience in a fast-paced, sometimes chaotic environment - you adapt quickly, stay effective under pressure, and don’t wait for perfect conditions to make progress
  • Strong organizational instincts - you can manage multiple workstreams, track dependencies, and keep things moving without losing the thread
  • Ability to zoom out - you can be deep in the weeds on an operational problem while keeping the bigger picture in view

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $175,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. This is a hybrid role based in the Bay Area.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

Share this job:
Please let Together AI know you found this job on Remote First Jobs 🙏

241 similar remote jobs

Explore latest remote opportunities and join a team that values work flexibility.

Remote companies like Together AI

Find your next opportunity with companies that specialize in Artificial Intelligence, Cloud Computing, Llm, and Open Source. Explore remote-first companies like Together AI that prioritize flexible work and home-office freedom.

Appen Logo

Appen

501-1000 appen.com

Provides AI training data and an end-to-end platform to build and optimize AI models.

View company profile →
Unstructured Logo

Unstructured

Transforms complex unstructured data into AI-ready formats for GenAI projects.

View company profile →
CloudFactory Logo

CloudFactory

Combining machine and human intelligence to develop, deploy, and operate reliable AI solutions.

View company profile →
Network Optix Logo

Network Optix

Develops video software for intelligent, AI-driven solutions and operational intelligence.

View company profile →
Crossing Minds Logo

Crossing Minds

Developed an AI personalization and retrieval platform for e-commerce before joining OpenAI.

View company profile →
PALO IT Logo

PALO IT

Global tech consultancy

View company profile →

Project: Career Search

Rev. 2026.5

[ Remote Jobs ]
Direct Access

We source jobs directly from 21,000+ company career pages. No intermediaries.

01

Discover Hidden Jobs

Unique jobs you won't find on other job boards.

02

Advanced Filters

Filter by category, benefits, seniority, and more.

03

Priority Job Alerts

Get timely alerts for new job openings every day.

04

Manage Your Job Hunt

Save jobs you like and keep a simple list of your applications.

21,000+ SOURCES UPDATED 24/7
Apply