Technical Program Manager for Inference - AI Infrastructure

About the Role

We're seeking a Technical Program Manager for Inference to join our team at Anthropic. This role is pivotal in bridging our inference systems with the broader organization. As a Technical Program Manager for Inference, you'll drive strategic initiatives around inference infrastructure adoption, capacity management, and deployment processes while ensuring seamless coordination across research, engineering, and product teams. This position is essential for scaling our inference infrastructure to meet growing demand while maintaining operational excellence.

What You'll Do

• Lead cross-functional initiatives for new infrastructure integration, establishing clear ownership, timelines, and communication channels between teams.
• Drive end-to-end planning for major infrastructure transitions including platform modernization and new tech adoption.
• Develop and maintain processes for inference capacity planning and optimization.
• Partner with engineering teams to track utilization metrics, identify bottlenecks, and coordinate with capacity teams on resource allocation and model deprecation strategies.
• Establish and enforce governance for deployment processes, defining clear policies for self-service versus managed deployments.
• Create and maintain service level agreements for different deployment types and ensure smooth launches across teams.
• Own and prioritize the inference deployment roadmap, working closely with engineering leadership to prioritize initiatives and manage dependencies.
• Build strong relationships across research, engineering, and product teams to understand requirements and constraints.

Requirements

• Several years of experience in technical program management, with proven success delivering complex infrastructure programs, preferably in ML/AI systems or large-scale distributed systems.
• Deep technical understanding of inference systems or cloud infrastructure, enough to engage substantively with engineers and identify technical risks.
• Strong stakeholder management skills and ability to build trust with both technical and non-technical partners.
• Experience with infrastructure scaling initiatives, hardware integrations, or deployment governance.
• Passionate about AI infrastructure and understand the unique challenges of deploying and scaling large language models.

Nice to Have

• Experience in fast-paced environments and can balance strategic planning with tactical execution.
• Excel at creating structure and processes in ambiguous environments.

What We Offer

• Competitive compensation and benefits package.
• Annual salary range of $290,000—$365,000 USD.
• Flexible working hours and generous vacation and parental leave.
• Relocation package and visa sponsorship available.
• Optional equity donation matching.

Join us in our mission to create reliable, interpretable, and steerable AI systems that are safe and beneficial for our users and society as a whole. Apply now to be part of our dynamic team!