Senior MLOps Engineer - LLMOps for Blockchain Intelligence

About the Role

We are seeking a Senior MLOps Engineer - LLMOps to join our team at TRM Labs. In this remote role, you will play a pivotal part in building and scaling the technical infrastructure for AI/ML systems, particularly focusing on Large Language Models (LLMs). Your work will directly contribute to our mission of protecting civilization through innovative blockchain intelligence solutions.

What You'll Do

• Build reusable CI/CD workflows for model training, evaluation, and deployment, integrating tools like Langfuse and GitHub Actions.
• Automate model versioning, approval workflows, and compliance checks across environments.
• Develop a modular and scalable AI infrastructure stack, including vector databases and observability tooling.
• Collaborate with engineering and data science teams to embed AI models into real-time applications.
• Continuously evaluate and integrate state-of-the-art AI tools, enhancing our capabilities in LLMOps.
• Drive AI reliability and governance, ensuring compliance, security, and uptime.
• Deploy infrastructure for offline and online evaluation of LLMs and agents.
• Enable researchers to iterate quickly by providing sandboxes and reproducible environments.

Requirements

• Strong programming skills in Python, with a focus on writing high-quality, maintainable software.
• Experience with scalable infrastructure, including containerization (Docker, Kubernetes) and infrastructure-as-code (Terraform).
• Familiarity with monitoring and logging frameworks such as Datadog and Prometheus.
• Understanding of ML Ops best practices, including model versioning and automated evaluation.
• Experience deploying and maintaining LLM and agentic workflows in production.
• Demonstrated ownership and pragmatism in balancing infrastructure elegance with iterative delivery.

Nice to Have

• Experience with LangChain, LlamaIndex, vLLM, MLflow, and BentoML.
• Background in AI governance and compliance.
• Familiarity with regression testing and cost monitoring for AI models.

What We Offer

• Competitive salary range of $200,000 - $220,000 per year.
• Eligibility to participate in TRM’s equity plan.
• A fast-paced, high-impact work environment focused on solving critical challenges.
• Opportunities for professional growth and development.
• Remote work flexibility with a collaborative team culture.