AI Platform Engineer - Applied AI for Remote Innovation
About the Role
We are seeking an AI Platform Engineer to join our innovative team at Circle. This remote position focuses on building robust AI systems that drive transformative applications for our customers. As an AI Platform Engineer, you will play a crucial role in shaping our AI infrastructure, ensuring that our systems work reliably at scale.
What You'll Do
- Build evaluation infrastructure to measure AI system speed and accuracy — both offline (during development) and online (in production).
- Create observability tooling and dashboards that surface quality metrics week-over-week.
- Diagnose quality gaps and trace issues to determine their root causes.
- Experiment with different models and agent configurations, using data to guide decisions.
- Prototype and validate improvements to our RAG pipeline — chunking strategies, retrieval methods, and re-ranking approaches.
- Analyze customer usage of AI features to identify improvements or new areas for development.
- Collaborate with other engineers to ensure quality improvements are effectively implemented.
- Stay up-to-date with cutting-edge AI research, techniques, and tools.
Requirements
- 6+ years of experience in software engineering, data science, or ML, with a foundation in search/retrieval, information extraction, NLP, or recommendation systems.
- Experience building and evaluating AI systems in production, including RAG pipelines and LLM-powered applications.
- Strong proficiency in Python for prototyping and experimentation.
- Willingness to learn Ruby on Rails for integration with our production system.
- Deep understanding of RAG architecture, including chunking strategies and context management.
- Strong experimentation mindset with experience in designing A/B tests.
- Excellent data analysis skills to interpret results and communicate findings clearly.
- Proficient in English at a CEFR Level C2 / ILR Level 5.
Nice to Have
- Experience with evaluation frameworks like Braintrust or LangSmith.
What We Offer
- Fully remote work: enjoy the flexibility to work from anywhere in the world.
- Autonomy and trust to do your job: we prioritize outcomes over hours worked.
- 35 days of paid time off annually, plus a paid sabbatical after 5 years.
- Generous compensation benchmarked against U.S. standards, including startup equity.
- Comprehensive medical coverage for you and your family.
- Parental leave for new parents.
- Home office stipend to set up your workspace.
- Learning & development stipend to enhance your professional skills.
This role offers a unique opportunity to shape AI systems at Circle, a fully remote company with a strong focus on innovation and employee well-being.
Who Will Succeed Here
Expertise in Python and Ruby on Rails, with a strong understanding of AI systems architecture, specifically in building and maintaining RAG (Retrieval-Augmented Generation) architectures for scalable applications.
Self-motivated and disciplined remote worker who thrives in a distributed team environment, capable of managing time effectively and demonstrating initiative in problem-solving and innovation.
Extensive experience (5+ years) in data analysis and NLP, with a track record of developing and deploying machine learning models that enhance user experiences and drive business value.
Learning Resources
Career Path
Market Overview
Skills & Requirements
Domain Trends
Industry News
Loading latest industry news...
Finding relevant articles from the last 6 months