AI Operations Engineer - Remote Role at Veracross

About the Role

We are excited to announce an opening for an AI Operations Engineer remote position at Veracross. In this role, you will help shape AI solutions across our entire product portfolio, directly impacting the quality of life for our users. As an AI Operations Engineer, you will work end-to-end across the AI stack, from infrastructure to shipping features, ensuring reliability, safety, and cost control.

What You'll Do

• Design and ship agentic AI products to optimize and automate school operations.
• Build systems using school-specific data and institutional knowledge; develop prompt strategies and reusable libraries.
• Integrate AI capabilities into existing Ruby on Rails applications via APIs and SDKs.
• Curate and maintain our AWS AI infrastructure (Bedrock, GuardRails, etc.).
• Evaluate and select models, benchmark quality, latency, and cost on school operations tasks.
• Optimize prompts, caching, batching, and workflows to improve performance and reduce spend.
• Monitor token usage and implement budgeting and cost controls; run A/B tests across approaches.
• Design guardrails to prevent hallucinations, bias, and inappropriate outputs.
• Detect and redact PII in AI inputs/outputs; establish safety protocols for K–12.
• Instrument AI systems with logging, metrics, and tracing; build dashboards for quality, latency, cost, and safety.
• Create evaluation datasets and automated testing pipelines, incorporating user feedback into ongoing improvements.
• Stay current with the AI/ML ecosystem; prototype new models, techniques, and tools.
• Evaluate and select AI hosting solutions (AWS AgentCore, Cloudflare Agents, etc.).

Requirements

• 5+ years of software engineering experience, including hands-on LLM work.
• Experience building and operating production AI applications.
• Strong understanding of prompt engineering LLM best practices.
• Comfortable working with APIs in a polyglot environment.

Nice to Have

• Applied AI skills.
• Ruby on Rails experience (or willingness to learn quickly) or similar frameworks.
• Experience in regulated or safety-sensitive domains.

What We Offer

• Fully remote work environment.
• 25 days holiday, plus public holidays.
• 4% matched pension contributions.
• Payroll Giving.
• Private medical insurance.
• Discounted Gym Membership.
• Cycle Scheme.
• Enhanced Sick Pay.
• Enhanced Maternity, Paternity, Adoption, and shared Paternity Leave pay.
• Employee Assistance Program.