Senior Software Engineer - AI/​LLMs Remote

About the Role

We are seeking a Senior Software Engineer (AI / LLMs Remote) to join our innovative team at G2i Inc. This role offers the opportunity to work on cutting-edge technology that supports mission-critical enterprise workloads. As a Senior Software Engineer, you will play a pivotal role in designing and building systems that power an AI-driven automation platform utilized by enterprise IT teams and managed service providers worldwide.

What You’ll Do

• Design and implement backend services that enable intelligent agent workflows and autonomous infrastructure actions.
• Develop APIs and orchestration layers in Python and TypeScript, integrating LLMs, vector databases, and observability pipelines.
• Build scalable systems to support LLM-based reasoning, retrieval, and decision-making across cloud infrastructure.
• Integrate with AWS Bedrock and other LLM platforms to support multi-model capabilities.
• Develop data access and semantic search layers using vector databases (e.g., pgvector, Pinecone, Qdrant).
• Build robust monitoring, testing, and CI/CD systems to ensure reliability and reproducibility of AI workflows.
• Collaborate closely with Product and DevOps teams to design architecture diagrams, plan deployments, and monitor system health.
• Write clean, maintainable code with clear documentation and strong adherence to security and performance best practices.
• Participate in code reviews, design discussions, and iterative delivery cycles to improve product velocity and quality.

Requirements

• 6+ years of backend engineering experience in production environments.
• Strong proficiency in Python and TypeScript for building distributed, event-driven systems.
• Deep understanding of AWS services (Lambda, ECS, Bedrock, S3, CloudWatch, etc.).
• Experience designing APIs, microservices, and event pipelines that interface with LLMs or AI models.
• Familiarity with vector databases and concepts such as embeddings, similarity search, and retrieval-augmented generation.
• Experience with infrastructure-as-code tools such as Terraform or AWS CDK.
• Strong understanding of SQL and schema migration workflows (PostgreSQL or similar).
• Hands-on experience with Docker, GitHub Actions, and cloud-native CI/CD workflows.
• Ability to diagram systems, communicate architecture decisions clearly, and work effectively in a distributed team.
• Strong ownership mindset and ability to deliver in fast-moving, ambiguous environments.

Nice to Have

• Experience working with LangChain, OpenAI, or Anthropic APIs.
• Familiarity with agentic frameworks or AI orchestration systems.
• Background in observability or APM tooling (e.g., Datadog, Dynatrace).
• Prior experience building automation or infrastructure management tools.
• Contributions to open-source LLM or MLOps projects.
• Interest in applying AI to real-world IT operations.

What We Offer

• Base Salary: $120,000 – $160,000 USD.
• Medical, dental, and vision — 100% paid for employees, 50% paid for dependents.
• Life and disability insurance — 100% paid for employees.
• 401(k) — 3% contribution, no employee contribution required.
• Education and tuition reimbursement — up to $50,000 annually.
• Employee Stock Options Plan.
• Accident, critical illness, and hospital indemnity coverage.
• Employee Assistance Program and legal assistance.
• Paid Time Off — up to 6 weeks per year.
• Sick Leave — up to 2 weeks per year.
• Parental Leave — up to 12 weeks.
• For international employees, our client partners with an Employer of Record and provides all statutory benefits required under local law.