Applied AI Engineer

Role overview Build and launch AI capabilities that solve real product needs, from early prototypes through production operation. This hands-on engineering role spans agent design, evaluation, deployment, and ongoing improvement, with close collaboration across product, mobile, and backend teams. The focus is on reliable user-facing systems, with attention to quality, latency, and operating cost.

Responsibilities - Develop user-facing agents using tool-calling language models, structured responses, parallel API calls, and streaming. - Create evaluation workflows and quality scoring to assess safety, effectiveness, and personalization. - Take features from prototype through evaluation, staging, production deployment, trace monitoring, and iteration. - Improve system reliability, response time, and cost through caching, token limits, retry behavior, and observability. - Build agent tools and integrations, including validated APIs, exercise search over local data, and structured workout submission.

Requirements - Strong Python skills and experience building and deploying services in production systems. - Experience with LangChain, LangGraph, or a comparable agent framework, and hands-on production use of language models. - Practical knowledge of prompt design, tool or function calling, structured output, and model evaluation. - Comfortable with asynchronous Python, HTTP APIs, and streaming methods such as SSE or webhooks. - Experience designing schemas and validating data with Pydantic, JSON Schema, or similar tools. - Able to troubleshoot across application and infrastructure layers and communicate clearly with product and engineering partners.

Nice to have - Familiarity with AWS services or other cloud hosting for AI agents; observability and tracing tools such as Langfuse, OpenTelemetry, or Datadog. - Exposure to model-as-judge evaluation, automated scoring, dataset management, or infrastructure as code such as Terraform or CDK.

Benefits and work setup The stated base salary is $215,000–$250,000 per year, with equity participation. The role is remote for employees in the continental United States, with no travel required. Other listed benefits include health coverage, a 401(k), flexible time off, monthly wellness support, mental health resources, medical travel reimbursement, an annual learning budget, and access to the company’s membership service.