Senior Software Developer, AI Agents

Role overview

This is a senior, hands-on engineering role focused on building and scaling production AI agents for a marketing automation SaaS platform. The work centers on agent internals—orchestration, tool calling, context management, and the evaluation infrastructure that keeps them reliable—rather than thin LLM wrappers. The role combines architecture, mentorship, and close collaboration with product, design, QA, and DevOps.

Responsibilities

- Design and implement the core agent runtime in Python, including orchestration loops, tool execution, memory and context management, structured outputs, and failure handling. - Build and maintain evaluation pipelines—datasets, automated evaluators, and LLM-as-judge workflows—so that prompt, model, and harness changes are measured and regressions are caught before reaching customers. - Diagnose agent failures from traces, tune prompts and tool designs, and run model comparisons and benchmarks to drive measurable quality gains. - Develop Python and Node.js microservices for agent hosting and LLM interaction. - Build and maintain PHP Laravel APIs that integrate agents into the broader platform, with strong testability, observability, and performance. - Deploy secure, scalable infrastructure on AWS (Lambda, Bedrock, CDN delivery), tune MySQL queries, lead code reviews, and mentor teammates.

Requirements

- 6+ years of backend software development experience. - Production experience building LLM-powered agents, including tool calling, orchestration, context management, and prompt engineering. - Hands-on experience designing and running evaluations for LLM systems: dataset curation, automated evaluators, LLM-as-judge, and regression tracking. - Strong proficiency in Python, Node.js, and MySQL. - Expertise in RESTful APIs, TDD, and CI/CD (e.g., GitHub Actions). - Experience with SaaS architecture, microservices, AWS, observability, performance tuning, scalability, and familiarity with Docker/Kubernetes.

Nice to have

- Interest or experience in full-stack work spanning frontend (e.g., Vue), backend (e.g., PHP Laravel), and agent engineering. - Background with LangGraph or other AI agent frameworks. - Prior experience shipping AI-powered product features in a fast-growing SaaS company.

Benefits and work setup

- Competitive compensation with equity in the company. - Paid vacation plus additional life-leave days. - Health and benefits package. - Team lunches, offsites, and a culture-led work environment. - Strong emphasis on career growth and internal development. - Inclusive hiring with accommodations available throughout the interview process.