Remote job
AI Engineer I/II/III
Job details
About this role
Role overview
Build and operate a growing fleet of AI agents that support employees in everyday business systems. The work centers on configuring prompt-based agents, providing shared tools they can use, and monitoring performance, security, and cost after deployment. When prompt-based approaches prove unreliable, you’ll develop hosted agents or specialized software to handle the task.
Responsibilities
- Build and maintain shared tools and capabilities used by agents. - Configure agents, including their instructions, models, tools, permissions, and safeguards, so specialists and subject matter experts can test them. - Work with those testers to evaluate agent behavior on real cases and improve prompt design. - Deploy agents and monitor evaluations, alerts, audit records, and operating costs. - Improve production agents by addressing drift, data quality, scope, or safeguard issues. - Build custom hosted agents or tooling when a prompt-based design cannot meet reliability needs, and share standards that make future deployments more effective.
Requirements
- A technical degree or equivalent combination of education and experience. - At least three years of professional software engineering, data engineering, or AI/ML experience. - Hands-on experience building LLM applications or agents, including prompt design, tool use, retrieval, and evaluation against real cases. - Strong Python engineering fundamentals, including version control, code review, testing, and API use. - Experience with Azure or a comparable cloud platform, including identity, permissions, and secrets management. - Familiarity with SQL and enterprise platforms, plus the judgment to choose between code and a simpler agent configuration. - Clear communication skills and ability to coach non-engineers through testing and tuning.
Nice to have
- Experience with Microsoft Foundry or similar agent platforms, frameworks, or protocols such as MCP, LangGraph, or Semantic Kernel. - Knowledge of Salesforce, Databricks, production AI monitoring, evaluation, cost tracking, and responsible AI practices.
Benefits and work setup
Remote work is being considered, with state-based exclusions. The hiring level will reflect the selected candidate’s experience.