Applied AI Engineer, SMB

Role overview Improve the accuracy and usefulness of AI agents built for small businesses. You’ll create evaluation sets, identify recurring answer failures, refine agent instructions, knowledge, and workflows, and use measured results to determine whether changes help.

Responsibilities - Build evaluation sets for common small-business scenarios. - Identify patterns in incorrect or unsuccessful agent answers. - Improve agent instructions, knowledge sources, and workflows. - Measure performance before and after changes using consistent evaluations. - Turn validated improvements into defaults and templates for builders.

Requirements - Experience building or evaluating applications that use large language models. - Strong prompting and evaluation skills. - Python or another programming language for analysis. - Understanding of how small businesses communicate with their customers.

Nice to have - Background in applied AI or machine learning, LLM evaluation, conversational AI, or AI-focused solutions engineering.

Benefits and work setup - Remote contract with flexible hours; compensation starts at $5,500 per month. - Freelancers and solo agencies may continue serving their own clients.