Remote job
Senior AI & LLM Systems Engineer
Job details
About this role
Role overview Design and operate production AI systems that combine language models, agent workflows and multimodal retrieval. The work spans architecture, model deployment and evaluation, with a focus on responsive services that can handle substantial query volume.
Responsibilities - Build stateful, multi-agent workflows using orchestration frameworks or custom components. - Develop hybrid retrieval pipelines, including vector search, chunking, reranking and semantic caching. - Fine-tune open-weight models and deploy inference services with strict latency targets. - Create automated evaluations to detect hallucinations and catch prompt regressions. - Collaborate with product leaders and customer teams to define and deliver AI features.
Requirements - At least four years of software engineering experience, with strong Python and FastAPI skills. - Experience operating reliable LLM applications in production. - Knowledge of vector databases and semantic search methods. - Understanding of token costs, streaming responses and prompt design. - Experience with Docker, cloud deployments on AWS or GCP, and CI/CD.