Remote job
LLM Engineer (100% Remote within Poland)
Job details
About this role
Role overview
Lead engineering work that enables product teams to build, evaluate, and operate large language model capabilities in a healthcare technology environment. The role spans technical leadership, production reliability, multilingual information retrieval, and responsible AI practices, including prompt governance, safety controls, auditability, and human oversight. You will work across engineering, research, and product to turn model capabilities into useful, dependable product features.
Responsibilities - Lead NLP and LLM initiatives in partnership with scientists, engineers, and product stakeholders. - Implement and evaluate LLM solutions at scale, and support their deployment and operation in production. - Design and deliver LLM-powered information retrieval for complex multilingual use cases. - Monitor model behavior and production data, investigate changes, and tune inference settings to maintain performance. - Establish evaluation, prompt management, safety, logging, and oversight practices that support regulatory needs. - Share technical guidance and mentor engineers while helping shape tools and team workflows.
Requirements - Strong software engineering and applied machine learning or NLP experience, with hands-on work delivering LLM-based systems. - Experience evaluating models and monitoring or supporting machine learning systems in production. - Ability to design scalable information retrieval solutions, including for multilingual products. - Sound judgment around model reliability, unsafe behavior, and responsible deployment. - Strong communication, cross-functional collaboration, prioritization, and technical leadership skills. - A product-focused approach that connects technical decisions to user problems and business outcomes.
Nice to have - Familiarity with Langfuse, Python-based or in-application LLM evaluations, and TypeScript application development. The broader environment also includes Python, PHP, and .NET systems, with models from multiple providers.
Benefits and work setup - Remote work within Poland, with a Warsaw hub option and flexible working hours. - 20 or 26 paid days off depending on contract, plus an additional paid birthday or work-anniversary day. - Private healthcare, a sports benefit, mental wellness support, and English and Spanish classes.