← Back to jobs

Remote job

Prompt Engineer & AI Evaluator

AI Engineer Full-time Indonesia

Job details

Not specified Salary
Indonesia Eligibility
Not specified Experience
Full-time Employment

About this role

Role overview This role focuses on shaping how enterprise large language models behave at scale, combining prompt design with rigorous evaluation work. The successful candidate will iterate on system prompts, design structured tests, and surface subtle failure modes such as hallucinations, unsafe outputs, and inconsistent formatting before they reach end users.

Responsibilities - Design, draft, and refine system prompts for production LLM features across multiple use cases. - Build and run systematic evaluation suites that measure accuracy, safety, and output consistency over time. - Investigate model failures, reproduce edge cases, and document findings for engineering and product teams. - Apply version control and structured formats (JSON, Markdown) when iterating on prompts and eval datasets. - Use basic Python scripting to automate test runs, parse model outputs, and aggregate results.

Requirements - 1+ years of hands-on experience with prompt engineering or AI evaluation in a production environment. - Fluent or native-level English (C1–C2), since the majority of prompting and evals are conducted in English. - Strong analytical and critical thinking skills, with the ability to spot subtle errors, bias, or hallucinations. - Working familiarity with JSON, Markdown, and basic Python scripting for automation and data handling. - Indonesian citizenship and current residence in Indonesia; the position is 100% full remote.

Nice to have Experience with LLM APIs, evaluation frameworks, or annotation tools used in NLP quality work.

Skills detected in the listing

PythonLLM
Detected Oct 2, 2026
Last verified Nov 17, 2026

Hidden Jobs Access

Unlock application links

Read the full job details for free. An active Hidden Jobs Access subscription is required to open the original application link.

Weekly

$6.99 /week
  • Original application links
  • Full access to all MCP features
  • Cancel anytime

Monthly

$35.99 $17.99 /month
  • Original application links
  • Full access to all MCP features
  • 35% cheaper than weekly

Lifetime

$99.99 $49.99 /forever
  • Original application links
  • Full access to all MCP features
  • One-time payment
Hidden Jobs gives subscribers direct access to original application links