Member of Technical Staff, AI Researcher (New Stealth Startup)

Role overview Combine AI research with hands-on engineering to turn complex real-world work into measurable tasks, evaluations and feedback systems. You will study how data and evaluation design affect model behavior, then build tools and experiments that help improve AI systems, including language models, agents and multimodal models.

Responsibilities - Design benchmarks and evaluation methods for models, agents and reinforcement learning environments. - Build reward models, automated graders, programmatic checks and other feedback mechanisms to assess model behavior. - Run controlled supervised fine-tuning and reinforcement learning experiments to examine capability, generalization and alignment. - Develop expert task design, annotation methods and quality signals for producing useful human-generated data. - Translate research questions into focused experiments; analyze results and failure modes, then improve benchmarks, datasets or systems. - Turn promising experimental methods into reliable implementations, collaborate across research and product functions, and contribute technical writing or open-source work.

Requirements - Five or more years of relevant experience in machine learning, AI, computer science, data science, software engineering or a related field. - Ability to work across research and software engineering, including building reliable, scalable software with Python. - Skill in designing rigorous experiments, interpreting ambiguous findings and using results to guide technical decisions. - Interest in how data selection, structure, attribution and quality influence model behavior. - Clear communication with technical and nontechnical partners, sound judgment and ownership in a changing environment. - Comfort translating unfamiliar operational workflows into measurable tasks and moving quickly while maintaining engineering quality.

Benefits and work setup The source describes a fast-moving team working on AI for mission-critical and regulated settings. Listed benefits include employer-paid medical, dental and vision coverage for employees and family, 14 weeks of paid parental leave, flexible paid time off subject to approval, professional development, and optional retirement, spending account and equity programs.