Remote job
Software Engineer I - LLM Observability
Job details
About this role
Role overview
Build product capabilities that help customers understand and troubleshoot AI agents and the systems around them. This full-stack role spans data ingestion, infrastructure, analysis, and customer-facing visualizations, including signals such as usage cost, token consumption, errors, and anomalies. You’ll work in a small cross-functional engineering group with product and design partners, iterating on features used in production.
Responsibilities
- Deliver AI observability features from data ingestion through in-product presentation. - Contribute to data models and infrastructure for observing agents and their surrounding systems. - Build ways to analyze and surface AI-specific signals, including cost, token usage, errors, and anomalies. - Work with product and design partners to shape usable workflows for customers. - Share findings that help people investigate AI behavior across conversations and workloads. - Use rapid feedback and experimentation to refine features and communicate lessons from the work.
Requirements
- At least three years of software engineering experience. - Experience delivering customer-facing features for a software-as-a-service product. - Full-stack capability, including backend development with Go and/or Python and frontend work with TypeScript and React. - Experience collaborating with product managers and designers. - Regular hands-on use of AI tools in engineering work. - On-call experience and comfort working in a fast-changing area where requirements may shift.
Nice to have
- Experience shipping LLM or agent-powered features in production. - Practical familiarity with observability tools such as OpenTelemetry.
Benefits and work setup
The role is fully distributed. The listed base salary is CAD $218,891–$245,946, depending on experience. Benefits include equity, unlimited paid time off, home office, coworking and internet stipends, employee health coverage with dependent options, up to 16 weeks of paid parental leave, and an annual development allowance.