Remote job
Product Manager, Provider Marketplace
Job details
About this role
Role overview Develop a marketplace that connects AI developers with inference providers and helps balance demand, capacity, service quality, and cost. You will own provider-facing products and marketplace mechanisms, partnering with engineering, operations, and commercial teams to make buying and selling inference more efficient and easier to operate.
Responsibilities - Own the roadmap for provider dashboards, self-service APIs, onboarding, traffic allocation, pricing, and quality systems. - Design and scale marketplace mechanisms such as auctions, committed capacity, and dynamic pricing. - Build controls for buyers and capacity-management tools for providers to support adoption and liquidity. - Define service tiers and priority lanes, accounting for customer reliability needs, provider margins, and platform economics. - Create evaluations, routing scorecards, and failure diagnostics that help providers understand and improve performance. - Turn manual onboarding, model staging, pricing changes, and health checks into self-service workflows and APIs. - Use request logs, routing measures, and unit economics to find unmet demand, unused capacity, and ineffective incentives.
Requirements - Experience building technical products that involve infrastructure, distributed systems, or marketplace dynamics. - Understanding of AI inference stacks and the performance and cost effects of caching, batching, and quantization. - Ability to use code, data, and AI agents to investigate problems, prototype workflows, and validate product specifications. - Strong commercial judgment, including the ability to model margin and capacity tradeoffs and design incentives across customers, providers, and the platform. - Clear written communication, high initiative, and the ability to work directly with users and partners while shipping iteratively.
Nice to have - Background with an inference provider, AI lab, GPU cloud, or model-serving and routing infrastructure. - Experience designing auctions, spot or batch compute markets, service-level tiers, or dynamic pricing. - Experience building business-to-business partner tools, self-service onboarding, or provider analytics dashboards.