Sr. Product Manager, AI Infrastructure
Own the full lifecycle management of AI infrastructure platforms (including large-scale clusters, distributed systems, lifecycle management toolchains, and model service gateways); develop 3-5 year strategies and annual roadmaps that align business goals with technical excellence, balancing performance, cost, usability, and reliability. Deeply analyze the core pain points of internal ML teams, data scientists, and enterprise clients; translate technical requirements into clear PRDs and technical specifications, leading products from 0→1 incubation to 1→N scaled iterations. Partner with hardware architecture, heterogeneous systems, software engineering, algorithms, and SRE teams to drive product R&D and operations; resolve critical technical trade-offs during the development process. Establish a core performance indicator system (e.g., throughput, latency, compute resource utilization, cost efficiency, and developer satisfaction); leverage data to drive continuous product optimization. Track cutting-edge advancements in AI Infrastructure (such as compiler optimization, cloud-native architectures, and large-scale model training/inference techniques) and industry trends to build differentiated competitive advantages. Collaborate with GTM and sales teams to articulate product value propositions, technical whitepapers, and POC solutions to drive commercial success and client acquisition.
- Own the full lifecycle management of AI infrastructure platforms (including large-scale clusters, distributed systems, lifecycle management toolchains, and model service gateways)
- Develop 3-5 year strategies and annual roadmaps that align business goals with technical excellence, balancing performance, cost, usability, and reliability
- Deeply analyze the core pain points of internal ML teams, data scientists, and enterprise clients
- Translate technical requirements into clear PRDs and technical specifications, leading products from 0→1 incubation to 1→N scaled iterations
- Partner with hardware architecture, heterogeneous systems, software engineering, algorithms, and SRE teams to drive product R&D and operations
- Resolve critical technical trade-offs during the development process
- Establish a core performance indicator system (e.g., throughput, latency, compute resource utilization, cost efficiency, and developer satisfaction)
- Leverage data to drive continuous product optimization
- Track cutting-edge advancements in AI Infrastructure (such as compiler optimization, cloud-native architectures, and large-scale model training/inference techniques) and industry trends to build differentiated competitive advantages
- Collaborate with GTM and sales teams to articulate product value propositions, technical whitepapers, and POC solutions to drive commercial success and client acquisition
- Master’s degree or higher in Computer Science, Electronic Engineering, Mathematics, or a related STEM field
- Extensive experience in product management, with a focused track record in AI Infrastructure, cloud computing, distributed systems, or developer platforms
- Familiar with the end-to-end model development lifecycle
- Understanding of compilation optimization, high-performance inference engines, and distributed training optimization techniques
- Product design experience in these areas is a strong plus
- Exceptional cross-team communication and "influence without authority"
- Ability to drive project execution in ambiguous, fast-paced environments
- Experience in major cloud service providers or leading AI companies (preferred)
- Active contributions to relevant open-source technical communities (preferred)
- Sign on payment (evaluated on a case-by-case basis)
- Relocation package (evaluated on a case-by-case basis)
- Restricted stock units (evaluated on a case-by-case basis)
- Medical, dental, vision, life and disability benefits
- Participation in the Company’s 401(k) plan
- 15 to 25 days of vacation per year (depending on tenure)
- 13 days of holidays throughout the calendar year
- 10 days of paid sick leave per year
