Product Manager AI and Apps Platform Job at Hippocratic Ai, Palo Alto, CA

QWJnSFdhRm52eDkwMVlsTUFOb3BpdGtyNmc9PQ==
  • Hippocratic Ai
  • Palo Alto, CA

Job Description

About Us

Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health.

Why Join Our Team

  • Innovative Mission: We are developing a safe, healthcare-focused large language model (LLM) designed to revolutionize health outcomes on a global scale.

  • Visionary Leadership: Hippocratic AI was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA.

  • Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.

  • World-Class Team: Our team is composed of leading experts in healthcare and artificial intelligence, ensuring our technology is safe, effective, and capable of delivering meaningful improvements to healthcare delivery and outcomes.

For more information, visit .

We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA, unless explicitly noted otherwise in the job description.

About the Role

We are seeking a Product Manager – AI and Apps Platform to define the vision, roadmap, and execution for the systems powering our large language and audio models, inference clusters, and SaaS applications across multiple clouds.

You’ll partner closely with engineering, AI research, and GTM teams to build a scalable, cost-efficient, and extensible platform for model training, deployment, and application hosting. This role blends product strategy, technical depth, and cross-team leadership to ensure the platform enables rapid innovation and operational excellence at scale.

What You'll Do:

  • Define and execute the roadmap for HippocraticAI’s cross-cloud AI and application platform.

  • Partner with engineering and research on capacity planning for inference and application clusters.

  • Maintain model capacity and utilization tracking across LLM and Audio workloads.

  • Coordinate with GTM on deployment strategy, onboarding, and demand forecasting.

  • Collaborate with cloud vendors on capacity, pricing, and new feature evaluation.

  • Build and refine cost-optimal platform to balance performance and margins.

  • Lead pricing and margin analysis to align product performance with business goals.

  • Define and track success metrics around latency, cost, utilization, and adoption.

What We're Looking For

Must Have:

  • 7+ years of product management experience, with at least 2+ years in AI/ML platform or infrastructure products .

  • Strong technical understanding of model training, inference, and cloud compute architectures (AWS, GCP, or Azure).

  • Proven ability to align engineering, research, and GTM teams around shared goals.

  • Experience with capacity planning , cost optimization , and multi-cloud infrastructure .

  • Knowledge of cloud economics , performance trade-offs , and observability frameworks .

  • Excellent communication and analytical skills, with a focus on measurable outcomes.

Nice-to-Have

  • Hands-on background in cloud infrastructure, MLOps, or distributed systems .

  • Experience with GPU orchestration , multi-cloud cost optimization , or AI inference workloads .

  • Familiarity with LLM and voice-agent technologies .

  • Passion for building platforms that empower both developers and customers.

***Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @ hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process. If anything

Job Tags

Full time, Work at office,

Similar Jobs

IsoTalent

Marketing Content Specialist Job at IsoTalent

 ...Marketing Content Specialist Location/Onsite: Onsite - Dallas, TX...  ...$60,000 - $75,000, based on experience ~401k + company matching...  ...digital marketing assets such as social posts, short videos, email graphics...  ...experience with social media strategy, SEO, and/or digital... 

Coventry

Senior Legal Counsel Job at Coventry

 ...high degree of competence and sophisticated business judgment and legal acumen. Experience with insurance regulatory matters,...  ...variety of commercial agreements including licensing agreements, consulting agreements, purchase agreements, NDAs, financing agreements and... 

Hippocratic Ai

Senior Site Reliability Engineer (GCP / Kubernetes) Job at Hippocratic Ai

 ...artificial intelligence researchers from leading institutions, including El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA. Strategic Investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz,... 

NP Now

Family Medicine Physician -4 Day Week Job at NP Now

 ...Job Description Job Description Thriving Community based Medical Center seeks a Family Medicine Physician to work in an Outpatient setting near Towson, Maryland! CONTACT: Raymond Stiles (***) ***-**** ****@*****.*** About Group ~ Outpatient clinic... 

Dentist Partner Pros

Associate Pediatric Dentist - Grand Rapids, MI Job at Dentist Partner Pros

 ...Associate Pediatric Dentist Mentorship Ownership / Partnership Potential Location: Grand Rapids, MI Status: Full-Time | 4 Days/Week (8 AM 3 PM) with 5 days available (MondayFriday; Friday hours end at 2 PM) Compensation & Benefits: $240,000$400,000+...