Staff Analyst (Artificial Intelligence Product)
- United States
- Lead/Staff
- 8+ years
- Bachelor's degree
- Posted
Skills
Required
- analytics
- causal inference
- survival analysis
- data science
- evaluate model outputs
- resolution
- A/B tests
- subscription-based business models and metrics
- cohort analysis
- SQL
- BigQuery
Preferred
- telehealth
- subscription-based healthcare models
- AI-assisted workflows
- conversational AI / LLM-based
- intent classification / containment / escalation / hallucination / quality monitoring
- time-to-event modeling
- pyfixest
- statsmodels
- Airflow
Hims & Hers, a telehealth company, as a Staff Analyst specializing in AI products. In this role, you will work cross-functionally with various teams to measure product performance, quantify commercial and clinical impact, and shape the experimentation and measurement strategy for AI-driven experiences. You will own the experimentation strategy for AI product launches and iterations, apply causal inference methods to assess AI impact, and define metrics frameworks for new AI product use cases. Additionally, you will partner with ML teams to evaluate model performance and own commercial impact analysis for AI products. This is a remote position with competitive salary and benefits.
Serve as a strategic analytics partner to teams building and operating AI products, working cross-functionally to measure product performance and shape experimentation strategy.
About Hims & Hers
We are committed to building a workforce that reflects diverse perspectives and prioritizes ethics, wellness, and a strong sense of belonging. If you're excited about this role, we encourage you to apply—even if you're not sure if your background or experience is a perfect match
Responsibilities
- Own experimentation strategy for AI product launches and iterations, including test design, success metrics, sample-size estimation, guardrails, and results interpretation.
- Define, validate, and own metrics frameworks and measurement plans for new and evolving AI product use cases, translating ambiguous business questions into rigorous metrics.
Requirements
- 8+ years of experience in analytics, data science, or a related quantitative field
- Experience partnering with ML teams to evaluate model outputs and translate them into product/business metrics (e.g., classification accuracy, confidence scores, resolution quality)
- 5+ years of experience designing, executing, and analyzing A/B tests, ideally including tests on AI/ML-driven product experiences
- Experience with subscription-based business models and metrics, including cohort analysis, retention/churn analysis, and addressability sizing
- Expert SQL skills (BigQuery preferred) and advanced experience with Looker or Tableau
- Bachelor's degree in Statistics, Mathematics, Economics, Computer Science, Engineering, or a related field
- Ability to explain technical analyses clearly to non-technical audiences, including senior leadership
- Extensive experience working with data engineering and analytics engineering teams, including dbt-modeled production pipelines
- Strong knowledge of experimental design and statistical inference; experience applying causal inference techniques beyond standard A/B testing, such as quasi-experimental methods or observational study design (e.g., fixed-effects regression, survival analysis)
- A proactive, ownership-driven mindset with strong organizational and prioritization skills
- Experience shaping and influencing product strategy, not just executing analyses
- Experience with GrowthBook or a comparable experimentation platform
Preferred
- Familiarity with telehealth concepts or subscription-based healthcare models, including clinical safety considerations in AI-assisted workflows
- Experience evaluating conversational AI or LLM-based products (intent classification, containment/escalation, hallucination or quality monitoring)
- Experience with survival analysis or time-to-event modeling (e.g., lifelines, pyfixest, statsmodels)
- Dbt, Airflow, and Databricks experience
Pay
USD 155,000 - 190,000
jobapplier