Senior Data Engineer
Schumacher Clinical Partners
- Lafayette, United States +1
- Senior Level
- 8+ years
- Bachelor's degree
- Posted
Skills
Required
- Data / Cloud / Security
- Snowflake architecture and operations
- governance controls
- performance tuning
- cost optimization
- operational monitoring
- query analytics
- platform conventions
- project organization
- macros
- incremental modeling
Preferred
- Revenue Cycle RCM
- PHI/PII
- regulated data
- Platform architecture
- scheduling
- EHR extracts
- SQL
- batch
- Parquet
About Schumacher Clinical Partners
At SCP Health, what you do matters As part of the SCP Health team, you have an opportunity to make a difference.
At our core, we work to bring hospitals and healers together in the pursuit of clinical effectiveness.
With a portfolio of over 8 million patients, 7500 providers, 30 states, and 400 healthcare facilities, SCP Health is a leader in clinical practice management spanning the entire continuum of care, including emergency medicine, hospital medicine, wellness, telemedicine, intensive care, and ambulatory care.
Strong track record of providing excellent work/life balance. - Comprehensive benefits package and competitive compensation. - Commitment to fostering an inclusive culture of belonging and empowerment through our core values - collaboration, courage, agility, and respect.
Responsibilities
- Platform architecture & technical direction: Define and evolve reference architectures and standards for ingestion, transformation, orchestration, and serving layers (Snowflake + dbt and adjacent tooling); lead design reviews and set guardrails that enable teams to deliver scalable, secure, observable, and maintainable solutions.
- Highest-impact data products (ownership & service levels): Own end-to-end delivery and operational excellence for the most critical datasets and pipelines that support revenue cycle, physician scheduling, billing, and performance monitoring; define SLAs/SLOs, error budgets (where applicable), and support models for sustained reliability.
- Complex integrations & facility onboarding at scale: Lead strategy and implementation for complex, multi-facility integrations (EHR extracts, HL7, FHIR, APIs, flat files), including backfills, reconciliation, and long-term maintainability; establish repeatable onboarding playbooks and reusable patterns adopted across teams.
- Own and enforce platform-wide conventions across Bronze/Silver/Gold layers (naming, modeling, testing, documentation, lineage, certification); drive alignment on canonical definitions and patterns to reduce ambiguity and rework across domains.
- Serve as an escalation point for major incidents impacting critical pipelines or multiple domains; lead triage, coordinate cross-team resolution, run blameless post-incident reviews, and drive systemic fixes (alerting, runbooks, resilience patterns, and backlog priorities) to prevent recurrence.
- Lead Snowflake performance and cost optimization initiatives (warehouse/workload design, scheduling, resource monitors, query tuning); establish team practices and decision frameworks that balance reliability, latency, and consumption, and communicate tradeoffs and drivers to stakeholders.
- Architect and implement HIPAA-aligned controls for PHI/PII (least-privilege RBAC, masking, row/column policies, auditing, secure sharing); partner with Security/Compliance on access patterns, periodic reviews, audits, and remediation for platform-level controls.
- Define and operationalize platform-level data quality strategy (tests, reconciliation, anomaly detection, freshness/completeness targets) and observability standards; ensure measurable coverage for critical pipelines and data products and guide teams toward consistent adoption.
- Lead technical discovery with stakeholders; clarify ambiguous requirements; propose implementation options; and align on definitions, acceptance criteria, change impacts, and rollout plans across multiple teams and initiatives.
- Mentor Data Engineers I–III through coaching, pairing, and feedback; raise the engineering bar via code/design reviews, reusable libraries/macros, documentation standards, and pragmatic guidance on tradeoffs.
- Lead improvements to data CI/CD and release practices (testing gates, automated checks, environment promotion, release strategy, rollback planning) that reduce defects and improve delivery predictability across teams.
- Partner with the Data Engineering Manager and stakeholders to shape the platform roadmap, identify systemic risks and dependencies, and propose investments that improve scalability, reliability, governance, and team velocity.
- Expert SQL & data engineering craft: Expert-level ability to design, optimize, and troubleshoot complex SQL workloads; diagnose performance at the query and system level; and define scalable patterns for data access and transformation.
- Ability to define canonical models and data products across domains (e.g., dimensional/domain-oriented), manage change over time (SCDs), and drive alignment on definitions that reduce ambiguity across the organization.
- Define SLAs/SLOs and availability targets; design monitoring/alerting and runbooks; lead incident response and postmortems for critical issues; and drive systemic improvements through problem management.
- Advanced knowledge of batch and near-real-time patterns (watermarking, CDC, replay/backfill strategy, idempotency), APIs and authentication, and semi-structured/columnar formats (JSON, Parquet); ability to build reusable onboarding patterns adopted across multiple facilities and domains.
- HIPAA-aligned design for PHI/PII, least-privilege access models, masking and row/column policies, auditability, and secure sharing; ability to partner with Security/Compliance to design controls and lead remediation when gaps are found.
- Lead discovery and design reviews, make pragmatic tradeoffs, and influence without authority; drive adoption through enablement (documentation, office hours, templates), clear communication, and consistent standards.
- Identify systemic issues and investment opportunities, articulate multi-quarter technical plans, evaluate build vs. buy tradeoffs, and sequence work to reduce risk and increase long-term leverage.
- Communicate clearly with technical and non-technical partners, align on definitions and expectations, and provide transparent status, risk, and tradeoff updates for cross-team initiatives.
Requirements
- Deep expertise with Snowflake architecture and operations, including workload strategy, governance controls, performance tuning, cost optimization, and operational monitoring; ability to set standards and coach others using usage and query analytics. dbt proficiency & platform conventions: Advanced proficiency with dbt project organization, macros, testing and documentation strategy, incremental modeling, and environment promotion; ability to define, enforce, and evolve conventions that scale across teams.
- Degree preferred in MIS, Computer Science, or business discipline with appropriate exposure to information technology concepts, processes, and systems.
- 8+ years of progressive professional experience in Data Engineering, Analytics Engineering, or a related technical role, including ownership of production data pipelines and data products across multiple domains and leadership of complex cross-domain initiatives.
- 4+ years of hands-on experience building and operating solutions within the Snowflake ecosystem, including performance tuning and practical cost management.
- Experience working in an Agile/Scrum environment, including technical leadership across initiatives (design reviews, estimation, delivery coordination) and mentoring other engineers through implementation and support.
- Relevant certification or license in Data, Analytics, Cloud, or Security is a plus.
- Data Engineer (preferred) or SnowPro Core Certification. dbt Analytics Engineering Certification (preferred), with demonstrated experience operating dbt in production.
- HIPAA Security/Privacy training (required) and/or related healthcare compliance certifications (preferred).
- Minimum travel, when applicable.
- Job requires a high level of mental awareness.
Preferred
- Bachelor’s degree (BA/BS) in MIS, Computer Science, or a related field; or equivalent combination of education and experience.
- Experience in Healthcare, Revenue Cycle (RCM), and/or integrating clinical data feeds is strongly preferred; experience working with PHI/PII and regulated data is expected.
Pay
Lafayette, LA (Corporate HQ) SECONDARY LOCATION(S): Atlanta, GA Dallas, TX Pay Range: 86,539.00 - 128,101.00 USD annually This range represents the anticipated base salary for this role.
Benefits
- Actual compensation will be determined based on experience, qualifications, and internal equity considerations. - We offer a comprehensive benefits package designed to support your health, financial well-being, and work-life balance, including medical dental, vision insurance, a 401(k) plan with a company match, paid time off and holidays, professional development support, and employee wellness resources.
WORK ENVIRONMENT AND PHYSICAL DEMANDS
Professional setting. Continuous sitting. Continuous oral & written communication and listening skills. Continuous computer use. Occasional bending, kneeling, lifting, pulling & pushing up to 10 pounds.
Visit our website for further information. https://myscpbenefits.com/ Login name: corp-guest Password: weheal
