Data Platform Engineer

Join Shift4, a leading payment processing company, as a Data Platform Engineer. In this hands-on infrastructure engineering role, you will build, maintain, and optimize data pipelines that move data from production systems into our analytics warehouse. You will focus on pipeline performance, reliability, scalability, resource optimization, cost efficiency, and observability. This position offers opportunities for career growth, skill-building, and advancement, as well as various benefits including wellness programs, paid time off, and flexible work schedules.

Responsibilities

• Operar, ajustar y escalar las tuberías de ingestión basadas en ECS/SQS desde Aurora MySQL hacia Snowflake, incluyendo el dimensionamiento de tareas, la escalabilidad automática y el manejo de errores.
• Definir los SLOs para la frescura y el retraso de los datos, construir alertas y paneles de control, liderar la respuesta a incidentes y el análisis de la causa raíz de las fallas en las tuberías.
• Construir y mantener la infraestructura como código, la automatización de despliegues y la CI/CD para los servicios de tuberías.
• Observability and alerting for pipeline health and lag using Prometheus/Grafana, CloudWatch, Datadog, or the Elastic Stack
• Infrastructure as code with Terraform/Ansible, containerization with Docker, and CI/CD pipelines

Requirements

Passion for automation, performance, and clean system design

• Deep hands-on AWS experience: ECS/Fargate (task sizing, autoscaling, deployments), SQS (throughput, DLQs, visibility timeouts, batching), S3, IAM, CloudWatch, and Aurora/RDS from the operator side
• 5+ years in platform, infrastructure, or DevOps roles supporting data-intensive systems in production
• Experience operating pipelines into Snowflake from the ingestion side (Snowpipe/COPY, stages, load monitoring)
• Enough Python to read, debug, and instrument worker code
• Proven track record tuning message-driven workloads: consumer concurrency, backpressure, retries, idempotency, throughput versus cost
• CDC tooling (Debezium, AWS DMS) and MySQL Binlog replication
• Elastic Stack or time-series database (Prometheus, InfluxDB) administration
• Message brokers beyond SQS: Apache Kafka/Confluent, RabbitMQ

Preferred

• Experience in a PCI or otherwise regulated environment
• Payments or fintech domain knowledge