Senior Software Engineer- Data Platform

Data & Messaging: SQL, Confluent Schema Registry, Kafka

Query Engines: Athena, Trino

Responsibilities

• Strong bias for action; accountable for end-to-end task execution and timely delivery in a fast-paced environment.
• Keep scalability/availability/resilience in mind while building.
• Interfacing with multiple stakeholders to understand the requirements and deliver accordingly.

Requirements

• Architect & Build: Design and develop scalable data pipelines and backend services using Java and Python.
• Infrastructure at Scale: Maintain and optimize high-throughput infrastructure, ensuring high availability and low latency.
• Design scalable ingestion layers and warehouse schemas that leverage Trino and Athena for high-performance, distributed querying at scale.
• Strong proficiency in Data Structures and Algorithms with a focus on optimizing high-scale distributed systems.
• Partner with cross-functional teams to deliver technical requirements and resolve platform bottlenecks.
• Languages: Java (Must-have), Python

Preferred

• Prior experience with product analytics tools is a plus
• Experenice in Trino is added advantage.
• Good to have Airflow