GCP(Big query + SQL) Data Engineer
Weekday
- Bengaluru, India
- On-site
- Full-time
- Mid Level
- Posted
This role is for one of our clients
About Weekday
- Industry: Artificial Intelligence
- Company Name: Brillio
Responsibilities
- Develop and maintain scalable, cloud-native data processing pipelines on GCP
- Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
- Automate infrastructure using Terraform and follow agile development practices
- Implement data solutions for enterprise-scale data lakes and data warehouses
- Write clean, efficient, and production-ready code using Python and SQL
- Handle data quality issues including data duplication and debugging code failures
- Collaborate with cross-functional teams to build resilient and reliable data platforms
Requirements
- Min Experience: 5+ years
- Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India
Preferred
- Exposure to identifying and resolving data duplication or consistency issues
- Should have worked on end-to-end data pipeline creation and monitoring
Experience in the data engineering field is preferred
- Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
- Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms.
- Apache Airflow
- 4..SQL (BigQuery preferred)
- Extensive hands-on experience working with data using SQL and Python
Additional Screening Points
- Hands-on experience with debugging/analyzing production issues
- Hands on Strong Experience in the below technology
- GBQ Query
- 2.Python
