jobapplier

GCP(Big query + SQL) Data Engineer

Weekday

This role is for one of our clients

About Weekday

  • Industry: Artificial Intelligence
  • Company Name: Brillio

Responsibilities

  • Develop and maintain scalable, cloud-native data processing pipelines on GCP
  • Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
  • Automate infrastructure using Terraform and follow agile development practices
  • Implement data solutions for enterprise-scale data lakes and data warehouses
  • Write clean, efficient, and production-ready code using Python and SQL
  • Handle data quality issues including data duplication and debugging code failures
  • Collaborate with cross-functional teams to build resilient and reliable data platforms

Requirements

  • Min Experience: 5+ years
  • Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India

Preferred

  • Exposure to identifying and resolving data duplication or consistency issues
  • Should have worked on end-to-end data pipeline creation and monitoring

Experience in the data engineering field is preferred

  • Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
  • Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms.
  • Apache Airflow
  • 4..SQL (BigQuery preferred)
  • Extensive hands-on experience working with data using SQL and Python

Additional Screening Points

  • Hands-on experience with debugging/analyzing production issues
  • Hands on Strong Experience in the below technology
  • GBQ Query
  • 2.Python