jobapplier

Senior GCP Data Engineer

Sales Consulting

Responsibilities

  • Data Engineering & Architecture: Design, develop, and maintain scalable data platforms and pipelines using Google Cloud services.
  • Implement data ingestion, transformation, and orchestration workflows using: BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud SQL / PostgreSQL Define data models, partitioning strategies, and storage architectures optimized for large-scale analytics.
  • Implement batch and near real-time data processing solutions.
  • Design, optimize, and maintain BigQuery datasets, tables, views, and data marts.
  • Develop complex BigQuery SQL solutions for analytics and operational reporting.
  • Optimize query performance, storage costs, partitioning, clustering, and workload management.
  • Establish best practices for BigQuery governance, security, and performance monitoring.
  • Design and develop PostgreSQL database solutions on GCP.
  • Create and optimize database schemas, indexes, stored procedures, and PL/pgSQL code.
  • Perform database performance tuning, capacity planning, and troubleshooting.
  • Support migration and modernization of legacy databases to PostgreSQL.
  • Support migration of legacy Oracle workloads to PostgreSQL and BigQuery.
  • Assess existing database architectures and recommend modernization approaches.
  • Collaborate with application teams to refactor data solutions for cloud-native environments.
  • Ensure data integrity, security, and operational readiness during migrations.
  • Implement IAM controls, encryption, auditing, and data protection standards.
  • Apply data governance and compliance requirements across the cloud platform.
  • Participate in architecture reviews, code reviews, and engineering standards definition.
  • Collaborate with product owners, architects, analysts, and platform teams to deliver business value.

Requirements

  • Minimum 5 years of hands-on experience working with relational and analytical databases Minimum 1 year of hands-on experience with Google BigQuery (GCP) Proven expertise in Google BigQuery (GCP), with the ability to build, manage, and optimize data solutions in a cloud environment.
  • Proven expertise in PostgreSQL administration and development, including schema design, data integrity, performance monitoring, and troubleshooting.
  • Proficiency with GitHub for version control and collaborative development.

Preferred

  • Experience migrating Oracle databases to PostgreSQL and/or BigQuery.
  • Oracle SQL and PL/SQL knowledge.
  • Experience with Ora2pg or similar migration tooling.
  • Google Cloud Professional Data Engineer certification.
  • Google Cloud Professional Cloud Architect certification.
  • Experience with Terraform.
  • Experience with containerized deployments using Docker and Kubernetes (GKE).
  • Experience with Airflow / Cloud Composer.
  • Experience with data governance, metadata management, and data quality frameworks.
  • Experience with Google Cloud Dataflow for building and managing data processing pipelines.
  • Experience with Google Cloud Dataproc for big data processing and analytics workloads.
  • Experience with Google Cloud Pub/Sub for event-driven architectures and real-time data streaming.
  • Python for data engineering, automation, data processing, and scripting tasks.