IN_Manager_Azure Databricks_D&A_Advisory_Bangalore
PwC Asia
- Kolkata - Magnacon Building, Kolkata, West Bengal, India
- 5+ years
- Master's degree
- Posted
This job is closed: the employer no longer lists it.
Skills
Required
- Data Engineering
- Databricks
- SparkSQL
- PySpark
- Python
- Delta Lake
- cloud
- AWS / Azure / GCP
- CI/CD implementation
- data platforms
- ETL
- SQL
- data modeling
Preferred
- GenAI/Agentic AI
- code conversion / automation / metadata generation
- Infrastructure as Code
- Terraform / CloudFormation
- on-prem
- Teradata / Oracle
- Lakehouse
- medallion architecture
About PwC Asia
At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In business intelligence at PwC, you will focus on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will develop and implement innovative solutions to optimize business performance and enhance competitive advantage.
Responsibilities
- Role Name: Senior Databricks Engineer
- Designation : Manager
Key Responsibilities
- Design Databricks Lakehouse medallion architecture (Bronze/Silver/Gold)
- Architect reusable ingestion & transformation frameworks using Databricks and Enterprise level ETL / orchestration tool.
Preparing Physical data Model
- Design and develop ingestion pipelines for various type of sources – RDBMS, API, Files, etc.
- Experience in writing code to transform variety data formats (structured, unstructured, and semi-structured) to uniform formats.
- Define CI/CD and DevOps automation strategy
- Implement RBAC for various user persona by Unity catalog
- Define clustering, scaling, and performance strategies
Requirements
Required Skills
- degree in Computer Science or Information Technology.
- 5-6+ years in Data Engineering; 3+ years in Databricks
- Deep expertise in SparkSQL, PySpark, Python, Delta Lake
- Strong cloud experience (AWS / Azure / GCP)
- CI/CD implementation for data platforms
- Strong performance tuning and workload optimization
- Experience designing large-scale ETL pipeline
- Strong understanding on SQL and data modeling skills
- Mandatory skill sets: Azure Databricks
- Years of experience required: 8—12 Years
- Education qualification: B.E/B.Tech/MBA/M.E/M.Tech
Preferred
- Good to Have
- Experience with GenAI/Agentic AI for code conversion, automation, or metadata generation
- Exposure to Infrastructure as Code (Terraform/CloudFormation)
- Experience integrating on-prem DBs (Teradata/Oracle) with cloud
- Preferred skill sets: Azure Databricks
Job Position Title
Job Position Title: IN_Manager_Azure Databricks_D&A_Advisory_Bangalore
