jobapplier

IN_Director_ Data Engineering_Data & Analytics _ Advisory _Bangalore(India)

PwC Asia

Skills

Required

  • data engineering
  • data processing
  • data warehousing concepts
  • ETL processes
  • Application Platform design /architecture

Preferred

  • Databricks
  • Azure / AWS
  • cloud-native
  • Snowflake
  • Amazon Web Services AWS
  • Docker
  • Kubernetes
  • Spark
  • PySpark
  • Python

A career within Data and Analytics services will provide you with the opportunity to help organizations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organizational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organizations to keep up with the changing nature of customers and technology.

We are seeking an experienced and Senior Data Architect with 15-20 years of experience specializing in data services, data architecture, and data platforms to lead our Data engineering and advanced analytics engagements. The ideal candidate will have a strong hands-on background in data engineering with specific expertise in Spark, PySpark, and Python. Additionally, experience with cloud-native data engineering platforms like Databricks

About PwC Asia

We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Responsibilities

  • IN_Director_ Data Engineering_Data & Analytics _ Advisory _Bangalore(India)

Position: Principal Data Architect/ Director

  • Define and execute the long-term roadmap for Data platforms.
  • Design, develop, and maintain scalable data pipelines and architectures using Spark, PySpark, and Python.
  • Lead and manage a team of data engineers, providing technical guidance, mentorship, and performance management.
  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
  • Ensure data quality, integrity, and security across all data engineering projects.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.
  • Stay up-to-date with the latest industry trends and technologies in data engineering and cloud computing.
  • Work closely with stakeholders to understand business needs and translate them into technical requirements.
  • Manage project timelines, resources, and budgets to ensure successful delivery of data engineering projects.

Requirements

  • Experience: 15-20 Years
  • Certifications
  • Spark 3.0(Mandatory) and Databricks Advanced/Professional Architect or SnowPro Advanced Architect.

Azure Data Engineering

  • Proven track record of designing and building scalable data pipelines and architectures.
  • Hands-on experience with data processing and transformation.
  • Strong understanding of data warehousing concepts and ETL processes.
  • Excellent problem-solving skills and the ability to troubleshoot complex technical issues.
  • Strong leadership and team management skills.
  • Effective communication skills, both written and verbal

Strong experience with data engineering technologies, particularly

  • Spark, PySpark, and Python.
  • 10+ years of hands-on experience in data engineering.
  • 5+ years of experience in a Sr. Data Architect.
  • 5+ years of experience in Application Platform design /architecture will be good to have.
  • Experience: 15 - 20 Years

Preferred

  • or Amazon Web Services (AWS) is highly desirable.
  • Experience with cloud-native data engineering on platforms such as Databricks and Snowflake on Azure/AWS.
  • Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes).
  • Experience with data visualization tools and techniques.
  • Familiarity with machine learning and data science concepts.
  • Experience in Financial services industry is a plus.
  • B.Tech / M.Tech / MCA/MBA

Every job at PwC Asia