Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d)
- Bengaluru, India
- On-site
- Senior Level
- 5+ years
- Bachelor's degree
- Posted
Skills
Required
- PySpark
- Cloudera
- Iceberg
- Airflow
- Data Engineering
- Big Data development
- Spark-based data processing
- data pipelines
- Apache
- Apache Airflow
- SQL
- Git
Preferred
- AWS
- S3
- Glue
- Lambda
- ECS/EKS
- EMR
- RDS
- IAM
- Kafka / event-driven data processing frameworks
- Java / Python application development
At Tieto, we believe in the power of diversity, equity, and inclusion.
About Tieto
- We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation.
- Our commitment to openness, trust, and diversity is at the heart of our mission to create digital futures that benefit businesses, societies, and humanity.
Requirements
- Qualifications Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
- 5+ years of IT experience with5+ years in Data Engineering and Big Data development.
- Strong hands-on experience with PySpark and Spark-based data processing.
- Experience developing data pipelines on Cloudera Data Platform (CDP) .
- Strong knowledge of Apache Iceberg table architecture and data lake concepts.
- Experience designing and managing workflows using Apache Airflow .
- Experience with SQL and data modeling techniques.
- Strong understanding of ETL/ELT development and data transformation frameworks.
- Experience working with large-scale structured and unstructured datasets.
- Knowledge of Git, CI/CD pipelines, and DevOps practices.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and collaboration skills.
- Senior Developer / Lead Developer Experience: 5+ years overall with strong expertise in PySpark, Cloudera CDP, Apache Iceberg, Airflow, and AWS Data Engineering.
Preferred
- Qualifications Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch .
- Experience building cloud-native data lake and Lakehouse solutions.
- Strong knowledge of data partitioning, performance tuning, and query optimization.
- Experience with Kafka or event-driven data processing frameworks.
- Experience with Java or Python application development.
- Experience implementing data quality, metadata, and data governance solutions.
- Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
- Experience working in Agile development environments.
- AWS Certification and/or Cloudera Certification preferred.
- Experience supporting large-scale cloud migration and modernization initiatives.
Diversity, equity and inclusion |
Sustainability | Tieto Stay alert to recruitment scams: • Tieto only communicates via @tieto.com email addresses. • We never ask candidates to pay fees or share financial details during recruitment. • If you receive a suspicious message claiming to be from Tieto, don't respond — verify it via our official careers site. • For more information visit Important Advisory Regarding Recruitment Fraud | Tieto Blog
