jobapplier

Senior Data Engineer

Airasia

Skills

Required

  • Python
  • Spark
  • DAG
  • airflow
  • terraform
  • data ETL
  • SQL
  • NoSQL databases
  • pipeline and workflow management tools
  • messaging
  • stream processing
  • Git
  • Jira
  • Confluence

Preferred

  • automation
  • pipeline optimization
  • infrastructure re-design
  • data visualization
  • data governance
  • maintaining data compliance standards

As a Senior Data Engineer, your day-to-day duties will encompass the following areas: Operational Excellence: Provide essential operational support, including system troubleshooting and implementing technical fixes.

Responsibilities

  • Ensure absolute data integrity and data quality across environments.
  • Continuously improve internal processes through automation, pipeline optimization, and infrastructure re-design.
  • Support and collaborate closely with cross-functional and multidisciplinary teams in a fast-paced environment.
  • Leverage data visualization tools and techniques to maximize the business impact and intrinsic value of data.
  • Manage technical communication, alignment, and relationships with internal business units, product managers, and engineering teams to ensure data deliverables align with organizational goals.
  • Contribute to improving data governance policies and maintaining data compliance standards.
  • Keep continuously current with the latest technical and industry developments.

Requirements

BS/MS/PhD in IT, Mathematics, Science or Engineering discipline

  • Up to 4+ yrs relevant experience beyond first degree
  • Experience with one of the following languages: Python, Spark Experience with DAG, airflow, terraform
  • Familiar with data ETL from a wide variety of data sources.
  • Experience with SQL and NoSQL databases.
  • Experience with pipeline and workflow management tools.
  • Experience with various messaging and stream processing.
  • Experience with object-oriented/object function scripting languages.
  • Familiar with containerisation and orchestration tools.
  • Familiar with one of the following cloud-based services: GCP and its tools and services.
  • Ability to work under pressure and change, and balance among speed, reliability, and interpretability.
  • Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
  • Experience with code versioning, code review and documentation.
  • Proficient understanding of distributed computing principles.
  • Able to select and integrate big data tools and frameworks.
  • Familiar or prone to adopt design thinking methods.

Benefits

  • Openness to experimenting with new techniques and new ways of working. ​ WHAT YOU’LL ENJOY: Physical Wellbeing: Key medical and insurance benefits, maternity expenses, flexible work arrangement, and health and fitness amenities.
  • Paid time off, wellness programmes, and childcare amenities.
  • Resources relating to financial, personal skills and career growth programmes.
  • Free flights, unlimited discounted flights, and exclusive discounts with partners.

A unique Allstar culture like no other OUR HIRING PROCESS: Application received Candidate screening Interview(s) and assessment(s) Background check and/or other assessments Offer and negotiation