jobapplier

Data Engineer Manager

Artefact

Responsibilities

  • Data Pipeline Development: Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
  • Database Management: Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
  • Cloud Services Integration: Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
  • Machine Learning Integration: Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
  • Utilising Spark & Kafka: Implementing and working with Spark and Kafka for real-time data processing and analytics.
  • Mentor and guide engineers, fostering knowledge sharing and best practices.

Requirements

  • Proficiency in Python, SQL, and database management.
  • Excellent communication skills to collaborate effectively within teams and with stakeholders.

What you will be doing?

As a Data Engineer Manager, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.

What we are looking for?

  • 8+ years of industry experience in data engineering.
  • Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP, AWS), ML Modeling, Spark & Kafka.

Data modelling and modern data platform design concepts

  • Building and maintaining data platforms in Azure/AWS or GCP
  • Experience working with business stakeholders either internally or externally
  • Strong business acumen with an interest in business-facing roles.
  • Adaptability and a start-up mentality to thrive in a dynamic environment.
  • Minimum of a bachelor's degree in Computer Science, Electronics, and Communication Engineering degrees.
  • Already have authorization to work and already working in the market
  • Artefact is the place to be: come and build the future of data and AI

Innovation

We have a passion for creating impacting projects and believe innovation can come from anyone.

Action

We make things rather than telling people how to make them.

Collaboration

We believe in bringing talented people together, winning together, and in learning from each other.