jobapplier

Data Engineer

TestYantra Software Solutions

We’re looking for a Data Engineer to build the data model and pipelines that underpin Client’s enterprise Knowledge Catalogue and Knowledge Manager experience. You’ll organise and connect information about domains, sub-domains, Knowledge Stewards, projects, sources, ownership, overlaps, status and lifecycle, making it easier for users and approved applications to discover, understand and consume trusted knowledge.

Responsibilities

  • Design and build the Knowledge Catalogue data model covering domains, sub-domains, Stewards, projects, sources, ownership, overlaps, status and lifecycle.
  • Develop reliable pipelines to ingest, transform, enrich and maintain catalogue information from approved platform and BGI sources.
  • Integrate catalogue data with Knowledge Manager, metadata, ontology, quality, publication, search and retrieval services.
  • Implement data-quality, lineage, provenance, access and lifecycle controls to keep catalogue information trusted and current.
  • Enable catalogue capabilities for browsing, semantic discovery, knowledge context, feedback and knowledge-health insights.
  • Work with Knowledge Source Analysts, Knowledge Stewards, architects, engineers and BGI project teams to agree data requirements and resolve quality or ownership issues.
  • Contribute to APIs, testing, monitoring, documentation and operational processes for catalogue data services.
  • What you need to have to succeed in this role

Requirements

  • Proven experience as a Data Engineer or in a similar role delivering production-grade data models and pipelines.
  • Strong experience with SQL, Python and data-processing technologies, including structured and semi-structured data.
  • Experience designing data models and pipelines for catalogues, metadata, data governance, knowledge management or enterprise platforms.
  • Practical understanding of data quality, lineage, provenance, ownership, access controls and lifecycle management.
  • Experience integrating data through APIs, databases, event streams or cloud data platforms.
  • Strong collaboration and communication skills, with the ability to work across product, architecture, engineering, Knowledge Steward and BGI teams.

Preferred

  • Familiarity with knowledge graphs, ontologies, semantic search, graph databases or vector platforms is advantageous.
  • Experience with data catalogues, search platforms, workflow tools or enterprise information systems is desirable.