jobapplier

Generative AI Developer - Senior Associate

Pwc (Crm Experienced)

Skills

Required

  • AI/ML / Generative AI development
  • Python
  • LangChain
  • LlamaIndex
  • CrewAI
  • LangGraph
  • LLM architectures
  • tokenization
  • embedding models
  • vector databases
  • prompt testing and evaluation frameworks
  • TruLens
  • Azure / AWS / GCP / OCI
  • Falcon

Preferred

  • Generative AI
  • agentic AI
  • LLM APIs
  • RAG pipelines
  • prompt engineering
  • multi-agent frameworks
  • performance monitoring
  • optimization
  • LLM
  • ReAct

Must have hands-on experience building, testing, and deploying LLM-based or agentic AI applications in production or pilot settings.

Responsibilities

  • The Senior Associate – Generative AI Developer will design, develop, and rigorously test end-to-end Generative AI and agentic AI applications.
  • This role requires hands-on expertise with LLM APIs, RAG pipelines, prompt engineering, and multi-agent frameworks, combined with a disciplined approach to testing, performance monitoring, and optimization .
  • LLM & GenAI Development: Design, develop, and maintain LLM-powered applications using APIs such as OpenAI, Azure OpenAI, Anthropic, or Cohere.
  • Implement core GenAI workflows including summarization, classification, Q&A, and content generation.
  • Build and orchestrate multi-agent systems using frameworks like CrewAI, LangGraph, OpenAI Agents SDK, or Azure AI Agent Framework .
  • Implement inter-agent communication, task routing, and tool orchestration for complex workflows.
  • Implement retrieval-augmented generation pipelines involving embedding creation, chunking, and vector indexing using FAISS, Pinecone, Chroma, or Milvus .
  • Ensure efficient retrieval for context-aware outputs.
  • Apply advanced prompting strategies such as Few-Shot Learning, Chain-of-Thought (CoT), ReAct, and CART to improve reliability and interpretability of model responses.
  • Establish automated and manual testing pipelines using TruLens , LangSmith , PromptLayer , or DeepEval to evaluate model quality, accuracy, safety, and factual grounding.
  • Define and track metrics such as coherence, hallucination rate, and response diversity.
  • Implement cost-effective token management and model observability using logging and tracing frameworks.
  • Continuously optimize prompts, retrieval logic, and memory mechanisms to improve efficiency.
  • Conduct EDA and pre-processing of textual datasets to ensure quality input for training, evaluation, and fine-tuning tasks.
  • Create detailed design documents, maintain experiment logs, and collaborate with architects, data scientists, UI/UX engineers, and product managers to ensure solution alignment with business goals.
  • Stay up to date with new model releases (OpenAI GPT, Claude, Gemini, Mistral, LLaMA, etc.) and frameworks in the GenAI and agentic AI ecosystem.

Requirements

  • Industry/Sector Not Applicable Specialism Oracle Management Level Senior Associate Job Description & Summary Job Title: Senior Associate – Generative AI Developer Experience: 5+ years of total IT experience, including 2–3 years in AI/ML or Generative AI development.
  • Strong proficiency in Python , LangChain , LlamaIndex , CrewAI , and LangGraph Deep understanding of LLM architectures , tokenization , embedding models , and vector databases
  • Experience with prompt testing and evaluation frameworks (TruLens, LangSmith, PromptLayer, DeepEval) Familiarity with bias mitigation , safety testing , and Responsible AI principles
  • Knowledge of MLOps/LLMOps practices for deploying and monitoring AI models
  • Strong analytical mindset, documentation discipline, and collaborative approach
  • Exposure to at least one major cloud AI platform ( Azure , AWS , GCP , or OCI ) Preferred Background: Prior experience in building chatbots, intelligent assistants, summarizers, or document automation solutions using LLMs Familiarity with open-weight model experimentation (LLaMA, Mistral, Falcon, etc.) Exposure to multi-modal AI (text, image, code) and integration with enterprise data sources
  • Experience supporting GenAI projects through testing, benchmarking, and performance optimization

Travel

Requirements Not Specified Job Posting End Date