Generative AI Developer - Senior Associate
- Bengaluru, India +1
- Senior Level
- 5+ years
- Posted
Skills
Required
- AI/ML / Generative AI development
- Python
- LangChain
- LlamaIndex
- CrewAI
- LangGraph
- LLM architectures
- tokenization
- embedding models
- vector databases
- prompt testing and evaluation frameworks
- TruLens
- Azure / AWS / GCP / OCI
- Falcon
Preferred
- Generative AI
- agentic AI
- LLM APIs
- RAG pipelines
- prompt engineering
- multi-agent frameworks
- performance monitoring
- optimization
- LLM
- ReAct
Must have hands-on experience building, testing, and deploying LLM-based or agentic AI applications in production or pilot settings.
Responsibilities
- The Senior Associate – Generative AI Developer will design, develop, and rigorously test end-to-end Generative AI and agentic AI applications.
- This role requires hands-on expertise with LLM APIs, RAG pipelines, prompt engineering, and multi-agent frameworks, combined with a disciplined approach to testing, performance monitoring, and optimization .
- LLM & GenAI Development: Design, develop, and maintain LLM-powered applications using APIs such as OpenAI, Azure OpenAI, Anthropic, or Cohere.
- Implement core GenAI workflows including summarization, classification, Q&A, and content generation.
- Build and orchestrate multi-agent systems using frameworks like CrewAI, LangGraph, OpenAI Agents SDK, or Azure AI Agent Framework .
- Implement inter-agent communication, task routing, and tool orchestration for complex workflows.
- Implement retrieval-augmented generation pipelines involving embedding creation, chunking, and vector indexing using FAISS, Pinecone, Chroma, or Milvus .
- Ensure efficient retrieval for context-aware outputs.
- Apply advanced prompting strategies such as Few-Shot Learning, Chain-of-Thought (CoT), ReAct, and CART to improve reliability and interpretability of model responses.
- Establish automated and manual testing pipelines using TruLens , LangSmith , PromptLayer , or DeepEval to evaluate model quality, accuracy, safety, and factual grounding.
- Define and track metrics such as coherence, hallucination rate, and response diversity.
- Implement cost-effective token management and model observability using logging and tracing frameworks.
- Continuously optimize prompts, retrieval logic, and memory mechanisms to improve efficiency.
- Conduct EDA and pre-processing of textual datasets to ensure quality input for training, evaluation, and fine-tuning tasks.
- Create detailed design documents, maintain experiment logs, and collaborate with architects, data scientists, UI/UX engineers, and product managers to ensure solution alignment with business goals.
- Stay up to date with new model releases (OpenAI GPT, Claude, Gemini, Mistral, LLaMA, etc.) and frameworks in the GenAI and agentic AI ecosystem.
Requirements
- Industry/Sector Not Applicable Specialism Oracle Management Level Senior Associate Job Description & Summary Job Title: Senior Associate – Generative AI Developer Experience: 5+ years of total IT experience, including 2–3 years in AI/ML or Generative AI development.
- Strong proficiency in Python , LangChain , LlamaIndex , CrewAI , and LangGraph Deep understanding of LLM architectures , tokenization , embedding models , and vector databases
- Experience with prompt testing and evaluation frameworks (TruLens, LangSmith, PromptLayer, DeepEval) Familiarity with bias mitigation , safety testing , and Responsible AI principles
- Knowledge of MLOps/LLMOps practices for deploying and monitoring AI models
- Strong analytical mindset, documentation discipline, and collaborative approach
- Exposure to at least one major cloud AI platform ( Azure , AWS , GCP , or OCI ) Preferred Background: Prior experience in building chatbots, intelligent assistants, summarizers, or document automation solutions using LLMs Familiarity with open-weight model experimentation (LLaMA, Mistral, Falcon, etc.) Exposure to multi-modal AI (text, image, code) and integration with enterprise data sources
- Experience supporting GenAI projects through testing, benchmarking, and performance optimization
Travel
Requirements Not Specified Job Posting End Date
