jobapplier

Senior Staff AI Engineer

SoFi

Skills

Required

  • AI
  • LLM
  • PEFT
  • retrieval-augmented generation
  • RAG
  • control flow
  • software development
  • implementing parameter-efficient fine-tuning
  • LoRA
  • vector databases
  • Elasticsearch / Pinecone / FAISS
  • Python

Preferred

  • Kubernetes
  • cloud platforms
  • AWS / Azure / GCP
  • containerization
  • Docker
  • AI observability
  • LangSmith
  • Arize
  • Deepchecks

Join SoFi, a leading personal finance company, as a Senior Staff AI Engineer. In this hands-on role, you will set the technical direction for our AI initiatives, focusing on risk management and compliance. You will work closely with the Director of Risk Analytics, mentor junior engineers, and collaborate with cross-functional teams. This position offers generous benefits, including vacation, parental leave, and health insurance.

Definir la arquitectura técnica a largo plazo y la estrategia para la plataforma de IA de próxima generación, centrándose en marcos robustos y escalables.

Experience with large-scale data handling, including unstructured and structured data pipelines, with a strong preference for Snowflake and DynamoDB

Experience in banking or financial services use cases such as conversational AI for customer service, intelligent document processing for loan applications, fraud detection, or risk analysis

USD 172,800 - 397,000

Responsibilities

  • Desarrollar una infraestructura robusta y persistente para la gestión del estado agentic, asegurando que los flujos de trabajo de agentes de larga duración mantengan el contexto.
  • Pionero y institucionalizar técnicas avanzadas de ajuste fino eficiente en parámetros (PEFT) y técnicas de compresión para maximizar el rendimiento del modelo.
  • Deep understanding of Large Language Model (LLM) architectures, prompt engineering, retrieval-augmented generation (RAG), and advanced text generation techniques
  • Exceptional ability to communicate complex technical concepts, drive consensus among senior technical leaders, and influence organizational AI strategy
  • React is strongly preferred

Requirements

  • 8+ years software development experience, with 3+ years of hands-on experience in developing and successfully deploying production-level AI applications that have been used by real customers or internal stakeholders
  • Proven experience implementing parameter-efficient fine-tuning (PEFT) techniques (e.g., LoRA) to customize and optimize pre-trained models for specific tasks with minimal computational overhead
  • Experience with vector databases and retrieval-augmented generation (RAG) techniques using systems like Elasticsearch, Pinecone, or FAISS for enhancing LLM performance
  • Strong collaboration skills, with experience working in agile, cross-functional teams
  • Strong analytical and problem-solving skills with attention to detail and an ability to work with complex, large-scale systems

Expert level Python is required

  • Expert-level experience with LangGraph to model and orchestrate complex, stateful multi-step reasoning and control flow in LLM applications
  • Expert-level proficiency in developing sophisticated agentic solutions, with a portfolio demonstrating advanced use of planning, memory management, tool integration, and control flow
  • Experience developing and integrating AI-powered APIs and microservices architecture into banking applications
  • Bachelor’s or Master’s degree in Computer Science, Data Science, AI, Machine Learning, or a related field. PhD is a plus
  • Deep expertise in building or extending inference engines (e.g., vLLM, NVIDIA Triton, or TGI) and managing the underlying Kubernetes/GPU orchestration for custom model deployments

Preferred

  • Experience with cloud platforms (AWS, Azure, or GCP) and containerization technologies (Docker, Kubernetes)
  • Deep experience designing and institutionalizing AI observability solutions (e.g., LangSmith, Arize, Deepchecks) and advanced tracing and testing methodologies for LLM and agentic systems
  • Familiarity with regulatory frameworks and ethical considerations in AI within the banking industry (e.g., GDPR, data privacy, model explainability)