Senior Data Scientist – VoiceAI
trustingsocial
- Ho Chi Minh City, Vietnam
- Senior Level
- 5+ years
- Posted
Skills
Required
- TTS
- LLM
- ML
- modelling
- deployment
- production monitoring
- AI
- speech or
- audio
- ASR
- Python
- SQL
Preferred
- VoiceAI
- real-time
- fine-tuning
- Vietnamese / Tagalog
- LLM models
- SFT
- preference optimization
- distillation
VoiceAI builds the real-time voice layer behind Trusting Social's AI agents, for both outbound and inbound calls.
Kompato (AI collections for US fintech lenders) and Sophia (financial services sales in Vietnam and the Philippines), working closely with the Collin and Sophia DS and product teams, who own the LLM dialogue scripts, and the engineering team, who owns telephony and inbound routing and connects to our layer through the same interface for inbound and outbound calls.
This is a senior, fully hands-on role. You will own a full area of the VoiceAI platform end to end, such as real-time speech generation, speech understanding, or pipeline orchestration quality. You will solve ambiguous problems independently, set the technical approach for your area, and mentor the people working on it.
About trustingsocial
Our platform powers
Responsibilities
- We own the cascade pipeline that connects the caller to the agent (ASR → LLM → TTS): real-time speech understanding (ASR), real-time speech generation (TTS), the real-time orchestration between speech and the LLM script, and the interaction behaviour on top, including turn-taking, latency, and answering machine detection.
- Own a full area of the VoiceAI platform end-to-end, from research and modelling to deployment and production monitoring
- Drive model development hands-on: TTS post-training and fine-tuning, AMD, end-of-turn detection, and speech model adaptation for Vietnamese, Tagalog, and US English
- Stay on top of the state of the art in speech understanding, speech generation, and speech-to-speech models (research, open-source releases, and commercial vendors), quickly benchmark what is new, and bring recommendations to the roadmap
- Design the evaluation methods for your area: offline benchmarks, TTS arenas, audio-based judges, human rating programs, and online A/B testing
- Own production quality and reliability for your area, with monitoring and alerting that catch regressions before callers hear them
- Mentor data scientists and engineers, and lead technical reviews
- Partner with the Collin and Sophia DS and product teams and with engineering; present evidence-first findings and trade-offs to senior stakeholders
Requirements
- Hands-on with a full-stack mindset: you own the whole lifecycle, from modelling and engineering to deployment and production monitoring
- AI-native way of working: you use AI tools (coding agents, LLM assistants) every day to build, analyze, and ship faster
- Real-time mindset, especially for voice and speech: you design for streaming and low latency by default, think in milliseconds, and care about how every delay and glitch sounds to the caller
- 5+ years in data science or applied ML, including technical ownership of a production ML system
- Deep expertise in speech or audio ML (ASR, TTS, VAD, speaker modeling) with models shipped to production
- Keeps up with SOTA in speech and LLM research and the vendor market, with a sharp sense of what is production-ready versus hype
- Strong statistics and evaluation fundamentals: experiment design, calibration, error analysis, FPR/FNR trade-offs
- Fluent in Python and SQL, and comfortable writing and reviewing production code and ML pipelines
- Clear written communication in English; able to make and defend technical decisions with data
Preferred
- Experience post-training or fine-tuning large speech or LLM models (SFT, preference optimization, distillation)
- Hands-on experience with real-time voice stacks (LiveKit, Pipecat) and GPU model serving
- Background in regulated domains such as lending or debt collection
- Vietnamese or Tagalog speech data experience
Benefits
- Opportunity to work and learn from one of the best and brightest technology teams in Vietnam
- Be part of a winning team with exponential growth regionally, experience recruiting world-class talents
- Competitive compensation package, including 13th-month salary and performance bonuses
- Comprehensive health care coverage for you and your dependents
- Generous leave policies, including annual leave, sick leave, and flexible work hours
- Convenient central district 1 office location, next to a future metro station
- On-site lunch with multiple options, including vegetarian
Grab for work allowance and fully equipped workstations
- Fun and engaging team-building activities, sponsored sports clubs, and happy hour every Thursday
- Unlimited free coffee, tea, snacks, and fruit to keep you energized
- An opportunity to make a social impact by helping to democratize credit access in emerging markets
- At Trusting Social, we live by ownership, integrity, and agility in execution. We believe in doing what's right, what's best, and what's innovative. If you're smart, driven, and want to make a difference in the world with the most advanced and fascinating technology, come join our team. We offer the runway to truly make an impact.
