AI Quality Engineer

Responsibilities

• This work supports broader modernization goals, including automating and streamlining servicing operations, reducing manual processing, improving data quality, aligning with the customer’s modernization standards, and establishing a roadmap toward the eventual retirement of legacy platforms.
• Key Functions Design and implement AI-enabled solutions for customer modernization use cases, developing and integrating AI capabilities into existing systems and workflows.
• Collaborate with DevOps engineers to create and orchestrate long-running, multi-agent workflows, ensuring reliability, observability, and recoverability in production environments.
• Support Value Engineers’ efforts by reviewing and quality-checking prototype outputs for accuracy, reliability, and adherence to standards prior to pipeline promotion.
• Continuously monitor AI-assisted development outputs for accuracy, reliability, and compliance drift, feeding findings back to Value Engineers and AI Engineers to improve prompts, skills, and agents over time.

Preferred

• Qualifications or Skills Direct experience supporting Federal clients.
• Experience with FedRAMP authorization processes.
• Mortgage, fintech, or other regulated industry experience (preferred, not required — willingness to learn quickly is essential).
• Familiarity with AI safety, governance, and compliance.
• Ability to use or teach tools such as ChatGPT, Claude, Gemini, Notion, Airtable, Zapier, LangChain, or similar.
• Experience in startups, consulting, internal strategy, learning & development (L&D), or innovation teams.

Minimum Qualifications

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience. Demonstrated experience in software quality assurance, test engineering, or a related discipline, including test plan design and defect management. Hands-on experience testing or validating AI-generated code, prototypes, or “vibe-coded” solutions for accuracy and reliability. Experience with automated testing tools and frameworks (e.g., Selenium) across web and enterprise applications. Experience with one or more of the following: Salesforce, AWS (including Lambda and Redshift), Java, or PostgreSQL, or a comparable enterprise technology stack. Familiarity with CI/CD pipelines and quality gates within modern software delivery practices. Strong analytical skills, with the ability to identify security, data-sensitivity, and compliance risks in AI-assisted solutions. Excellent written and verbal communication skills, with the ability to work across product, engineering, data, and business SME teams. Must be a U.S. citizen and eligible to obtain and maintain a Public Trust clearance / favorable suitability determination.

Position Details Employment type

Full-Time Location: 100% Remote (US-based) Hours: 8am–5pm ET Eligibility: Must be a U.S. citizen and suitable for, and eligible to obtain and maintain, a Public Trust clearance