Principal AI Software Engineer
PermitFlow
- New York, United States
- Lead/Staff
- Posted
Join PermitFlow as a Principal AI Software Engineer, where you'll be responsible for building the core product AI Assistant, infrastructure, and workflow agents. This role requires a strong software engineering background, experience in building AI and agentic infrastructure, and a deep understanding of the agentic stack. You'll work closely with customers, design the agent architecture, build the context layer, and establish evaluation standards. Benefits include equity packages, 100% paid health coverage, and unlimited PTO.
This is a role that will require UX and technical acumen to deliver high quality agents in a genuinely complex domain, while also up-leveling our core agentic infrastructure and data flywheel
The ideal candidate will mix an exceptional history of product delivery with true experience building AI and Agentic infrastructure from the ground up. You ship quickly, instrument everything, hold a high quality bar, and stay close to the users of what you build
Responsibilities
- Ownership of the agent architecture, including the design of the reasoning loop, planning and decomposition strategy, state and session model, and recovery behavior for long-running tasks.
- Building the context layer, which involves retrieval, memory, and context-window management over project documents, jurisdictional requirements, prior submissions, and customer-specific conventions.
- Establishing the abstractions, SDKs, and review standards for other engineers to build agentic features on, and setting the bar for the organization in terms of quality and standards.
Requirements
- You are a genuinely strong software engineer, not an AI specialist who needs someone else to make it production-ready. You’ve owned services in production and you write code that other people are glad to inherit
- You’ve built eval harnesses that changed what a team worked on, and you can articulate what makes an eval trustworthy
- You've shipped an assistant or agentic product at meaningful scale
- Deep, current knowledge of the agentic stack (tool calling and tool design, context engineering, memory, retrieval, orchestration patterns, etc)
- You operate with earned authority. You influence through demonstrated judgment, working code, and clear writing rather than title or mandate
- 10+ years of software engineering experience with recent time spent building LLM-powered products
Pay
USD 250,000 - 300,000
jobapplier