Sully.ai logo

Head of Engineering, Voice AI

Sully.ai
Full-time
Remote
United States
$230,000 - $260,000 USD yearly
Audio Software Design, Speech Acoustics, Management & Leadership, AI Audio

About Us
πŸ‘ Team from OpenAI, DeepMind, NASA, GoogleX, Tesla, and 2 physicians: 6 exits, 2 IPOs.
πŸ”₯ Our model outperforms Claude, Gemini, and GPT-4.5 on clinical benchmarks.
πŸ“ˆ 400+ healthcare orgs signed in 16 months.
⚑️ $25M raised from YC, Amity Ventures, Sequoia scouts, and more.
🌎 $1T+ market opportunity. We’re going after all of it.

About the Role
We are seeking a Head of Engineering, Receptionist to own Sully.ai’s voice agent. You will lead end-to-end velocity, reliability, and quality for telephony, ASR, dialog, and scheduling. Focus on Twilio or VoIP stability, low-latency accurate transcription in noisy medical calls, robust dialogue handling, conflict-free scheduling, and enterprise-grade EHR write-backs. Scale from thousands of practice admins to millions of patient interactions. Build the team and the platform.

Key Responsibilities

  • Own voice stack architecture across telephony, ASR, TTS, diarization, dialog, and EHR write-back.
  • Drive reliability and latency with SLAs, error budgets, incident response, and observability.
  • Lead enterprise EHR integrations and multi-office configuration tooling for large practices.
  • Build scheduling sync that is conflict free across EMRs and calendars.
  • Hire, coach, and organize teams for platform, voice, SMS, integrations, and dashboard.

Hard Requirements

  • 7+ years engineering with 3+ years leading teams shipping real-time voice agents at scale.
  • Deep telephony and realtime expertise across Twilio or SIP, WebRTC or gRPC, Kafka or queues.
  • Strong ASR and TTS production experience and prompt or policy or routing for LLM agents.
  • Proven CI or CD, Kubernetes, Docker, and cloud on GCP or AWS or Azure.
  • Track record reducing p95 or p99 latency and raising correctness in production ML systems.

Nice-to-Have

  • Healthcare data standards and EHR integrations across FHIR or HL7.
  • Multilingual voice systems and medical terminology accuracy work.
  • SRE or DevOps leadership and automated QA at safety bar.

First-Month Focus

  • Establish latency, accuracy, and reliability baselines with dashboards and alerts.
  • Stabilize telephony and scheduling: fix call drops, ASR in noise, double-booking, and sync drift.
  • Define enterprise roadmap: Epic or Cerner integrations, multi-office tooling, and self-hosted UAE or KSA stack plan.

Success OKRs (90 Days)

  • Reduce end-to-end p95 call handling latency by 40 percent and ASR WER on noisy calls by 30 percent.
  • Achieve 99.9 percent successful scheduling writes with zero double-booking incidents in pilot cohorts.
  • Ship one enterprise EHR integration to pilot and deliver a self-hosted deployment plan with security review.

Culture Fit

  • Willing to push back on leadership to defend quality/timelines
  • Thrives in high-ambiguity, fast-paced startup environments
  • Zero to One Builder, self-managed and self-directed
  • Persistent, driven problem solver. Loves getting in the trenches.

Why Join Sully.ai?
πŸ”₯ Shape the Future of Healthcare: Build category-defining partnerships that enable doctors to focus on saving lives.
πŸ“ˆ Early-Stage Impact: Join early and play a critical role in shaping our partnership roadmap and overall company growth.
🌎 Remote-First Culture: Work with a talented, mission-driven team in a flexible, remote environment.
πŸ’° Competitive Compensation: Enjoy a competitive salary, equity, and the opportunity to make a real difference.
πŸ† Solve Scalability Challenges: Tackle complex challenges in a rapidly growing company, driving impactful change in healthcare.

Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.