Sully.ai

SDET

San Francisco, US Full-time

About Us

At Sully.ai, We’re Building the Most Impactful Healthcare Company on Earth

We believe that access to a great doctor is a basic human right. Today, that’s not a reality. Delays, misdiagnoses, administrative chaos, and burnout plague the system.

Our Mission:

One Human, One Doctor. We build AI teammates that augment clinicians — scribes, nurses, receptionists, translators — all powered by our own world-class models and deployed in real-world care.

Our Traction

  • 450+ organizations signed 16 months
  • AI agents cut admin by ~2.8 hours daily and reduce onboarding 85%.
  • 5M+ Clinical Tasks completed to date, serving 36+ specialties.
  • Raised $25M from YC, Eric Yuan, Amity, Semper Virens
  • Patented AI architecture (MedCon-1) outperforms GPT-4.5, Gemini, Claude on clinical reasoning tasks

Sully requires A-players capable of 4 months = 1 year output.

What You’ll Do

  • Own automated testing for Sully’s AI voice and workflow platform
  • Build test coverage across APIs, AI pipelines, integrations, and core user flows
  • Partner with backend, ML, and product to bake testability into features
  • Validate AI behavior, edge cases, and regressions in real healthcare scenarios
  • Build fast, reliable CI test pipelines that block bad deploys
  • Load and reliability test high-volume call and workflow traffic

What You Must Bring

  • 5+ years in software engineering or SDET roles
  • Required early startup experience or have previously founded a SaaS company
  • Strong Python and backend testing experience
  • Deep experience testing APIs and distributed systems
  • Hands-on ownership of CI/CD and test infrastructure
  • Clear communicator who can influence engineering decisions

First-Month Focus

  • Identify highest-risk failure points across voice, AI, and integrations
  • Ship initial automated tests that cover critical paths
  • Set baseline quality metrics and gaps in test coverage

90 Day OKRs

  • Understand Sully’s architecture and highest-risk workflows
  • Ship meaningful automated coverage for core systems
  • Stand up CI tests that materially reduce production incidents

Who Thrives Here

  • Entrepreneurial to your core: You think in outcomes, thrive in chaos, and take ownership without limits
  • Mission-obsessed: You’re here to save lives, not just ship features — patients and doctors are your why.
  • Impact-driven & fast-moving: You sprint toward hard problems and ship with sharp judgment.
  • Elite teammate: You raise the bar through high standards, direct feedback, and craft excellence.

Why Join Sully.ai?

🔥 Revolutionizing the antiquated $800B+ Healthcare market

🧠 50%+ of us are ex-founders. We hire A-players, not passengers

⚡️ Speed matters - we operate with urgency, autonomy, and ownership

🧪 You’ll work on real, first-of-their-kind problems at the edge of AI and medicine

❤️ Your work helps doctors reclaim their time - and patients get better, faster care

🚀 Y Combinator Company Info

Y Combinator Batch: S21
Team Size: 49 employees
Industry: B2B Software and Services -> Productivity
Company Description: AutonomousOS for healthcare organizations

💰 Compensation

Salary Range: $165,000 - $180,000

📋 Job Details

Job Type: Full-time
Experience Level: 6+ years
Engineering Type: QA engineer