Senior Software Engineer, Ai Engineer

Midi Health  ยท  via Devremote
๐Ÿ“ San Francisco, CA โฐ Full Time

About the Role

Senior Software Engineer focused on building and shipping production LLM-powered features for healthcare workflows. The role combines end-to-end AI feature development (prompting, retrieval, agents, evaluation, and production ops) with cross-functional partnership in a hybrid Palo Alto / San Francisco environment.

Explicitly requires vibe-coding skills and use of AI assistants (Claude Code, Cursor, Copilot) for fast, AI-native development.

Location: San Francisco, CA

Salary: USD 170,000 - 210,000/year

Type: Full-time

Posted: 3 days ago

Category: Software Engineering

Company Rating: 2.8 (20 reviews)

Company Size: 501-1000

Vibe Markers: ๐Ÿ’ป Open Source, ๐Ÿ”ฅ Hot

Experience Level: Senior

Job Description

Role

Senior Software Engineer (AI) responsible for designing, building, and operating LLM-powered features and systems that improve clinician and patient experiences in healthcare. Work spans prompt design, retrieval, tool use, agents, evaluation, and production operations with a strong emphasis on safety and measurable outcomes.

Key Responsibilities

  • Design, build, and ship LLM-powered features end-to-end: prompt design, retrieval, tool use, agents, evaluation, and production operations
  • Build evaluation harnesses and feedback loops for responsible AI feature deployment
  • Integrate AI capabilities into patient, clinician, and operational workflows
  • Partner with clinical, product, and safety stakeholders to define success criteria and ensure safety
  • Contribute to internal AI-for-engineering practices and tooling
  • Keep abreast of research and ecosystem developments and operationalize relevant advances

Requirements

  • 6+ years of software engineering experience with recent, meaningful time building production LLM/ML features
  • Strong hands-on coding skills in Python; comfortable across the full stack when required
  • Seasoned at system design for AI systems (retrieval, orchestration, caching, evaluation, cost and latency tradeoffs)
  • Deep, hands-on command of modern AI coding tools (e.g., Claude Code, Cursor, Copilot) and rapid adoption of new techniques
  • Strong mentorship instincts and collaborative communication skills; able to explain model behavior to non-technical stakeholders
  • Rigorous about evaluation and safety in production; avoids โ€œvibes-onlyโ€ launches

Nice to Have

  • Experience with healthcare, clinical NLP, or regulated AI deployments
  • Experience building agentic systems or production RAG at scale

Interview Process

  • Recruiter Screen (30 min)
  • Hiring Manager Screen (45 min)
  • Live Technical Assessment (3 sessions: 150 min)
  • On-Site Interview and Lunch (4 sessions: 150 min)

Compensation & Logistics

  • Estimated salary range: $170,000 - $210,000 per year
  • Full-time, W-2 role
  • Hybrid by design: two days/week in-office (Tuesday and Thursday) in Palo Alto or San Francisco
  • Midi cannot provide visa sponsorship; candidates must be authorized to work in the United States without sponsorship

Tech Stack

Python, Claude Code, Cursor, Copilot, LLMs, RAG, Agentic systems

Skills

System Design, Prompt Design, Evaluation & Safety, Full-Stack Development, Mentorship, Communication, Cross-functional Collaboration, Production Operations, Research Awareness, Clinical Domain Understanding

Benefits

  • Hybrid schedule (Tue/Thu in-office)
  • Full-time W-2 employment
  • Equity
  • Benefits (unspecified)
  • Pay transparency