General Physician, AI Evaluation
Gramian Consulting · via
Devremote
🌎 Remote
Job Description:
- Review AI-generated medical content for accuracy, safety, and completeness
- Evaluate diagnoses, treatment plans, case summaries, and clinical reasoning
- Identify inaccurate, unsafe, misleading, or incomplete medical outputs
- Apply evidence-based medical standards and professional clinical judgment
- Provide structured expert feedback to improve model quality
- Follow detailed evaluation and annotation guidelines
- Complete structured questionnaires and reviews using web-based tools
- Collaborate with clinical and AI teams on quality improvement
Requirements:
- Medical Doctor (MD) or equivalent medical qualification such as MBBS, MBChB, or equivalent
- Fully licensed to practice medicine in the United States
- Currently actively practicing medicine in the US
- At least 1 year of post-residency clinical practice experience as a physician
- Strong general clinical judgment; no specific specialty is required