RN/NP Clinical Quality Reviewer

Primary Care, Acute Symptom Triage & Travel Health | Contract, up to 25 hrs/week

About the Role

We are seeking Nurses & Nurse Practitioners with clinical experience in one or more of the following areas:

• Telephone or virtual acute symptom triage

• Hypertension and congestive heart failure (CHF) management

• Medication titration for hypertension and/or CHF

• Diabetes management and insulin titration

• Travel health

to serve as a subject matter expert supporting the evaluation of AI-driven clinical agents. In this role, you will evaluate agent conversations and recommendations spanning acute symptom triage and escalation decisions, insulin/diabetes titration, and pre-travel health guidance, ensuring clinical accuracy, guideline adherence, and patient safety. This is a part-time, remote contract position (1099) requiring up to 25 hours per week, with flexible scheduling.

Key Responsibilities

• Review recorded and simulated AI agent interactions involving acute symptom triage and assess the appropriateness of triage, escalation, and de-escalation decisions.

• Evaluate AI agent conversations involving hypertension and CHF management, including medication titration, for clinical accuracy and adherence to evidence-based protocols.

• Review agent conversations related to diabetes management and insulin titration for clinical accuracy and guideline adherence.

• Evaluate agent-delivered travel health guidance, including pre-travel counseling, vaccination recommendations, and destination-specific risk assessment.

• Review AI agent calls for adherence to established clinical protocols and appropriate medical management.

• Score and annotate agent performance using structured evaluation rubrics.

• Perform clinical data annotation by rewriting or correcting AI agent responses to align with evidence-based protocols and clinical practice guidelines.

• Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning.

• Provide clear, actionable written feedback to clinical and product teams to inform agent refinement.

• Participate in periodic case review and calibration sessions with other clinical SMEs to ensure consistent evaluation standards.

• Help develop and refine test scenarios used in ongoing agent quality assurance.

Qualifications

• Registered Nurses: Active, unrestricted RN license in the United States.

• Nurse Practitioners: Active, unrestricted NP license in the United States, with current board certification (ANCC or AANP).

• Hands-on professional experience conducting protocol-based virtual or telephone clinical triage; and/or

• Hands-on clinical experience directly managing patients with hypertension and/or congestive heart failure (CHF).

• For candidates with hypertension/CHF management experience, hands-on experience prescribing, adjusting, or titrating medications for these patients.

• Strong working knowledge of evidence-based protocols and clinical practice guidelines relevant to acute triage and/or hypertension and CHF management.

Recommended

It is not a requirement that candidates have all of the recommended criteria

• Experience in telephone triage or nurse advice line settings.

• Experience in travel medicine, occupational health, or pre-travel consultation.

• Familiarity with CDC and other travel medicine guidelines.

• Prior experience in clinical quality assurance, utilization review, or case review.

• Familiarity with AI-assisted clinical tools or digital health platforms.

Engagement Details

• Contract (1099) position, up to 25 hours per week.

• Fully remote; flexible scheduling.

• Hourly compensation, commensurate with experience.

• Engagement expected to run in support of ongoing agent development and FDA evaluation milestones.

Please be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information during the hiring process.