Sample 146

Evaluation Instructions

Task Overview: AI models read clinical trial protocol documents and were asked to extract evidence supporting specific eligibility criteria modifications. You're evaluating whether the AI extracted the RIGHT evidence that justifies the post-modified (final) eligibility criteria.

Workflow: AI reads protocol → AI extracts evidence → Ground truth is final modified criteria → You evaluate if AI's evidence actually supports those final criteria

Important: Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. ComBaCaL-TwiC 1:Participant of the ComBaCaL cohort study (signed informed consent available)
  2. Living with aHT, defined as reporting intake of antihypertensive medication or being newly diagnosed during screening via standard diagnostic algorithmBP ≥140/90 mmHg at baseline

INCLUSION CRITERIA

  1. ComBaCaL-TwiC 2
  2. Participant of the ComBaCaL cohort study (signed informed consent available)
  3. Reporting intake of antihypertensive medicationBP<140/90 mmHg at baseline

EXCLUSION CRITERIA

  1. for both ComBaCaL-TwiC 1&2:Reported pregnancy (at baseline or during follow-up)

Prediction

INCLUSION CRITERIA

  1. ComBaCaL-TwiC 1:
  2. Participant of the ComBaCaL cohort study (signed informed consent available)
  3. Living with aHT, defined as reporting intake of antihypertensive medication or being newly diagnosed during screening via standard diagnostic algorithm
  4. BP ≥140/90 mmHg at baseline

INCLUSION CRITERIA

  1. ComBaCaL-TwiC 2:
  2. Participant of the ComBaCaL cohort study (signed informed consent available)
  3. Reporting intake of antihypertensive medication
  4. BP <140/90 mmHg at baseline

EXCLUSION CRITERIA

  1. for both ComBaCaL-TwiC 1 & 2:
  2. Severe comorbidity with an estimated life-expectancy of less than one year
  3. Reported pregnancy (at baseline or during follow-up)