Sample 112

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. Males or females that have provided consent and are currently enrolled in BIOCARD study
  2. Ability to tolerate PET scan procedures
  3. Ability to provide informed consent for study procedures

EXCLUSION CRITERIA

  1. Has condition(s) that could augment risk to participant or compromise ability to tolerate experimental procedures or interfere with analysis of the study data as determined by the investigatorHas a history of risk factors for Torsades de Pointes or taking medications known to cause QT prolongation.
  2. Has ECG acquired prior to initial 18F-AV-1451 scan that clinically contradicts subject's participation in the study as determined by the investigator.
  3. Bazett's corrected QT (QTcB) interval must be assessed and not exceed accepted values (458 msec in males, 474 msec in females).
  4. Females of childbearing potential who are not surgically sterile, not refraining from sexual activity, or not using reliable contraceptive methods.
  5. Has hypersensitivity to 18F-AV-1451.
  6. Has a currently clinically significant infectious disease, endocrine/metabolic disease, pulmonary/renal/hepatic impairment, or cancer that could impact study participation or scan results in the opinion of the investigator.
  7. Has a non-study related radiopharmaceutical imaging/treatment procedure within seven days prior to 18F-AV-1451 imaging visit.
  8. Is unsuitable for a study of this type in the opinion of the investigator.

Prediction

Amended Eligibility Criteria (Version 2):

INCLUSION CRITERIA

1. Males or females that have provided consent and are currently enrolled in the BIOCARD study.
2. Can tolerate PET scan procedures.
3. Have the ability to provide informed consent for study procedures (if the patient is ineligible to give informed consent, based on local standards, the patient’s legal representative may consent on behalf of the patient, but the patient must still confirm assent).

EXCLUSION CRITERIA

1. Has any condition by history or abnormal findings on physical examination or screening tests that, in the investigator’s opinion, could increase risk to the participant, limit the participant’s ability to tolerate the experimental procedures, or interfere with analysis of the data.
2. Has a history of risk factors for Torsades de Pointes or is taking medications known to prolong QT interval. A list of restricted medications will be provided.
3. Has ECG obtained prior to the initial flortaucipir (18F) scan that in the opinion of the investigator is clinically significant with regard to the subject’s participation in the study. Bazett’s corrected QT (QTcB) interval must be evaluated and must not exceed 458 msec in males, or 474 msec in females.
4. Are females of childbearing potential who are not surgically sterile, not refraining from sexual activity, or not using reliable methods of contraception. Females of childbearing potential must not be pregnant (negative serum β-hCG at the time of screening and negative urine β-hCG on imaging day) or breastfeeding at screening. Females must agree to avoid becoming pregnant, and refrain from sexual activity or to use reliable contraceptive methods for 24 hours following administration of flortaucipir (18F).
5. Has hypersensitivity to flortaucipir (18F) or any of its excipients.
6. Has a current clinically significant infectious disease, endocrine or metabolic disease, pulmonary, renal or hepatic impairment, or cancer that the investigator believes would affect study participation or scan results.
7. Has had a non-study related radiopharmaceutical imaging or treatment procedure within 7 days prior to the flortaucipir (18F) imaging session.
8. In the opinion of the investigator, are otherwise unsuitable for a study of this type.