Sample 148

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

1. Participated in the MSK-002 studyWilling and able to provide written informed consent after the nature of the study has been explained and before the start of any research-related procedures.
2. Female patients of childbearing potential must have a negative pregnancy test (urine human chorionic gonadotropin [HCG] at the end of MSK-002 study); and must practice an effective, reliable contraceptive regimen during the study and for up to 30 days following discontinuation of treatment.
3. Ability to participate in the study based on overall health of the patient and disease prognosis, as applicable, in the opinion of the Investigator; and able to comply with all requirements of the protocol, including completion of study questionnaires.
4. Individuals who met any of the

EXCLUSION CRITERIA

1. in the original protocol or those listed below are not eligible to participate in the study:Epilepsy and currently on medication.
2. Clinically significant abnormalities in 12 lead ECG, in the opinion of the Investigator.
3. Breastfeeding or pregnant at Screening or planning to become pregnant at any time during the study.
4. Intolerable amifampridine-related side effectsTreatment with an investigational drug (other than amifampridine) or device while participating in this study.
5. Any medical condition that, in the opinion of the Investigator, might interfere with the patient's participation in the study, poses an added risk for the patient, or confound the assessment of the patient.

Prediction

INCLUSION CRITERIA

  1. Participated in the MSK-002 study
  2. Willing and able to provide written informed consent after the nature of the study has been explained and before the start of any research-related procedures.
  3. Female patients of childbearing potential must have a negative pregnancy test (urine human chorionic gonadotropin [HCG] at the end of MSK-002 study); and must practice an effective, reliable contraceptive regimen during the study and for up to 30 days following discontinuation of treatment.
  4. Ability to participate in the study based on overall health of the patient and disease prognosis, as applicable, in the opinion of the Investigator; and able to comply with all requirements of the protocol, including completion of study questionnaires.

EXCLUSION CRITERIA

  1. Epilepsy and currently on medication.
  2. Clinically significant abnormalities in 12 lead ECG, in the opinion of the Investigator.
  3. Breastfeeding or pregnant at Screening or planning to become pregnant at any time during the study.
  4. Intolerable amifampridine-related side effects.
  5. Treatment with an investigational drug (other than amifampridine) or device while participating in this study.
  6. Any medical condition that, in the opinion of the Investigator, might interfere with the patient’s participation in the study, poses an added risk for the patient, or confound the assessment of the patient.