Sample 22

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. The mother must be enrolled in the Fabry Registry, pregnant, and receiving or have received Fabrazyme treatment during the pregnancy.
  2. At least 5 women must be planning to breastfeed while receiving Fabrazyme treatment.
  3. The mother must provide signed, written informed consent for themselves and their infant to participate in the study prior to any protocol-related procedures being performed.
  4. The mother must agree to adhere to the Fabry Registry recommended guidelines for antibody collection.
  5. The mother must agree to adhere to the schedule of events within this protocol including the testing of their infant.

EXCLUSION CRITERIA

  1. The patients (mother and infant) will be excluded from this study if the mother has received an investigational drug within 30 days prior to study enrollment.

Prediction

INCLUSION CRITERIA

  1. Mothers must:
  2. Be enrolled in the Fabry Registry
  3. Be pregnant or lactating
  4. Be receiving or have received Fabrazyme treatment during the pregnancy.
  5. Provide signed, written informed consent for themselves and their infant to participate in the study prior to any protocol-related procedures being performed.
  6. Agree to adhere to the Fabry Registry recommended guidelines for antibody collection.
  7. Agree to adhere to the schedule of events within this protocol including the testing of their infant.

EXCLUSION CRITERIA

  1. The patients (mother and infant) will be excluded from this study if the mother has received an investigational drug within 30 days prior to study enrollment.