Sample 19

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. includes:Men or women ≥ 18 years
  2. Subjects having IDA caused by different etiologies
  3. Subjects with intolerance to oral iron therapy or a need for rapid repletion of iron stores:Haemoglobin (Hb) ≤ 11 g/dLTransferrin Saturation (TSAT) < 20 %S-ferritin < 100 ng/mLWillingness to participate and signing the informed consent form

EXCLUSION CRITERIA

  1. includes :Anemia predominantly caused by factors other than IDAHemochromatosis or other iron storage disorders
  2. Previous serious hypersensitivity reactions to any IV iron compound
  3. Erythropoiesis stimulating agent (ESA) treatment
  4. Prior to screening or during the trial period; has or will be treated with a red blood cell transfusion, radiotherapy, and/or chemotherapy
  5. Will require a surgical procedure that necessitated general anesthesia prior to screening or during the trial period
  6. Alanine aminotransferase and/or aspartate aminotransferase > 3 times upper limit of normal
  7. Required dialysis for treatment of chronic kidney disease (CKD)
  8. Alcohol or drug abuse within the past 6 months
  9. Pregnant or nursing women

Prediction

INCLUSION CRITERIA

  1. includes:Men or women ≥ 18 years
  2. Subjects having IDA caused by different etiologies
  3. Subjects with intolerance to oral iron therapy or a need for rapid repletion of iron stores:Hb ≤ 11 g/dLTSAT < 20 %S-ferritin < 100 ng/mLWillingness to participate and signing the informed consent form

EXCLUSION CRITERIA

  1. includes :Anemia predominantly caused by factors other than IDAHemochromatosis or other iron storage disorders
  2. Previous serious hypersensitivity reactions to any IV iron compound
  3. Erythropoiesis stimulating agent (ESA) treatment
  4. Prior to screening or during the trial period; has or will be treated with a red blood cell transfusion, radiotherapy, and/or chemotherapy
  5. Will require a surgical procedure that necessitated general anesthesia prior to screening or during the trial period
  6. Alanine aminotransferase and/or aspartate aminotransferase > 3 times upper limit of normal
  7. Required dialysis for treatment of CKDAlcohol or drug abuse within the past 6 months
  8. Pregnant or nursing women