Sample 81

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

For more information regarding BMS clinical trial participation, please visit www.BMSStudyConnect.com

INCLUSION CRITERIA

  1. Newly Diagnosed Acute Myeloid Leukemia (AML)
  2. Considered inappropriate for intensive remission induction therapy by an investigator
  3. Not eligible for stem cell transplantation

EXCLUSION CRITERIA

  1. Acute promyelocytic leukemia
  2. Current Myelodysplastic syndrome only subjects
  3. Other protocol defined inclusion/

EXCLUSION CRITERIA

  1. could apply

Prediction

For more information regarding BMS clinical trial participation, please visit www.BMSStudyConnect.com

INCLUSION CRITERIA

  1. AML
  2. Considered inappropriate for intensive remission induction therapy by an investigator
  3. Not eligible for stem cell transplantation

EXCLUSION CRITERIA

  1. Acute promyelocytic leukemia
  2. Myelodysplastic syndrome only subjects
  3. Note: The

EXCLUSION CRITERIA

  1. was revised to specify allogeneic transplants in patients who received prior hematopoietic stem cell transplantation.