Sample 132

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. Have Crohn's disease (CD) or fistulizing Crohn's disease of at least 3 months duration (defined as a minimum of 12 weeks), with colitis, ileitis, or ileocolitis, confirmed at any time in the past by radiography, histology, and/or endoscopy
  2. Have moderate to severe CD as assessed by CDAI, stool frequency (SF), and abdominal pain (AP) scores, and Simple Endoscopic Score for Crohn's Disease (SES-CD)
  3. Have screening laboratory test results within the protocol specified parametersA female participant of childbearing potential must have a negative urine pregnancy test result at screening and baseline
  4. Demonstrated intolerance or inadequate response to conventional or to biologic therapy for CD

EXCLUSION CRITERIA

  1. Current diagnosis of ulcerative colitis or indeterminate colitis
  2. Has complications of Crohn's disease, such as symptomatic strictures or stenoses, short gut syndrome, or any other manifestation
  3. Unstable doses of concomitant Crohn's disease therapy
  4. Receipt of Crohn's disease approved biologic agents, investigational agents, or procedures outside of permitted timeframe as specified in the protocol
  5. Any medical contraindications preventing study participation

Prediction

INCLUSION CRITERIA

  1. Have Crohn's disease (CD) or fistulizing Crohn's disease of at least 3 months duration (defined as a minimum of 12 weeks), with colitis, ileitis, or ileocolitis, confirmed at any time in the past by radiography, histology, and/or endoscopy.
  2. Have moderate to severe CD as assessed by CDAI, stool frequency (SF), and abdominal pain (AP) scores, and Simple Endoscopic Score for Crohn's Disease (SES-CD).
  3. Have screening laboratory test results within the protocol specified parameters.
  4. A female participant of childbearing potential must have a negative urine pregnancy test result at screening and baseline.
  5. Demonstrated intolerance or inadequate response to conventional or biologic therapy for CD.
  6. Participants must be able to comply with the study protocol requirements.

EXCLUSION CRITERIA

  1. Current diagnosis of ulcerative colitis or indeterminate colitis.
  2. Has complications of Crohn's disease, such as symptomatic strictures or stenoses, short gut syndrome, or any other manifestation.
  3. Unstable doses of concomitant Crohn's disease therapy.
  4. Receipt of Crohn's disease approved biologic agents, investigational agents, or procedures outside of permitted timeframe as specified in the protocol.
  5. Prior exposure to p40 inhibitors or p19 inhibitors.
  6. Any medical contraindications preventing study participation.
  7. Participants with anticipated events that align with updated protocol guidelines.