Sample 102

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

1. Part A and C:Overtly healthy as determined by medical evaluationTo qualify as Japanese for the purpose of this study, the participant must be first generation Japanese, defined as the participant's biological parents and all of the participant's biological grandparents must be of exclusive Japanese descent, and must have been born in JapanTo qualify as Chinese for the purpose of this study, the participant must be, at a minimum, third-generation Chinese, defined as all 4 of the participant's biological grandparents must be of exclusive Chinese descent and born in China
2. Have a body mass index of 18.0 to 32.0 kilograms per square meter (kg/m²), inclusive
3. Male participants who agree to use highly effective or effective methods of contraception and women not of childbearing potential may participate in part A and CPart B:Participants who have a diagnosis of atopic dermatitis at least 12 months prior to screening as defined by the American Academy of Dermatology
4. Have a history, documented by a physician and/or investigator, of inadequate response to existing topical medications within 6 months preceding screening, or participants who failed systemic therapies intended to treat atopic dermatitis or a history of intolerance to topical therapy
5. Have a body mass index of 18.0 to 38.0 kilograms per square meter (kg/m²), inclusive
6. Male participants who agree to use highly effective or effective methods of contraception, women not of childbearing potential and women of childbearing potential may participate in part B

EXCLUSION CRITERIA

1. Women who are pregnant and/or lactating
2. Participants who have received live vaccine(s) (including attenuated live vaccines) or Bacillus Calmette- Guérin within 35 days of screening
3. Have a history or presence of multiple or severe allergies or an anaphylactic reaction to prescription or nonprescription drugs
4. Have a known history of diabetes
5. Have fasting glucose level of ≥126 milligrams per deciliter (mg/dL) and glycated hemoglobin ≥6.5 percent (%) and/or taking anti-diabetes medications at screening
6. Have known history of osteoporosis

Prediction

Amended Eligibility Criteria (Version 2):

INCLUSION CRITERIA

1. Part A and C:
2. Overtly healthy as determined by medical evaluation.
3. To qualify as Japanese for the purpose of this study, the participant must be first generation Japanese, defined as the participant's biological parents and all of the participant's biological grandparents must be of exclusive Japanese descent, and must have been born in Japan.
4. To qualify as Chinese for the purpose of this study, the participant must be, at a minimum, third-generation Chinese, defined as all 4 of the participant's biological grandparents must be of exclusive Chinese descent and born in China.
5. Have a body mass index (BMI) of 18.0 to 32.0 kilograms per square meter (kg/m²), inclusive.
6. Male participants who agree to use highly effective or effective methods of contraception and women not of childbearing potential may participate in Part A and C.
7. Part B:
8. Participants who have a diagnosis of atopic dermatitis at least 12 months prior to screening as defined by the American Academy of Dermatology.
9. Have a history, documented by a physician and/or investigator, of inadequate response to existing topical medications within 6 months preceding screening, or participants who failed systemic therapies intended to treat atopic dermatitis or a history of intolerance to topical therapy.
10. Have a body mass index (BMI) of 18.0 to 38.0 kilograms per square meter (kg/m²), inclusive.
11. Male participants who agree to use highly effective or effective methods of contraception, women not of childbearing potential, and women of childbearing potential who agree to use highly effective methods of contraception or practice abstinence may participate in Part B.

EXCLUSION CRITERIA

1. Women who are pregnant and/or lactating.
2. Have received live vaccine(s) (including attenuated live vaccines) or Bacillus Calmette-Guérin within 35 days of screening.
3. Have a history or presence of multiple or severe allergies or an anaphylactic reaction to prescription or nonprescription drugs.
4. Known history of diabetes.
5. Fasting glucose level of ≥126 mg/dL and glycated hemoglobin ≥6.5% and/or taking anti-diabetes medications at screening.
6. Known history of osteoporosis.
7. ---
8. Note: The inclusion and

EXCLUSION CRITERIA

1. have been updated to reflect the amendments, particularly the addition of criteria related to diabetes and osteoporosis, as well as clarifications on the definition of childbearing potential and contraception methods.