Sample 124

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

1. Japanese participants ≥ 18 years of age upon entry into initial screening
2. Palmoplantar pustulosis diagnosis with or without pustulotic arthro-osteitis (PAO) for no less than 24 weeksPPPASI total score of ≥12 at screening and at baseline
3. Moderate or severe pustules/vesicles on palms or soles (PPPASI severity score ≥2) at screening and at baseline
4. Inadequate response (defined as repeated relapsing-remitting in the same location for a 24-week period) to topical treatments prior to or at screening

EXCLUSION CRITERIA

1. Changes in disease severity during screening (PPPASI total score change ≥ 5 improvement, from screening to baseline)
2. Periodontitis requiring treatment
3. Chronic or recurrent tonsillitis or sinusitis requiring any continuous treatment
4. Has a diagnosis of plaque-type psoriasis at baseline
5. Has the presence of pustular psoriasis on any part of the body other than the palms and soles
6. Has evidence of skin conditions of hand and feet at baseline that would interfere with evaluations of the effect of Investigational Product
7. Has unstable cardiovascular disease, defined as a recent clinical deterioration or a cardiac hospitalization within 12 weeks prior to screening
8. Malignancy or history of malignancy
9. Participant has received any procedures for focal infection within 24 weeks of baseline
10. Female participants who are breastfeeding or who plan to breastfeed while on study
11. Female participants of childbearing potential with a positive pregnancy test
12. Had prior treatment with apremilast
13. Has a prior medical history of suicide attempt at any time in the participant's lifetime prior to signing of informed consent or randomization, or major psychiatric illness requiring hospitalization within the last 3 years prior to signing of informed consent

Prediction

INCLUSION CRITERIA

1. Japanese participants ≥ 18 years of age upon entry into initial screening
2. Palmoplantar pustulosis diagnosis with or without pustulotic arthro-osteitis (PAO) for no less than 24 weeks
3. PPPASI total score of ≥12 at screening and at baseline
4. Moderate or severe pustules/vesicles on palms or soles (PPPASI severity score ≥2) at screening and at baseline
5. Inadequate response to topical treatments prior to or at screening

EXCLUSION CRITERIA

1. Changes in disease severity during screening (PPPASI total score change ≥ 5 improvement, from screening to baseline)
2. Periodontitis requiring treatment
3. Chronic or recurrent tonsillitis or sinusitis requiring any continuous treatment
4. Has a diagnosis of plaque-type psoriasis at baseline
5. Has the presence of pustular psoriasis on any part of the body other than the palms and soles
6. Has evidence of skin conditions of hand and feet at baseline that would interfere with evaluations of the effect of Investigational Product
7. Unstable cardiovascular disease, defined as a recent clinical deterioration or a cardiac hospitalization within 12 weeks prior to screening
8. Malignancy or history of malignancy
9. Participant has received any procedures for focal infection within 24 weeks of baseline
10. Female participants who are breastfeeding or who plan to breastfeed while on study
11. Female participants of childbearing potential with a positive pregnancy test
12. Had prior treatment with apremilast
13. Has a prior medical history of suicide attempt at any time in the participant's lifetime prior to signing of informed consent or randomization, or major psychiatric illness requiring hospitalization within the last 3 years prior to signing of informed consent