Sample 153

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Clean view: Shows formatted, readable text for easy comparison
Diff view: Highlights differences between ground truth and prediction
Raw view: Shows original unformatted text as it appears in the dataset

Evaluation scale (0-4):

0 = No match: Prediction is unrelated or contradicts the target criteria
1 = Poor match: Minimal overlap with ground truth, major errors or omissions
2 = Partial match: Some key elements captured, but notable gaps or inaccuracies
3 = Good match: Most elements correct, minor differences or formatting issues
4 = Excellent match: Essentially identical content, fully correct capture

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. The subject has provided written informed consent with HIPAA authorization before the initiation of any study-related procedures.
  2. The subject is at least 18 years of age at the time of consent.
  3. The subject is HIV positive.
  4. The subject has a biopsy-confirmed diagnosis of KS and is classified into one of the categories below:Confirmed cutaneous KS/oral lesions without edema.
  5. Confirmed cutaneous KS/oral lesions with edema.
  6. Confirmed cutaneous KS/oral lesions with or without edema and suspected non-cutaneous KS due to clinical symptomology or confirmed non-cutaneous KS lesion(s).

EXCLUSION CRITERIA

  1. The subject is pregnant or lactating.
  2. The subject has received chemotherapy or radiation therapy to KS sites within one year of enrollment.
  3. The subject has known sensitivity to dextran.
  4. The subject has received an investigational product within 30 days prior to the Tc 99m tilmanocept administration.
  5. The subject has received any radiopharmaceutical within 7 days prior to the administration of Tc 99m tilmanocept.
  6. Any condition that, in the clinical judgment of the treating physician, is likely to prevent the subject from complying with any aspect of the protocol or that may put the subject at unacceptable risk.

Prediction

INCLUSION CRITERIA

  1. The subject has provided written informed consent with HIPAA (Health Insurance Portability and Accountability Act) authorization before the initiation of any study-related procedures.
  2. The subject is at least 18 years of age at the time of consent.
  3. The subject is HIV positive.
  4. The subject has a biopsy-confirmed diagnosis of Kaposi Sarcoma (KS) and is classified into one of the categories below:
  5. a. Confirmed cutaneous KS/oral lesions without edema
  6. b. Confirmed cutaneous KS/oral lesions with edema
  7. c. Confirmed cutaneous KS/oral lesions with or without edema and suspected non-cutaneous KS due to clinical symptomology or confirmed non-cutaneous KS lesion(s).

EXCLUSION CRITERIA

  1. The subject is pregnant or lactating.
  2. The subject has received chemotherapy or radiation therapy to KS sites within six weeks of enrollment.
  3. The subject has known sensitivity to dextran.
  4. The subject has received an investigational product within 30 days prior to the Tc 99m tilmanocept administration on Day 1.
  5. The subject has received any radiopharmaceutical within 7 days prior to the administration of Tc 99m tilmanocept on Day 1.
  6. Any condition that, in the clinical judgment of the treating physician, is likely to prevent the subject from complying with any aspect of the protocol or that may put the subject at unacceptable risk.