Sample 150

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Evaluation scale (0-4):

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. Imaging results consistent with locally-advanced RCCCandidate for partial or complete nephrectomy as part of treatment plan.
  2. Measurable disease per RECIST version 1.1.
  3. ECOG performance status 0 or 1.
  4. Adequate bone marrow and organ function.

EXCLUSION CRITERIA

  1. Prior systemic anti-tumor treatment for RCC.
  2. Patients who are receiving any other investigational agents.
  3. Clinical status indicating that immediate surgery (within 6 weeks) is warranted regardless of whether neoadjuvant therapy is to be administered, as assessed by the treating surgeon.
  4. Inability to undergo baseline tumor biopsy.
  5. Active or prior documented autoimmune or immunocompromising conditions.
  6. Uncontrolled hypertension.

Prediction

INCLUSION CRITERIA

  1. Imaging results consistent with locally-advanced renal cell carcinoma (RCC) without evidence of metastatic disease, with absence of adjacent organ invasion or retroperitoneal adenopathy (cT2-T3b, N0, M0).
  2. Candidate for partial or complete nephrectomy that extirpates all tumor tissue as part of treatment plan.
  3. Measurable disease as per RECIST version 1.1.
  4. Eastern Cooperative Oncology Group (ECOG) performance status (PS) 0 or 1.
  5. Adequate bone marrow and organ function demonstrated by:
  6. a. Absolute neutrophil count ≥ 1,000/mm3 (≥ 1.0 × 10^9/L);
  7. b. Platelet count ≥ 100 × 10^9/L (≥ 100,000 per mm3);
  8. c. ALT and AST ≤ 2.5 × ULN;
  9. d. Serum bilirubin ≤ 1.5 × ULN, or ≤ 3.0 × ULN for patients with Gilbert Syndrome;
  10. e. Serum creatinine ≤ 1.5 × ULN, or creatinine clearance (CrCl) ≥ 50 mL/min (using the Cockcroft-Gault formula or following local institutional standards).
  11. ≥ 18 years of age.
  12. Women of child-bearing potential (WOCBP) or men whose partner is a WOCBP agree to use contraception while participating in this study, and for a period of 6 months following termination of study treatment.
  13. Completed informed consent process, including signing Institutional Review Board/Ethics Committee/Research Ethics Board (IRB/EC/REB) approved informed consent form.
  14. Willing to comply with clinical trial instructions and requirements.

EXCLUSION CRITERIA

  1. Prior systemic anti-tumor treatment for RCC.
  2. Patients who are receiving any other investigational agents.
  3. Clinical status indicating that immediate surgery (within 6 weeks) is warranted regardless of whether neoadjuvant therapy is to be administered, as assessed by the treating surgeon.
  4. Inability to undergo baseline tumor biopsy.
  5. Active or prior documented autoimmune disease:
  6. a. Inflammatory bowel disease (e.g., Crohn’s disease, ulcerative colitis);
  7. b. Interstitial lung disease (ILD), drug-induced ILD, radiation pneumonitis which required steroid treatment, or any evidence of clinically active interstitial lung disease;
  8. c. Other active or prior, documented autoimmune disease within the past 2 years.
  9. Active or prior immunocompromising conditions:
  10. a. Current or prior use of immunosuppressive medication within 28 days before the first dose of study treatment, with exceptions for intranasal and inhaled corticosteroids or systemic corticosteroids at physiological doses not exceeding 10 mg/day of prednisone, or an equivalent dose of another corticosteroid;
  11. b. Known acute or chronic human immunodeficiency virus (HIV);
  12. c. History of primary immunodeficiency;
  13. d. History of allogeneic transplant.
  14. Known acute or chronic hepatitis B or hepatitis C.
  15. History of hypersensitivity to study treatment excipient.
  16. History of severe hypersensitivity reaction to any monoclonal antibody.
  17. Use of live vaccines against infectious disease (e.g., varicella) within 28 days of initiation of study therapy; killed vaccinations (e.g., influenza) are allowed at any appropriate time before and during the study.
  18. Uncontrolled arterial hypertension (> 150 mm Hg systolic or > 100 mm Hg diastolic) on multiple observations despite standard of care treatment.
  19. History of stroke or transient ischemic attack within the previous 6 months.
  20. Any of the following cardiac abnormalities:
  21. a. Unstable angina pectoris;
  22. b. Congestive heart failure ≥ NYHA (New York Heart Association Functional Classification) Class 3;
  23. c. QTc > 480 milliseconds;
  24. d. Left ventricular ejection fraction (LVEF) ≤ 40%.
  25. Concomitant medication known to cause prolonged QT which cannot be discontinued or changed to a different medication prior to enrollment.
  26. Known or suspected presence of another malignancy that could be mistaken for the malignancy under study during disease assessments.
  27. Pregnancy. WOCBP must have a negative serum or urine pregnancy test documented within the screening period prior to the start of study drug.
  28. Breast-feeding or planning to breastfeed during the study or within 6 months after study treatment.
  29. Any serious illness, uncontrolled inter-current illness, psychiatric illness, active or uncontrolled infection, or other medical history, including laboratory results, which, in the Investigator’s opinion, would be likely to interfere with the patient’s participation in the study, or with the interpretation of the results.