Sample 28

Evaluation Instructions

Important: Models were tasked with extracting evidence from documents. Some outputs may be low quality and should be scored accordingly.

Your task: Compare the model-generated prediction (right panel) against the ground truth criteria (left panel).

Evaluation scale (0-4):

Consider both content accuracy and completeness. Some predictions may be technically "correct" but incomplete or out of order.

Ground Truth

INCLUSION CRITERIA

  1. Definite or probable PBC diagnosis (consistent with American Association for the Study of Liver Diseases [AASLD] and the European Association for the Study of the Liver [EASL] practice guidelines;
  2. Lindor 2009;
  3. EASL 2009), as demonstrated by the presence of ≥2 of the following 3 diagnostic factors:History of elevated Alkaline phosphatase levels for at least 6 monthsPositive antimitochondrial antibody (AMA) titer or if AMA negative or in low titer (<1:80) PBC-specific antibodies (anti-GP210 and/or anti-SP100 and/or antibodies against the major M2 components [PDC-E2, 2-oxo-glutaric acid dehydrogenase complex])Liver biopsy consistent with PBCA mean total bilirubin >ULN and ≤5x ULN and/or a mean ALP >3x ULNEither is not taking UDCA (no UDCA dose in the past 3 months) or has been taking UDCA for at least 12 months with a stable dose for ≥3 months prior to Day 0

EXCLUSION CRITERIA

  1. History or presence of other concomitant liver diseases including:Hepatitis C virus infectionActive Hepatitis B infection; however, subjects who have seroconverted (hepatitis B surface antigen and hepatitis B e antigen negative) may be included in this study after consultation with the medical monitorPrimary sclerosing cholangitis (PSC)Alcoholic liver diseaseDefinite autoimmune liver disease or overlap hepatitisNonalcoholic steatohepatitis (NASH)Gilbert's SyndromePresence of clinical complications of PBC or clinically significant hepatic decompensation, including:History of liver transplant, current placement on a liver transplant list, or current Model of End Stage Liver Disease (MELD) score >12.
  2. Subjects who are placed on a transplant list despite a relatively early disease stage (for example per regional guidelines) may be eligible as long as they do not meet any of the other

EXCLUSION CRITERIA

  1. Cirrhosis with complications, including history (within the past 12 months) or presence of:Variceal bleedUncontrolled ascitesEncephalopathySpontaneous bacterial peritonitisKnown or suspected HCCPrior transjugular intrahepatic portosystemic shunt procedureHepatorenal syndrome (type I or II) or screening (Visit 1 or 2) serum creatinine >2 mg/dL (178 μmol/L)Mean total bilirubin >5x ULNSubjects who have undergone gastric bypass procedures (gastric lap band is acceptable) or ileal resection or plan to undergo either of these proceduresOther medical conditions that may diminish life expectancy, including known cancers (except carcinomas in situ or other stable, relatively benign conditions)If female: plans to become pregnant, known pregnancy or a positive urine pregnancy test (confirmed by a positive serum pregnancy test), or lactatingKnown history of human immunodeficiency virus infectionMedical conditions that may cause nonhepatic increases in ALP (eg, Paget's disease or fractures within 3 months)Other clinically significant medical conditions that are not well controlled or for which medication needs are anticipated to change during the studyHistory of alcohol abuse or other substance abuse within 1 year prior to Day 0Participation in another investigational product, biologic, or medical device study within 30 days prior to Screening.
  2. Participation in a previous study of OCA is allowed with 3 months washout prior to enrollment in this studyMental instability or incompetence, such that the validity of informed consent or ability to be compliant with the study is uncertainHistory of known or suspected clinically significant hypersensitivity to OCA or any of its componentsUDCA naïve (unless contraindicated)

Prediction

Amended Eligibility Criteria (Version 45)

INCLUSION CRITERIA

  1. Definite or probable PBC diagnosis (consistent with American Association for the Study of Liver Diseases [AASLD] and the European Association for the Study of the Liver [EASL] practice guidelines; Lindor 2009; EASL 2009), as demonstrated by the presence of ≥2 of the following 3 diagnostic factors:
  2. History of elevated Alkaline Phosphatase (ALP) levels for at least 6 months
  3. Positive antimitochondrial antibody (AMA) titer or if AMA negative or in low titer (<1:80) PBC-specific antibodies (anti-GP210 and/or anti-SP100 and/or antibodies against the major M2 components [PDC-E2, 2-oxo-glutaric acid dehydrogenase complex])
  4. Liver biopsy consistent with PBC
  5. Mean total bilirubin >ULN and ≤5x ULN and/or a mean ALP >3x ULN
  6. Age ≥18 years
  7. Either is not taking UDCA (UDCA naïve or no UDCA dose in the past 3 months) or has been taking UDCA for at least 12 months with an approved, stable dose for ≥3 months prior to Day 0
  8. Contraception: Female subjects must be postmenopausal, surgically sterile, or if premenopausal (and not surgically sterile), be prepared to use ≥1 highly effective method of contraception during the study and for 30 days after the end of treatment visit. Highly effective methods of contraception per the CTFG guidelines are those that alone or in combination result in a failure rate of less than 1% per year when used consistently and correctly. Highly effective methods of contraception are as follows:
  9. Intrauterine device (IUD)
  10. Intrauterine hormone-releasing system (IUS)
  11. Bilateral tubal occlusion
  12. Vasectomy (partner)
  13. Combined (estrogen and progestogen containing) hormonal contraception (e.g., oral, intravaginal or transdermal) associated with inhibition of ovulation. If oral contraceptives are used, they must be used in combination with a male or female condom. Female subjects should have been on the hormone contraception for at least 8 days prior to Day 1.
  14. Progestogen-only hormonal contraception (e.g., oral, injectable or implantable) associated with inhibition of ovulation. If oral contraceptives are used, they must be used in combination with a male or female condom. Female subjects should have been on the hormone contraception for at least 8 days prior to Day 1.
  15. Sexual abstinence, if in line with the preferred and usual lifestyle of the subject (where abstinence is defined as refraining from heterosexual intercourse during the entire period of risk associated with study treatments).
  16. Must provide written informed consent and agree to comply with the study protocol

EXCLUSION CRITERIA

  1. History or presence of other concomitant liver diseases including:
  2. Hepatitis C virus infection
  3. Active hepatitis B infection; however, subjects who have seroconverted (hepatitis B surface antigen and hepatitis B e antigen negative) may be included in this study after consultation with the medical monitor
  4. Primary sclerosing cholangitis
  5. Alcoholic liver disease
  6. Definite autoimmune liver disease or overlap hepatitis
  7. Nonalcoholic steatohepatitis
  8. Gilbert’s Syndrome
  9. Presence of clinical complications of PBC or clinically significant hepatic decompensation, including:
  10. History of liver transplant, current placement on a liver transplant list, or current Model of End Stage Liver Disease (MELD) score >12. Subjects who are placed on a transplant list despite a relatively early disease stage (for example per regional guidelines) may be eligible as long as they do not meet any of the other

EXCLUSION CRITERIA

  1. Cirrhosis with complications, including history (within the past 12 months) or presence of:
  2. Variceal bleed
  3. Uncontrolled ascites
  4. Encephalopathy
  5. Spontaneous bacterial peritonitis
  6. Known or suspected hepatocellular carcinoma
  7. Prior transjugular intrahepatic portosystemic shunt procedure
  8. Hepatorenal syndrome (type I or II) or screening serum creatinine >2 mg/dL (178 μmol/L)
  9. Subjects who have undergone gastric bypass procedures (gastric lap band is acceptable) or ileal resection or plan to undergo either of these procedures
  10. Other medical conditions that may diminish life expectancy, including known cancers (except carcinomas in situ or other stable, relatively benign conditions)
  11. If female: plans to become pregnant, known pregnancy or a positive urine pregnancy test (confirmed by a positive serum pregnancy test), or lactating
  12. Known history of human immunodeficiency virus (HIV) infection
  13. Medical conditions that may cause non-hepatic increases in ALP (e.g., Paget’s disease or fractures within 3 months)
  14. Other clinically significant medical conditions that are not well controlled or for which medication needs are anticipated to change during the study
  15. History of alcohol abuse or other substance abuse within 1 year prior to Day 0
  16. Participation in another investigational product, biologic, or medical device study within 30 days prior to Screening. Participation in a previous study of OCA is allowed with a 3-month washout period prior to enrollment in this study
  17. Mental instability or incompetence, such that the validity of informed consent or ability to be compliant with the study is uncertain
  18. History of known or suspected clinically significant hypersensitivity to OCA or any of its components