An Evidence-Based Framework for Evaluating Pharmacogenomics Knowledge for Personalized Medicine

Michelle Whirl-Carrillo, Rachel Huddart, Li Gong, Katrin Sangkuhl, Caroline F Thorn, Ryan Whaley, Teri E Klein, Michelle Whirl-Carrillo, Rachel Huddart, Li Gong, Katrin Sangkuhl, Caroline F Thorn, Ryan Whaley, Teri E Klein

Abstract

Clinical annotations are one of the most popular resources available on the Pharmacogenomics Knowledgebase (PharmGKB). Each clinical annotation summarizes the association between variant-drug pairs, shows relevant findings from the curated literature, and is assigned a level of evidence (LOE) to indicate the strength of support for that association. Evidence from the pharmacogenomic literature is curated into PharmGKB as variant annotations, which can be used to create new clinical annotations or added to existing clinical annotations. This means that the same clinical annotation can be worked on by multiple curators over time. As more evidence is curated into PharmGKB, the task of maintaining consistency when assessing all the available evidence and assigning an LOE becomes increasingly difficult. To remedy this, a scoring system has been developed to automate LOE assignment to clinical annotations. Variant annotations are scored according to certain attributes, including study size, reported P value, and whether the variant annotation supports or fails to find an association. Clinical guidelines or US Food and Drug Administration (FDA)-approved drug labels which give variant-specific prescribing guidance are also scored. The scores of all annotations attached to a clinical annotation are summed together to give a total score for the clinical annotation, which is used to calculate an LOE. Overall, the system increases transparency, consistency, and reproducibility in LOE assignment to clinical annotations. In combination with increased standardization of how clinical annotations are written, use of this scoring system helps to ensure that PharmGKB clinical annotations continue to be a robust source of pharmacogenomic information.

Conflict of interest statement

The authors report no conflict of interest.

© 2021 The Authors. Clinical Pharmacology & Therapeutics published by Wiley Periodicals LLC on behalf of American Society for Clinical Pharmacology and Therapeutics.

Figures

Figure 1
Figure 1
The PharmGKB curation process. Blue boxes represent primary literature and source documents that are curated. Green boxes represent basic PharmGKB annotations derived from curated literature and documents. Orange boxes represent PharmGKB annotations based on aggregated and evaluated basic annotations and curated literature. CPIC, Clinical Pharmacogenetics Implementation Consortium; DPWG, Royal Dutch Association for the Advancement of Pharmacy‐ Pharmacogenetics Working Group; EMA, European Medicines Agency; FDA, US Food and Drug Administration; HCSC, Health Canada (Santé Canada); PD, pharmacodynamics; PharmGKB, Pharmacogenomics Knowledgebase; PK, pharmacokinetics; PMDA, Pharmaceuticals and Medical Devices Agency, Japan; VIPs, Very Important Pharmacogenes.
Figure 2
Figure 2
Illustrated example of clinical annotation scoring. FDA, US Food and Drug Administration; HR, hazard ratio; LOE, level of evidence; OR, odds ratio; RR, relative risk.
Figure 3
Figure 3
Venn diagram showing the number of level 1A clinical annotations with PGx guideline or drug label annotations as support. CPIC, Clinical Pharmacogenetics Implementation Consortium; DPWG, Royal Dutch Association for the Advancement of Pharmacy‐ Pharmacogenetics Working Group; FDA, US Food and Drug Administration; PGx, pharmacogenomics.
Figure 4
Figure 4
An example gene‐level clinical annotation. All clinical annotations provide genotype‐ or allele‐specific summaries of the curated evidence (Box 1) and display the LOE along with associated genes, haplotypes, drugs and phenotypes (Box 2). The Limited Evidence tag on gene‐level clinical annotations is added to alleles which are supported by substantially less evidence than other alleles in the same annotation (Box 3). The clinical annotation score and a scoring breakdown are displayed under the main annotation text (Box 4). This annotation can be viewed on the PharmGKB website at https://www.pharmgkb.org/clinicalAnnotation/1444842106. CPIC, Clinical Pharmacogenetics Implementation Consortium; LOE, level of evidence; PharmGKB, Pharmacogenomics Knowledgebase; PK, pharmacokinetic.

References

    1. Eichelbaum, M., Altman, R.B., Ratain, M. & Klein, T.E. New feature: pathways and important genes from PharmGKB. Pharmacogenet. Genomics 19, 403 (2009).
    1. Lever, al. PGxMine: text mining for curation of PharmGKB. Pac. Symp. Biocomput. 25, 611–622 (2020).
    1. Whirl‐Carrillo, al. Pharmacogenomics knowledge for personalized medicine. Clin. Pharmacol. Ther. 92, 414–417 (2012).
    1. Ashley, al. Clinical assessment incorporating a personal genome. Lancet 375, 1525–1535 (2010).
    1. Dewey, al. Clinical interpretation and implications of whole‐genome sequencing. JAMA 311, 1035–1045 (2014).
    1. Chen, al. Personal omics profiling reveals dynamic molecular and medical phenotypes. Cell 148, 1293–1307 (2012).
    1. Dewey, al. Phased whole‐genome genetic risk in a family quartet using a major allele reference sequence. PLoS Genet. 7, e1002280 (2011).
    1. Johnson, J.A., Burkley, B.M., Langaee, T.Y., Clare‐Salzler, M.J., Klein, T.E. & Altman, R.B. Implementing personalized medicine: development of a cost‐effective customized pharmacogenetics genotyping array. Clin. Pharmacol. Ther. 92, 437–439 (2012).
    1. Burge, al. Biocurators and biocuration: surveying the 21st century challenges. Database 2012, bar059 (2012).
    1. Relling, M.V. & Klein, T.E. CPIC: Clinical Pharmacogenetics Implementation Consortium of the pharmacogenomics research network. Clin. Pharmacol. Ther. 89, 464–467 (2011).
    1. U.S. Food and Drug Administration (FDA) Table of Pharmacogenomic Biomarkers in Drug Labeling <>. Accessed March 2021.
    1. PharmGKB ‐ Drug Label Information and Legend <>. Accessed March 2021.
    1. Jeiziner, al. Pharmacogenetic information in Swiss drug labels ‐ a systematic analysis. Pharmacogenomics J. 10.1038/s41397-020-00195-4. [e‐pub ahead of print].
    1. PharmGKB ‐ Variant Annotation Scoring page <>. Accessed March 2021.
    1. Gaedigk, A., Ingelman‐Sundberg, M., Miller, N.A., Leeder, J.S., Whirl‐Carrillo, M. & Klein, T.E. The Pharmacogene Variation (PharmVar) Consortium: incorporation of the human cytochrome P450 (CYP) allele nomenclature database. Clin. Pharmacol. Ther. 103, 399–401 (2018).
    1. Appell, al. Nomenclature for alleles of the thiopurine methyltransferase gene. Pharmacogenet. Genomics 23, 242–248 (2013).
    1. PharmGKB ‐ Clinical Annotations Help File page <>. Accessed March 2021.
    1. Strande, al. Evaluating the clinical validity of gene‐disease associations: an evidence‐based framework developed by the clinical genome resource. Am. J. Hum. Genet. 100, 895–906 (2017).
    1. Buza, T.J., McCarthy, F.M., Wang, N., Bridges, S.M. & Burgess, S.C. Gene Ontology annotation quality analysis in model eukaryotes. Nucleic Acids Res. 36, e12 (2008).
    1. PharmGKB ‐ Rare Variants <>. Accessed July 2021.

Source: PubMed

3
Tilaa