Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project

BackgroundTumor mutational burden (TMB), defined as the number of somatic mutations per megabase of interrogated genomic sequence, demonstrates predictive biomarker potential for the identification of patients with cancer most likely to respond to immune checkpoint inhibitors. TMB is optimally calcu...

Full description

Bibliographic Details
Main Authors: Jeff Allen, Diana M Merino, Lisa M McShane, David Fabrizio, Vincent Funari, Shu-Jen Chen, James R White, Paul Wenz, Jonathan Baden, J Carl Barrett, Ruchi Chaudhary, Wangjuh (Sting) Chen, Jen-Hao Cheng, Dinesh Cyanam, Jennifer S Dickey, Elena Helman, Joerg Maas, Arnaud Papin, Rajesh Patidar, Katie J Quinn, Hongseok Tae, Christine Ward, Mingchao Xie, Ahmet Zehir, Manfred Dietel, Mark Stewart
Format: Article
Language:English
Published: BMJ Publishing Group 2020-06-01
Series:Journal for ImmunoTherapy of Cancer
Online Access:https://jitc.bmj.com/content/8/1/e000147.full
id doaj-e8663839837544db9634250292b948f0
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Jeff Allen
Diana M Merino
Lisa M McShane
David Fabrizio
Vincent Funari
Shu-Jen Chen
James R White
Paul Wenz
Jonathan Baden
J Carl Barrett
Ruchi Chaudhary
Wangjuh (Sting) Chen
Jen-Hao Cheng
Dinesh Cyanam
Jennifer S Dickey
Elena Helman
Joerg Maas
Arnaud Papin
Rajesh Patidar
Katie J Quinn
Hongseok Tae
Christine Ward
Mingchao Xie
Ahmet Zehir
Manfred Dietel
Mark Stewart
spellingShingle Jeff Allen
Diana M Merino
Lisa M McShane
David Fabrizio
Vincent Funari
Shu-Jen Chen
James R White
Paul Wenz
Jonathan Baden
J Carl Barrett
Ruchi Chaudhary
Wangjuh (Sting) Chen
Jen-Hao Cheng
Dinesh Cyanam
Jennifer S Dickey
Elena Helman
Joerg Maas
Arnaud Papin
Rajesh Patidar
Katie J Quinn
Hongseok Tae
Christine Ward
Mingchao Xie
Ahmet Zehir
Manfred Dietel
Mark Stewart
Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project
Journal for ImmunoTherapy of Cancer
author_facet Jeff Allen
Diana M Merino
Lisa M McShane
David Fabrizio
Vincent Funari
Shu-Jen Chen
James R White
Paul Wenz
Jonathan Baden
J Carl Barrett
Ruchi Chaudhary
Wangjuh (Sting) Chen
Jen-Hao Cheng
Dinesh Cyanam
Jennifer S Dickey
Elena Helman
Joerg Maas
Arnaud Papin
Rajesh Patidar
Katie J Quinn
Hongseok Tae
Christine Ward
Mingchao Xie
Ahmet Zehir
Manfred Dietel
Mark Stewart
author_sort Jeff Allen
title Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project
title_short Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project
title_full Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project
title_fullStr Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project
title_full_unstemmed Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization Project
title_sort establishing guidelines to harmonize tumor mutational burden (tmb): in silico assessment of variation in tmb quantification across diagnostic platforms: phase i of the friends of cancer research tmb harmonization project
publisher BMJ Publishing Group
series Journal for ImmunoTherapy of Cancer
issn 2051-1426
publishDate 2020-06-01
description BackgroundTumor mutational burden (TMB), defined as the number of somatic mutations per megabase of interrogated genomic sequence, demonstrates predictive biomarker potential for the identification of patients with cancer most likely to respond to immune checkpoint inhibitors. TMB is optimally calculated by whole exome sequencing (WES), but next-generation sequencing targeted panels provide TMB estimates in a time-effective and cost-effective manner. However, differences in panel size and gene coverage, in addition to the underlying bioinformatics pipelines, are known drivers of variability in TMB estimates across laboratories. By directly comparing panel-based TMB estimates from participating laboratories, this study aims to characterize the theoretical variability of panel-based TMB estimates, and provides guidelines on TMB reporting, analytic validation requirements and reference standard alignment in order to maintain consistency of TMB estimation across platforms.MethodsEleven laboratories used WES data from The Cancer Genome Atlas Multi-Center Mutation calling in Multiple Cancers (MC3) samples and calculated TMB from the subset of the exome restricted to the genes covered by their targeted panel using their own bioinformatics pipeline (panel TMB). A reference TMB value was calculated from the entire exome using a uniform bioinformatics pipeline all members agreed on (WES TMB). Linear regression analyses were performed to investigate the relationship between WES and panel TMB for all 32 cancer types combined and separately. Variability in panel TMB values at various WES TMB values was also quantified using 95% prediction limits.ResultsStudy results demonstrated that variability within and between panel TMB values increases as the WES TMB values increase. For each panel, prediction limits based on linear regression analyses that modeled panel TMB as a function of WES TMB were calculated and found to approximately capture the intended 95% of observed panel TMB values. Certain cancer types, such as uterine, bladder and colon cancers exhibited greater variability in panel TMB values, compared with lung and head and neck cancers.ConclusionsIncreasing uptake of TMB as a predictive biomarker in the clinic creates an urgent need to bring stakeholders together to agree on the harmonization of key aspects of panel-based TMB estimation, such as the standardization of TMB reporting, standardization of analytical validation studies and the alignment of panel-based TMB values with a reference standard. These harmonization efforts should improve consistency and reliability of panel TMB estimates and aid in clinical decision-making.
url https://jitc.bmj.com/content/8/1/e000147.full
work_keys_str_mv AT jeffallen establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT dianammerino establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT lisammcshane establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT davidfabrizio establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT vincentfunari establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT shujenchen establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT jamesrwhite establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT paulwenz establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT jonathanbaden establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT jcarlbarrett establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT ruchichaudhary establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT wangjuhstingchen establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT jenhaocheng establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT dineshcyanam establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT jennifersdickey establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT elenahelman establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT joergmaas establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT arnaudpapin establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT rajeshpatidar establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT katiejquinn establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT hongseoktae establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT christineward establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT mingchaoxie establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT ahmetzehir establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT manfreddietel establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
AT markstewart establishingguidelinestoharmonizetumormutationalburdentmbinsilicoassessmentofvariationintmbquantificationacrossdiagnosticplatformsphaseiofthefriendsofcancerresearchtmbharmonizationproject
_version_ 1721295037014212608
spelling doaj-e8663839837544db9634250292b948f02021-07-19T12:00:59ZengBMJ Publishing GroupJournal for ImmunoTherapy of Cancer2051-14262020-06-018110.1136/jitc-2019-000147Establishing guidelines to harmonize tumor mutational burden (TMB): in silico assessment of variation in TMB quantification across diagnostic platforms: phase I of the Friends of Cancer Research TMB Harmonization ProjectJeff Allen0Diana M Merino1Lisa M McShane2David Fabrizio3Vincent Funari4Shu-Jen Chen5James R White6Paul Wenz7Jonathan Baden8J Carl Barrett9Ruchi Chaudhary10Wangjuh (Sting) Chen11Jen-Hao Cheng12Dinesh Cyanam13Jennifer S Dickey14Elena Helman15Joerg Maas16Arnaud Papin17Rajesh Patidar18Katie J Quinn19Hongseok Tae20Christine Ward21Mingchao Xie22Ahmet Zehir23Manfred Dietel24Mark Stewart25Aff8 grid.428652.fFriends of Cancer Research 1800 M St. NW Washington, DC USAFriends of Cancer Research, Washington, DC, USANational Cancer Institute, Bethesda, Maryland, USAFoundation Medicine Inc, Cambridge, Massachusetts, USANeoGenomics Laboratories, Aliso Viejo, California, USAACT Genomics, Taipei, TaiwanResphera Biosciences, Baltimore, Maryland, USAClinical Genomics, Illumina Inc, San Diego, California, USABristol-Myers Squibb Co, Princeton, New Jersey, USATranslational Medicine, Oncology Research and Early Development, AstraZeneca Pharmaceuticals LP, Boston, Massachusetts, USAClinical Sequencing Division, Thermo Fisher Scientific, Ann Arbor, Michigan, USACaris Life Sciences Inc, Phoenix, Arizona, USAACT Genomics, Taipei, TaiwanClinical Sequencing Division, Thermo Fisher Scientific, Ann Arbor, Michigan, USAPersonal Genome Diagnostics, Baltimore, Maryland, USABioinformatics, Guardant Health Inc, Redwood City, California, USAQuality in Pathology (QuIP), Berlin, GermanyQIAGEN Inc, Waltham, Massachusetts, USAMolecular Characterization Laboratory, Frederick National Laboratory for Cancer Research, Frederick, Maryland, USABioinformatics, Guardant Health Inc, Redwood City, California, USACaris Life Sciences Inc, Phoenix, Arizona, USABristol-Myers Squibb Co, Princeton, New Jersey, USAAstraZeneca Pharmaceuticals LP, Waltham, Massachusetts, USAMemorial Sloan Kettering Cancer Center, New York, New York, USAQuality in Pathology (QuIP), Berlin, GermanyFriends of Cancer Research, Washington, DC, USABackgroundTumor mutational burden (TMB), defined as the number of somatic mutations per megabase of interrogated genomic sequence, demonstrates predictive biomarker potential for the identification of patients with cancer most likely to respond to immune checkpoint inhibitors. TMB is optimally calculated by whole exome sequencing (WES), but next-generation sequencing targeted panels provide TMB estimates in a time-effective and cost-effective manner. However, differences in panel size and gene coverage, in addition to the underlying bioinformatics pipelines, are known drivers of variability in TMB estimates across laboratories. By directly comparing panel-based TMB estimates from participating laboratories, this study aims to characterize the theoretical variability of panel-based TMB estimates, and provides guidelines on TMB reporting, analytic validation requirements and reference standard alignment in order to maintain consistency of TMB estimation across platforms.MethodsEleven laboratories used WES data from The Cancer Genome Atlas Multi-Center Mutation calling in Multiple Cancers (MC3) samples and calculated TMB from the subset of the exome restricted to the genes covered by their targeted panel using their own bioinformatics pipeline (panel TMB). A reference TMB value was calculated from the entire exome using a uniform bioinformatics pipeline all members agreed on (WES TMB). Linear regression analyses were performed to investigate the relationship between WES and panel TMB for all 32 cancer types combined and separately. Variability in panel TMB values at various WES TMB values was also quantified using 95% prediction limits.ResultsStudy results demonstrated that variability within and between panel TMB values increases as the WES TMB values increase. For each panel, prediction limits based on linear regression analyses that modeled panel TMB as a function of WES TMB were calculated and found to approximately capture the intended 95% of observed panel TMB values. Certain cancer types, such as uterine, bladder and colon cancers exhibited greater variability in panel TMB values, compared with lung and head and neck cancers.ConclusionsIncreasing uptake of TMB as a predictive biomarker in the clinic creates an urgent need to bring stakeholders together to agree on the harmonization of key aspects of panel-based TMB estimation, such as the standardization of TMB reporting, standardization of analytical validation studies and the alignment of panel-based TMB values with a reference standard. These harmonization efforts should improve consistency and reliability of panel TMB estimates and aid in clinical decision-making.https://jitc.bmj.com/content/8/1/e000147.full