Clinical sequencing is looming and recently I’ve heard more, and better, arguments for using whole genomes. These have mainly focused on the quality of PCR-free genomes, which have uniform coverage and few regions of missing or very low coverage. Compared to the PCR and hybridisation-capture artefact’s in exomes, or the focus on a biased set of genes a genome can sound very convincing (especially if you ignore the analysis/storage issues). Until recently the cost has still been too high, but Illumina recently released PCR-free on X Ten reducing the cost substantially. However there are so many different arguments that it is difficult to determine if we can perform a one-size-fits-all sequencing experiment.

Comparison of Illumina PCR-free to PCR+ kits

Recently I started talking to people who use terms like analytic validity, clinical validity and clinical utility – these meant something to me, but what they meant for genome sequencing assays, exomes and amplicomes I was not so sure so I thought I’d find out.
Which should we use: Genomes, exomes and amplicomes all have pro’s and con’s: cost, turnaround time, depth of coverage, analytical simplicity, etc – but in a lab like mine we never really consider, or spend time considering, what the sequencing methods we are using or developing need to look like to meet the needs of a doctor prescribing a treatment for a patient. This is where the terms analytic validity, clinical validity and clinical utility become important.

Analytic validity: simply put this asks “if a mutation is present, can our test find it?” The developers of a test should report the analytical sensitivity (if the variant being tested for is present, the likelihood the test will be positive) and analytical specificity (if the variant being tested for is not present, the likelihood the test will be negative). Usually this will consider validity at several stages

  • Pre-analytical – sample collection
  • The analytical stage – sample prep and running the test
  • The post analytical stage – analysis, interpretation and reporting
Clinical validity: simply put this asks “if a variant is found, will the patient develop a disease? In a ctDNA context we may be more interested in understanding if a specific mutation is found, does the patient have cancer? Developers of predictive tests will report positive predictive value and negative predictive value (the likelihood that an individual will, or will not, develop a disease). Often two things can affect clinical validity – mutation heterogeneity, or incomplete penetrance (not all patients with the variant will get the disease). 
Clinical utility: simply put this asks “if a variant is present, should we change the patients treatment? This is the big one, and the one I certainly feel farthest from in the Core Genomics lab. If a test does not have clinical utility it can still be useful in giving patients information, i.e as reported in exome sequencing projects for patients who’ve been through a “diagnostic odyssey” of standard tests. At least a confirmed result is a positive one. 
Application to Genomes, exomes or amplicones: At the simplest level a single gene NGS test that reports on a known causal variant with an approved treatment is an amplicome with high clinical utility. A gene panel may report on the same single causal variant, but is does this still have the same clinical utility? And what about exomes and genomes? Again the same variant may well be reported but with an increase in other variants, many of which are likely to have zero clinical utility; and I have not even discussed false positives!

Does the additional data, reporting on variants that may not be causal and for which no treatment is available make the test less valid? In the extreme case a single de novo causal mutation discovered by whole genome sequencing, that has an effective treatment may be accompanied by lots of noise – but for the patient it has very high utility indeed.

This post was written as I’m simply trying to get my head around an end of the NGS process I usually never consider. Comments on this post would really be appreciated.