Quality and Accessibility of Liquid Biopsy Information
Henry K. Litt, Emma Greenstreet-Akman, Evelin Trejo, Narjust Florez, Ana I. Velazquez

TL;DR
This study assesses how accurate and accessible information about a liquid biopsy test is on popular websites.
Contribution
The study provides an evaluation of public-facing information about a liquid biopsy test's quality and accessibility.
Findings
Information about the test was found on various popular internet resources.
The study highlights the need for clearer and more accurate public information on liquid biopsy tests.
Abstract
This cross-sectional study evaluates the information on a circulating tumor DNA test available to the public on popular internet resources.
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
| Characteristic | No. (%) |
|---|---|
| No. of videos | 100 |
| No. of featured speakers | 125 |
| Understandability or quality measures | |
| Understandable (PEMAT score: ≥70%) | 9 (9.0) |
| Moderate to high quality (DISCERN score: 3-5) | 8 (8.0) |
| Video creator | |
| Academic journal or society | 38 (38.0) |
| Media organization | 29 (29.0) |
| Health care industry company | 12 (12.0) |
| Hospital system | 11 (11.0) |
| Other | 10 (10.0) |
| Intended audience | |
| Health care practitioner or scientific community | 72 (72.0) |
| General public | 28 (28.0) |
| Type of speaker or narrator | |
| Physician | 77 (61.6) |
| Basic science researcher | 26 (20.8) |
| Industry | 9 (7.2) |
| Media group | 6 (4.8) |
| Patient | 4 (3.2) |
| Other or unknown | 3 (2.4) |
| Perceived race and ethnicity of speaker | |
| Asian | 22 (17.6) |
| Black | 1 (0.8) |
| Hispanic or Latino | 1 (0.8) |
| Non-Hispanic White | 98 (78.4) |
| Unknown | 3 (2.4) |
| Perceived sex of speaker | |
| Male | 82 (65.6) |
| Female | 39 (31.2) |
| Unknown | 4 (3.2) |
| Characteristic | No. (%) |
|---|---|
| No. of web pages | 100 |
| Web page creator | |
| Health care industry company | 35 (35.0) |
| Academic society or journal | 19 (19.0) |
| Hospital system | 18 (18.0) |
| Media organization | 18 (18.0) |
| Other | 10 (10.0) |
| Accessibility | |
| Visual aid present | 20 (20.0) |
| Multiple languages available | 5 (5.0) |
| Quality | |
| Authors’ names present | 42 (42.0) |
| Citation present | 29 (29.0) |
| Publication year present | 57 (57.0) |
| Indications mentioned | 36 (36.0) |
| Limitations mentioned | 35 (35.0) |
| Cost or insurance coverage mentioned | 16 (16.0) |
| Commercial bias | 61 (61.0) |
| Corporation brand mentioned | 50 (50.0) |
| Liquid biopsy company website | 29 (29.0) |
| Company logo present | 27 (27.0) |
| Conflict of interest mentioned | 5 (5.0) |
| Funded by liquid biopsy company | 3 (3.0) |
| Reading level, median (IQR) text readability | |
| Flesch-Kincaid Grade Level | 14.1 (12.1-15.8) |
| Gunning Fog Index | 16.4 (14.4-18.6) |
| SMOG Index | 15.9 (13.9-16.9) |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSocial Media in Health Education · Biomedical Text Mining and Ontologies · Health Literacy and Information Accessibility
Introduction
Circulating tumor DNA assays, known as liquid biopsies, are increasingly used to genotype cancers, guide therapy selection, and identify resistance mechanisms to cancer therapy.^1^ As more patients undergo liquid biopsies, it is essential that they can understand the benefits and limitations. Patients often obtain medical information on the internet or social media. Because online medical information can be inaccurate, biased, and difficult to comprehend,^2^ we evaluated the quality, accessibility, and understandability of online information about liquid biopsies.
Methods
We performed an online search of liquid biopsy using a search engine (Google; Alphabet) and social network (YouTube; Alphabet) and conducted a cross-sectional analysis of the top videos and web page results. Videos over 5 minutes, scientific articles, and non–English language content were excluded. The University of California, San Francisco Institutional Review Board approved this cross-sectional study and waived the informed consent requirement as the work was not human participant research. We followed the STROBE reporting guideline.
Two independent reviewers (H.K.L., E.G.A.) evaluated each video for characteristics, perceived speaker identities and roles, and health information presented. Understandability and quality of consumer health information were evaluated using validated tools (PEMAT [Patient Education Materials Assessment Tool], DISCERN).^3,4^ Interobserver agreement between reviewers was 87%. Disagreements (n = 26) were resolved by another independent reviewer (E.T.).
Web pages were evaluated for accessibility (visual aids, languages available, reading level), quality of information (authors, citations, publication year, indications, limitations), discussion of cost or insurance coverage, and presence of commercial bias. Reading level was evaluated using validated indices: Flesch-Kincaid Grade Level, Gunning Fog, and Simple Measure of Gobbledygook (SMOG) Index.^5^ Commercial bias included disclosure of conflicts of interest, primary company websites, and presence of branding or funding from for-profit corporations.
Descriptive statistics were calculated using Stata, version 17 (StataCorp LLC). Analyses were performed between November 2022 and February 2023.
Results
We analyzed 100 liquid biopsy videos, with median (IQR) views per video of 190 (75-719). Video speakers lacked diversity, with 82 (65.6%) perceived as male and 39 (31.2%) as female and 98 (78.4%) as non-Hispanic White (Table 1). These videos were complex and of low quality. Only 9.0% of videos were understandable (PEMAT score: ≥70%), and 8.0% presented moderate to high quality health information (DISCERN score: 3-5).
We reviewed 100 web pages about liquid biopsies, of which none had reading levels of sixth grade or lower, as recommended by medical society guidelines^2^ (Table 2). Median (IQR) Flesch-Kincaid Grade Level, Gunning Fog Index, and SMOG Index readability scores were 14.1 (12.1-15.8), 16.4 (14.4-18.6), and 15.9 (13.9-16.9), respectively, which are equivalent to college-level education. Web pages rarely promoted accessibility through visual aids (20.0%) or multiple languages (5.0%). Sixty-one percent of web pages had commercial biases, and less than half included author names (42%), citations (29%), and mentions of indications (36%) or limitations (35%) of liquid biopsies.
Discussion
We found that liquid biopsy videos and web pages had extensive shortcomings as sources of patient health information. Consistent with previous research assessing cancer-related online materials,^2^ most patients need help understanding online content about liquid biopsies and may be more confused after searching online. Health literacy plays an important role in patient experiences and outcomes. Patients with cancer often report knowledge gaps about their care and may be unable to clarify their concerns with clinicians, necessitating accessible resources to make informed decisions.^6^ It is crucial that patients understand emerging technologies, such as liquid biopsies, as their potential benefits, costs, and unintended adverse effects are being discovered.^1^
Study limitations include lack of longitudinal evaluation of available information, exclusion of lengthy and non–English language content, lack of blinding of reviewers to the study’s purpose, and potential reviewers’ biased perceptions of speaker demographics (vs self-identification). With increasing propagation of medical misinformation online, efforts must be made to ensure that unbiased, high-quality information about novel diagnostic technologies and treatments is understandable and easily accessible to patients and caregivers.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Carr DJ, Welch HG. Assessing the clinical utility of liquid biopsies across 5 potential indications from therapy selection to population screening: a review. JAMA Intern Med. 2023;183(10):1144-1151. doi:10.1001/jamainternmed.2023.3603 37639262 · doi ↗ · pubmed ↗
- 2Li JZH, Kong T, Killow V, . Quality assessment of online resources for the most common cancers. J Cancer Educ. 2023;38(1):34-41. doi:10.1007/s 13187-021-02075-2 34365589 · doi ↗ · pubmed ↗
- 3Shoemaker SJ, Wolf MS, Brach C. Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. Patient Educ Couns. 2014;96(3):395-403. doi:10.1016/j.pec.2014.05.027 24973195 PMC 5085258 · doi ↗ · pubmed ↗
- 4DISCERN. Background. Accessed February 8, 2023. http://www.discern.org.uk/background_to_discern.php
- 5Friedman DB, Hoffman-Goetz L. A systematic review of readability and comprehension instruments used for print and web-based cancer information. Health Educ Behav. 2006;33(3):352-373. doi:10.1177/1090198105277329 16699125 · doi ↗ · pubmed ↗
- 6Koay K, Schofield P, Jefford M. Importance of health literacy in oncology. Asia Pac J Clin Oncol. 2012;8(1):14-23. doi:10.1111/j.1743-7563.2012.01522.x 22369440 · doi ↗ · pubmed ↗
