Quantifying biases in test-negative studies of vaccine effectiveness

Lewnard, J. A.; Tedijanto, C. A.; Cowling, B. J.; Lipsitch, M.

doi:10.1101/237503

Home/Archive/bioRxiv

bioRxiv · 10.1101/237503

Quantifying biases in test-negative studies of vaccine effectiveness

Lewnard, J. A.·Tedijanto, C. A.·Cowling, B. J.·Lipsitch, M.

View original source ↗Export metadata ↓

Abstract

Test-negative designs have become commonplace in assessments of seasonal influenza vaccine effectiveness. Vaccine effectiveness is measured from the exposure odds ratio (OR) of vaccination among individuals seeking treatment for acute respiratory illness and receiving a laboratory test for influenza infection. This approach is widely believed to correct for differential healthcare-seeking behavior among vaccinated and unvaccinated persons. However, the relation of the measured OR to true vaccine effectiveness is poorly understood. We derive the OR under circumstances of real-world test-negative studies. The OR recovers the true vaccine direct effect when two conditions are met: (1) that individuals vaccination decisions are uncorrelated with exposure or susceptibility to infection, and (2) that vaccination confers \"all-or-nothing\" protection (whereby certain individuals have no protection while others are perfectly protected). Biased effect size estimates arise if either condition is unmet. Such bias may suggest misleading associations of the OR with time since vaccination or the force of infection of influenza. The test-negative design may also fail to correct for differential healthcare-seeking behavior among vaccinated and unvaccinated persons without stringent criteria for enrollment and testing. Our findings demonstrate a need to reassess how data from test-negative studies are interpreted for policy decisions conventionally based on causal inferences.

Source connections

Published article ↗

Explore related subjects

epidemiology Preprint

Keep this discovery

BibTeX RIS

Lewnard, J. A., Tedijanto, C. A., Cowling, B. J., Lipsitch, M.. 2017-12-22. Quantifying biases in test-negative studies of vaccine effectiveness. https://doi.org/10.1101/237503

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2018

Translating surveillance data into incidence estimates

Monitoring a population for a disease requires the hosts to be sampled and tested for the pathogen. This results in sampling series from which to estimate the disease incidence, i.e. the proportion of hosts infected. Existing estimation methods assume that disease incidence is not changing between monitoring rounds, resulting in underestimation of the disease incidence. In this paper we develop an incidence estimation model accounting for epidemic growth with monitoring rounds sampling varying incidence. We also show how to accommodate the asymptomatic period characteristic to most diseases. For practical use, we produce an approximation of the model, which is subsequently shown accurate for relevant epidemic and sampling parameters. Both the approximation and the full model are applied to stochastic spatial simulations of epidemics. The results prove their consistency for a very wide range of situations.

epidemiology↗

bioRxiv2018

The Swiss Primary Ciliary Dyskinesia registry: objectives, methods and first results

Primary Ciliary Dyskinesia (PCD) is a rare hereditary, multi-organ disease caused by defects in ciliary structure and function. It results in a wide range of clinical manifestations, most commonly in the upper and lower airways. Central data collection in national and international registries is essential to studying the epidemiology of rare diseases and filling in gaps in knowledge of diseases such as PCD. For this reason, the Swiss Primary Ciliary Dyskinesia Registry (CH-PCD) was founded in 2013 as a collaborative project between epidemiologists and adult and paediatric pulmonologists.\n\nThe registry records patients of any age, suffering from PCD, who are treated and resident in Switzerland. It collects information from patients identified through physicians, diagnostic facilities, and patient organisations. The registry dataset contains data on diagnostic evaluations, lung function, microbiology and imaging, symptoms, treatments, and hospitalizations.\n\nBy May 2018, CH-PCD has contacted 566 physicians of different specialties and identified 134 patients with PCD. At present this number represents an overall 1 in 63,000 prevalence of people diagnosed with PCD in Switzerland. Prevalence differs by age and region; it is highest in children and adults younger than 30 years, and in Espace Mittelland. The median age of patients in the registry is 25 years (range 5-73), and 49 patients have a definite PCD diagnosis based on recent international guidelines. Data from CH-PCD are contributed to international collaborative studies and the registry facilitates patient identification for nested studies.\n\nCH-PCD has proven to be a valuable research tool that already has highlighted weaknesses in PCD clinical practice in Switzerland. Development of centralised diagnostic and management centres and adherence to international guidelines are needed to improve diagnosis and management--particularly for adult PCD patients.

epidemiology↗

bioRxiv2018

Perfect Counterfactuals for Epidemic Simulations

Simulation studies are often used to predict the expected impact of control measures in infectious disease outbreaks. Typically, two independent sets of simulations are conducted, one with the intervetnion, and one without, and epidemic sizes (or some related metric) are compared to estimate the effect of the intervention. Since it is possible that controlled epidemics are larger than uncontrolled ones if there is substantial stochastic variation between epidemics, uncertainty intervals from this approach can include a negative effect even for an effective intervention. To more precisely estimate the number of cases an intervention will prevent within a single epidemic, here we develop a single world approach to matching simulations of controlled epidemics to their exact uncontrolled counterfac-tual. Our method borrows concepts from percolation approaches prune out possible epidemic histories and create potential epidemic graph that can be realized to create perfectly matched controlled and uncontrolled epidemics. We present an implementation of this method for a common class of compartmental models, and its application in a simple SIR model. Results illustrate how, at the cost of some computation time, this method substantially narrows confidence intervals and avoids non-sensical inferences.

epidemiology↗