Proton Pump Inhibitors increase COVID-19 risk: real-time meta analysis of 39 studies

Studies have shown increased risk with proton pump inhibitors for serious infections9, spontaneous bacterial peritonitis10, C. diff infection11,12, bacterial infections13, and influenza14.

We analyze all significant controlled studies of Proton Pump Inhibitors for COVID-19. Search methods, inclusion criteria, effect extraction criteria (more serious outcomes have priority), all individual study data, PRISMA answers, and statistical methods are detailed in Appendix 1. We present random effects meta-analysis results for all studies, studies within each treatment stage, individual outcomes, peer-reviewed studies, and higher quality studies.

Figure 2 shows stages of possible treatment for COVID-19. Prophylaxis refers to regularly taking medication before becoming sick, in order to prevent or minimize infection. Early Treatment refers to treatment immediately or soon after symptoms appear, while Late Treatment refers to more delayed treatment.

The time between infection or the onset of symptoms and treatment may critically affect how well a treatment works. For example an antiviral may be very effective when used early but may not be effective in late stage disease, and may even be harmful. Oseltamivir, for example, is generally only considered effective for influenza when used within 0-36 or 0-48 hours20,21. Baloxavir marboxil studies for influenza also show that treatment delay is critical — Ikematsu et al. report an 86% reduction in cases for post-exposure prophylaxis, Hayden et al. show a 33 hour reduction in the time to alleviation of symptoms for treatment within 24 hours and a reduction of 13 hours for treatment within 24-48 hours, and Kumar et al. report only 2.5 hours improvement for inpatient treatment.

Figure 15 shows a mixed-effects meta-regression for efficacy as a function of treatment delay in COVID-19 studies from 112 treatments, showing that efficacy declines rapidly with treatment delay. Early treatment is critical for COVID-19.

Details of the patient population including age and comorbidities may critically affect how well a treatment works. For example, many COVID-19 studies with relatively young low-comorbidity patients show all patients recovering quickly with or without treatment. In such cases, there is little room for an effective treatment to improve results, for example as in López-Medina et al.

Efficacy may depend critically on the distribution of SARS-CoV-2 variants encountered by patients. Risk varies significantly across variants26, for example the Gamma variant shows significantly different characteristics27-30. Different mechanisms of action may be more or less effective depending on variants, for example the degree to which TMPRSS2 contributes to viral entry can differ across variants31,32.

Effectiveness may depend strongly on the dosage and treatment regimen.

The quality of medications may vary significantly between manufacturers and production batches, which may significantly affect efficacy and safety. Williams et al. analyze ivermectin from 11 different sources, showing highly variable antiparasitic efficacy across different manufacturers. Xu (B) et al. analyze a treatment from two different manufacturers, showing 9 different impurities, with significantly different concentrations for each manufacturer.

The use of other treatments may significantly affect outcomes, including supplements, other medications, or other interventions such as prone positioning. Treatments may be synergistic35-46, therefore efficacy may depend strongly on combined treatments.

Across all studies there is a strong association between different outcomes, for example improved recovery is strongly associated with lower mortality. However, efficacy may differ depending on the effect measured, for example a treatment may be more effective against secondary complications and have minimal effect on viral clearance.

The distribution of studies will alter the outcome of a meta analysis. Consider a simplified example where everything is equal except for the treatment delay, and effectiveness decreases to zero or below with increasing delay. If there are many studies using very late treatment, the outcome may be negative, even though early treatment is very effective. All meta analyses combine heterogeneous studies, varying in population, variants, and potentially all factors above, and therefore may obscure efficacy by including studies where treatment is less effective. Generally, we expect the estimated effect size from meta analysis to be less than that for the optimal case. Looking at all studies is valuable for providing an overview of all research, important to avoid cherry-picking, and informative when a positive result is found despite combining less-optimal situations. However, the resulting estimate does not apply to specific cases such as early treatment in high-risk populations. While we present results for all studies, we also present treatment time and individual outcome analyses, which may be more informative for specific use cases.

This section validates the use of pooled effects for COVID-19, which enables earlier detection of harm, however pooled effects are no longer required for proton pump inhibitors as of August 2021. Harm is now known based on specific outcomes. Harm based on specific outcomes was delayed by 11.1 months compared to using pooled outcomes.

For COVID-19, delay in clinical results translates into additional death and morbidity, as well as additional economic and societal damage. Combining the results of studies reporting different outcomes is required. There may be no mortality in a trial with low-risk patients, however a reduction in severity or improved viral clearance may translate into lower mortality in a high-risk population. Different studies may report lower severity, improved recovery, and lower mortality, and the significance may be very high when combining the results. "The studies reported different outcomes" is not a good reason for disregarding results. Pooling the results of studies reporting different outcomes allows us to use more of the available information. Logically we should, and do, use additional information when evaluating treatments—for example dose-response and treatment delay-response relationships provide additional evidence of efficacy that is considered when reviewing the evidence for a treatment.

We present both specific outcome and pooled analyses. In order to combine the results of studies reporting different outcomes we use the most serious outcome reported in each study, based on the thesis that improvement in the most serious outcome provides comparable measures of efficacy for a treatment. A critical advantage of this approach is simplicity and transparency. There are many other ways to combine evidence for different outcomes, along with additional evidence such as dose-response relationships, however these increase complexity.

Trials with high-risk patients may be restricted due to ethics for treatments that are known or expected to be effective, and they increase difficulty for recruiting. Using less severe outcomes as a proxy for more serious outcomes allows faster and safer collection of evidence.

For many COVID-19 treatments, a reduction in mortality logically follows from a reduction in hospitalization, which follows from a reduction in symptomatic cases, which follows from a reduction in PCR positivity. We can directly test this for COVID-19.

Analysis of the the association between different outcomes across studies from all 112 treatments we cover confirms the validity of pooled outcome analysis for COVID-19. Figure 16 shows that lower hospitalization is very strongly associated with lower mortality (p < 0.000000000001). Similarly, Figure 17 shows that improved recovery is very strongly associated with lower mortality (p < 0.000000000001). Considering the extremes, Singh et al. show an association between viral clearance and hospitalization or death, with p = 0.003 after excluding one large outlier from a mutagenic treatment, and based on 44 RCTs including 52,384 patients. Figure 18 shows that improved viral clearance is strongly associated with fewer serious outcomes. The association is very similar to Singh et al., with higher confidence due to the larger number of studies. As with Singh et al., the confidence increases when excluding the outlier treatment, from p = 0.00000032 to p = 0.000000011.

Currently, 48 of the treatments we analyze show statistically significant efficacy or harm, defined as ≥10% decreased risk or >0% increased risk from ≥3 studies. 89% of these have been confirmed with one or more specific outcomes, with a mean delay of 5.0 months. When restricting to RCTs only, 56% of treatments showing statistically significant efficacy/harm with pooled effects have been confirmed with one or more specific outcomes, with a mean delay of 6.4 months. Figure 19 shows when treatments were found effective during the pandemic. Pooled outcomes often resulted in earlier detection of efficacy.

Pooled analysis could hide efficacy, for example a treatment that is beneficial for late stage patients but has no effect on viral clearance may show no efficacy if most studies only examine viral clearance. In practice, it is rare for a non-antiviral treatment to report viral clearance and to not report clinical outcomes; and in practice other sources of heterogeneity such as difference in treatment delay is more likely to hide efficacy.

Analysis validates the use of pooled effects and shows significantly faster detection of efficacy on average. However, as with all meta analyses, it is important to review the different studies included. We also present individual outcome analyses, which may be more informative for specific use cases.

Studies have also shown increased risk with proton pump inhibitors for serious infections9, spontaneous bacterial peritonitis10, C. diff infection11,12, bacterial infections13, and influenza14.

Publishing is often biased towards positive results, however evidence suggests that there may be a negative bias for inexpensive treatments for COVID-19. Both negative and positive results are very important for COVID-19, media in many countries prioritizes negative results for inexpensive treatments (inverting the typical incentive for scientists that value media recognition), and there are many reports of difficulty publishing positive results48-51. For proton pump inhibitor, there is currently not enough data to evaluate publication bias with high confidence.

Funnel plots have traditionally been used for analyzing publication bias. This is invalid for COVID-19 acute treatment trials — the underlying assumptions are invalid, which we can demonstrate with a simple example. Consider a set of hypothetical perfect trials with no bias. Figure 20 plot A shows a funnel plot for a simulation of 80 perfect trials, with random group sizes, and each patient's outcome randomly sampled (10% control event probability, and a 30% effect size for treatment). Analysis shows no asymmetry (p > 0.05). In plot B, we add a single typical variation in COVID-19 treatment trials — treatment delay. Consider that efficacy varies from 90% for treatment within 24 hours, reducing to 10% when treatment is delayed 3 days. In plot B, each trial's treatment delay is randomly selected. Analysis now shows highly significant asymmetry, p < 0.0001, with six variants of Egger's test all showing p < 0.0552-59. Note that these tests fail even though treatment delay is uniformly distributed. In reality treatment delay is more complex — each trial has a different distribution of delays across patients, and the distribution across trials may be biased (e.g., late treatment trials may be more common). Similarly, many other variations in trials may produce asymmetry, including dose, administration, duration of treatment, differences in SOC, comorbidities, age, variants, and bias in design, implementation, analysis, and reporting.

Pharmaceutical drug trials often have conflicts of interest whereby sponsors or trial staff have a financial interest in the outcome being positive. PPI for COVID-19 lack this because they are generally inexpensive and widely available.

Summary statistics from meta analysis necessarily lose information. As with all meta analyses, studies are heterogeneous, with differences in treatment delay, treatment regimen, patient demographics, variants, conflicts of interest, standard of care, and other factors. We provide analyses for specific outcomes and by treatment delay, and we aim to identify key characteristics in the forest plots and summaries. Results should be viewed in the context of study characteristics.

Some analyses classify treatment based on early or late administration, as done here, while others distinguish between mild, moderate, and severe cases. Viral load does not indicate degree of symptoms — for example patients may have a high viral load while being asymptomatic. With regard to treatments that have antiviral properties, timing of treatment is critical — late administration may be less helpful regardless of severity.

Details of treatment delay per patient is often not available. For example, a study may treat 90% of patients relatively early, but the events driving the outcome may come from 10% of patients treated very late. Our 5 day cutoff for early treatment may be too conservative, 5 days may be too late in many cases.

Comparison across treatments is confounded by differences in the studies performed, for example dose, variants, and conflicts of interest. Trials with conflicts of interest may use designs better suited to the preferred outcome.

In some cases, the most serious outcome has very few events, resulting in lower confidence results being used in pooled analysis, however the method is simpler and more transparent. This is less critical as the number of studies increases. Restriction to outcomes with sufficient power may be beneficial in pooled analysis and improve accuracy when there are few studies, however we maintain our pre-specified method to avoid any retrospective changes.

Studies show that combinations of treatments can be highly synergistic and may result in many times greater efficacy than individual treatments alone35-46. Therefore standard of care may be critical and benefits may diminish or disappear if standard of care does not include certain treatments.

This real-time analysis is constantly updated based on submissions. Accuracy benefits from widespread review and submission of updates and corrections from reviewers. Less popular treatments may receive fewer reviews.

No treatment or intervention is 100% available and effective for all current and future variants. Efficacy may vary significantly with different variants and within different populations. All treatments have potential side effects. Propensity to experience side effects may be predicted in advance by qualified physicians. We do not provide medical advice. Before taking any medication, consult a qualified physician who can compare all options, provide personalized advice, and provide details of risks and benefits based on individual medical history and situations.

8 other meta analyses show significant harm with proton pump inhibitors for mortality1-3, severity1,2,4-8, and cases2.

SARS-CoV-2 infection and replication involves a complex interplay of 50+ host and viral proteins and other factors60-66, providing many therapeutic targets. Over 8,000 compounds have been predicted to reduce COVID-19 risk67, either by directly minimizing infection or replication, by supporting immune system function, or by minimizing secondary complications. Figure 21 shows an overview of the results for proton pump inhibitors in the context of multiple COVID-19 treatments, and Figure 22 shows a plot of efficacy vs. cost for COVID-19 treatments.