SARS-CoV-2 infection typically starts in the upper respiratory tract, and specifically the nasal respiratory epithelium. Entry via the eyes and gastrointestinal tract is possible, but less common, and entry via other routes is rare. Infection may progress to the lower respiratory tract, other tissues, and the nervous and cardiovascular systems. The primary initial route for entry into the central nervous system is thought to be the olfactory nerve in the nasal cavity2. Progression may lead to cytokine storm, pneumonia, ARDS, neurological injury3-19 and cognitive deficits6,11, cardiovascular complications20-26, DNA damage27-30, organ failure, and death. Even mild untreated infections may result in persistent cognitive deficits31—the spike protein binds to fibrin leading to fibrinolysis-resistant blood clots, thromboinflammation, and neuropathology. Systemic treatments may be insufficient to prevent neurological damage10. Minimizing replication as early as possible is recommended.

Logically, stopping replication in the upper respiratory tract should be simpler and more effective. Wu et al., using an airway organoid model incorporating many in vivo aspects, show that SARS-CoV-2 initially attaches to cilia—hair-like structures responsible for moving the mucus layer and where ACE2 is localized in nasal epithelial cells34. The mucus layer and the need for ciliary transport slow down infection, providing more time for localized treatments32,33. Early or prophylactic nasopharyngeal/oropharyngeal treatment may avoid the consequences of viral replication in other tissues, and avoid the requirement for systemic treatments with greater potential for side effects.

SARS-CoV-2 infection and replication involves the complex interplay of 500+ host and viral proteins and other factorsA,35-42, providing many therapeutic targets for which many existing compounds have known activity. Scientists have predicted that over 12,000 compounds may reduce COVID-19 risk43, either by directly minimizing infection or replication, by supporting immune system function, or by minimizing secondary complications.

We analyze all COVID-19 early treatment and prophylaxis studies using direct administration to the upper respiratory tract via nasal or oral sprays, rinses, or drops with one of the treatments we cover. This analysis is intended to show an overview of studies using respiratory tract administration, to compare nasal vs. oral administration, and to compare mono vs. polytherapy. Other papers analyze each treatment individually. Search methods, inclusion criteria, effect extraction criteria (more serious outcomes have priority), all individual study data, PRISMA details, and statistical methods are detailed in Appendix 1.

Fig. 4 shows stages of possible treatment for COVID-19. Prophylaxis refers to regularly taking medication before becoming sick, in order to prevent or minimize infection. Early treatment refers to treatment immediately or soon after symptoms appear, while late treatment refers to more delayed treatment.

RCTs help to make study groups more similar and can provide a higher level of evidence, however they are subject to many biases51, and analysis of double-blind RCTs has identified extreme levels of bias52. For COVID-19, the overhead may delay treatment, dramatically compromising efficacy; they may encourage monotherapy for simplicity at the cost of efficacy which may rely on combined or synergistic effects; the participants that sign up may not reflect real world usage or the population that benefits most in terms of age, comorbidities, severity of illness, or other factors; standard of care may be compromised and unable to evolve quickly based on emerging research for new diseases; errors may be made in randomization and medication delivery; and investigators may have hidden agendas or vested interests influencing design, operation, analysis, reporting, and the potential for fraud. All of these biases have been observed with COVID-19 RCTs. There is no guarantee that a specific RCT provides a higher level of evidence.

RCTs are expensive and many RCTs are funded by pharmaceutical companies or other organizations with conflicts of interest, for example governments that previously denied treatment with the study drug. For COVID-19, this creates an incentive to show efficacy for patented commercial products, and an incentive to show a lack of efficacy for inexpensive treatments. The bias is expected to be significant, for example Als-Nielsen et al. analyzed 370 RCTs from Cochrane reviews, showing that trials funded by for-profit organizations were 5 times more likely to recommend the experimental drug compared with those funded by nonprofit organizations. Bekelman et al. and Lundh et al. show that industry-sponsored studies are more likely to be favorable. For COVID-19, some major philanthropic organizations are largely funded by investments with extreme conflicts of interest for and against specific COVID-19 interventions.

High quality RCTs for novel acute diseases are more challenging, with increased ethical issues due to the urgency of treatment, increased risk due to enrollment delays, and more difficult design with a rapidly evolving evidence base. For COVID-19, the most common site of initial infection is the upper respiratory tract. Immediate treatment is likely to be most successful and may prevent or slow progression to other parts of the body. For a non-prophylaxis RCT, it makes sense to provide treatment in advance and instruct patients to use it immediately on symptoms, just as some governments have done by providing medication kits in advance. Unfortunately, no RCTs have been done in this way. Every treatment RCT to date involves delayed treatment. Among the 227 treatments we have analyzed, 67% of RCTs involve very late treatment 5+ days after onset. No non-prophylaxis COVID-19 RCTs match the potential real-world use of early treatments. They may more accurately represent results for treatments that require visiting a medical facility, e.g., those requiring intravenous administration.

Evidence shows that observational studies can also provide reliable results. Concato et al. found that well-designed observational studies do not systematically overestimate the magnitude of the effects of treatment compared to RCTs. Anglemyer et al. analyzed reviews comparing RCTs to observational studies and found little evidence for significant differences in effect estimates.

We performed a similar analysis across the 227 treatments we cover, showing no significant difference in the results of RCTs compared to observational studies, RR 0.97 [0.91‑1.03]48. Similar results are found for all low-cost treatments, RR 0.98 [0.90‑1.06]. High-cost treatments show a non-significant trend towards RCTs showing greater efficacy, RR 0.92 [0.84‑1.02]. Details can be found in the supplementary data.

Lee (B) et al. showed that only 14% of the guidelines of the Infectious Diseases Society of America were based on RCTs. Evaluation of studies relies on an understanding of the study and potential biases. Limitations in an RCT can outweigh the benefits, for example excessive dosages, excessive treatment delays, or remote survey bias may have a greater effect on results. Ethical issues may also prevent running RCTs for known effective treatments. For more on issues with RCTs see60,61.

Concato et al. report a paradoxical finding—RCT results had higher variability, and only RCTs were found to sometimes report significant results the opposite of the overall result. The same trend is seen for the most popular (most politicized) COVID-19 treatments—considering all statistically significant results reported in studies, RCTs are slightly more likely to report a result in the opposite direction. In other words, for these COVID-19 treatments and for the topics covered by Concato et al., assuming causality from a single study is more likely to result in an incorrect conclusion for RCTs.

Increased risk of inconsistent results for RCTs suggests higher prevalence of bias, which may arise due to many issues including design bias, conflicts of interest, treatment differences by physicians aware of allocation, attrition bias, ascertainment bias, randomization failures, errors, or fraud.

Currently, 59 of the treatments we analyze show statistically significant efficacy or harm, defined as ≥10% decreased risk or >0% increased risk from ≥3 studies. Of these, 54% have been confirmed in RCTs, with a mean delay of 7.8 months (62% with 8.7 months delay for low-cost treatments). The remaining treatments either have no RCTs, or the point estimate is consistent.

Neither observational studies nor RCTs prove causation—any study can be flawed or fraudulent. We need much more, for example a combination of results from many independent teams, detailed understanding of each study, knowledge of conflicts/team reliability, dose-response relationships, delay-response relationships, logical results across outcomes, or details consistent with preclinical expectations.

All studies must be evaluated individually. RCTs for a given medication and disease may be more reliable, however they may also be less reliable. For off-patent medications, very high conflict of interest trials may be more likely to be RCTs, and more likely to be large trials that dominate meta-analyses.