Artemisinin reduces COVID-19 risk: real-time meta analysis of 3 studies
Abstract
Significantly lower risk is seen for recovery. One study shows significant benefit.
Meta analysis using the most serious outcome reported shows
34% [11‑51%] lower risk. Results are similar for peer-reviewed studies and better for Randomized Controlled Trials.
Results are consistent with early treatment being more effective than late treatment.
Currently there is limited data, with only 217 patients and only 9 control events for the most serious outcome in trials to date. Studies to date are from only 3 different groups.
No treatment is 100%
effective. Protocols combine safe and effective options with individual
risk/benefit analysis and monitoring.
Other treatments are more effective.
All data and sources to reproduce this analysis are in the appendix.
Artemisinin for COVID-19 — Highlights
Artemisinin reduces
risk with very high confidence for recovery and in pooled analysis, and very low confidence for hospitalization.
41st treatment shown effective in
November 2022, now with p = 0.0066 from 3 studies, recognized in 13 countries.
Real-time updates
and corrections with a consistent protocol for 117 treatments. Outcome specific analysis and combined evidence from all
studies including treatment delay, a primary confounding factor.
Figure 1.
A. Random effects
meta-analysis. This plot shows pooled effects,
see the specific outcome analyses for individual outcomes.
Analysis validating pooled outcomes for
COVID-19 can be found below.
Effect extraction is pre-specified, using the most serious outcome reported.
For details see the appendix.
B. Timeline of results in artemisinin studies. The marked date indicates the time when efficacy was known with a statistically significant improvement of ≥10% from ≥3 studies for pooled outcomes.
SARS-CoV-2 infection primarily begins in the upper respiratory
tract and may progress to the lower respiratory tract, other tissues, and the
nervous and cardiovascular systems, which may lead to cytokine storm,
pneumonia, ARDS, neurological injury3-15 and
cognitive deficits6,11, cardiovascular
complications16-19, organ failure, and death.
Minimizing replication as early as possible is recommended.
SARS-CoV-2 infection and replication involves the complex interplay of 50+
host and viral proteins and other factorsA,20-26, providing many
therapeutic targets for which many existing compounds have known activity.
Scientists have predicted that over 8,000 compounds may
reduce COVID-19 risk27, either by
directly minimizing infection or replication, by supporting immune system
function, or by minimizing secondary complications.
We analyze all significant
controlled studies of
artemisinin
for COVID-19.
Search methods, inclusion criteria, effect extraction criteria (more serious
outcomes have priority), all individual study data, PRISMA answers, and
statistical methods are detailed in Appendix 1. We present random
effects meta-analysis results for all studies, studies within each treatment stage, individual outcomes, peer-reviewed studies, and Randomized Controlled Trials (RCTs).
Figure 2 shows stages of possible treatment for
COVID-19. Prophylaxis refers to regularly taking medication before
becoming sick, in order to prevent or minimize infection. Early
Treatment refers to treatment immediately or soon after symptoms appear,
while Late Treatment refers to more delayed treatment.
Figure 2. Treatment stages.
An In Vitro study supports the efficacy of artemisinin30.
An In Vivo animal study supports the efficacy of artemisinin30.
Preclinical research is an important part of the development of
treatments, however results may be very different in clinical trials.
Preclinical results are not used in this paper.
Table 1 summarizes the results for all stages combined, for Randomized Controlled Trials, for peer-reviewed studies, and for specific outcomes.
Table 2 shows results by treatment stage.
Figure 3 plots individual results by treatment stage.
Figure 4, 5, 6, 7, 8, and 9
show forest plots for random effects meta-analysis of
all studies with pooled effects, hospitalization, progression, recovery, viral clearance, and peer reviewed studies.
| Improvement | Studies | Patients | Authors | |
|---|---|---|---|---|
| All studies | 34% [11‑51%] ** | 3 | 217 | 32 |
| Peer-reviewed studiesPeer-reviewed | 30% [4‑50%] * | 2 | 157 | 25 |
| Randomized Controlled TrialsRCTs | 47% [-14‑76%] | 2 | 174 | 23 |
| HospitalizationHosp. | 8% [-5‑20%] | 2 | 157 | 25 |
| Recovery | 32% [14‑46%] ** | 3 | 181 | 32 |
| Viral | 12% [-24‑37%] | 2 | 119 | 25 |
| Early treatment | Late treatment | |
|---|---|---|
| All studies | 47% [-14‑76%] | 31% [5‑50%] * |
| Peer-reviewed studiesPeer-reviewed | -152% [-5946‑89%] | 31% [5‑50%] * |
| Randomized Controlled TrialsRCTs | 47% [-14‑76%] | |
| HospitalizationHosp. | -152% [-5946‑89%] | 8% [-5‑20%] |
| Recovery | 32% [5‑51%] * | 31% [5‑50%] * |
| Viral | -1% [-8‑5%] | 29% [-1‑50%] |
Figure 3. Scatter plot showing the most serious outcome in all studies, and for studies within each stage. Diamonds shows the results of random effects meta-analysis.
Loading..
Loading..
Figure 4. Random effects meta-analysis for all studies.
This plot shows pooled effects,
see the specific outcome analyses for individual outcomes.
Analysis validating pooled outcomes for
COVID-19 can be found below.
Effect extraction is pre-specified, using the most serious outcome reported.
For details see the appendix.
Loading..
Figure 5. Random effects meta-analysis for hospitalization.
Loading..
Figure 6. Random effects meta-analysis for progression.
Loading..
Figure 7. Random effects meta-analysis for recovery.
Loading..
Figure 8. Random effects meta-analysis for viral clearance.
Loading..
Figure 9. Random effects meta-analysis for peer reviewed studies.
Effect extraction is pre-specified, using the most serious outcome reported,
see the appendix for details.
Analysis validating pooled outcomes for
COVID-19 can be found below.
Zeraatkar et al. analyze 356 COVID-19 trials, finding no significant
evidence that preprint results are inconsistent with peer-reviewed studies.
They also show extremely long peer-review delays, with a median of 6 months to
journal publication. A six month delay was equivalent to around 1.5 million
deaths during the first two years of the pandemic. Authors recommend using
preprint evidence, with appropriate checks for potential falsified data, which
provides higher certainty much earlier. Davidson et al. also showed no
important difference between meta analysis results of preprints and
peer-reviewed publications for COVID-19, based on 37 meta analyses including
114 trials.
Figure 10 shows a comparison of results for RCTs and non-RCT studies.
Random effects meta analysis of RCTs shows
47% improvement,
compared to 31% for other studies.
Figure 11 shows a forest plot for random
effects meta-analysis of all Randomized Controlled Trials.
RCT results are included in Table 1 and Table 2.
Loading..
Figure 10. Results for RCTs and non-RCT studies.
Loading..
Figure 11. Random effects meta-analysis for all Randomized Controlled Trials.
This plot shows pooled effects,
see the specific outcome analyses for individual outcomes.
Analysis validating pooled outcomes for
COVID-19 can be found below.
Effect extraction is pre-specified, using the most serious outcome reported.
For details see the appendix.
RCTs help to make study groups more similar and can provide a higher level of
evidence, however they are subject to many biases34, and
analysis of double-blind RCTs has identified extreme levels of bias35.
For COVID-19, the overhead may delay treatment, dramatically compromising
efficacy; they may encourage monotherapy for simplicity at the cost of
efficacy which may rely on combined or synergistic effects; the participants
that sign up may not reflect real world usage or the population that benefits
most in terms of age, comorbidities, severity of illness, or other factors;
standard of care may be compromised and unable to evolve quickly based on
emerging research for new diseases; errors may be made in randomization and
medication delivery; and investigators may have hidden agendas or vested
interests influencing design, operation, analysis, reporting, and the
potential for fraud. All of these biases have been observed with COVID-19
RCTs. There is no guarantee that a specific RCT provides a higher level of
evidence.
RCTs are expensive and many RCTs are funded
by pharmaceutical companies or interests closely aligned with pharmaceutical
companies. For COVID-19, this creates an incentive to show efficacy for
patented commercial products, and an incentive to show a lack of efficacy for
inexpensive treatments. The bias is expected to be significant, for example
Als-Nielsen et al. analyzed 370 RCTs from Cochrane reviews, showing that
trials funded by for-profit organizations were 5 times more likely to
recommend the experimental drug compared with those funded by nonprofit
organizations. For COVID-19, some major philanthropic organizations are
largely funded by investments with extreme conflicts of interest for and
against specific COVID-19 interventions.
High quality RCTs for novel acute diseases are more challenging, with
increased ethical issues due to the urgency of treatment, increased risk due
to enrollment delays, and more difficult design with a rapidly evolving
evidence base. For COVID-19, the most common site of initial infection is the
upper respiratory tract. Immediate treatment is likely to be most successful
and may prevent or slow progression to other parts of the body. For a
non-prophylaxis RCT, it makes sense to provide treatment in advance and
instruct patients to use it immediately on symptoms, just as some governments
have done by providing medication kits in advance. Unfortunately, no RCTs have
been done in this way. Every treatment RCT to date involves delayed treatment.
Among the 117 treatments we have analyzed,
65% of RCTs involve very late treatment 5+ days after
onset. No non-prophylaxis COVID-19 RCTs match the potential real-world use of
early treatments. They may more accurately represent results for treatments
that require visiting a medical facility, e.g., those requiring intravenous
administration.
For COVID-19, observational study results do not systematically
differ from RCTs, RR 1.00 [0.93‑1.08]
across 117 treatments37.
Evidence shows that observational studies
can also provide reliable results. Concato et al. found that well-designed
observational studies do not systematically overestimate the magnitude of the
effects of treatment compared to RCTs. Anglemyer et al. analyzed reviews
comparing RCTs to observational studies and found little evidence for
significant differences in effect estimates.
We performed a similar analysis across the 117 treatments
we cover, showing no significant difference in the results of RCTs compared to
observational studies, RR 1.00 [0.93‑1.08]. Similar results are found for all low-cost treatments, RR
1.02 [0.93‑1.13]. High-cost treatments
show a non-significant trend towards RCTs showing greater efficacy,
RR 0.92 [0.82‑1.03].
Details can be found in the
supplementary data.
Lee et al. showed that only 14% of the guidelines of the Infectious
Diseases Society of America were based on RCTs. Evaluation of studies relies
on an understanding of the study and potential biases. Limitations in an RCT
can outweigh the benefits, for example excessive dosages, excessive treatment
delays, or remote survey bias may have a greater effect on results. Ethical
issues may also prevent running RCTs for known effective treatments. For more
on issues with RCTs see41,42.
Currently, 49 of the treatments we analyze show statistically significant efficacy or harm, defined as ≥10% decreased risk or >0% increased risk from ≥3 studies. Of these, 59% have been confirmed in RCTs, with a mean delay of 7.2 months (66% with 8.3 months delay for low-cost treatments). The remaining treatments either have no RCTs, or the point estimate is consistent.
We need to evaluate each trial on its own merits. RCTs for a
given medication and disease may be more reliable, however they may also be
less reliable. For off-patent medications, very high conflict of interest
trials may be more likely to be RCTs, and more likely to be large trials that
dominate meta analyses.
Heterogeneity in COVID-19 studies arises from many factors including:
The time between infection or the onset of symptoms and
treatment may critically affect how well a treatment works. For example an
antiviral may be very effective when used early but may not be effective in
late stage disease, and may even be harmful. Oseltamivir, for example, is
generally only considered effective for influenza when used within 0-36 or
0-48 hours43,44. Baloxavir marboxil studies for influenza
also show that treatment delay is critical — Ikematsu et al. report
an 86% reduction in cases for post-exposure prophylaxis, Hayden et al.
show a 33 hour reduction in the time to alleviation of symptoms for treatment
within 24 hours and a reduction of 13 hours for treatment within 24-48 hours,
and Kumar et al. report only 2.5 hours improvement for inpatient
treatment.
| Treatment delay | Result |
| Post-exposure prophylaxis | 86% fewer cases45 |
| <24 hours | -33 hours symptoms46 |
| 24-48 hours | -13 hours symptoms46 |
| Inpatients | -2.5 hours to improvement47 |
Figure 12 shows a mixed-effects meta-regression for efficacy
as a function of treatment delay in COVID-19 studies from 117 treatments, showing
that efficacy declines rapidly with treatment delay. Early treatment is
critical for COVID-19.
Loading..
Figure 12. Early treatment is more effective. Meta-regression showing efficacy as a function of treatment delay in COVID-19 studies from 117 treatments.
Details of the patient population including age and comorbidities may
critically affect how well a treatment works. For example, many COVID-19
studies with relatively young low-comorbidity patients show all patients
recovering quickly with or without treatment. In such cases, there is little
room for an effective treatment to improve results, for example as in
López-Medina et al.
Efficacy may depend critically on the distribution of
SARS-CoV-2 variants encountered by patients. Risk varies significantly across
variants49, for example the Gamma variant shows significantly
different characteristics50-53. Different
mechanisms of action may be more or less effective depending on variants, for
example the degree to which TMPRSS2 contributes to viral entry can differ
across variants54,55.
Effectiveness may depend strongly on the dosage and treatment regimen.
The quality of medications may vary significantly between
manufacturers and production batches, which may significantly affect efficacy
and safety. Williams et al. analyze ivermectin from 11 different sources,
showing highly variable antiparasitic efficacy across different manufacturers.
Xu et al. analyze a treatment from two different manufacturers, showing 9
different impurities, with significantly different concentrations for each
manufacturer.
Across all
studies there is a strong association between different outcomes, for example
improved recovery is strongly associated with lower mortality. However,
efficacy may differ depending on the effect measured, for example a treatment
may be more effective against secondary complications and have minimal effect
on viral clearance.
The
distribution of studies will alter the outcome of a meta analysis. Consider a
simplified example where everything is equal except for the treatment delay,
and effectiveness decreases to zero or below with increasing delay. If there
are many studies using very late treatment, the outcome may be negative, even
though early treatment is very effective.
All meta analyses combine heterogeneous studies, varying in population,
variants, and potentially all factors above, and therefore may obscure
efficacy by including studies where treatment is less effective. Generally, we
expect the estimated effect size from meta analysis to be less than that for
the optimal case.
Looking at all studies is valuable for providing an overview of all research,
important to avoid cherry-picking, and informative when a positive result is
found despite combining less-optimal situations. However, the resulting
estimate does not apply to specific cases such as
early treatment in high-risk populations.
While we present results for all studies, we also present treatment time and
individual outcome analyses, which may be more informative for specific use
cases.
For COVID-19, delay in clinical results translates into
additional death and morbidity, as well as additional economic and societal
damage. Combining the results of studies reporting different outcomes is
required.
There may be no mortality in a trial with low-risk patients,
however a reduction in severity or improved viral clearance may translate
into lower mortality in a high-risk population.
Different studies may report lower severity, improved recovery, and lower mortality,
and the significance may be very high when combining the results.
"The studies reported different outcomes" is not a good reason for
disregarding results.
Pooling the results of studies reporting different outcomes allows us to use
more of the available information. Logically we should, and do, use additional
information when evaluating treatments—for example dose-response and
treatment delay-response relationships provide additional evidence of efficacy
that is considered when reviewing the evidence for a treatment.
We present both specific outcome and pooled analyses.
In order to combine the results of studies reporting different outcomes we use
the most serious outcome reported in each study, based on the thesis that
improvement in the most serious outcome provides comparable measures of
efficacy for a treatment. A critical advantage of this approach is
simplicity and transparency.
There are many other ways to combine evidence for different outcomes, along
with additional evidence such as dose-response relationships, however these
increase complexity.
Trials with high-risk patients may be restricted due to ethics for treatments
that are known or expected to be effective, and they increase difficulty for
recruiting. Using less severe outcomes as a proxy for more serious outcomes
allows faster and safer collection of evidence.
For many COVID-19 treatments, a reduction in mortality logically
follows from a reduction in hospitalization, which follows from a reduction in
symptomatic cases, which follows from a reduction in PCR positivity. We can
directly test this for COVID-19.
Analysis of the the association between different outcomes across studies from
all 117
treatments we cover confirms the validity of pooled outcome analysis for COVID-19.
Figure 13 shows that lower hospitalization is very strongly associated
with lower mortality (p < 0.000000000001).
Similarly, Figure 14 shows that improved recovery is very strongly associated
with lower mortality (p < 0.000000000001).
Considering the extremes, Singh et al. show an association between viral clearance and
hospitalization or death, with p = 0.003 after excluding one large
outlier from a mutagenic treatment, and based on 44 RCTs including 52,384
patients.
Figure 15 shows that improved viral clearance is strongly associated
with fewer serious outcomes. The association is very similar to
Singh et al., with higher confidence due to the larger number of
studies. As with Singh et al., the confidence increases
when excluding the outlier treatment, from p = 0.00000023 to p = 0.0000000094.
Loading..
Figure 13. Lower hospitalization is associated with lower mortality, supporting pooled outcome analysis.
Loading..
Figure 14. Improved recovery is associated with lower mortality, supporting pooled outcome analysis.
Loading..
Figure 13. Improved viral clearance is associated with fewer serious outcomes, supporting pooled outcome analysis.
Currently, 49 of the treatments we analyze show statistically significant efficacy or harm, defined as ≥10% decreased risk or >0% increased risk from ≥3 studies. 87% of these have been confirmed with one or more specific outcomes, with a mean delay of 4.7 months. When restricting to RCTs only, 56% of treatments showing statistically significant efficacy/harm with pooled effects have been confirmed with one or more specific outcomes, with a mean delay of 7.7 months.
Figure 16 shows when treatments were found effective during the
pandemic. Pooled outcomes often resulted in earlier detection of efficacy.
Loading..
Loading..
Figure 16. The time when studies showed that
treatments were effective, defined as statistically significant improvement of
≥10% from ≥3 studies.
Pooled results typically show efficacy earlier than specific
outcome results. Results from all studies often shows efficacy much earlier
than when restricting to RCTs.
Results reflect conditions as used in trials to date, these depend on the
population treated, treatment delay, and treatment regimen.
Pooled analysis could hide efficacy, for example a treatment that is
beneficial for late stage patients but has no effect on viral clearance may
show no efficacy if most studies only examine viral clearance. In practice, it
is rare for a non-antiviral treatment to report viral clearance and to not
report clinical outcomes; and in practice other sources of heterogeneity such
as difference in treatment delay is more likely to hide efficacy.
Analysis validates the use of pooled effects and shows significantly faster
detection of efficacy on average.
However, as with all meta analyses, it is important to review the different
studies included. We also present individual outcome analyses, which may be
more informative for specific use cases.
Publishing is often biased
towards positive results, however evidence suggests that there may be a negative bias for
inexpensive treatments for COVID-19. Both negative and positive results are
very important for COVID-19, media in many countries prioritizes negative
results for inexpensive treatments (inverting the typical incentive for
scientists that value media recognition), and there are many reports of
difficulty publishing positive results71-74.
For artemisinin, there is currently not
enough data to evaluate publication bias with high confidence.
One method to evaluate bias is to compare prospective vs.
retrospective studies. Prospective studies are more likely to be published
regardless of the result, while retrospective studies are more likely to
exhibit bias. For example, researchers may perform preliminary analysis with
minimal effort and the results may influence their decision to continue.
Retrospective studies also provide more opportunities for the specifics of
data extraction and adjustments to influence results.
Figure 17 shows a scatter plot of
results for prospective and retrospective studies.
100% of retrospective studies
report positive effects, compared to
50% of prospective studies, consistent with a bias toward publishing positive results.
Loading..
Figure 17. Prospective vs. retrospective studies.
The diamonds show the results of random effects meta-analysis.
Pharmaceutical drug
trials often have conflicts of interest whereby sponsors or trial staff have a
financial interest in the outcome being positive. Artemisinin for COVID-19
lacks this because it is off-patent, has multiple manufacturers, and is very low cost.
In contrast, most COVID-19 artemisinin trials have been run by
physicians on the front lines with the primary goal of finding the best
methods to save human lives and minimize the collateral damage caused by
COVID-19. While pharmaceutical companies are careful to run trials under
optimal conditions (for example, restricting patients to those most likely to
benefit, only including patients that can be treated soon after onset when
necessary, and ensuring accurate dosing), not all artemisinin trials
represent the optimal conditions for efficacy.
Summary statistics from
meta analysis necessarily lose information. As with all meta analyses, studies
are heterogeneous, with differences
in treatment delay, treatment regimen, patient demographics, variants,
conflicts of interest, standard of care, and other factors. We provide analyses for specific
outcomes and by treatment delay, and we aim to identify key characteristics in
the forest plots and summaries. Results should be viewed in the context of
study characteristics.
Some analyses classify treatment based on early or late
administration, as done here, while others distinguish between mild, moderate,
and severe cases. Viral load does not indicate degree of symptoms — for
example patients may have a high viral load while being asymptomatic. With
regard to treatments that have antiviral properties, timing of treatment is
critical — late administration may be less helpful regardless of
severity.
Details of treatment delay per patient is often not available.
For example, a study may treat 90% of patients relatively early, but the
events driving the outcome may come from 10% of patients treated very late.
Our 5 day cutoff for early treatment may be too conservative, 5 days may be too late in many cases.
Comparison across treatments is confounded by differences in
the studies performed, for example dose, variants, and conflicts of interest.
Trials with conflicts of interest may use designs better suited to the
preferred outcome.
In some cases, the most serious outcome has very few events,
resulting in lower confidence results being used in pooled analysis, however
the method is simpler and more transparent. This is less critical as the
number of studies increases. Restriction to outcomes with sufficient power may
be beneficial in pooled analysis and improve accuracy when there are few
studies, however we maintain our pre-specified method to avoid any
retrospective changes.
Studies show that combinations of treatments can be highly
synergistic and may result in many times greater efficacy than individual
treatments alone58-69.
Therefore standard of care may be critical and benefits may diminish or
disappear if standard of care does not include certain treatments.
This real-time analysis is constantly updated based on
submissions. Accuracy benefits from widespread review and submission of
updates and corrections from reviewers. Less popular treatments may receive
fewer reviews.
No treatment or intervention is 100% available and
effective for all current and future variants. Efficacy may vary significantly
with different variants and within different populations. All treatments have
potential side effects. Propensity to experience side effects may be predicted
in advance by qualified physicians. We do not provide medical advice. Before
taking any medication, consult a qualified physician who can compare all
options, provide personalized advice, and provide details of risks and
benefits based on individual medical history and situations.
1 of 3 studies
combine treatments. The results of
artemisinin
alone may differ.
1 of 2 RCTs use combined treatment.
SARS-CoV-2 infection and replication involves a complex
interplay of 50+ host and viral proteins and other
factors20-26, providing many therapeutic
targets.
Over 8,000 compounds have been predicted to reduce COVID-19
risk27, either by directly
minimizing infection or replication, by supporting immune system function, or
by minimizing secondary complications.
Figure 18 shows an overview of the results for artemisinin
in the context of multiple COVID-19 treatments, and Figure 19 shows a plot
of efficacy vs. cost for COVID-19 treatments.
Loading..
Figure 18.
Scatter plot showing results within the context of multiple COVID-19 treatments.
Diamonds shows the results of random effects meta-analysis.
0.5% of 8,000+ proposed treatments show efficacy78.
Loading..
Loading..
Figure 19. Efficacy vs. cost for COVID-19 treatments.
Studies to date show that artemisinin is
an effective treatment for COVID-19.
Significantly lower risk is seen for recovery. One study shows significant benefit.
Meta analysis using the most serious outcome reported shows
34% [11‑51%] lower risk. Results are similar for peer-reviewed studies and better for Randomized Controlled Trials.
Results are consistent with early treatment being more effective than late treatment.
Currently there is limited data, with only 217 patients and only 9 control events for the most serious outcome in trials to date. Studies to date are from only 3 different groups.
Very high COI low-risk patient RCT in South Africa, showing no significant differences with artesunate-amodiaquine or pyronaridine-artesunate.
Estimated 966 patient artemisinin late treatment RCT with results not reported over 9 months after estimated completion.
Estimated 400 patient artemisinin late treatment RCT with results not reported over 2 years after estimated completion.
Prospective study of 43 hospitalized COVID-19 patients in China showing faster symptom improvement and shorter hospitalization with artesunate. Artesunate 60 mg twice daily for 10 days.
RCT 60 mild-moderate COVID-19 patients showing faster recovery with artemisinin.
We perform ongoing searches of PubMed, medRxiv, Europe PMC,
ClinicalTrials.gov, The Cochrane Library, Google Scholar, Research
Square, ScienceDirect, Oxford University Press, the reference lists of other
studies and meta-analyses, and submissions to the site c19early.org.
Search terms are artemisinin and COVID-19 or SARS-CoV-2. Automated searches are performed twice daily, with all matches reviewed for inclusion.
All studies regarding the use of artemisinin for COVID-19 that report
a comparison with a control group are included in the main analysis.
This is a living analysis and is updated regularly.
We extracted effect sizes and associated data from all studies.
If studies report multiple kinds of effects then the most serious
outcome is used in pooled analysis, while other outcomes are included in the
outcome specific analyses. For example, if effects for mortality and cases are
both reported, the effect for mortality is used, this may be different to the
effect that a study focused on.
If symptomatic
results are reported at multiple times, we used the latest time, for example
if mortality results are provided at 14 days and 28 days, the results at 28
days have preference. Mortality alone is preferred over combined outcomes.
Outcomes with zero events in both arms are not used, the next most serious
outcome with one or more events is used. For example, in low-risk populations
with no mortality, a reduction in mortality with treatment is not possible,
however a reduction in hospitalization, for example, is still valuable.
Clinical outcomes are considered more important than viral test status. When
basically all patients recover in both treatment and control groups,
preference for viral clearance and recovery is given to results mid-recovery
where available. After most or all patients have recovered there is little or
no room for an effective treatment to do better, however faster recovery is
valuable.
If only individual symptom data is available, the most serious symptom has
priority, for example difficulty breathing or low SpO2 is more
important than cough.
When results provide an odds ratio, we compute the relative risk when
possible, or convert to a relative risk according to79.
Reported confidence intervals and p-values were used when available,
using adjusted values when provided. If multiple types of adjustments are
reported propensity score matching and multivariable regression has preference
over propensity score matching or weighting, which has preference over
multivariable regression. Adjusted results have preference over unadjusted
results for a more serious outcome when the adjustments significantly alter
results. When needed, conversion between reported p-values and
confidence intervals followed Altman, Altman (B), and Fisher's exact
test was used to calculate p-values for event data. If continuity
correction for zero values is required, we use the reciprocal of the opposite
arm with the sum of the correction factors equal to 182.
Results are expressed with RR < 1.0 favoring treatment, and using the risk of
a negative outcome when applicable (for example, the risk of death rather than
the risk of survival). If studies only report relative continuous values such
as relative times, the ratio of the time for the treatment group versus the
time for the control group is used. Calculations are done in Python
(3.13.2) with
scipy (1.15.2), pythonmeta (1.26), numpy (1.26.4), statsmodels (0.14.4), and plotly (6.0.0).
Forest plots are computed using PythonMeta83
with the DerSimonian and Laird random effects model (the fixed effect
assumption is not plausible in this case) and inverse variance weighting.
Results are presented with 95% confidence intervals. Heterogeneity among studies was
assessed using the I2 statistic.
Mixed-effects meta-regression results are computed with R (4.4.0) using the metafor
(4.6-0) and rms (6.8-0) packages, and using the most serious sufficiently powered outcome.
For all statistical tests, a p-value less than 0.05 was considered statistically significant.
Grobid 0.8.0 is used to parse PDF documents.
We have classified studies as early treatment if most patients
are not already at a severe stage at the time of treatment (for example based
on oxygen status or lung involvement), and treatment started within 5 days of
the onset of symptoms. If studies contain a mix of early treatment and late
treatment patients, we consider the treatment time of patients contributing
most to the events (for example, consider a study where most patients are
treated early but late treatment patients are included, and all mortality
events were observed with late treatment patients).
We note that a shorter time may be preferable. Antivirals are typically only
considered effective when used within a shorter timeframe, for example 0-36 or
0-48 hours for oseltamivir, with longer delays not being effective43,44.
We received no funding, this research is done in our spare
time. We have no affiliations with any pharmaceutical companies or political
parties.
A summary of study results is below. Please submit
updates and corrections at https://c19early.org/artmeta.html.
Effect extraction follows pre-specified rules as detailed above
and gives priority to more serious outcomes.
For pooled analyses, the first (most serious) outcome is used, which may
differ from the effect a paper focuses on.
Other outcomes are used in outcome specific analyses.
| Chandiwana, 11/1/2022, Randomized Controlled Trial, South Africa, peer-reviewed, mean age 34.9, 16 authors, study period 3 September, 2020 - 23 August, 2021, this trial uses multiple treatments in the treatment arm (combined with amodiaquine or pyronaridine) - results of individual treatments may vary, trial NCT04532931 (history). | risk of hospitalization, 152.0% higher, RR 2.52, p = 1.00, treatment 1 of 75 (1.3%), control 0 of 39 (0.0%), continuity correction due to zero event (with reciprocal of the contrasting arm). |
| risk of progression, 28.7% lower, RR 0.71, p = 0.66, treatment 39, control 39, adjusted per study, both artesunate arms. | |
| risk of progression, 31.0% higher, OR 1.31, p = 0.73, treatment 39, control 39, adjusted per study, ASAQ, day 28, Table S9, RR approximated with OR. | |
| risk of progression, 71.0% lower, OR 0.29, p = 0.22, treatment 36, control 39, adjusted per study, PA, day 28, Table S9, RR approximated with OR. | |
| time to WHO zero score, 26.8% lower, HR 0.73, p = 0.10, treatment 39, control 39, both artesunate arms. | |
| time to WHO zero score, 22.5% lower, HR 0.78, p = 0.33, treatment 39, control 39, inverted to make HR<1 favor treatment, ASAQ, Cox proportional hazards, Table S10. | |
| time to WHO zero score, 31.0% lower, HR 0.69, p = 0.17, treatment 36, control 39, inverted to make HR<1 favor treatment, PA, Cox proportional hazards, Table S10. | |
| viral load, 1.1% higher, relative load 1.01, p = 0.76, treatment 39, control 37, both artesunate arms. | |
| viral load, 4.6% higher, relative load 1.05, p = 0.02, treatment mean 3.25 (±0.26) n=39, control mean 3.4 (±0.27) n=37, ASAQ, day 14, Table S7. | |
| viral load, 2.3% lower, relative load 0.98, p = 0.23, treatment mean 3.48 (±0.29) n=36, control mean 3.4 (±0.27) n=37, PA, day 14, Table S7. | |
| risk of no viral clearance, 34.3% higher, RR 1.34, p = 0.18, treatment 39, control 38, adjusted per study, both artesunate arms. | |
| risk of no viral clearance, 25.0% higher, RR 1.25, p = 0.48, treatment 24 of 39 (61.5%), control 25 of 38 (65.8%), adjusted per study, inverted to make RR<1 favor treatment, ASAQ. | |
| risk of no viral clearance, 44.9% higher, RR 1.45, p = 0.25, treatment 23 of 33 (69.7%), control 25 of 38 (65.8%), adjusted per study, inverted to make RR<1 favor treatment, PA. | |
| Trieu, 2/1/2021, Randomized Controlled Trial, India, preprint, median age 44.5, 7 authors, study period 8 October, 2020 - 21 November, 2020, trial CTRI/2020/09/028044 (ARTI-19). | risk of no recovery, 52.1% lower, RR 0.48, p = 0.08, treatment 8 of 39 (20.5%), control 9 of 21 (42.9%), NNT 4.5, day 5. |
Effect extraction follows pre-specified rules as detailed above
and gives priority to more serious outcomes.
For pooled analyses, the first (most serious) outcome is used, which may
differ from the effect a paper focuses on.
Other outcomes are used in outcome specific analyses.
| Fowler, 5/18/2024, Randomized Controlled Trial, Canada, trial NCT04330690 (history) (CATCO). | Estimated 966 patient RCT with results unknown and over 9 months late. | Gyanwali, 12/1/2022, Randomized Controlled Trial, Nepal, trial NCT05273242 (history). | Estimated 400 patient RCT with results unknown and over 2 years late. |
| Lin, 4/28/2020, retrospective, China, peer-reviewed, 9 authors. | recovery time, 31.2% lower, relative time 0.69, p = 0.02, treatment mean 3.33 (±1.91) n=18, control mean 4.84 (±2.19) n=25. |
| recovery time, 27.9% lower, relative time 0.72, p = 0.04, treatment mean 5.39 (±2.36) n=18, control mean 7.48 (±3.78) n=25, lung lesion absorption start. | |
| recovery time, 17.2% lower, relative time 0.83, p = 0.03, treatment mean 14.11 (±4.16) n=18, control mean 17.04 (±4.42) n=25, lung lesion absorption greater than 70%. | |
| hospitalization time, 8.2% lower, relative time 0.92, p = 0.22, treatment mean 16.56 (±3.71) n=18, control mean 18.04 (±3.97) n=25. | |
| time to viral-, 29.3% lower, relative time 0.71, p = 0.05, treatment mean 4.72 (±2.16) n=18, control mean 6.68 (±3.76) n=25. |
Viral infection and replication involves attachment, entry, uncoating and release, genome replication and transcription, translation and protein processing, assembly and budding, and release. Each step can be disrupted by therapeutics.
Fowler et al., A Multi-centre, Adaptive, Randomized, Open-label, Controlled Clinical Trial of the Safety and Efficacy of Investigational Therapeutics for the Treatment of COVID-19 in Hospitalized Patients (CATCO: Canadian Treatments for COVID-19), in Conjunction With the Public Health Emergency SOLIDARITY Trial (World Health Organization), NCT04330690, clinicaltrials.gov/study/NCT04330690.
Gyanwali et al., WHO Solidarity Trial Plus: An International Randomised Trial of Additional Treatments for COVID-19 in Hospitalised Patients Who Are All Receiving the Local Standard of Care in Nepal, NCT05273242, clinicaltrials.gov/study/NCT05273242.
Rong et al., Persistence of spike protein at the skull-meninges-brain axis may contribute to the neurological sequelae of COVID-19, Cell Host & Microbe, doi:10.1016/j.chom.2024.11.007.
Yang et al., SARS-CoV-2 infection causes dopaminergic neuron senescence, Cell Stem Cell, doi:10.1016/j.stem.2023.12.012.
Scardua-Silva et al., Microstructural brain abnormalities, fatigue, and cognitive dysfunction after mild COVID-19, Scientific Reports, doi:10.1038/s41598-024-52005-7.
Hampshire et al., Cognition and Memory after Covid-19 in a Large Community Sample, New England Journal of Medicine, doi:10.1056/NEJMoa2311330.
Duloquin et al., Is COVID-19 Infection a Multiorganic Disease? Focus on Extrapulmonary Involvement of SARS-CoV-2, Journal of Clinical Medicine, doi:10.3390/jcm13051397.
Sodagar et al., Pathological Features and Neuroinflammatory Mechanisms of SARS-CoV-2 in the Brain and Potential Therapeutic Approaches, Biomolecules, doi:10.3390/biom12070971.
Sagar et al., COVID-19-associated cerebral microbleeds in the general population, Brain Communications, doi:10.1093/braincomms/fcae127.
Verma et al., Persistent Neurological Deficits in Mouse PASC Reveal Antiviral Drug Limitations, bioRxiv, doi:10.1101/2024.06.02.596989.
Panagea et al., Neurocognitive Impairment in Long COVID: A Systematic Review, Archives of Clinical Neuropsychology, doi:10.1093/arclin/acae042.
Ariza et al., COVID-19: Unveiling the Neuropsychiatric Maze—From Acute to Long-Term Manifestations, Biomedicines, doi:10.3390/biomedicines12061147.
Vashisht et al., Neurological Complications of COVID-19: Unraveling the Pathophysiological Underpinnings and Therapeutic Implications, Viruses, doi:10.3390/v16081183.
Ahmad et al., Neurological Complications and Outcomes in Critically Ill Patients With COVID-19: Results From International Neurological Study Group From the COVID-19 Critical Care Consortium, The Neurohospitalist, doi:10.1177/19418744241292487.
Wang et al., SARS-CoV-2 membrane protein induces neurodegeneration via affecting Golgi-mitochondria interaction, Translational Neurodegeneration, doi:10.1186/s40035-024-00458-1.
Eberhardt et al., SARS-CoV-2 infection triggers pro-atherogenic inflammatory responses in human coronary vessels, Nature Cardiovascular Research, doi:10.1038/s44161-023-00336-5.
Van Tin et al., Spike Protein of SARS-CoV-2 Activates Cardiac Fibrogenesis through NLRP3 Inflammasomes and NF-κB Signaling, Cells, doi:10.3390/cells13161331.
Borka Balas et al., COVID-19 and Cardiac Implications—Still a Mystery in Clinical Practice, Reviews in Cardiovascular Medicine, doi:10.31083/j.rcm2405125.
AlTaweel et al., An In-Depth Insight into Clinical, Cellular and Molecular Factors in COVID19-Associated Cardiovascular Ailments for Identifying Novel Disease Biomarkers, Drug Targets and Clinical Management Strategies, Archives of Microbiology & Immunology, doi:10.26502/ami.936500177.
Malone et al., Structures and functions of coronavirus replication–transcription complexes and their relevance for SARS-CoV-2 drug design, Nature Reviews Molecular Cell Biology, doi:10.1038/s41580-021-00432-z.
Murigneux et al., Proteomic analysis of SARS-CoV-2 particles unveils a key role of G3BP proteins in viral assembly, Nature Communications, doi:10.1038/s41467-024-44958-0.
Lv et al., Host proviral and antiviral factors for SARS-CoV-2, Virus Genes, doi:10.1007/s11262-021-01869-2.
Lui et al., Nsp1 facilitates SARS-CoV-2 replication through calcineurin-NFAT signaling, Virology, doi:10.1128/mbio.00392-24.
Niarakis et al., Drug-target identification in COVID-19 disease mechanisms using computational systems biology approaches, Frontiers in Immunology, doi:10.3389/fimmu.2023.1282859.
Katiyar et al., SARS-CoV-2 Assembly: Gaining Infectivity and Beyond, Viruses, doi:10.3390/v16111648.
Wu et al., Decoding the genome of SARS-CoV-2: a pathway to drug development through translation inhibition, RNA Biology, doi:10.1080/15476286.2024.2433830.
Bagheri-Far et al., Non-spike protein inhibition of SARS-CoV-2 by natural products through the key mediator protein ORF8, Molecular Biology Research Communications, doi:10.22099/mbrc.2024.50245.2001.
Irfan et al., Phytoconstituents of Artemisia Annua as potential inhibitors of SARS CoV2 main protease: an in silico study, BMC Infectious Diseases, doi:10.1186/s12879-024-09387-w.
El-Megharbel et al., Chemical and spectroscopic characterization of (Artemisinin/Quercetin/ Zinc) novel mixed ligand complex with assessment of its potent high antiviral activity against SARS-CoV-2 and antioxidant capacity against toxicity induced by acrylamide in male rats, PeerJ, doi:10.7717/peerj.15638.
Sekiou et al., In-Silico Identification of Potent Inhibitors of COVID-19 Main Protease (Mpro) and Angiotensin Converting Enzyme 2 (ACE2) from Natural Products: Quercetin, Hispidulin, and Cirsimaritin Exhibited Better Potential Inhibition than Hydroxy-Chloroquine Against COVID-19 Main Protease Active Site and ACE2, ChemRxiv, doi:10.26434/chemrxiv.12181404.v1.
Zeraatkar et al., Consistency of covid-19 trial preprints with published reports and impact for decision making: retrospective review, BMJ Medicine, doi:10.1136/bmjmed-2022-0003091.
Davidson et al., No evidence of important difference in summary treatment effects between COVID-19 preprints and peer-reviewed publications: a meta-epidemiological study, Journal of Clinical Epidemiology, doi:10.1016/j.jclinepi.2023.08.011.
Jadad et al., Randomized Controlled Trials: Questions, Answers, and Musings, Second Edition, doi:10.1002/9780470691922.
Gøtzsche, P., Bias in double-blind trials, Doctoral Thesis, University of Copenhagen, www.scientificfreedom.dk/2023/05/16/bias-in-double-blind-trials-doctoral-thesis/.
Als-Nielsen et al., Association of Funding and Conclusions in Randomized Drug Trials, JAMA, doi:10.1001/jama.290.7.921.
Anglemyer et al., Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials, Cochrane Database of Systematic Reviews 2014, Issue 4, doi:10.1002/14651858.MR000034.pub2.
Lee et al., Analysis of Overall Level of Evidence Behind Infectious Diseases Society of America Practice Guidelines, Arch Intern Med., 2011, 171:1, 18-22, doi:10.1001/archinternmed.2010.482.
Deaton et al., Understanding and misunderstanding randomized controlled trials, Social Science & Medicine, 210, doi:10.1016/j.socscimed.2017.12.005.
Nichol et al., Challenging issues in randomised controlled trials, Injury, 2010, doi: 10.1016/j.injury.2010.03.033, www.injuryjournal.com/article/S0020-1383(10)00233-0/fulltext.
Treanor et al., Efficacy and Safety of the Oral Neuraminidase Inhibitor Oseltamivir in Treating Acute Influenza: A Randomized Controlled Trial, JAMA, 2000, 283:8, 1016-1024, doi:10.1001/jama.283.8.1016.
McLean et al., Impact of Late Oseltamivir Treatment on Influenza Symptoms in the Outpatient Setting: Results of a Randomized Trial, Open Forum Infect. Dis. September 2015, 2:3, doi:10.1093/ofid/ofv100.
Ikematsu et al., Baloxavir Marboxil for Prophylaxis against Influenza in Household Contacts, New England Journal of Medicine, doi:10.1056/NEJMoa1915341.
Hayden et al., Baloxavir Marboxil for Uncomplicated Influenza in Adults and Adolescents, New England Journal of Medicine, doi:10.1056/NEJMoa1716197.
Kumar et al., Combining baloxavir marboxil with standard-of-care neuraminidase inhibitor in patients hospitalised with severe influenza (FLAGSTONE): a randomised, parallel-group, double-blind, placebo-controlled, superiority trial, The Lancet Infectious Diseases, doi:10.1016/S1473-3099(21)00469-2.
López-Medina et al., Effect of Ivermectin on Time to Resolution of Symptoms Among Adults With Mild COVID-19: A Randomized Clinical Trial, JAMA, doi:10.1001/jama.2021.3071.
Korves et al., SARS-CoV-2 Genetic Variants and Patient Factors Associated with Hospitalization Risk, medRxiv, doi:10.1101/2024.03.08.24303818.
Faria et al., Genomics and epidemiology of the P.1 SARS-CoV-2 lineage in Manaus, Brazil, Science, doi:10.1126/science.abh2644.
Nonaka et al., SARS-CoV-2 variant of concern P.1 (Gamma) infection in young and middle-aged patients admitted to the intensive care units of a single hospital in Salvador, Northeast Brazil, February 2021, International Journal of Infectious Diseases, doi:10.1016/j.ijid.2021.08.003.
Karita et al., Trajectory of viral load in a prospective population-based cohort with incident SARS-CoV-2 G614 infection, medRxiv, doi:10.1101/2021.08.27.21262754.
Zavascki et al., Advanced ventilatory support and mortality in hospitalized patients with COVID-19 caused by Gamma (P.1) variant of concern compared to other lineages: cohort study at a reference center in Brazil, Research Square, doi:10.21203/rs.3.rs-910467/v1.
Willett et al., The hyper-transmissible SARS-CoV-2 Omicron variant exhibits significant antigenic change, vaccine escape and a switch in cell entry mechanism, medRxiv, doi:10.1101/2022.01.03.21268111.
Peacock et al., The SARS-CoV-2 variant, Omicron, shows rapid replication in human primary nasal epithelial cultures and efficiently uses the endosomal route of entry, bioRxiv, doi:10.1101/2021.12.31.474653.
Williams, T., Not All Ivermectin Is Created Equal: Comparing The Quality of 11 Different Ivermectin Sources, Do Your Own Research, doyourownresearch.substack.com/p/not-all-ivermectin-is-created-equal.
Xu et al., A study of impurities in the repurposed COVID-19 drug hydroxychloroquine sulfate by UHPLC-Q/TOF-MS and LC-SPE-NMR, Rapid Communications in Mass Spectrometry, doi:10.1002/rcm.9358.
Jitobaom et al., Favipiravir and Ivermectin Showed in Vitro Synergistic Antiviral Activity against SARS-CoV-2, Research Square, doi:10.21203/rs.3.rs-941811/v1.
Jitobaom (B) et al., Synergistic anti-SARS-CoV-2 activity of repurposed anti-parasitic drug combinations, BMC Pharmacology and Toxicology, doi:10.1186/s40360-022-00580-8.
Jeffreys et al., Remdesivir-ivermectin combination displays synergistic interaction with improved in vitro activity against SARS-CoV-2, International Journal of Antimicrobial Agents, doi:10.1016/j.ijantimicag.2022.106542.
Ostrov et al., Highly Specific Sigma Receptor Ligands Exhibit Anti-Viral Properties in SARS-CoV-2 Infected Cells, Pathogens, doi:10.3390/pathogens10111514.
Alsaidi et al., Griffithsin and Carrageenan Combination Results in Antiviral Synergy against SARS-CoV-1 and 2 in a Pseudoviral Model, Marine Drugs, doi:10.3390/md19080418.
Andreani et al., In vitro testing of combined hydroxychloroquine and azithromycin on SARS-CoV-2 shows synergistic effect, Microbial Pathogenesis, doi:10.1016/j.micpath.2020.104228.
De Forni et al., Synergistic drug combinations designed to fully suppress SARS-CoV-2 in the lung of COVID-19 patients, PLoS ONE, doi:10.1371/journal.pone.0276751.
Wan et al., Synergistic inhibition effects of andrographolide and baicalin on coronavirus mechanisms by downregulation of ACE2 protein level, Scientific Reports, doi:10.1038/s41598-024-54722-5.
Said et al., The effect of Nigella sativa and vitamin D3 supplementation on the clinical outcome in COVID-19 patients: A randomized controlled clinical trial, Frontiers in Pharmacology, doi:10.3389/fphar.2022.1011522.
Fiaschi et al., In Vitro Combinatorial Activity of Direct Acting Antivirals and Monoclonal Antibodies against the Ancestral B.1 and BQ.1.1 SARS-CoV-2 Viral Variants, Viruses, doi:10.3390/v16020168.
Xing et al., Published anti-SARS-CoV-2 in vitro hits share common mechanisms of action that synergize with antivirals, Briefings in Bioinformatics, doi:10.1093/bib/bbab249.
Thairu et al., A Comparison of Ivermectin and Non Ivermectin Based Regimen for COVID-19 in Abuja: Effects on Virus Clearance, Days-to-discharge and Mortality, Journal of Pharmaceutical Research International, doi:10.9734/jpri/2022/v34i44A36328.
Singh et al., The relationship between viral clearance rates and disease progression in early symptomatic COVID-19: a systematic review and meta-regression analysis, Journal of Antimicrobial Chemotherapy, doi:10.1093/jac/dkae045.
Boulware, D., Comments regarding paper rejection, twitter.com/boulware_dr/status/1311331372884205570.
Farmanpour-Kalalagh et al., Artemisinins in Combating Viral Infections Like SARS-CoV-2, Inflammation and Cancers and Options to Meet Increased Global Demand, Frontiers in Plant Science, doi:10.3389/fpls.2022.780257.
Uckun et al., Repurposing Anti-Malaria Phytomedicine Artemisinin as a COVID-19 Drug, Frontiers in Pharmacology, doi:10.3389/fphar.2021.649532.
Zhang et al., What's the relative risk? A method of correcting the odds ratio in cohort studies of common outcomes, JAMA, 80:19, 1690, doi:10.1001/jama.280.19.1690.
Altman (B) et al., How to obtain the confidence interval from a P value, BMJ, doi:10.1136/bmj.d2090.
Sweeting et al., What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data, Statistics in Medicine, doi:10.1002/sim.1761.
Chandiwana et al., Safety and efficacy of four drug regimens versus standard-of-care for the treatment of symptomatic outpatients with COVID-19: A randomised, open-label, multi-arm, phase 2 clinical trial, eBioMedicine, doi:10.1016/j.ebiom.2022.104322.
Please send us corrections, updates, or comments.
c19early involves the extraction of 100,000+ datapoints from
thousands of papers. Community updates
help ensure high accuracy.
Treatments and other interventions are complementary.
All practical, effective, and safe
means should be used based on risk/benefit analysis.
No treatment or intervention is 100% available and effective for all current
and future variants.
We do not provide medical advice. Before taking any medication,
consult a qualified physician who can provide personalized advice and details
of risks and benefits based on your medical history and situation. FLCCC and WCH
provide treatment protocols.