British Medical Journal
Covid-19 vaccines and treatments: we must have raw data, now
Covid-19 vaccines and treatments: we must have raw data, now
Data should be fully and immediately available for public scrutiny
In the pages of
The BMJ a decade ago, in the middle of a different pandemic, it came to light that governments around the world had spent billions stockpiling antivirals for influenza that had not been shown to reduce the risk of complications, hospital admissions, or death. The majority of trials that underpinned regulatory approval and government stockpiling of oseltamivir (Tamiflu) were sponsored by the manufacturer; most were unpublished, those that were published were ghostwritten by writers paid by the manufacturer, the people listed as principal authors lacked access to the raw data, and academics who requested access to the data for independent analysis were denied.
1234
The Tamiflu saga heralded a decade of unprecedented attention to the importance of sharing clinical trial data.
56 Public battles for drug company data,
78 transparency campaigns with thousands of signatures,
910 strengthened journal data sharing requirements,
1112 explicit commitments from companies to share data,
13 new data access website portals,
8 and landmark transparency policies from medicines regulators
1415 all promised a new era in data transparency.
Progress was made, but clearly not enough. The errors of the last pandemic are being repeated. Memories are short. Today, despite the global rollout of covid-19 vaccines and treatments, the anonymised participant level data underlying the trials for these new products remain inaccessible to doctors, researchers, and the public—and are likely to remain that way for years to come.
16 This is morally indefensible for all trials, but especially for those involving major public health interventions.
Unacceptable delay
Pfizer’s pivotal covid vaccine trial was funded by the company and designed, run, analysed, and authored by Pfizer employees. The company and the contract research organisations that carried out the trial hold all the data.
17 And Pfizer has indicated that it will not begin entertaining requests for trial data until May 2025, 24 months after the primary study completion date, which is listed on ClinicalTrials.gov as 15 May 2023 (
NCT04368728).
The lack of access to data is consistent across vaccine manufacturers.
16 Moderna says data “may be available … with publication of the final study results in 2022.”
18 Datasets will be available “upon request and subject to review once the trial is complete,” which has an estimated primary completion date of 27 October 2022 (
NCT04470427).
As of 31 December 2021, AstraZeneca may be ready to entertain requests for data from several of its large phase III trials.
19 But actually obtaining data could be slow going. As its website explains, “timelines vary per request and can take up to a year upon full submission of the request.”
20
Underlying data for covid-19 therapeutics are similarly hard to find. Published reports of Regeneron’s phase III trial of its monoclonal antibody therapy REGEN-COV flatly state that participant level data will not be made available to others.
21 Should the drug be approved (and not just emergency authorised), sharing “will be considered.” For remdesivir, the US National Institutes of Health, which funded the trial, created a new portal to share data (
NIAID Clinical Trials Repository), but the dataset on offer is limited. An accompanying document explains: “The longitudinal data set only contains a small subset of the protocol and statistical analysis plan objectives.”
We are left with publications but no access to the underlying data on reasonable request. This is worrying for trial participants, researchers, clinicians, journal editors, policy makers, and the public. The journals that have published these primary studies may argue that they faced an awkward dilemma, caught between making the summary findings available quickly and upholding the best ethical values that support timely access to underlying data. In our view, there is no dilemma; the anonymised individual participant data from clinical trials must be made available for independent scrutiny.
Journal editors, systematic reviewers, and the writers of clinical practice guideline generally obtain little beyond a journal publication, but regulatory agencies receive far more granular data as part of the regulatory review process. In the words of the European Medicine Agency’s former executive director and senior medical officer, “relying solely on the publications of clinical trials in scientific journals as the basis of healthcare decisions is not a good idea ... Drug regulators have been aware of this limitation for a long time and routinely obtain and assess the full documentation (rather than just publications).”
22
Among regulators, the US Food and Drug Administration is believed to receive the most raw data but does not proactively release them.
After a freedom of information request to the agency for Pfizer’s vaccine data, the FDA offered to release 500 pages a month, a process that would take decades to complete, arguing in court that publicly releasing data was slow owing to the need to first redact sensitive information.23 This month, however, a judge rejected the FDA’s offer and ordered the data be released at a rate of 55 000 pages a month. The data are to be made available on the requesting organisation’s website (Public Health and Medical Professionals for Transparency - Public Health and Medical Professionals for Transparency).
In releasing thousands of pages of clinical trial documents, Health Canada and the EMA have also provided a degree of transparency that deserves acknowledgment.
2425 Until recently, however, the data remained of limited utility, with copious redactions aimed at protecting trial blinding. But study reports with fewer redactions have been available since September 2021,
2425 and missing appendices may be accessible through freedom of information requests.
Even so, anyone looking for participant level datasets may be disappointed because Health Canada and the EMA do not receive or analyse these data, and it remains to be seen how the FDA responds to the court order. Moreover, the FDA is producing data only for Pfizer’s vaccine; other manufacturers’ data cannot be requested until the vaccines are approved, which the Moderna and Johnson & Johnson vaccines are not. Industry, which holds the raw data, is not legally required to honour requests for access from independent researchers.
Like the FDA, and unlike its Canadian and European counterparts, the UK’s regulator—the Medicines and Healthcare Products Regulatory Agency—does not proactively release clinical trial documents, and it has also become delayed in posting information released in response to freedom of information requests on its website.
26
Transparency and trust
As well as access to the underlying data, transparent decision making is essential. Regulators and public health bodies could release details
27 such as why vaccine trials were not designed to test efficacy against infection and spread of SARS-CoV-2.
28 Had regulators insisted on this outcome, countries would have learnt sooner about the effect of vaccines on transmission and been able to plan accordingly.
29
Big pharma is the least trusted industry.
30 At least three of the many companies making covid-19 vaccines have past criminal and civil settlements costing them billions of dollars.
31 One pleaded guilty to fraud.
31 Other companies have no pre-covid track record. Now the covid pandemic has minted many new pharma billionaires, and vaccine manufacturers have reported tens of billions in revenue.
32
The BMJ supports vaccination policies based on sound evidence. As the global vaccine rollout continues, it cannot be justifiable or in the best interests of patients and the public that we are left to just trust “in the system,” with the distant hope that the underlying data may become available for independent scrutiny at some point in the future. The same applies to treatments for covid-19. Transparency is the key to building trust and an important route to answering people’s legitimate questions about the efficacy and safety of vaccines and treatments and the clinical and public health policies established for their use.
Twelve years ago we called for the immediate release of raw data from clinical trials.
1 We reiterate that call now. Data must be available when trial results are announced, published, or used to justify regulatory decisions. There is no place for wholesale exemptions from good practice during a pandemic. The public has paid for covid-19 vaccines through vast public funding of research, and it is the public that takes on the balance of benefits and harms that accompany vaccination. The public, therefore, has a right and entitlement to those data, as well as to the interrogation of those data by experts.
Pharmaceutical companies are reaping vast profits without adequate independent scrutiny of their scientific claims.33 The purpose of regulators is not to dance to the tune of rich global corporations and enrich them further; it is to protect the health of their populations. We need complete data transparency for all studies, we need it in the public interest, and we need it now.
