Review | Open | Published:
Conflict of interest disclosure in biomedical research: a review of current practices, biases, and the role of public registries in improving transparency
Research Integrity and Peer Reviewvolume 1, Article number: 1 (2016)
A database error is stopping the peer review reports from showing for this article. We are working hard to get it fixed.
Conflicts of interest held by researchers remain a focus of attention in clinical research. Biases related to these relationships have the potential to directly impact the quality of healthcare by influencing decision-making, yet conflicts of interest remain underreported, inconsistently described, and difficult to access. Initiatives aimed at improving the disclosure of researcher conflicts of interest are still in their infancy but represent a vital reform that must be addressed before potential biases associated with conflicts of interest can be mitigated and trust in the impartiality of clinical evidence restored. In this review, we examine the prevalence of conflicts of interest, evidence of the effects that disclosed and undisclosed conflicts of interest have had on the reporting of clinical evidence, and the emerging approaches for improving the completeness and consistency of disclosures. Through this review of emerging technologies, we recognize a growing interest in publicly accessible registries for researcher conflicts of interest and propose five desiderata aimed at maximizing the value of such registries: mandates for ensuring that researchers keep their records up to date; transparent records that are made available to the public; interoperability to allow researchers, bibliographic databases, and institutions to interact with the registry; a consistent taxonomy for describing different classes of conflicts of interest; and the ability to automatically generate conflicts of interest statements for use in published articles.
For researchers, conflicts of interest describe situations where the impartiality of research may be compromised because the researcher stands to profit in some way from the conclusions they draw . The clearest and most often discussed example of a conflict of interest in biomedical research involves doing research on a specific intervention while receiving research funding or personal remuneration from the company producing that intervention. While there are many other forms of financial and non-financial conflicts of interests , this is the type that is most often measured and discussed. In practice, every researcher holds a set of interests—financial, personal, ideological, or otherwise—which may lead to bias in the context of specific research. The topic of disclosing conflicts of interest has been debated since the 1980s , with disagreements about whether or not conflicts of interest should be disclosed and whether methods of peer review are sufficient for mitigating the potential for bias associated with research undertaken by researchers who hold conflicts of interest.
Despite a general consensus favoring disclosure, and nearly 20 years after disclosures have been required for submissions to medical journals , conflicts of interest are still often missing from published articles, guidelines, and news media [5–8]. The lack of transparency in the disclosure of conflicts of interest is a problem in biomedical research because it hinders our ability to mitigate the risk of bias. These biases, when hidden, can affect clinical decision-making by making interventions appear safer or more effective than they really are. High-profile examples where undisclosed conflicts of interest have clearly affected clinical practice may have contributed to the erosion of public trust in biomedical research and peer review processes [9–14]. New methods for further improving the completeness and consistency with which researchers disclose their conflicts of interest are now needed to support mitigation and increase trust in peer-reviewed research. In this review, we provide a narrative review of studies that have measured the prevalence of disclosed and undisclosed conflicts of interest, summarize what is and what is not known about associations between conflicts of interest and biased reporting, describe some of the pertinent examples of where conflicts of interest appear to have affected the presentation of clinical evidence or public opinion, and discuss some recent and emerging approaches aimed at improving the accuracy and completeness of disclosures [6, 15, 16]. We conclude by speculating on the benefits of a global, publicly accessible registry for recording researchers’ declarations of interests and recommend five key features that would maximize its value in measuring risk of bias due to conflicts of interest.
Conflicts of interest are common and underreported
Studies measuring the incidence of disclosed and undisclosed conflicts of interest have to date been generally small, heterogeneous in terms of setting and outcomes, and often focused largely on the subset of conflicts of interest that are financial in nature. In a 2003 systematic review of the prevalence of conflicts of interest, Bekelman et al.  found that a third of biomedical researchers in academic institutions have held conflicts of interest that could introduce a risk of bias. Cross-sectional studies across a heterogeneous set of conditions suggest that between 29 and 69 % of published clinical trial reports include disclosures of conflicts of interest [17–24].
Studies measuring undisclosed conflicts of interest suggest that between 43 and 69 % of study reports and other articles fail to include disclosures of conflicts of interest [5, 6, 25, 26]. However, these values are not directly comparable because the studies involve different types of conflicts of interests and data sources and are restricted to specific financial conflicts of interests and the study sizes are relatively small. In a cross-sectional study of published clinical practice guidelines issued by medical organizations in the USA and Canada, 48 % of authors disclosed conflicts of interest and 25 % formally declared none, among which 11 % were found to have undisclosed conflicts of interest . In a study of Danish clinical practice guidelines, 96 % of guidelines included at least one author with a conflict of interest, but only 2 % of the guidelines disclosed those conflicts of interest .
Conflicts of interest appear to be even more rarely reported in science journalism. A 2007 study showed that very few newspaper stories about scientific research report the financial ties of researchers and quoted sources, even when the conflicts of interest are disclosed in the journal article . In 2013, Mandeville et al.  found that 3 of 425 newspaper articles on the 2009 to 2010 A/H1N1 pandemic noted the competing interests of the quoted researchers.
Conflicts of interest can introduce biases that lead to harm
While we know of no systematic review that quantifies the risk of bias associated with the presence of financial and non-financial conflicts of interest, a group of observational studies have shown that financial conflicts of interests are associated with biases across the spectrum of biomedical research. Researchers with conflicts of interest were found to be more likely to choose comparators that would produce favorable results , selectively include only certain outcomes in published reports , publish conclusions that are inconsistent with the study results [31, 32], or complete a clinical trial without subsequent publication of the results . These types of biases can also impact the quality and reliability of systematic reviews, arguably the most critical publications guiding clinical care [34, 35]. When authors of systematic reviews hold financial conflicts of interest, they are more likely to interpret data as evidence supporting an intervention [9, 36, 37]. Contributors to clinical practice guidelines are more likely to recommend the intervention in clinical practice if they hold a conflict of interest [10, 38, 39].
Both disclosed and undisclosed conflicts of interest can have a negative impact on clinical evidence, public opinion, and clinical decision-making . For example, following a meta-analysis linking rosiglitazone to an increased risk of myocardial infarction, researchers with conflicts of interest continued to defend the drug, often failing to disclose links to pharmaceutical companies , and this may have further delayed the market withdrawal of the drug in several countries. Table 1 enumerates some examples of the influence of undisclosed researcher conflicts of interest on patient care through published research reports and statements in the news media.
Unintended consequences of disclosing conflicts of interest
Concerns have been raised about the possibility of unintended consequences and burdens associated with disclosing conflicts of interest . For researchers, the disclosure of conflicts of interest may exacerbate biases in the presentation of research by creating the impetus to compensate for the disclosure [42–45]. For readers, the presence of a disclosed conflict of interest may influence their response to information in unexpected ways, including increasing their trust or making them dismissive of the material [46, 47]. However, in a recent study within a small group, it was found that the disclosure of a financial conflict of interest had little impact on a lay audience’s interpretation of research and helped to moderate the concerns of audiences with training in ethics .
Journal editors have implemented different policies for addressing researcher conflicts of interest, with some outright avoiding publication of certain article types submitted by authors with industry relationships . In a series of editorials, one journal recently questioned the division this may have created between industry and academia [50–53], which garnered passionate and wide-ranging responses from previous and current journal editors [54, 55].
Regardless of journal policy in the area, nearly half of all clinical trials completed each year are partially or completely funded by industry , indicating that a substantial proportion of primary clinical evidence is being produced by researchers who hold conflicts of interest. Industry-sponsored studies differ from otherwise-funded studies across several key characteristics in terms of their designs. Individual studies on specific conditions and interventions have found that industry-sponsored studies enroll larger numbers of patients tend to have lower risk of bias in relation to blinding, may select different comparators, and may select different measurable outcomes [29, 34, 57, 58]. Given the current reliance on industry funding for the production of primary evidence, a blanket dismissal or exclusion of industry authors across all article types is too simplistic, would greatly reduce the volume of evidence available for many interventions, and is unlikely to improve the quality of clinical evidence for most interventions.
The limits of disclosure
In previous reviews, researchers have concluded that disclosure alone is not enough to mitigate the effects of researchers’ conflicts of interest [1, 59]. To paraphrase Thompson , disclosure only reveals the possibility of bias, without providing any guidance for resolving it.
Improved disclosure alone is unlikely to solve the problem of biases associated with conflicts of interest. Rather, improvements in the disclosure of conflicts of interest should be viewed as a way of providing increasingly precise observations of one factor that can influence the design and reporting of research. Given that biases introduced by conflicts of interest are not adequately explained by the differences measured using standard risk-of-bias tools [34, 35], it makes sense to treat conflicts of interest in the same way as we treat any other confounder that may affect the results of a study. The more precisely we can measure the association between different classes of conflicts of interest and biases in design or reporting, the more effectively we can statistically account for them when synthesizing evidence.
Methods for improving the disclosure of potential conflicts of interest
Systems have been put in place with the aim of measuring or mitigating the biases associated with conflicts of interest for researchers and clinicians. These changes include the introduction of clinical trial registries [61–64], and the release of information related to payments from pharmaceutical companies to physicians . Together with associated policy changes, these systems have been successful in revealing the biases associated with conflicts of interest but it is unclear whether these systems have helped to mitigate these biases.
The databases of registered clinical trials are used to measure and mitigate reporting biases [64, 66]. Lessons about how to introduce a registry for detailing researchers’ declared interests can be gleaned from the successful implementation of ClinicalTrials.gov, which has helped to make the prospective registration of clinical trials a standard practice. The registry was first implemented in 2000 following the Food and Drug Administration Modernization Act of 1997 with reporting requirements further expanded in the Food and Drug Administration Amendments Act of 2007. The registry was endorsed by the International Committee of Medical Journal Editors (ICMJE) which, in 2005, established a policy mandating the prospective registration of clinical trials as a prerequisite for publication in member journals . This action along with support by other journals and federal policies greatly accelerated rates of compliance with trial registration , although compliance with registration and results reporting is not yet perfect [30, 68]. For instance, journals still publish trials that were not prospectively registered [69, 70], even where it is a precondition of publication , and inconsistencies between information in registries and manuscripts do not appear to influence publication . Today, the registry is the largest single database of clinical trials conducted in the USA and internationally, and its growth highlights the importance of providing not only the tools for reporting and sharing information but also encouraging uptake through changes in policy. When clinical trial publications fail to completely report measurable outcomes, or remain unpublished after an extended delay, clinical trial registries can be used to audit these biases , and may help to identify unpublished evidence.
Another example that can be used to inform the development of a publicly accessible registry for declarations of interests comes from recent changes that require physicians in the USA to publicly document relationships between physicians and pharmaceutical industry. The USA passed the Physician Payments Sunshine Act in 2007, which sought public reporting of all financial ties between physicians and pharmaceutical companies. This was followed in 2014 by Open Payments—the release of individual and identifiable financial conflict of interest information for individual physicians by the United States Centers for Medicare and Medicaid Services. This information was publicly released in a searchable database that includes reports on payments to approximately 546,000 licensed physicians in the USA. In 2011, a unique identifier for researchers was proposed for linking physician payments to authors of biomedical research . Some concerns have been raised about the unintended consequences of publicly releasing payment information, including unexpected patient reactions, deliberate underreporting, and payments to non-physicians .
Moving to a publicly accessible registry for disclosing interests
In 2012, an Institute of Medicine (IOM) initiative described a centralized repository for conflicts of interest disclosures and highlighted several advantages including a reduced burden for researchers and organizations, the ability to harmonize on standardized definitions, and the ability to quickly capture discrepancies when including multiple sources . In mid-2015, the Association of American Medical Colleges developed Convey based on the IOM recommendations and sought to become a central repository for researchers to store records of their financial conflicts of interest. In 2014, Rasmussen et al.  advocated for the use of public information from registries where physicians and drug companies are responsible for providing information about industry relationships. Other examples of emerging registries include a voluntary register aimed at doctors registered in the UK with just over 250 entries  and reported plans to extract and aggregate disclosures from existing published articles .
To populate a centralized registry for conflicts of interest, we recommend the development of computational methods for accessing and aggregating information from published articles and the linking of local private sources of information with the public registry. We propose five desiderata to ensure the growth of the registry and its ongoing comprehensiveness once it has been populated with existing records (Table 2).
For a global public registry of researchers’ declared interests to be comprehensive, it requires a critical mass of support from researchers, journal editors, institutions, companies, and funding organizations. When ClinicalTrials.gov was launched in 2000, its success was not immediate. Recommendations in 2003 suggested that for the clinical trial registry to be comprehensive, it would require support from the National Institutes of Health, industry leaders, journal editors, and lawmakers . More recently, there has been a strong push for the release of patient-level trial data [76–78], with buy-in from both sides of the industry divide and indications that access to some types of patient level data is on the horizon. We are still lacking a corresponding level of unified pressure to ensure the comprehensive and transparent reporting of conflicts of interest disclosures.
A public record of changes to the registry would ensure that conflicts of interest disclosures can be audited, promoting the accuracy of the recorded information. The registry should permit the editing of records by individual researchers and permanently store public listings of the history of changes for all entries in the registry. In relation to the updating of registry information and the currency of the information available, the ICMJE and individual institutions could lead the development of publishing standards by requiring authors to update their registry profile as part of the manuscript submission or publication process.
Academic institutions, funding organizations, and external organizations could link internal registries to the public registry to update researcher information as they secure new funding, commercialize products or services, or enter into new agreements with companies and other organizations. To enable this form of interoperability, the registry must uniquely identify each active researcher. Where previous registries for disclosing industry relationships relied on uniquely identifying practicing physicians and doctors within individual countries [16, 73], it is much harder to reconcile the set of active researchers globally, and this may hinder the coverage of a registry. However, unique identifiers for researchers already exist to track authors across publications. The Open Researcher and Contributor ID (ORCID) is one candidate for the registry. It assigns unique identifiers to authors, allows users to update their own records, and supports the system-to-system communication that would be needed to link disclosed conflicts of interest to researchers and their publications. Another option is PubMed from the US National Library of Medicine, which assigns unique identifiers to authors, and includes programmatic access. However, the facilities provided by the NLM for authors to update, merge, or disambiguate their own record of publication are not widely used outside of the USA. Other systems like Google Scholar profiles provide author identifiers and the ability to disambiguate and remove articles, but do not yet provide public access for the system-to-system communication that would be required.
A taxonomy of disclosures
In order to clearly distinguish between the variety of financial and non-financial interests of a researcher and the specific conditions and interventions with which these interests may be in conflict, the registry should use an agreed and consistent taxonomy. A standardized language for describing conflicts of interest would enable users and researchers to better understand the potential impact of various types of conflicts of interest—in particular for non-financial conflicts of interest, for which there is a lack of evidence about prevalence and impact. In 2010, Rochon et al.  produced a checklist for clinical research studies that includes structured information appropriate for clinical trials, and this might provide partial information for primary studies. The IOM report commented on the difficulty of producing a standardized format for reporting disclosures , suggesting that this remains an unsolved problem in the area.
Registry data could be particularly useful to journal editors and the lay press if an Application Programming Interface (API) is developed to allow users to read and write conflicts of interest information for researchers using their unique identifiers. Publishers could support journals by using the API to create customizable templates that are automatically filled with authors’ relevant disclosures during the publishing process. Methods for tagging researchers’ interests by condition, intervention, or other medical concept may permit the automatic identification of conflicts. For example, methods applied in information retrieval use medical concept similarity to identify relationships between documents [80–82], which could be adapted to suit this purpose. These would work by matching the set of tags attached to each item in a researcher’s list of potential conflicts of interest with the interventions studied in a trial being submitted to a journal for review, assisting or replacing the manual identification of the subset of relevant disclosures.
If implemented to meet each of the above desiderata, a global public registry for researcher conflicts of interest would benefit multiple stakeholders in the research enterprise. The disclosure process would be more efficient for researchers, who could rely on a central repository of comprehensive, up-to-date, and standardized conflict of interest information for inclusion in research reports. Journal editors and peer reviewers could query the database to assess the types of conflicts of interest held by potential reviewers . Clinicians could evaluate research reports in the context of clear and concise descriptions of conflicts of interest. Similarly, journalists could support their readers in understanding and gauging research findings by providing relevant links in media reports to the registry.
To be clear, the act of disclosing a set of interests that could be in conflict with a researcher’s work does not alone guarantee that we are then able to effectively mitigate for the risk of bias [35, 59], but a comprehensive and accessible registry could provide the basis that would permit a more precise understanding of how conflicts of interest relate to biases and can influence a research consensus. For example, storing conflicts of interest as computable data would provide further opportunities for researchers conducting meta-analyses, performing systematic reviews, or compiling clinical guidelines. For the purposes of analysis, such data might allow researchers to investigate the influence of conflicts of interest in more systematic ways and would dramatically reduce what is an unusually resource-intensive task in meta-research. For journalists and readers of news media, removing disclosures from behind paywalls and centralizing the information greatly simplifies the process of understanding the context in which research is undertaken and reported.
While other forms of potential bias in biomedical research have been addressed through new processes and policies in the last decade, our ability to efficiently recognize and report on researcher conflicts of interest is still lagging behind other initiatives. It is imperative that we devise and support new approaches to identify, track, and account for conflicts of interest held by researchers in the biomedical sciences. This disclosure process should incorporate the key features outlined here, promoting a comprehensive and transparent approach that aims to ensure productive and trustworthy partnerships between researchers and industry.
Bekelman JE, Li Y, Gross CP. Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289(4):454–65. doi:10.1001/jama.289.4.454.
Horton R. Conflicts of interest in clinical research: opprobrium or obsession? Lancet. 1997;349(9059):1112–3. doi:10.1016/S0140-6736(97)22016-7.
Krimsky S, Rothenberg LS. Financial interest and its disclosure in scientific publications. JAMA. 1998;280(3):225–6. doi:10.1001/jama.280.3.225.
International Committee of Medical Journal Editors. Uniform requirements for manuscripts submitted to biomedical journals. JAMA. 1997;277(11):927–34. doi:10.1001/jama.1997.03540350077040.
Kesselheim AS, Wang B, Studdert DM, Avorn J. Conflict of interest reporting by authors involved in promotion of off-label drug use: an analysis of journal disclosures. PLoS Med. 2012;9(8):e1001280. doi:10.1371/journal.pmed.1001280.
Rasmussen K, Schroll J, Gøtzsche PC, Lundh A. Under-reporting of conflicts of interest among trialists: a cross-sectional study. J R Soc Med. 2014;108(3):101–7. doi:10.1177/0141076814557878.
Neuman J, Korenstein D, Ross JS, Keyhani S. Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study. BMJ. 2011;343:d5621. doi:10.1136/bmj.d5621.
Cook DM, Boyd EA, Grossmann C, Bero LA. Reporting science and conflicts of interest in the lay press. PLoS One. 2007;2(12):e1266. doi:10.1371/journal.pone.0001266.
Bes-Rastrollo M, Schulze MB, Ruiz-Canela M, Martinez-Gonzalez MA. Financial conflicts of Interest and reporting bias regarding the association between sugar-sweetened beverages and weight gain: a systematic review of systematic reviews. PLoS Med. 2013;10(12):e1001578. doi:10.1371/journal.pmed.1001578.
Lenzer J, Hoffman JR, Furberg CD, Ioannidis JPA. Ensuring the integrity of clinical practice guidelines: a tool for protecting patients. BMJ. 2013;347:f5535. doi:10.1136/bmj.f5535.
Wang AT, McCoy CP, Murad MH, Montori VM. Association between industry affiliation and position on cardiovascular risk with rosiglitazone: cross sectional systematic review. BMJ. 2010;340:c1344. doi:10.1136/bmj.c1344.
Stelfox HT, Chua G, O’Rourke K, Detsky AS. Conflict of interest in the debate over calcium-channel antagonists. NEJM. 1998;338(2):101–6. doi:10.1056/NEJM199801083380206.
Lenzer J. Alteplase for stroke: money and optimistic claims buttress the “brain attack” campaign. BMJ. 2002;324(7339):723–9. doi:10.1136/bmj.324.7339.723.
Cohen D, Carter P. WHO and the pandemic flu “conspiracies”. BMJ. 2010;340:c2912. doi:10.1136/bmj.c2912.
Lichter AS, McKinney R. Toward a harmonized and centralized conflict of interest disclosure: progress from an IOM initiative. JAMA. 2012;308(20):2093–4. doi:10.1001/jama.2012.51172.
McCartney M, Goldacre B, Chalmers I, Reynolds C, Mendel J, Smith S et al. Why the GMC should set up a central registry of doctors’ competing interests. BMJ. 2014;348. doi:10.1136/bmj.g236.
Roseman M, Milette K, Bero LA, Coyne JC, Lexchin J, Turner EH, et al. Reporting of conflicts of interest in meta-analyses of trials of pharmacological treatments. JAMA. 2011;305(10):1008–17. doi:10.1001/jama.2011.257.
Roseman M, Turner EH, Lexchin J, Coyne JC, Bero LA, Thombs BD. Reporting of conflicts of interest from drug trials in Cochrane reviews: cross sectional study. BMJ. 2012;345:e5155. doi:10.1136/bmj.e5155.
Jagsi R, Sheets N, Jankovic A, Motomura AR, Amarnath S, Ubel PA. Frequency, nature, effects, and correlates of conflicts of interest in published clinical cancer research. Cancer. 2009;115(12):2783–91. doi:10.1002/cncr.24315.
Perlis CS, Harwood M, Perlis RH. Extent and impact of industry sponsorship conflicts of interest in dermatology research. J Am Acad Dermatol. 2005;52(6):967–71. doi:10.1016/j.jaad.2005.01.020.
Perlis RH, Perlis CS, Wu Y, Hwang C, Joseph M, Nierenberg AA. Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry. Am J Psychiatry. 2005;162(10):1957–60. doi:10.1176/appi.ajp.162.10.1957.
Matsen FA, Jette JL, Neradilek MB. Demographics of disclosure of conflicts of interest at the 2011 Annual Meeting of the American Academy of Orthopaedic Surgeons. J Bone Joint Surg. 2013;95(5):e29. doi:10.2106/JBJS.K.01514.
Bosch X, Pericas JM, Hernández C, Doti P. Financial, nonfinancial and editors’ conflicts of interest in high‐impact biomedical journals. Eur J Clin Investig. 2013;43(7):660–7. doi:10.1111/eci.12090.
Bridoux V, Moutel G, Schwarz L, Michot F, Herve C, Tuech J-J. Disclosure of funding sources and conflicts of interest in Phase III surgical trials: survey of ten general surgery journals. World J Surg. 2014;38(10):2487–93. doi:10.1007/s00268-014-2580-5.
Norris SL, Holmer HK, Ogden LA, Burda BU, Fu R. Characteristics of physicians receiving large payments from pharmaceutical companies and the accuracy of their disclosures in publications: an observational study. BMC Med Ethics. 2012;13:24. doi:10.1186/1472-6939-13-24.
Chimonas S, Frosch Z, Rothman DJ. From disclosure to transparency: the use of company payment data. Arch Intern Med. 2011;171(1):81–6. doi:10.1001/archinternmed.2010.341.
Bindslev JBB, Schroll J, Gøtzsche PC, Lundh A. Underreporting of conflicts of interest in clinical practice guidelines: cross sectional study. BMC Med Ethics. 2013;14(1):19. doi:10.1186/1472-6939-14-19.
Mandeville KL, O’Neill S, Brighouse A, Walker A, Yarrow K, Chan K. Academics and competing interests in H1N1 influenza media reporting. J Epidemiol Community Health. 2013;68(3):197–203. doi:10.1136/jech-2013-203128.
Lathyris DN, Patsopoulos NA, Salanti G, Ioannidis JPA. Industry sponsorship and selection of comparators in randomized clinical trials. Eur J Clin Investig. 2010;40(2):172–82. doi:10.1111/j.1365-2362.2009.02240.x.
Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009;302(9):977–84. doi:10.1001/jama.2009.1242.
Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003;290(7):921–8. doi:10.1001/jama.290.7.921.
Yank V, Rennie D, Bero LA. Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ. 2007;335(7631):1202–5. doi:10.1136/bmj.39376.447211.BE.
Bourgeois FT, Murthy S, Mandl KD. Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med. 2010;153(3):158–66. doi:10.1059/0003-4819-153-3-201008030-00006.
Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012;2012(12):MR000033. doi:10.1002/14651858.MR000033.pub2.
Bero L. Industry sponsorship and research outcome: a Cochrane review. JAMA Intern Med. 2013;173(7):580–1. doi:10.1001/jamainternmed.2013.4190.
Dunn AG, Arachi D, Hudgins J, Tsafnat G, Coiera E, Bourgeois FT. Financial conflicts of interest and conclusions about neuraminidase inhibitors for influenza: an analysis of systematic reviews. Ann Intern Med. 2014;161(7):513–8. doi:10.7326/m14-0933.
Jørgensen AW, Hilden J, Gøtzsche PC. Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. BMJ. 2006;333(7572):782. doi:10.1136/bmj.38973.444699.0B.
Norris SL, Holmer HK, Ogden LA, Burda BU. Conflict of interest in clinical practice guideline development: a systematic review. PLoS One. 2011;6(10):e25153. doi:10.1371/journal.pone.0025153.
Shaneyfelt TM, Centor RM. Reassessment of clinical practice guidelines: go gently into that good night. JAMA. 2009;301(8):868–9. doi:10.1001/jama.2009.225.
Institute of Medicine (US) Committee on conflict of interest in medical research, education, and practice. Field MJ, Lo B. Conflict of interest in medical research, education, and practice. Washington (DC), United States: National Academies Press (US); 2009.
Loewenstein G, Sah S, Cain DM. The unintended consequences of conflict of interest disclosure. JAMA. 2012;307(7):669–70. doi:10.1001/jama.2012.154.
Barbour V, Clark J, Norton M, Simpson P, Veitch E. Does conflict of interest disclosure worsen bias? PLoS Med. 2012;9(4):e1001210. doi:10.1371/journal.pmed.1001210.
Cain DM, Loewenstein G, Moore DA. The dirt on coming clean: perverse effects of disclosing conflicts of interest. J Leg Stud. 2005;34(1):1–25. doi:10.1086/426699.
Cain DM, Loewenstein G, Moore DA. When sunlight fails to disinfect: understanding the perverse effects of disclosing conflicts of interest. J Consum Res. 2011;37(5):836–57. doi:10.1086/655862.
Dana J, Loewenstein G. A social science perspective on gifts to physicians from industry. JAMA. 2003;290(2):252–5. doi:10.1001/jama.290.2.252.
Loewenstein G, Cain DM, Sah S. The limits of transparency: pitfalls and potential of disclosing conflicts of interest. Am Econ Rev. 2011;101(3):423–8.
Kesselheim AS, Robertson CT, Myers JA, Rose SL, Gillet V, Ross KM, et al. A randomized study of how physicians interpret research funding disclosures. NEJM. 2012;367(12):1119–27. doi:10.1056/NEJMsa1202397.
Sacco D, Bruton S, Hajnal A, Lustgraaf CN. The influence of disclosure and ethics education on perceptions of financial conflicts of interest. Sci Eng Ethics. 2015;21(4):875–94. doi:10.1007/s11948-014-9572-6.
Smith R, Gøtzsche PC, Groves T. Should journals stop publishing research funded by the drug industry? BMJ. 2014;348:g171. doi:10.1136/bmj.g171.
Rosenbaum L. Reconnecting the dots—reinterpreting industry-physician relations. NEJM. 2015;372(19):1860–4. doi:10.1056/NEJMms1502493.
Rosenbaum L. Beyond moral outrage—weighing the trade-offs of COI regulation. NEJM. 2015;372(21):2064–8. doi:10.1056/NEJMms1502498.
Rosenbaum L. Understanding bias–—the case for careful study. NEJM. 2015;372(20):1959–63. doi:10.1056/NEJMms1502497.
Drazen JM. Revisiting the commercial-academic interface. NEJM. 2015;372(19):1853–4. doi:10.1056/NEJMe1503623.
Loder E, Brizzell C, Godlee F. Revisiting the commercial-academic interface in medical journals. BMJ. 2015;350:h2957. doi:10.1136/bmj.h2957.
Horton R. Offline: the BMJ vs NEJM—lessons for us all. Lancet. 2015;385(9984):2238. doi:10.1016/S0140-6736(15)61034-0.
Dunn AG, Coiera E. Should comparative effectiveness research ignore industry-funded data? J Comp Eff Res. 2014;3(4):317–20. doi:10.2217/cer.14.31.
Dunn AG, Bourgeois FT, Murthy S, Mandl KD, Day RO, Coiera E. The role and impact of research agendas on the comparative-effectiveness research among antihyperlipidemics. Clin Pharmacol Ther. 2012;91(4):685–91. doi:10.1038/clpt.2011.279.
Dunn AG, Mandl KD, Coiera E, Bourgeois FT. The effects of industry sponsorship on comparator selection in trial registrations for neuropsychiatric conditions in children. PLoS One. 2013;8(12):e84951. doi:10.1371/journal.pone.0084951.
Greenland S. Accounting for uncertainty about investigator bias: disclosure is informative: how could disclosure of interests work better in medicine, epidemiology and public health? J Epidemiol Community Health. 2009;63(8):593–8. doi:10.1136/jech.2008.084913.
Thompson DF. Understanding financial conflicts of interest. NEJM. 1993;329:573. doi:10.1056/NEJM199308193290812.
Califf R, Zarin D, Kramer J, Sherman R, Aberle L, Tasneem A. Characteristics of clinical trials registered in clinicaltrials.gov, 2007-2010. JAMA. 2012;307(17):1838–47. doi:10.1001/jama.2012.3424.
Zarin DA, Tse T, Ide NC. Trial registration at ClinicalTrials.gov between May and October 2005. NEJM. 2005;353(26):2779–87. doi:10.1056/NEJMsa053234.
Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC. The ClinicalTrials.gov results database—update and key issues. NEJM. 2011;364(9):852–60. doi:10.1056/NEJMsa1012065.
Dickersin K, Rennie D. Registering clinical trials. JAMA. 2003;290(4):516–23. doi:10.1001/jama.290.4.516.
Agrawal S, Brennan N, Budetti P. The Sunshine Act—effects on physicians. NEJM. 2013;368(22):2054–7. doi:10.1056/NEJMp1303523.
Dwan K, Gamble C, Williamson PR, Kirkham JJ, the Reporting Bias Group. Systematic review of the empirical evidence of study publication bias and outcome reporting bias—an updated review. PLoS ONE. 2013;8(7):e66844. doi:10.1371/journal.pone.0066844.
Laine C, Horton R, DeAngelis CD, Drazen JM, Frizelle FA, Godlee F, et al. Clinical trial registration—looking back and moving ahead. NEJM. 2007;356(26):2734–6. doi:10.1056/NEJMe078110.
Prayle AP, Hurley MN, Smyth AR. Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study. BMJ. 2012;344:d7373. doi:10.1136/bmj.d7373.
Hooft L, Korevaar DA, Molenaar N, Bossuyt PM, Scholten RJ. Endorsement of ICMJE's Clinical Trial Registration Policy: a survey among journal editors. Neth J Med. 2014;72(7):349–55.
Wager E, Williams P. “Hardly worth the effort”? Medical journals’ policies and their editors’ and publishers’ views on trial registration and publication bias: quantitative and qualitative study. BMJ. 2013;347:f5248. doi:10.1136/bmj.f5248.
van Lent M, IntHout J, Out HJ. Differences between information in registries and articles did not influence publication acceptance. J Clin Epidemiol. 2015;68(9):1059–67. doi:10.1016/j.jclinepi.2014.11.019.
Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2012;344. doi:10.1136/bmj.d7292.
Carpenter D, Joffe S. A unique researcher identifier for the Physician Payments Sunshine Act. JAMA. 2011;305(19):2007–8. doi:10.1001/jama.2011.651.
Pham-Kanter G. Act II, of the Sunshine Act. PLoS Med. 2014;11(11):e1001754. doi:10.1371/journal.pmed.1001754.
Robertson C. To support physician decision-making, re-evaluate industry funding of science. Health Affairs Blog. 2015. Available at: http://healthaffairs.org/blog/2015/07/16/to-support-physician-decision-making-re-evaluate-industry-funding-of-science/ [Accessed 20 Jan 2016].
Dunn AG, Day RO, Mandl KD, Coiera E. Learning from hackers: open-source clinical trials. Sci Transl Med. 2012;4(132):132cm5. doi:10.1126/scitranslmed.3003682.
Ross JS, Krumholz HM. Ushering in a new era of open science through data sharing: the wall must come down. JAMA. 2013;309(13):1355–6. doi:10.1001/jama.2013.1299.
Drazen JM. Sharing individual patient data from clinical trials. NEJM. 2015;372(3):201–2. doi:10.1056/NEJMp1415160.
Rochon PA, Hoey J, Chan A-W, Ferris LE, Lexchin J, Kalkar SR, et al. Financial Conflicts of Interest Checklist 2010 for clinical research studies. Open Med. 2010;4(1):e69–91.
Koopman B, Zuccon G, Bruza P, Sitbon L, Lawley M. An evaluation of corpus-driven measures of medical concept similarity for information retrieval. In: Proceedings of the 21st ACM international conference on Information and knowledge management. Maui: ACM; 2012. p. 2439–42. doi:10.1145/2396761.2398661.
Sánchez D, Batet M. Semantic similarity estimation in the biomedical domain: an ontology-based information-theoretic perspective. J Biomed Inform. 2011;44(5):749–59. doi:10.1016/j.jbi.2011.03.013.
Mu T, Goulermas JY, Korkontzelos I, Ananiadou S. Descriptive document clustering via discriminant learning in a co-embedded space of multilevel similarities. J Assoc Inf Sci Technol. 2016;67(1):106–33. doi:10.1002/asi.23374.
Vastag B. Reviewer leaked Avandia study to drug firm. Nature. 2008;451(7178):509. doi:10.1038/451509a.
Edlow JA, Smith EE, Stead LG, Gronseth G, Messé SR, Jagoda AS, et al. Clinical policy: use of intravenous tPA for the management of acute ischemic stroke in the emergency department. Ann Emerg Med. 2013;61(2):225–43. doi:10.1016/j.annemergmed.2012.11.005.
Lenzer J. Why we can’t trust clinical guidelines. BMJ. 2013;346:f3830. doi:10.1136/bmj.f3830.
Robbins BD, Higgins M, Fisher M, Over K. Conflicts of interest in research on antipsychotic treatment of pediatric bipolar disorder, temper dysregulation disorder, and attenuated psychotic symptoms syndrome: exploring the unholy alliance between big pharma and psychiatry. J Psychol Issues Organ Cult. 2011;1(4):32–49. doi:10.1002/jpoc.20039.
Deer B. How the case against the MMR vaccine was fixed. BMJ. 2011;342:c5347. doi:10.1136/bmj.c5347.
Deer B. How the vaccine crisis was meant to make money. BMJ. 2011;342:c5258. doi:10.1136/bmj.c5258.
Freed GL, Clark SJ, Butchart AT, Singer DC, Davis MM. Parental vaccine safety concerns in 2009. Pediatrics. 2010;125(4):654–9. doi:10.1542/peds.2009-1962.
Drs. Bourgeois and Mandl were supported by a grant from the National Institute on Aging (1R21AG043715), National Institutes of Health.
Dr. Dunn is an Associate Editor for Research Integrity and Peer Review. The authors have previously undertaken research measuring associations between financial conflicts of interest and the presentation of clinical evidence in published research.
AD, EC, KM, and FB conceived and designed the research and drafted and critically revised the manuscript. All authors read and approved the final manuscript.