Professional medical writing support and the quality, ethics and timeliness of clinical trial reporting: a systematic review

Abstract

Background

Many authors choose to work with professional medical writers when reporting the results of clinical trials. We conducted a systematic review to examine the relationship between professional medical writing support (PMWS) and the quality, ethics and timeliness of publications reporting clinical trials.

Methods

Using terms related to ‘medical writer’ and ‘observational study’, we searched MEDLINE and Embase (no date limits), as well as abstracts and posters from meetings of the International Society for Medical Publication Professionals (ISMPP; 2014–2018). We also hand-searched the journals Medical Writing and The Write Stuff (2014–2018) and the bibliographies of studies identified in the electronic searches. We screened the results to identify studies that compared the quality, ethics and timeliness of clinical trial publications written with and without declared PMWS.

Results

Our searches identified 97 potentially relevant studies, of which 89 were excluded during screening and full paper review. The remaining eight studies compared 849 publications with PMWS with 2073 articles developed without such support. In these eight studies, PMWS was shown to be associated with increased adherence to Consolidated Standards of Reporting Trials (CONSORT) guidelines (in 3/3 studies in which this was assessed), publication in journals with an impact factor (one study), a higher quality of written English (one study), and a lower likelihood of reporting non-pre-specified outcomes (one study). PMWS was not associated with increased adherence to CONSORT for Abstracts guidelines (one study) or with the impact of published articles (mean number of citations per year, mean number of article views per year and Altmetric score; one study). In studies that assessed timeliness of publication, PMWS was associated with a reduced time from last patient visit in clinical trials to primary publication (one study), whereas time from submission to acceptance showed inconsistent results (two studies).

Conclusions

This systematic review of eight observational studies suggests that PMWS is positively associated with measures of overall quality of reporting of clinical trials and may improve the timeliness of publication.

Video abstract. (MP4 161000 kb)

Background

Timely and complete reporting of the results of clinical trials is an ethical imperative [1]; it helps to efficiently disseminate research findings and eliminate duplicative effort thereby reducing waste in research funding [2], enables researchers to develop more up-to-date study hypotheses and allows clinicians and patients to judge the benefits or risks of different therapies. Although the pharmaceutical industry has made great strides to address criticism for a perceived lack of transparency in the disclosure of clinical trial results, the quality, ethics and timeliness of clinical trial reporting remain closely scrutinized for both industry-funded and academically funded trials [3,4,5,6,7].

Pharmaceutical companies often offer authors professional medical writing support (PMWS) to assist in the reporting of clinical trial results [8]. International guidelines endorse the acknowledgement of PMWS [9, 10], and the proportion of articles in the medical literature with such an acknowledgement is 5–18% [8, 11, 12]. We conducted a systematic review to identify and analyse published studies that investigated the association between PMWS and the quality, ethics and timeliness of clinical trial reporting.

Methods

Systematic literature search

Published studies relating to medical writing were identified through a systematic literature review. Cochrane, Embase, MEDLINE In-Process & Other Non-Indexed Citations, and MEDLINE 1946–present were searched on 8 March 2018 via the Ovid platform.

The search strategy comprised terms relating to medical writing, medical publication professional and medical communication and was combined with terms for observational, cross-sectional or epidemiological studies, with no limits on date, language or country in which the research was conducted (Fig. 1).

Fig. 1

PRISMA diagram of included and excluded studies. ISMPP, International Society for Medical Publication Professionals; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses

Supplementary searches

Supplementary searches were conducted of the International Society for Medical Publication Professionals (ISMPP) congress proceedings (which are published as supplementary articles in Current Medical Research Opinion) and the journals Medical Writing and The Write Stuff (which are available via the European Medical Writers Association [EMWA] website) using the terms ‘medical writ*’ and ‘medical publication professional’. A search of the American Medical Writers Association (EMWA) was not part of the search strategy. Supplementary searches were limited to 2014–2018. We contacted the corresponding authors of congress abstracts identified in the supplementary searches to request access to full posters/presentations. The bibliographies of studies identified in the electronic searches were also reviewed to identify additional relevant references.

Study selection and data collection

All identified studies were screened against inclusion and exclusion criteria in accordance with the 2009 Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [13]. For congress abstracts identified in the supplementary searches, full posters were obtained from the ISMPP website or from the authors. Identified congress abstracts were excluded as ‘duplicates’ if a full version of the study had been published. Studies eligible for inclusion were in English and compared the quality, ethics or timeliness of articles reporting clinical trials that had been developed with and without acknowledged PMWS. Studies that did not directly compare clinical trial publications that had been developed with and without PMWS were excluded, as were those that reported outcomes that were unrelated to quality, ethics or timeliness and those that assessed study types other than clinical trials.

Details of study methodology, study size, main outcome measures, quality and ethics-related outcomes (e.g. adherence to Consolidated Standards of Reporting Trials [CONSORT] or CONSORT for Abstracts [CONSORT-A], quality of written English, reporting of non-pre-specified outcomes) and timeliness-related outcomes were extracted from each eligible study. The effect of PMWS was classified as positive, non-significant or negative for each study, based on the results and statistical analyses reported in each publication.

Results

Search results

Our searches identified 75 potentially relevant publications after exclusion of 22 duplicate publications; three publications were identified in bibliographies of identified studies during screening, and 70 were excluded during screening and full paper review (Fig. 1). Of the eight included studies, three were full publications (two in peer-reviewed journals [14, 15], one in a non-peer-reviewed journal [16]), and five were congress abstracts (four poster presentations [17,18,19,20], one oral presentation [21]). Although no date limit was included in the search strategy, only two of the identified studies were published before 2015: one in 2006 [8] and the other in 2010 [16] (Table 1). The eight included studies analysed 849 articles that had been developed with PMWS and 2073 articles developed without.

Table 1 Overview of included studies

Quality and ethics of reporting

Of the identified studies comparing articles developed with and without PMWS, three assessed adherence to CONSORT guidelines [15, 16, 20]. Each of these studies, using a different statistical approach to assess adherence, showed that PMWS was associated with increased adherence to CONSORT guidelines (Table 2). Articles developed with PMWS were significantly more likely to report completely at least 50% of the assessed CONSORT items (p < 0.05) [15, 18] and to comply with more CONSORT items than articles without PMWS (p < 0.05) [16]. Similarly, articles with 80–100% compliance with CONSORT items were significantly more likely to have been developed with PMWS than those with less than 80% compliance (p < 0.0001) [20]. Looking at individual CONSORT items, one identified study showed that articles with PMWS were significantly more likely to report all important adverse events or side effects than those without PMWS [16] and another showed that PMWS increased adherence to six of 12 CONSORT items assessed: specification of primary outcome, sample size calculation, type of randomization, publication of a participant flow diagram, provision of dates defining recruitment and follow-up, and details of trial registration [15]. Additionally, in this study, another CONSORT item (who generated the allocation sequence) was only reported in 5/110 articles developed with PMWS and none of the 123 articles without PMWS; thus, a relative risk could not be calculated [15]. One additional study assessed adherence to CONSORT-A and showed that PMWS was not associated with an overall increase in adherence [14]; PMWS was associated with lower levels of adherence with respect to reporting of study setting and higher levels of adherence in relation to disclosure of harms/side effects and funding source in the abstract [14].

Table 2 Summary of results

Two studies which represented different analyses of the same group of articles looked at other markers of quality in reporting (Table 2) [15, 18]. In these studies, PMWS was positively associated with various measures of reporting quality, including a higher standard of written English (p < 0.01) [15, 18], higher likelihood of publication in a journal with an impact factor (p = 0.001) [18], and higher mean impact factor of the journal accepting the article (p < 0.001) [18]. However, there was no association between PMWS and article-level measures of impact, such as mean number of citations per year (p = 0.11), mean number of article views per year (p = 0.84) and Altmetric score (p = 0.55) (Table 2) [18]. Of the identified studies, one examined the relationship between outcome reporting and PMWS using data from the publicly available Centre for Evidence-Based Medicine Outcome Monitoring Project (COMPare) [23]. PMWS was associated with the reporting of fewer non-pre-specified outcomes (p = 0.028) [17].

Timeliness of publication

Three studies looked at the timeliness of clinical trial reporting in articles developed with or without PMWS (Table 2) [15, 19, 21]. The only study investigating the complete manuscript development time, from last patient visit in clinical trials to article publication, showed that PMWS was associated with reduced time to publication [19]. Two studies investigating the timing of one step in the process, from manuscript submission to acceptance, showed inconsistent results [15, 21]. In the first of these studies, PMWS was associated with increased time from manuscript submission to acceptance, although the mean number of versions submitted was unchanged [15]; in the second study, time from manuscript submission to acceptance was reduced, but not significantly [21].

Conclusions

This systematic review aimed to identify and evaluate studies assessing the effects of PMWS on quality, ethics and timeliness of clinical trial reporting. Overall findings from eight studies assessing 849 articles developed with PMWS and 2073 articles developed without PMWS suggest a positive association between PMWS and improvements in clinical trial reporting. These results were consistent across measures of quality (adherence to CONSORT guidelines and quality of written English), ethics (reporting of non-pre-specified outcomes) and timeliness (time to publication). The improvement in CONSORT adherence associated with PMWS is perhaps unsurprising, given that professional medical writers are routinely trained in Good Publication Practice (GPP3) for the development of peer-reviewed manuscripts [25]; GPP3 guidelines state that authors should follow established reporting standards, including CONSORT [9, 10]. Although PMWS was associated with improved adherence to CONSORT, it was not associated with improved adherence to CONSORT-A. Due to word-count constraints, authors may prioritize the reporting of key results over methodology and protocol details in the abstract (which is all that is read by many readers). Thus, although professional medical writers improve disclosure overall, they may need to improve reporting in the abstract.

The improvements in manuscript quality may not be reflected by increased article impact and social media attention. In the one study identified in our systematic review, which examined measures of article impact, there were no significant differences between articles developed with and without PMWS in relation to Altmetric score, number of citations per year and number of article views per year. Medical publications professions have no influence on the subject matter or relevance of the clinical trial, and as such, PMWS may not be expected to affect an article’s post-publication impact.

It is important that authors remain transparent about which specific clinical trial outcomes will be measured and reported. The COMPare project determined the proportion of pre-specified and non-pre-specified outcomes that were reported in clinical studies published in the top five medical journals over a 3-month period [23]. In the present systematic review, one included study conducted a sub-analysis of the publicly available COMPare data and assessed the relationship between PMWS and outcome reporting. The authors found that fewer non-pre-specified outcomes were reported for articles developed with PMWS than for those developed without. This is not the only study to have shown a positive association between PMWS and publication ethics. For instance, a recent study showed that PMWS is associated with increased transparency relating to the source of funding, the author disclosures of financial interest and the acknowledgements of conflicts of interest (or lack thereof) in health economics and outcomes research publications [26]; another study showed that, of 214 publications retracted owing to misconduct between January 1966 and February 2008, only three declared PMWS [27].

One included study looking at the influence of PMWS on timeliness found that PMWS was associated with reduced time from last patient visit to article publication. This period includes processes in which professional medical writers are involved and have a major role, namely manuscript preparation, editing and submission. Two other included studies that examined the influence of PMWS on time from manuscript submission to acceptance revealed mixed results. One of the studies found that time to acceptance was reduced with PMWS, but that the difference was not statistically significant. The other study found that time to acceptance was increased with PMWS. This finding may reflect increased scrutiny by peer reviewers in industry-funded research publications (which are more likely to involve PMWS) [28, 29]; however, it should be noted that the period from submission to article acceptance is not primarily the responsibility of professional medical writers.

Clinicians have reported lack of time as a common reason for non-publication of research findings [30,31,32]. By specializing in preparation of clinical trial publications, professional medical writers are well placed to aid in the rapid dissemination of trial findings under the direction of the authors, subject to strict publication guidelines [10]. In fact, results from a recent survey showed that authors who use PMWS were more likely to have published as first author at least once in the previous 2 years [33], suggesting that PMWS can also improve overall publication rates.

This systematic review has some limitations, notably that study inclusion was largely based on the assumption that differences in outcomes were attributable to PMWS. It is possible that other factors caused these differences in quality and timeliness. This issue may affect the results of individual studies, but this systematic review combined results from different studies looking at different outcomes of interest, and showed a consistent benefit of PMWS on manuscript quality (including adherence to publication guidelines, quality of written English and publication in high-quality journals), ethics (reporting of pre-specified outcomes) and timeliness (time from completion of trial to publication). Taken together, the findings of this systematic review support the conclusion that PMWS has a positive impact on the high quality, ethical and timely dissemination of clinical trial data.

The included studies classified articles as having been developed with PMWS only when there was a clear acknowledgement of this support. As such, it is possible that some of the studies classified as having been developed with no PMWS might have had PMWS but had simply failed to acknowledge it. By classifying publications with no clear acknowledgment of PMWS as ‘without PMWS’, the studies identified in this systematic review may have underestimated the effects of PMWS. To minimize the risk of publication bias, we employed a broad search strategy with no limits on date, country, language or type of observational study. Most of the identified studies were sourced from conference proceedings (for which the full poster or oral presentation was available in 4/5 cases) and one was published in a non-peer-reviewed journal.

In the identified studies, the outcome measures chosen were widely accepted as measures of quality and completeness. For instance, CONSORT is an independently developed measure of reporting standards recommended by the International Committee of Medical Journal Editors and also medical publications and medical writing societies, including ISMPP, EMWA and the American Medical Writers Association [10]. Other outcomes of interest assessed in this review were assigned independently of the investigators involved in each of the articles analysed in each included study (e.g. standard of written English—assessed during peer review of analysed articles [18]). As such, in this systematic review, we have been successful in analysing a range of outcomes assessed in observational (‘real-world’) studies in a standardized manner that minimizes publication bias.

Further research is needed to elucidate the role of PMWS in clinical trial publication, particularly with regard to productivity and added value [34]. Further research is also required to assess the impact of PMWS in other types of studies published by the pharmaceutical industry, such as observational studies and systematic reviews. As our systematic review identified that most studies of PMWS have only been presented at conferences or published in non-peer-reviewed journals, it is crucial that future studies are published in full in peer-reviewed journals [35, 36].

Currently, the pharmaceutical industry is more likely than non-industry institutions to disclose clinical trial results properly [37]. This is probably due to a larger investment in internal processes and infrastructure, which includes the use of PMWS. In fact, there have been calls for professional medical writers and publication experts to be employed by academic institutions [38, 39]. Additionally, in a survey looking at attitudes to PMWS, academic and clinician respondents to an online survey were generally accepting of PMWS, particularly its influence on editing, journal styling and adherence to reporting guidelines, with 84% of respondents stating that they valued PMWS [40]. In this survey, 82.9% of respondents felt that it was acceptable to receive PMWS; in another survey, PMWS was seen as ‘adding value to publication development’ by almost 90% of participants [41]. Our systematic review appraising current research in this area helps to substantiate the positive attitude to PMWS that is held by clinical and academic professionals seeking to ensure the ethical, accurate and timely publication of clinical trials.