Skip to content

Advertisement

Research Integrity and Peer Review

Research
Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Reporting of sex and gender in randomized controlled trials in Canada: a cross-sectional methods study

Research Integrity and Peer Review20172:15

https://doi.org/10.1186/s41073-017-0039-6

©  The Author(s) 2017

Received: 29 March 2017

Accepted: 26 June 2017

Published: 1 September 2017

Open Peer Review reports

Abstract

Background

Accurate reporting on sex and gender in health research is integral to ensuring that health interventions are safe and effective. In Canada and internationally, governments, research organizations, journal editors, and health agencies have called for more inclusive research, provision of sex-disaggregated data, and the integration of sex and gender analysis throughout the research process. Sex and gender analysis is generally defined as an approach for considering how and why different subpopulations (e.g., of diverse genders, ages, and social locations) may experience health conditions and interventions in different or similar ways.

The objective of this study was to assess the extent and nature of reporting about sex and/or gender, including whether sex and gender analysis (SGA) was carried out in a sample of Canadian randomized controlled trials (RCTs) with human participants.

Methods

We searched MEDLINE from 01 January 2013 to 23 July 2014 using a validated filter for identification of RCTs, combined with terms related to Canada. Two reviewers screened the search results to identify the first 100 RCTs that were either identified in the trial publication as funded by a Canadian organization or which had a first or last author based in Canada. Data were independently extracted by two people from 10% of the RCTs during an initial training period; once agreement was reached on this sample, the remainder of the data extraction was completed by one person and verified by a second.

Results

The search yielded 1433 records. We screened 256 records to identify 100 RCTs which met our eligibility criteria. The median sample size of the RCTs was 107 participants (range 12–6085). While 98% of studies described the demographic composition of their participants by sex, only 6% conducted a subgroup analysis across sex and 4% reported sex-disaggregated data. No article defined “sex” and/or “gender.” No publication carried out a comprehensive sex and gender analysis.

Conclusions

Findings highlight poor uptake of sex and gender considerations in the Canadian RCT context and underscore the need for better articulated guidance on sex and gender analysis to improve reporting of evidence, inform policy development, and guide future research.

Keywords

Sex/gender analysisGenderRandomized controlled trials as a topicCanadaQuality

Background

Over the past several decades, there has been increasing awareness within the community of health researchers, funders, and knowledge users (e.g., policy-makers, practitioners, and patients) of the need to understand how sex and gender influence health outcomes [1, 2]. “Sex” is commonly used to refer to genetic, biological, and physiological processes; whereas “gender” is commonly used to refer to the roles, relationships, behaviors, relative power, and other traits that societies ascribe to women, men, and people of diverse gender identities [3]. Sex and gender interact with each other and other characteristics to influence health outcomes [4–9]. For example, research indicates there are significant physiological differences in cardiac function between males and females such as susceptibility to QT interval prolongation and serious heart arrhythmias as well as gender differences in how men and women who have heart disease are diagnosed and treated [10–12]. Failure to take these differences into account, not just between men and women, but also across other characteristics such as age and socioeconomic status, can have serious, even life-threatening, consequences for individual patients.

As used in this paper, sex and gender analysis is an approach and framework for considering fundamental questions about how and why different subpopulations (e.g., of diverse genders, ages, and social locations) may experience health conditions and interventions in different or similar ways. These fundamental questions are systematically applied to all stages of the research process, starting with the formulation of the initial research question, followed by the development of methodology, conduct of the analysis, and interpretation of results and reflecting on their implications [13–16].

Policies and guidance increasingly mandate or recommend routine collection, reporting and analysis of the influence of sex and gender in scientific research. However, uptake of sex and gender analysis, and its impacts on reporting and on health outcomes remain unclear [2, 17, 18]. For example, funding policies of the U.S. National Institutes of Health (Revitalization Act 1993) [19], mandating the appropriate inclusion of women and minorities in clinical trials have resulted in increased inclusion of diverse populations in some areas of health research [20, 21] but not all [22]. Furthermore, sex and gender analysis to assess similarities or differences in health outcomes remains limited [23]. In the Canadian federal context, neither Health Canada’s 1997 Guidance Document on Inclusion of Women in Clinical Trials nor the more detailed May 2013 document that replaced it, “Considerations for Inclusion of Women in Clinical Trials and Analysis of Sex Differences” [24], provide mechanisms to track implementation of this guidance by researchers and sponsors of clinical trials in Canada to identify outcomes in relation to sex and gender considerations. In 2011, the Canadian Institutes of Health Research (CIHR) implemented a requirement that all research grant applicants indicate whether their research proposal addresses sex and gender and to provide justification for their response [25, 26]. The preliminary results assessing the implementation of this policy indicate increased consideration of sex and gender in most categories of research proposals [26], but the impact of the policy on the conduct and reporting of research, including randomized controlled trials (RCTs), has yet to be examined.

The objective of this study was to provide a preliminary assessment of the extent and nature of reporting about sex and/or gender, including whether sex and gender analysis was carried out, in a sample of recently published Canadian RCTs with human participants.

Methods

A collaborative research team (all authors on this paper) engaged in a deliberative, consensus building process and team meetings conducted to plan, develop, and conduct a cross-sectional study to meet our objective.

Consensus was reached on a data extraction form and methods for the study. Our working definitions of sex and gender were adapted from the Canadian Institutes of Health Research, Canada’s health research funding agency, which recognizes sex and gender as analytically distinct but interdependent concepts and which also acknowledges the nuances of sex and gender beyond the binary [27].

For the purposes of our search, Canadian trials were defined as those that were either identified in the publication as funded by a Canada-based funder and/or had a first or last author with affiliation based in Canada. To account for the diverse nature of Canadian trials, which can involve cross-border and inter-sectoral collaborations, we included multi-centre trials, as well as trials funded jointly by Canadian and international sources. We did not restrict inclusion on the basis of age (e.g., children, adolescents) or whether the trial focused on specific populations (including across sex and/or gender). We chose a sample size of 100 RCTs based on the sample size of other similar methodological studies [23, 28, 29]. This sample size of 100 trials will detect a proportion of 25% with a 95% confidence interval of ±8.5%.

A search strategy was developed in consultation with a librarian scientist (TR) to identify Canadian RCTs conducted with human participants. This strategy comprised a MEDLINE search using the OVID interface with the specific filter (randomized controlled trial.pt OR randomized controlled trial.mp) combined with Canadian provinces/territories (Quebec or Ontario or “Prince Edward Island” or New Brunswick or Nunavut or “Northwest Territories” or Nova Scotia or Newfoundland or Labrador or Yukon or British Columbia or Manitoba or Alberta or Saskatchewan).in OR (Canadian or Canada).in) from 01 January 2013 to 23 July 2014. We chose to search MEDLINE up to 1 year prior to data collection because most articles would be indexed according to Medical Subject Headings by this time, allowing the use of the specific filter for randomized trials.

Two authors screened records independently (duplicate screening) in order of date of publication, starting with the most recent, to identify those RCTs meeting eligibility criteria.

A data extraction form was developed and pre-tested to capture data on the type of intervention, study design (cluster or individually randomized trial), sample size, and funding sources. We assessed whether sex and gender analysis was conducted, what was done and how this was reported, drawing from items in the PRISMA-Equity extension [30] and the European Association of Science Editors (EASE) guidance [31]. Details on whether sex or gender were mentioned and in what context were collected from the title/abstract, introduction, methods, eligibility criteria, population characteristics, results, subgroup analysis, interpretation of applicability, and discussion. We also collected data on reporting of social determinants of health (e.g., socioeconomic status, occupation, place of residence) which will be reported in a separate paper (contact first author for details) (see Additional file 1: Appendix 1 for complete list of data extraction items).

Data were independently extracted by two people from 10% of the RCTs as a training exercise: once agreement was reached on this sample [32] the remainder of the data extraction was completed by one person (one of TB, LQ, and MY) and was verified by a second (one of JJ, VW).

We included both primary publications of RCTs as well as secondary publications (i.e., secondary analyses on RCTs that had already been published). For 13 secondary publications, we identified the primary RCT publication and used that as the basis for the data extraction, and supplemented with information from the secondary publication. Secondary publications were included because subgroup analyses are sometimes reported in secondary, follow-up publications rather than in the primary trial report.

Results

Search results

The search identified 1433 records. We screened 256 records from the most recent to the oldest to identify the first 100 eligible RCTs. Of the ineligible records, 120 were excluded because they were not RCTs or involved non-human subjects. We also excluded 36 RCTs that did not have a Canadian funder or a first or last author based in Canada (Fig. 1).
Figure 1
Fig. 1

Study flow chart

Description of the sample

Inclusion criteria

Canadian funding was reported in 68/100 of the RCTs (68%), while the remaining 32 trials were eligible for inclusion in the sample on the basis of having a first or last author based in Canada. Of these 32 trials, 13 were funded by non-Canadian sources and 19 did not report on any sources of funding. Of the 81 RCTs that did report on funding sources, 37 identified non-profit sources of funding; 22 identified government sources (e.g., Canadian Institutes of Health Research, Health Canada); 10 indicated they were solely funded by industry; while 8 RCTs identified a combination of non-profit and government sources; 2 identified non-profit and industry funding and 2 identified government and industry sources of funding (Additional file 2: Appendix 2).

Population

We classified trials as “single-sex” and “mixed-sex”, based on the terminology used by Gendered Innovations [33]. Twelve RCTs were classified as single-sex studies because they had eligibility criteria that restricted participation to women, one RCT enrolled girls and one RCT enrolled boys. The remainder of RCTs were classified as mixed-sex because they enrolled male and female participants. Eighty-five out of 88 mixed-sex RCTs reported the number of enrolled male and female participants. For these, the median number of male participants was 45 (range 3–3843) and the median number of female participants was 53 (range 1–1712). As shown in Table 1, the median sample size of the 100 RCTs was 103 (range 20–1466) for single sex studies and 107 participants (range 12–6085) for mixed-sex studies. As noted, we did not restrict inclusion on the basis of age or focus on specific populations. Two trials did not provide any information about the sex of the population, referring to the population as patients or nurses/care aides.
Table 1

Characteristics of RCTs (n = 100)

Study characteristics

Single-sex RCTs (n = 12)

Mixed-sex RCTs (n = 88)

Total (100)

N (%) unless otherwise specified

N (%) unless otherwise specified

N (%) unless otherwise specified

First author Canadian

11

88

99 (99%)

Last author Canadian

12

81

93 (93%)

Sample size (randomized)

103 (median) Range (20–1466)

107 (median) Range (12–6085)

107 (median) range (12–6085)

Reports recruitment methods

7 (58%)

43 (49%)

50 (50%)

Cluster RCTs

1 (8%)

8 (9%)

9 (9%)

Type of intervention

Pharmacological

5 (42%)

32 (36%)

37 (37%)

Non-pharmacological

7 (58%)

45 (51%)

52 (52%)

Surgical

0 (0%)

6 (7%)

6 (6%)

Organizational

0 (0%)

5 (6%)

5 (5%)

Multi-site

Within Canada

3 (25%)

24 (27%)

27 (27%)

Outside of Canada (includes Canada)

0 (0%)

13 (15%)

13 (13%)

Outside of Canada (not including Canada)

0 (0%)

1 (1%)

1 (1%)

Region NRa

0 (0%)

1 (1%)

1 (1%)

Single-site

Within Canada

8 (67%)

47 (53%)

55 (55%)

Outside of Canada

1 (8%)

1 (1%)

2 (2%)

Region NR

0 (0%)

1 (1%)

1 (1%)

Canadian funding

Yes

9 (75%)

59 (67%)

68 (68%)

No

0 (0%)

13 (15%)

13 (13%)

NR

3 (25%)

16 (18%)

19 (19%)

Type of funding

Non-profit

3 (25%)

34 (39%)

37 (37%)

Government

4 (33%)

18 (20%)

22 (22%)

Industry

0 (0%)

10 (11%)

10 (10%)

Non-profit + government

2 (17%)

6 (7%)

8 (8%)

Non-profit + industry

0 (0%)

2 (2%)

2 (2%)

Government + industry

0 (0%)

2 (2%)

2 (2%)

Not reported

3 (25%)

16 (18%)

19 (19%)

a NR not reported. No information was provided

Multi- and single site

Of the 100 RCTs, 42 were reported as multi-site and 58 were single-site RCTs. Not all trials provided information on the study site(s) (Table 1). In the subset of multi-site trials that did report information on site location, 27/42 (64%) were conducted entirely within Canada and only one out of the remaining 15 included no sites within Canada. In single-site RCTs reporting location, the majority (55/58 or 95%) were conducted in Canada, 2 RCTs were conducted in other countries but had Canadian first or last authors and one RCT did not describe site location.

Types of interventions

The interventions included in the sample of 100 RCTs were highly diverse. These included 52 non-pharmacological interventions, such as rehabilitation techniques, food supplements (e.g., canola oil and ginseng), and cognitive behavior interventions; 37 pharmacological interventions, (e.g., the use of simvastatin in hypertension); 6 surgical interventions, (e.g., coronary artery bypass grafting); and 5 organizational interventions (e.g., simulation-based training for laparoscopic inguinal repair) (see complete list of included studies in Additional file 3: Appendix 3).

Reporting of sex/gender in RCTs

Sex and gender terminology in RCTs

The terminology used by authors to describe the participant demographic composition by “sex or gender” varied. For example, some trials used the term gender and some used sex. No RCT provided or referenced a definition of sex or gender or of sex and gender analysis. No studies reported on inclusion of gender diverse participants (e.g., transgender, gender non-binary, or other gender identities). Similarly, no studies used the term cisgender or transgender to describe the populations. For this reason, reference to males and females in this review and in the source references is assumed to refer to cisgender females and males according to Schilt and Westbrook’s (2009) definition of cisgender referring to “individuals who have a match between the gender they were assigned at birth, their bodies, and their personal identity” (p. 461) [34]. Because the RCTs varied in the use of terms related to sex and gender, we use the expression sex or gender to report the results.

Reporting of sex or gender in the sample of RCTs

None of the RCT authors stated that they intended to conduct sex and gender analysis, nor did any do so.

The extent to which sex or gender was reported across various sections of RCT publications varied considerably, as shown in Fig. 2. We provide examples of reporting to illustrate each section.
Figure 2
Fig. 2

Reporting of sex and/or gender in RCTs

Title/abstract of RCTs

In the title or abstract, 19 (19%) RCTs reported on some aspect of sex or gender.

Single-sex studies

In the title or abstract, 11 out of 12 (92%) single-sex RCTs reported some aspect of sex or gender. For four of these, the population was defined in the title. For example, “Effect of a Novel Movement Strategy in Decreasing ACL Risk Factors in Female Adolescent Soccer Players: A Randomized Controlled Trial” [35].

Mixed-sex studies

Eight out of 88 (9%) RCTs reported on some aspect of sex or gender, and this was mentioned only in the abstract.

Background/rationale of RCTs

In the rationale or background section, sex or gender was only mentioned in 11 (11%) of the RCTs. Single-sex studies: 5 out of 12 single-sex RCTs (42%) reported on sex or gender in the background section. Three of the RCTs reported information on prevalence or importance of a condition in subpopulations. Two of these studies reported a rationale related to sex or gender.

Mixed-sex studies

Six out of 88 mixed-sex RCTs (7%) reported sex or gender information in the background section. One RCT reported information on prevalence across sex or gender. For example, one RCT stated that “…symptomatic knee OA (ed: osteoarthritis) occurs in 10% of men and 13% of women ages ˃59 years (pg.1837)” [36]. Five RCTs reported a rationale related to why the intervention might work differently across sex or gender or provided background evidence about differential effects. For example, one study of compression technologies for leg ulcer care stated in the background that, “women did more poorly according to one study, but two other studies found no significant effect of gender (pg. 1834)” [37]. Of these six studies, none report analyzing the effect of sex or gender but three RCTs discuss applicability of results with regards to sex or gender.

Eligibility criteria of RCTs

Single-sex studies

All 12 single-sex RCTS described an exclusion based on sex or gender. Two of these 12 RCTs (1 with pharmacological intervention and 1 with non-pharmacological intervention) excluded pregnant/breastfeeding women.

Mixed-sex studies

Twenty-one of the 88 mixed-sex RCTs (24%) described exclusion criteria based on sex or gender. Twelve RCTs excluded pregnant/breastfeeding women, 1 excluded women of child-bearing age, and 4 RCTs excluded both pregnant women and women of childbearing age. Thirteen of these 17 RCTs evaluated pharmacological interventions. For example, one pharmacological intervention using “low (50 mg/day) or high (200 mg/day) dose of Losartan” excluded “pregnant and lactating women”(pg. 590) [38] and another using a “supplement with a high-dose micronutrient, mineral and antioxidant preparation (K-PAX UltraH) or an identically appearing 100% RDA preparation of multivitamins and minerals” had exclusion criteria that included “HIV-2 infection alone, pregnancy or not willing to practice barrier method of birth control” (pg. 3) [39]. Of the remaining four RCTs that excluded pregnant/breastfeeding women or women of child-bearing age, two RCTs were non-pharmacological interventions, one surgical, and one organizational intervention. No studies discuss the rationale or risk considerations for excluding on the basis of pregnancy.

Intervention description in RCTs

Only one mixed-sex RCT took sex or gender into account when describing the characteristics of how an intervention was implemented. In that study, authors reported using a “male and female team” to present educational sessions on managing side effects of androgen deprivation therapy (ADT) and the impact on couples [40]. The rationale provided was: “so that attendees would understand that the program was meant to serve equally the concerns of the male patient and the female partner (in heterosexual couples) (pg. 228)” [40].

Description of participants in RCTs

Almost all RCTs (98%) reported demographic characteristics by sex or gender by identifying number of male/female participants in text or as part of their demographic table describing baseline characteristics.

Single-sex studies

Six of the 12 single-sex RCTs used terms related to gender (men, women, boys) to report the population studied and the other six RCTs use the terms male and/or female.

Mixed-sex studies

Fifteen of 88 RCTs used the term gender to describe the population and 16 RCTs used the terms ‘men/women’ to report the population demographics. Eighty-six RCTs reported the population demographics according to sex or gender. As noted above, two RCTs did not provide any description of population by sex but instead referred to participants as “patients” (n = 1) [41] or “nurses/care aides” (n = 1) [42].

Statistical analysis of RCTs across sex or gender

Mixed-sex studies

Twenty of the 88 RCTs (23%) reported analyses related to sex or gender in the methods section, but none included a comprehensive sex and gender analysis across stages of the research process [6]. These statistical methods included randomization stratified by sex or gender (3 RCTs) [43–45], adjusting for sex or gender as a covariate (11 RCTs) [37, 46–55] and subgroup analysis across sex or gender (6 RCTs) [56–61].

The three trials which stratified randomization by sex or gender did not report subgroup analyses across sex or gender [43–45]. All 11 RCTs that described an intention to adjust for sex or gender as a variable, adjusted for or included sex or gender as a covariate in their analysis model.

For the six RCTs that reported results of subgroup analyses across sex or gender mentioned above, five RCTs pre-specified the intention to conduct subgroup analysis by sex or gender in the methods section. Only four studies provided sex-disaggregated data across intervention and comparator arms [51, 58, 60, 62]. For example, a study looking at effects of Korean red ginseng provides the mean and standard deviation of the outcome for each intervention arm and control arm disaggregated for male and female (pg. 166) [51]. Only one of the six studies that conducted subgroup analyses discussed the treatment interactions by sex in their discussion of results [60].

Discussion/conclusions of RCTs

Single-sex studies

Seven of 12 RCTs reported on sex or gender in their discussion regarding applicability and implications. For example, one study examining the effect of zinc supplementation on copper status in boys reported that “… the results of this study are expected to be generalizable to girls (pg. 288)” [63].

Mixed-sex studies

Eleven of the 88 RCTs reported on sex or gender implications of their findings. For example, one study stated that: “…although differences did not attain statistical significance, women were overrepresented in the SBI (ed: spiritually based intervention) and the extent to which findings can be fully extended to men is not clear (pg.504)” [64]. A study on colorectal cancer screening concluded: “Our results confirm those reported in that FOBT (ed: fecal occult blood test) uptake tends to increase with age among men and women (pg.9)” [65].

Discussion

We found no examples of sex and gender analysis in a sample of 100 Canadian-led or funded RCTs [24, 27, 66]. Where sex and gender were considered, these considerations were often limited and mainly focused on biomedical analysis of differences across sex. For example, no studies considered the influence of gender. Only 6% (six studies) of our sample reported subgroup analyses across sex or gender. This was despite the fact that over 50% of our sample of RCTs evaluated non-pharmacologic interventions such as decision aids, cognitive therapy, self-help education tools, and community-based interventions where gender may play an important role in how the intervention is delivered (by whom and in what context) and received. Furthermore, of the six RCTs with subgroup analysis, only one commented in any depth on the methodological challenges of conducting sub-group analysis or on the significance of their findings and implications for clinical practice. We also noted inconsistent use of terminology in some RCTs, with sex and gender being used without definition and sometimes interchangeably. In RCTs, information on eligibility and recruitment forms is usually collected as “male/female”, and the use of the term “gender” may be inaccurate. These findings are consistent with those of recent studies looking at sex-related reporting in randomized trials published in major medical journals [23, 67]. Clarity in the application of the conceptual constructs of sex and gender and of sex and gender analysis is an important component of scientific rigor and contributes to the growing understanding of the ways that sex-based biological factors and gendered social factors are intertwined and interact with other social factors, shaping health behavior, opportunities, and outcomes [5, 24, 68–70].

The credibility and clinical importance of sex-based subgroup analyses must be carefully scrutinized since there is a risk of spurious findings due to under-powered tests and multiple testing. A recent meta-synthesis found that statistically significant effects of sex on treatment response in randomized trials were rarely reported, and when they were, they were rarely confirmed in subsequent trials or in meta-analyses, and very rarely led to a recommendation for differential treatment [71]. However, examples where differential treatment has been recommended (e.g., weight management for men by Public Health England [72], statin management [71], and differential dosage recommendations based on a differential risk-benefit ratio for Ambien (Zolpidem) [73], justify the need for sex and gender analysis in trials. The lack of data and analysis about women and coronary heart disease (due to exclusion of women from some clinical trials) is postulated as one of the reasons for under-treatment of women with symptoms of ischaemic heart disease [74]. There is a need for an improved evidence-base and for robust methodologies to determine differences and similarities of effects across sex and gender [6].

A variety of initiatives are attempting to address inconsistent terminology and the lack of robust sex and gender analysis in health research. For example, the Canadian Institutes of Health Research has published a casebook [66] and a tool for peer reviewers of grants and/or papers [27], a major advancement in promoting appropriate sex and gender analysis in research [75]. The SAGER (Sex and Gender Equity in Research) guidelines were developed by the Gender Policy Committee of the European Association of Science Editors (EASE) for reporting sex and gender in all types of science publications [31]. At the same time, academic journals are putting in place editorial policies that require sex-specific or gender-specific reporting [76]. Members of our team have recently developed reporting guidelines for health equity relevant RCTs, as an extension of the CONSORT statement (Consolidated Reporting of Randomized Trials) [77] and briefing notes to improve the consideration of sex and gender in systematic reviews [3]. All of these tools can be used by authors of RCTs to improve reporting of sex and gender.

More initiatives are needed to implement these and other tools and encourage their use to address the lack of sex and gender analysis in trials. Different strategies may be needed to tailor these initiatives for specific audiences such as trialists, funders, journal editors, patients/public, and policy-makers [78].

Furthermore, in our study, there were no RCTs that mentioned gender diverse populations. As knowledge of sex and gender analysis develops, approaches to study design and analysis need to keep current with clear and consistent terminology to support gender-sensitive decision-making [6].

This study examined reporting of sex, gender, and sex and gender analysis in a sample of Canadian RCTs, where sectors of the funding environment are actively promoting inclusion of sex and gender analysis in all research [26]. Although our study reviewed only a small cross-section of Canadian RCTs, our findings suggest that despite policies to encourage sex and gender analysis we are not yet seeing impacts in terms of sex and gender reporting in RCTs and uptake of sex and gender analysis. Reporting sex and gender considerations in peer-reviewed publications is a key indicator of whether policy efforts to mandate and encourage sex and gender analysis are effective. Thus, it will be important to continue to monitor changes in reporting over time to determine whether policy interventions are delivering their intended outcomes and develop new approaches for increasing skill level in the research and knowledge user communities.

This preliminary study has a number of limitations. This study is limited to what is reported in the included RCTs. It is possible that the effects of sex and/or gender on response were tested in more studies but not reported. Also, this sample of RCTs includes relatively small RCTs (with a median of 100 participants) and many of the studies would be underpowered to detect differences in response across sex or gender. In the six RCTs which did conduct a subgroup analysis across sex or gender, we did not assess the power for this analysis, nor the quality of these analyses because we expected there to be too few studies with these analyses to be generalizable to other situations. Another limitation is that our definition of “Canadian” trials may have missed or under-selected multi-national trials. We did not collect whether the flow of participants was reported according to gender (e.g., recruited, enrolled, completed), and this information would be important for conducting a sex and gender-based analysis. We also did not contact authors to obtain any additional details about sex and gender analysis, methods, or results. As well, the findings in this study may not be extrapolated to RCTs conducted primarily in other countries, due to the focus on Canadian RCTs, although some studies included multiple non-Canadian sites [23, 79].

Conclusions

This survey of a sample of Canadian RCTs reveals very little analysis of differences or similarities in health outcomes across sex and/or gender, and no clear attempts on the part of researchers to integrate elements of sex and gender analysis. Furthermore, there was no mention of inclusion or exclusion of gender diverse people. This study provides a baseline and methodological approach to compare and assess changes in reporting about sex and gender and in the application of sex and gender analysis in future Canadian RCTs, and adds to global and Canadian efforts to make the case for integrating sex and gender analysis in health research. This study demonstrates a need for continued efforts to improve appropriate consideration and reporting of sex and gender and the integration of sex and gender analysis in randomized trials so that ultimately health services and policies address the needs of diverse populations and improve health outcomes for all.

Abbreviations

CIHR: 

Canadian Institutes of Health Research

EASE: 

European Association of Science Editors

NIH: 

National Institute of Health

PRISMA-Equity: 

Preferred Reporting Items for Systematic Reviews and Meta-Analyses for equity-focused systematic reviews

RCT: 

Randomized controlled trials

Declarations

Acknowledgements

We would like to thank our funders and Theo Ambie who assisted with data collection.

Funding

Institute of Gender and Health, Canadian Institutes of Health Research, Planning Grant (#328296).

Availability of data and materials

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

VW, MD, SEC, VR, ST, LP, BS, and MB conceptualized the cross-sectional method study. MY, JJ, LQ, and TB extracted the data. TR contributed to the search strategy. MY, VW, JJ, and JP interpreted the data and wrote the initial manuscript. All co-authors contributed to the planning and interpretation of the data through revisions of the manuscript. All authors read and approved the final manuscript.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Bruyère Research Institute, Bruyère Continuing Care, Ottawa, Canada
(2)
University of Ottawa, Ontario, Canada
(3)
School of Nursing, University of British Columbia, Vancouver, Canada
(4)
Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Canada
(5)
Research Sex/gender, Health Equity, Primary Care Consultant, North Vancouver, Canada
(6)
Department of Geography and Planning, Queen’s University, Kingston, Canada
(7)
Renison University College, University of Waterloo, Waterloo, Canada
(8)
Cochrane Musculoskeletal, University of Ottawa, Ottawa Hospital Research Institute, The Ottawa Hospital, Ottawa, Canada
(9)
B.C. Women’s Hospital + Health Centre, Vancouver, Canada
(10)
Department of Anesthesiology, Pharmacology & Therapeutics, Faculty of Medicine, University of British Columbia, Vancouver, Canada
(11)
Canadian Agency for Drugs and Technology in Health, Ottawa, Canada
(12)
Globalization and Health Equity Research Unit, School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Canada
(13)
Gender and Health Consultant, Ottawa, Canada

References

  1. Clayton JA, Collins FS. Policy: NIH to balance sex in cell and animal studies. Nature. 2014;509:282–3.View ArticleGoogle Scholar
  2. Johnson JL, Beaudet A. Sex and gender reporting in health research: why Canada should be a leader. Can J Public Health. 2013;104(1):e80–1.Google Scholar
  3. Doull M, Welch V, Puil L, Runnels V, Coen SE, Shea B, O'Neill J, Borkhoff C, Tudiver S, Boscoe M. Development and evaluation of ‘briefing notes’ as a novel knowledge translation tool to aid the implementation of sex/gender analysis in systematic reviews: a pilot study. PLoS One. 2014;9(11):e110786.View ArticleGoogle Scholar
  4. Krieger N. Genders, sexes, and health: what are the connections—and why does it matter? Int J Epidemiol. 2003;32(4):652–7.View ArticleGoogle Scholar
  5. Springer KW, Mager Stellman J, Jordan-Young RM. Beyond a catalogue of differences: a theoretical frame and good practice guidelines for researching sex/gender in human health. Soc Sci Med. 2012;74(11):1817–1824.View ArticleGoogle Scholar
  6. Tudiver S, Boscoe M, Runnels V, Doull M, Coen S, Jull J et al. Sex, Gender and Systematic Reviews in Health: A Case Study of Critical Engagement. In: Critical Perspectives on Gender Equality Measurement. Edited by Gabriel C, Rankin P; Manuscript in progress.Google Scholar
  7. Kaiser A, Haller S, Schmitz S, Nitsch C. On sex/gender related similarities and differences in fMRI language research. Brain Res Rev. 2009;61(2):49–59.View ArticleGoogle Scholar
  8. Whittle KL, Inhorn MC. Rethinking difference: a feminist reframing of gender/race/class for the improvement of women's health research. Int J Health Serv. 2001;31(1):147–165.View ArticleGoogle Scholar
  9. Hankivsky O, Christoffersen A. Intersectionality and the determinants of health: a Canadian perspective. Critical Public Health. 2008;18(3):271–83.View ArticleGoogle Scholar
  10. Finks SW. Cardiovascular disease in women. In: Pharmacotherapy Self-Assessment Program, Seventh Edition (PSAP-VII), Book 1 (Cardiology). Reviewed by Spencer A, Hume A; 2010;179–99.Google Scholar
  11. Maas A, Appelman YEA. Gender differences in coronary heart disease. Neth Heart J. 2010;18(12):598–602.View ArticleGoogle Scholar
  12. Mehta LS, Beckie TM, DeVon HA, Grines CL, Krumholz HM, Johnson MN et al. Acute Myocardial Infarction in Women: A Scientific Statement From the American Heart Association. Circulation. 2016;133(9):916–947.View ArticleGoogle Scholar
  13. Clow BN, Pederson A, Haworth-Brockman M, Bernier J. Rising to the challenge: sex-and gender-based analysis for health planning, policy and research in Canada. Halifax, NS: Atlantic Centre of Excellence for Women’s Health; 2009.Google Scholar
  14. Johnson JL, Greaves L, Repta R. Better science with sex and gender: a primer for health research. Vancouver BC: Women's Health Research Network; 2007.Google Scholar
  15. Spitzer D. Gender and sex-based analysis in health research: a guide for CIHR peer review committees. Ottawa: Canadian Institutes of Health Research (CIHR); 2007.Google Scholar
  16. Status of Women Canada: GBA+ resources. [http://cfc-swc.gc.ca/gba-acs/resources-ressources-en.html]. Accessed 10 June 2015.
  17. Kim AM, Tingen CM, Woodruff TK. Sex bias in trials and treatment must end. Nature. 2010;465(7299):688–9.View ArticleGoogle Scholar
  18. National Research Council. Sex-Specific Reporting of Scientific Research: A Workshop Summary. The National Academies Press; 2012. http://www.nap.edu/openbook.php?record_id=13307. Accessed 10 June 2015.
  19. National Institutes of Health Revitalization Act of 1993. 1993. https://orwh.od.nih.gov/resources/pdf/NIH-Revitalization-Act-1993.pdf. Accessed 06 Nov 2016.
  20. Farahani P. Sex/gender disparities in randomized controlled trials of statins: the impact of awareness efforts. Clin Invest Med. 2014;37(3), E163.View ArticleGoogle Scholar
  21. Poon R, Khanijow K, Umarjee S, Fadiran E, Yu M, Zhang L, Parekh A. Participation of women and sex analyses in late-phase clinical trials of new molecular entity drugs and biologics approved by the FDA in 2007–2009. J Women's Health. 2013;22(7):604–16.View ArticleGoogle Scholar
  22. Kwiatkowski K, Coe K, Bailar JC, Swanson GM. Inclusion of minorities and women in cancer clinical trials, a decade later: have we improved? Cancer. 2013;119(16):2956–63.View ArticleGoogle Scholar
  23. Phillips SP, Hamberg K. Doubly blind: a systematic review of gender in randomised controlled trials. Glob Health Action. 2016;9.Google Scholar
  24. Health Canada. Guidance Document: considerations for the inclusion of women in clinical trials and analysis of sex differences. [https://www.canada.ca/en/health-canada/services/drugs-health-products/drug-products/applications-submissions/guidance-documents/clinical-trials/considerations-inclusion-women-clinical-trials-analysis-data-sex-differences.html]. Accessed 10 June 2015.
  25. Johnson J, Sharman Z, Vissandjée B, Stewart DE. Does a change in health research funding policy related to the integration of sex and gender have an impact? PLoS One. 2014; 9(6).Google Scholar
  26. Sharman Z, Johnson J. Towards the inclusion of gender and sex in health research and funding: an institutional perspective. Soc Sci Med. 2012;74(11):1812–1816.View ArticleGoogle Scholar
  27. Canadian Institute of Health Research (CIHR). Integrating Gender and Sex in Health Research: A Tool for CIHR Peer Reviewers. 2014. http://www.cihr-irsc.gc.ca/e/43216.html. Accessed 06 Nov 2015.
  28. Furler J, Magin P, Pirotta M, van Driel M. Participant demographics reported in "Table 1" of randomised controlled trials: a case of "inverse evidence"? Int J Equity Health. 2012;11:14.View ArticleGoogle Scholar
  29. Frampton GK, Shepherd J, Dorne JL. Demographic data in asthma clinical trials: a systematic review with implications for generalizing trial findings and tackling health disparities. Soc Sci Med. 2009;69(8):1147–1154.View ArticleGoogle Scholar
  30. Welch V, Petticrew M, Tugwell P, Moher D, O'Neill J, Waters E et al. PRISMA-Equity 2012 Extension: Reporting Guidelines for Systematic Reviews with a Focus on Health Equity. PLoS Medicine. 2012;9(10):e1001333.View ArticleGoogle Scholar
  31. Heidari S, Babor TF, De Castro P, Tort S, Curno M. Sex and gender equity in research: rationale for the SAGER guidelines and recommended use. Research Integrity and Peer Review. 2016;1(1):1.View ArticleGoogle Scholar
  32. Tricco AC, Zarin W, Antony J, Hutton B, Moher D, Sherifali D et al. An international survey and modified Delphi approach revealed numerous rapid review methods. J Clin Epidemiol. 2016;70:61–7.View ArticleGoogle Scholar
  33. Gendered innovations in science, health & medicine, engineering, and environment [https://genderedinnovations.stanford.edu]. Accessed 22 July 2015.
  34. Schilt K, Westbrook L. Doing Gender, Doing Heteronormativity. Gender & Society. 2009;23(4):440–64.View ArticleGoogle Scholar
  35. Celebrini RG, Eng JJ, Miller WC, Ekegren CL, Johnston JD, Depew TA et al. Effect of a novel movement strategy in decreasing ACL risk factors in female adolescent soccer players: a randomized controlled trial. Clin J Sport Med. 2014;24(2):134–141.View ArticleGoogle Scholar
  36. Marra CA, Cibere J, Grubisic M, Grindrod KA, Gastonguay L, Thomas JM, Embley P, Colley L, Tsuyuki RT, Khan KM, et al. Pharmacist-initiated intervention trial in osteoarthritis: a multidisciplinary intervention for knee osteoarthritis. Arthritis Care Res. 2012;64(12):1837–45.View ArticleGoogle Scholar
  37. Hopman WM, VanDenKerkhof EG, Carley ME, Kuhnke JL, Harrison MB. Factors associated with health-related quality of life in chronic leg ulceration. Qual Life Res. 2014;23(6):1833–40.View ArticleGoogle Scholar
  38. Ruzicka M, Floras JS, McReynolds AJ, Coletta E, Haddad H, Davies R, Leenen FH. Do high doses of AT(1)-receptor blockers attenuate central sympathetic outflow in humans with chronic heart failure? Clin Sci (Lond). 2013;124(9):589–95.View ArticleGoogle Scholar
  39. Balfour L, Spaans JN, Fergusson D, Huff H, Mills EJ, la Porte CJ, Walmsley S, Singhal N, Rosenes R, Tremblay N, et al. Micronutrient deficiency and treatment adherence in a randomized controlled trial of micronutrient supplementation in ART-naïve persons with HIV. PLoS One. 2014;9(1), e85607.View ArticleGoogle Scholar
  40. Walker LM, Hampton AJ, Wassersug RJ, Thomas BC, Robinson JW. Androgen deprivation therapy and maintenance of intimacy: a randomized controlled pilot study of an educational intervention for patients and their partners. Contemp Clin Trials. 2013;34(2):227–31.View ArticleGoogle Scholar
  41. Hoppe DJ, Denkers M, Hoppe FM, Wong IH. The use of video before arthroscopic shoulder surgery to enhance patient recall and satisfaction: a randomized-controlled study. J Shoulder Elbow Surg. 2014;23(6):e134–9.View ArticleGoogle Scholar
  42. Ghandehari OO, Hadjistavropoulos T, Williams J, Thorpe L, Alfano DP, Dal Bello-Haas V, Malloy DC, Martin RR, Rahaman O, Zwakhalen SM, et al. A controlled investigation of continuing pain education for long-term care staff. Pain Res Manag. 2013;18(1):11–8.View ArticleGoogle Scholar
  43. Choi S, Rampersaud YR, Chan VW, Persaud O, Koshkin A, Tumber P, Brull R. The addition of epidural local anesthetic to systemic multimodal analgesia following lumbar spinal fusion: a randomized controlled trial. Can J Anaesth. 2014;61(4):330–9.View ArticleGoogle Scholar
  44. Jenkins DJ, Kendall CW, Vuksan V, Faulkner D, Augustin LS, Mitchell S, Ireland C, Srichaikul K, Mirrahimi A, Chiavaroli L, et al. Effect of lowering the glycemic load with canola oil on glycemic control and cardiovascular risk factors: a randomized controlled trial. Diabetes Care. 2014;37(7):1806–14.View ArticleGoogle Scholar
  45. Masson PC, von Ranson KM, Wallace LM, Safer DL. A randomized wait-list controlled pilot study of dialectical behaviour therapy guided self-help for binge eating disorder. Behav Res Ther. 2013;51(11):723–8.View ArticleGoogle Scholar
  46. Kidd SA, Kaur J, Virdee G, George TP, McKenzie K, Herman Y. Cognitive remediation for individuals with psychosis in a supported education setting: a randomized controlled trial. Schizophr Res. 2014;157(1-3):90–8.View ArticleGoogle Scholar
  47. Bedard M, Felteau M, Marshall S, Cullen N, Gibbons C, Dubois S, Maxwell H, Mazmanian D, Weaver B, Rees L, et al. Mindfulness-based cognitive therapy reduces symptoms of depression in people with a traumatic brain injury: results from a randomized controlled trial. J Head Trauma Rehabil. 2014;29(4):E13–22.View ArticleGoogle Scholar
  48. Carlsten C, Dimich-Ward H, Ferguson A, Watson W, Rousseau R, Dybuncio A, Becker A, Chan-Yeung M. Atopic dermatitis in a high-risk cohort: natural history, associated allergic outcomes, and risk factors. Ann Allergy Asthma Immunol. 2013;110(1):24–8.View ArticleGoogle Scholar
  49. Fiest KM, Sajobi TT, Wiebe S. Epilepsy surgery and meaningful improvements in quality of life: results from a randomized controlled trial. Epilepsia. 2014;55(6):886–92.View ArticleGoogle Scholar
  50. Gillingham LG, Harding SV, Rideout TC, Yurkova N, Cunnane SC, Eck PK, Jones PJ. Dietary oils and FADS1-FADS2 genetic variants modulate [13C]alpha-linolenic acid metabolism and plasma fatty acid composition. Am J Clin Nutr. 2013;97(1):195–207.View ArticleGoogle Scholar
  51. Jovanovski E, Peeva V, Sievenpiper JL, Jenkins AL, Desouza L, Rahelic D, Sung MK, Vuksan V. Modulation of endothelial function by Korean red ginseng (Panax ginseng C.A. Meyer) and its components in healthy individuals: a randomized controlled trial. Cardiovasc Ther. 2014;32(4):163–9.View ArticleGoogle Scholar
  52. Oviedo-Joekes E, Guh D, Marchand K, Marsh DC, Lock K, Brissette S, Anis AH, Schechter MT. Differential long-term outcomes for voluntary and involuntary transition from injection to oral opioid maintenance treatment. Subst Abuse Treat Prev Policy. 2014;9(1):1.View ArticleGoogle Scholar
  53. Patterson ML, Moniruzzaman A, Somers JM. Community participation and belonging among formerly homeless adults with mental illness after 12 months of housing first in Vancouver, British Columbia: a randomized controlled trial. Community Ment Health J. 2014;50(5):604–11.View ArticleGoogle Scholar
  54. Pollock N, Sharma N, Christenson C, Law M, Gorter JW, Darrah J. Change in parent-identified goals in young children with cerebral palsy receiving a context-focused intervention: associations with child, goal and intervention factors. Phys Occup Ther Pediatr. 2014;34(1):62–74.View ArticleGoogle Scholar
  55. Sydor DT, Bould MD, Naik VN, Burjorjee J, Arzola C, Hayter M, Friedman Z. Challenging authority during a life-threatening crisis: the effect of operating theatre hierarchy. Br J Anaesth. 2013;110(3):463–71.View ArticleGoogle Scholar
  56. Armstrong PW, Gershlick AH, Goldstein P, Wilcox R, Danays T, Lambert Y, Sulimov V, Rosell Ortiz F, Ostojic M, Welsh RC, et al. Fibrinolysis or primary PCI in ST-segment elevation myocardial infarction. N Engl J Med. 2013;368(15):1379–87.View ArticleGoogle Scholar
  57. Lamy A, Devereaux PJ, Prabhakaran D, Taggart DP, Hu S, Paolasso E, Straka Z, Piegas LS, Akar AR, Jain AR, et al. Effects of off-pump and on-pump coronary-artery bypass grafting at 1 year. N Engl J Med. 2013;368(13):1179–88.View ArticleGoogle Scholar
  58. Macdonald RL, Higashida RT, Keller E, Mayer SA, Molyneux A, Raabe A, Vajkoczy P, Wanke I, Bach D, Frey A, et al. Randomised trial of clazosentan, an endothelin receptor antagonist, in patients with aneurysmal subarachnoid hemorrhage undergoing surgical clipping (CONSCIOUS-2). Acta Neurochir Suppl. 2013;115:27–31.Google Scholar
  59. Thibault B, Harel F, Ducharme A, White M, Ellenbogen KA, Frasure-Smith N, Roy D, Philippon F, Dorian P, Talajic M, et al. Cardiac resynchronization therapy in patients with heart failure and a QRS complex <120 milliseconds: the Evaluation of Resynchronization Therapy for Heart Failure (LESSER-EARTH) trial. Circulation. 2013;127(8):873–81.View ArticleGoogle Scholar
  60. Turpie AG, Hull RD, Schellong SM, Tapson VF, Monreal M, Samama MM, Chen M, Yusen RD. Venous thromboembolism risk in ischemic stroke patients receiving extended-duration enoxaparin prophylaxis: results from the EXCLAIM study. Stroke. 2013;44(1):249–51.View ArticleGoogle Scholar
  61. Glicksman JT, Sherman I, Rotenberg BW. Informed consent when prescribing medication: a randomized controlled trial. Laryngoscope. 2014;124(6):1296–300.View ArticleGoogle Scholar
  62. Scheifele DW, McNeil SA, Ward BJ, Dionne M, Cooper C, Coleman B, Loeb M, Rubinstein E, McElhaney J, Hatchette T, et al. Safety, immunogenicity, and tolerability of three influenza vaccines in older adults: results of a randomized, controlled comparison. Hum Vaccin Immunother. 2013;9(11):2460–73.View ArticleGoogle Scholar
  63. Bertinato J, Simpson JR, Sherrard L, Taylor J, Plouffe LJ, Van Dyke D, Geleynse M, Dam YY, Murphy P, Knee C, et al. Zinc supplementation does not alter sensitive biomarkers of copper status in healthy boys. J Nutr. 2013;143(3):284–9.View ArticleGoogle Scholar
  64. Koszycki D, Bilodeau C, Raab-Mayo K, Bradwejn J. A multifaith spiritually based intervention versus supportive therapy for generalized anxiety disorder: a pilot randomized controlled trial. J Clin Psychol. 2014;70(6):489–509.View ArticleGoogle Scholar
  65. Clouston K, Katz A, Martens PJ, Sisler J, Turner D, Lobchuk M, McClement S. Does access to a colorectal cancer screening website and/or a nurse-managed telephone help line provided to patients by their family physician increase fecal occult blood test uptake?: a pragmatic cluster randomized controlled trial study protocol. BMC Cancer. 2012;12:182.View ArticleGoogle Scholar
  66. Canadian Institute of Health Research (CIHR)-Institute of Gender and Health. What a Difference Sex and Gender Make: A Gender, Sex and Health Research Casebook. 2012.Google Scholar
  67. Avery E, Clark J. Sex-related reporting in randomised controlled trials in medical journals. The Lancet. 2016;388(10062):2839–40.View ArticleGoogle Scholar
  68. Burke JF, Brown DL, Lisabeth LD, Sanchez BN, Morgenstern LB. Enrollment of women and minorities in NINDS trials. Neurology. 2011;76(4):354–60.View ArticleGoogle Scholar
  69. Wood SF, Blehar MC, Mauery DR. Policy implications of a new national institutes of health agenda for women’s health research, 2010–2020. Women's Health Issues. 2011;21(2):99–103.View ArticleGoogle Scholar
  70. National Institutes of Health (NIH). Consideration of Sex as a Biological Variable in NIH-funded Research. Maryland: National Institutes of Health (NIH); 2015.Google Scholar
  71. Wallach JD, Sullivan PG, Trepanowski JF, Steyerberg EW, Ioannidis JPA. Sex based subgroup differences in randomized controlled trials: empirical evidence from Cochrane meta-analyses. BMJ. 2016;355:i5826.View ArticleGoogle Scholar
  72. Men's Health Forum: How To Make Weight-Loss Services Work For Men [https://www.menshealthforum.org.uk/sites/default/files/pdf/how_to_weight_final_lr_1.pdf]. Accessed 06 Nov 2016.
  73. Tannenbaum C. Response to: Sex based subgroup differences in randomized controlled trials: empirical evidence from Cochrane meta-analyses. BMJ. 2016; 355(5826).Google Scholar
  74. Petticrew M, McKee M, Jones J. Coronary artery surgery: are women discriminated against? BMJ. 1993;306(6886):1164–6.View ArticleGoogle Scholar
  75. Puil L., Doull M., Runnels V., Welch V., Shea B., Tudiver S., Boscoe M for the Sex/Gender Methods Group. Addressing Sex/Gender in Systematic Reviews: Cochrane Hypertension Group Briefing Note. Version 2014-01. Accessed at: http://equity.cochrane.org/sex-and-gender-analysis.
  76. Schiebinger L, Leopold SS, Miller VM. Editorial policies for sex and gender analysis. The Lancet. 2016;388(10062):2841–42.View ArticleGoogle Scholar
  77. Welch V, Norheim O, Jull J, Cookson R, Sommerfelt H, Tugwell P et al. Better reporting of health equity in randomized trials: CONSORT-Equity 2017 extension and elaboration. Hamilton: In the Cochrane Canada Symposium; 2017.Google Scholar
  78. Oertelt-Prigione S, Parol R, Krohn S, Preissner R, Regitz-Zagrosek V. Analysis of sex and gender-specific research reveals a common increase in publications and marked differences between disciplines. BMC Med. 2010;8:70.View ArticleGoogle Scholar
  79. Califf RM, Zarin DA, Kramer JM, Sherman RE, Aberle LH, Tasneem A. Characteristics of clinical trials registered in ClinicalTrials.gov, 2007-2010. JAMA. 2012;307(17):1838–47.View ArticleGoogle Scholar

Copyright

© The Author(s) 2017

Advertisement

Research Integrity and Peer Review

ISSN: 2058-8615

Contact us