ObjectivesTo assess the methodological and reporting quality of surgical meta-analyses published in English in 2014.MethodsAll meta-analyses investigating surgical procedures published in 2014 were selected from PubMed and EMbase. The characteristics of these meta-analyses were collected, and their reporting and methodological quality were assessed by the PRISMA and AMSTAR, respectively. Independent predictive factors associated with these two qualities were evaluated by univariate and multivariate analyses.ResultsA total of 197 meta-analyses covering 10 surgical subspecialties were included. The mean PRISMA and AMSTAR score (by items) were 22.2±2.4 and 7.8±1.2, respectively, and a positive linear correlation was found between them with a R2 of 0.754. Those meta-analyses conducted by the first authors who had previously published meta-analysis was significantly higher in reporting and methodological quality than those who had not (P<0.001). Meanwhile, there were also significant differences in these reporting (P<0.001) and methodological (P<0.001) quality between studies published in Q1 ranked journals and (Q2+Q3) ranked jounals. On multivariate analyses, region of origin (non-Asiavs. Asia), publishing experience of first authors (ever vs. never), rank of publishing journals (Q1 vs. Q2+Q3), and preregistration (presence vs. absence) were associated with better reporting and methodologic quality, independently.ConclusionThe reporting and methodological quality of current surgical meta-analyses remained suboptimal, and first authors' experience and ranking of publishing journals were independently associated with both qualities. Preregistration may be an effective measure to improve the quality of meta-analysis, which deserves more attention from future meta-analysis reviewers.
Objective To assess the reporting quality of noninferiority and equivalence randomized controlled trials (RCTs) related to Traditional Chinese Medicine (TCM). Methods The noninferiority and equivalence RCTs related to TCM were searched, and the quality of the included RCTs was identified in accordance with the extended version of CONSORT statement which refers to the reporting standard of noninferiority and equivalence RCTs. Results A total of 13 noninferiority and equivalence RCTs were included. Except for the common questions of RCTs in reporting quality, some contents related to noninferiority and equivalence trials in reporting were not enough: a) The title of RCTs did not reflect the most important content of the literature; b) The introduction of background was quite simple. The rationale about noninferiority and equivalence trials, and the effectiveness of positive control were not clearly defined; c) All literatures did not indicate whether the subjects, interventions and outcomes in the noninferiority and equivalence trials were identical or similar to those in previous trials of defining the effectiveness of control treatment; d) Most literatures did not define the critical value of noninferiority and equivalence, and did not estimate the sample size; e) Only half of literature described the statistical methods of noninferiority test and equivalence test; and f) Some literature had mistakes in noninferiority and equivalence conclusion. Conclusion The researchers still need deeper understanding of the theoretical basis of noninferiority and equivalence trials. The reference to the extended version of CONSORT statement, which refers to the reporting standard of noninferiority and equivalence RCTs, is helpful for researchers to identify the key points of the design, performance and reporting of the noninferiority and equivalence RCTs, to lay stress on the related contents of noninferiority and equivalence trial reporting, and to radically improve the reporting quality of such clinical trials.
Objective To evaluate the reporting quality of randomized controlled trials (RCTs) on acupuncture for acute ischemic stroke. Methods Six databases including The Cochrane Central Register of Controlled Trials (CENTRAL, Issue 4, 2005), MEDLINE (1966 to December 2005), EMbase (1984 to December 2005), China National Knowledge Infrastructure (CNKI, 1994 to December 2005), China Biomedicine Database disc (CBMdisc, 1980 to December 2005), VIP (a full text issues database of China, 1989 to December 2005) were searched systematically. Handsearch for further references was conducted. Language was limited to Chinese and English. We identified 74 RCTs that used acupuncture as an intervention and assessed the quality of these reports against the Consolidated Standards for Reporting of Trials (CONSORT) statement and Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA).Results In regard to the items in the CONSORT statement, 54 (73%) RCTs described baseline demographic and clinical characteristics in each group. Twenty-six (35%) mentioned the method of generating the random sequence, with 4 (5%) using a computer allocation. Only 6 (8%) RCTs had adequate allocation concealment, with 5 RCTs using sealed opaque envelopes and 1 RCT using centralized computer allocation. Only 8 (11%) RCTs used blinding, including 5 described as double-blind. Four (5%) RCTs reported the sample size calculation and 5 (7%) RCTs reported that an intention-to-treat (ITT) analysis. In regard to the items in STRICTA , only 4 (5%) RCTs reported the numbers of needles inserted. In 35 (47%) RCTs the needle type was reported, but only 26 (35%) mentioned the depths of insertion. Only 1 (1%) RCT mentioned the length of clinical experience and 6 (8%) RCTs reported the background of the acupuncture practitioners, but none stated the duration of their training.Conclusion The reporting quality of RCTs of acupuncture for acute ischemic stroke was low. The CONSORT statement and STRICTA should be used to standardize the reporting of RCTs of acupuncture.
ObjectivesTo analyze the current methodological and reporting quality of both domestic and overseas clinical practice guidelines on acupuncture, and to provide reference for the development of high quality acupuncture clinical practice guidelines.MethodsGIN, NICE, AHRQ, PubMed, EMbase, AMED, CINAHL, WanFang Data, CNKI, VIP and CBM databases were electronically searched to collect domestic and overseas clinical practice guidelines on acupuncture from inception to September, 2018. Two reviewers independently screened literature, extracted data and evaluated the methodological and reporting quality by using AGREE Ⅱ and RIGHT tools.ResultsA total of 23 acupuncture clinical practice guidelines were included, in which three were developed by foreign institutions, and the remaining 20 guidelines were jointly developed by WHO Western Pacific Region and China Institute of Acupuncture and Moxibustion. Three foreign and two domestic guidelines were selected for evaluation. The AGREE Ⅱ evaluation showed that the domestic guidelines have higher scores in terms of " scope and purpose”, " stakeholder involvement”, " rigor of development”, " applicability” and " clarity of presentation”, while only " editorial independence” is lower. The overall recommendation is stronger than the foreign guidelines. The RIGHT evaluation showed that for three foreign guidelines, the " reported” items accounted for 52.38%, " unreported” items accounted for 38.09%, " partly reported” items accounted for 6.66%%; however, for domestic guidelines, the " reported” accounted for 45.71%, " unreported” items accounted for 40%, and " partly reported” items accounted for 14.28% respectively. Overall, the difference is not significant (SD<10%). Due to the specificity of acupuncture interventions, the use of AGREEⅡ and RIGHT to evaluate acupuncture clinical practice guidelines still had barriers to some extend on its applicability.ConclusionThe methodological and reporting quality of acupuncture clinical practice guidelines are relatively low. It is urgent to further improve the methodological level and reporting standards of the guidelines, and to develop evaluation tools for the acupuncture field guidelines.
Objective To evaluate reporting and methodological quality of systematic reviews or meta-analyses in nursing field in China. Methods CNKI database was searched for systematic reviews or meta-analyses in nursing field from the establishment date to December 2011. Two reviewers independently identified the literature according to inclusion and exclusion criteria, and then extracted the data using Excel software. The PRISMA and AMSTAR checklists were used to assess reporting characteristics and methodological quality, respectively. Results A total of 63 systematic reviews or meta-analyses involving 21 systematic reviews and 42 meta-analyses were identified. These articles were published on 13 journals such as The Chinese Nursing Research, the Chinese Journal of Nursing, and the Chinese Journal of Evidence-Based Medicine. The deficiencies of methodological quality mainly contained literature search, heterogeneity handling, recognition and assessment of publication bias. In addition, the deficiencies of reporting characteristics were reflected on incomplete reporting of literature search, quality assessment, risk of bias and results (some studies lacked forest plot, estimated value of pooled results, 95%CI or heterogeneity). Conclusion As a whole, the included reviews and meta-analyses have more or less flaws with regard to the quality of reporting and methodology based on the PRISMA and AMSTAR checklists. Focusing on the improvement of reporting and methodological quality of systematic review or meta-analysis in nursing field in China is urgently needed in order to increase the value of these studies.
ObjectivesTo evaluate the reporting quality of domestic and foreign randomized controlled trials (RCTs) on acupuncture for dry eye based on Consolidated Standards of Reporting Trials Expand Statement 2010 (CONSORT 2010) and Standards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA).MethodsCNKI, VIP, CBM, WanFang Data, PubMed, EMbase and The Cochrane Library databases were electronically searched to collect RCTs of acupuncture for dry eye at home and abroad from inception to February 2020. The reporting quality of the selected literature was evaluated with the items in the CONSORT and STRICTA, respectively.ResultsA total of 69 Chinese literatures and 8 English literatures were included. The average reporting rate of all items of CONSORT in Chinese and English literatures was 41.4% and 56.4%, respectively. The missing items of Chinese literature report primarily focused on the sections of “methodology”, “results”, and “other information”. The Chinese and English literature report rate was relatively close in terms of the literature report rate of STRICTA, and both were relatively complete in the description of acupuncture intervention.ConclusionsThe reporting quality of RCTs of acupuncture treatment for dry eye in China and abroad is generally low. Further improving the relevant reporting quality according to the CONSORT statement 2010 and STRICTA 2010 is urgent.
ObjectiveTo analyze the reporting and methodological quality of tranexamic acid meta-analyses published in Chinese journals. MethodsThe CNKI, WanFang Data, and CBM databases were electronically searched for meta-analyses of tranexamic acid from inception to August 12th, 2021. Two reviewers independently screened literature, extracted data, and used AMSTAR 2 and PRISMA 2009 to assess the methodological and reporting quality of publications. ResultsA total of 68 meta-analyses were included. The identified meta-analyses required improvement for items 2, 3, 4, 7, 8, 10, 12, 15, and 16 in the AMSTAR 2, and items 2, 5, 8, 12, 15, 17, 22, 24, and 27 in the PRISMA 2009 assessments, respectively. The methodological and reporting quality scores were positively correlated (rs=0.36, P=0.002). Linear regression analysis identified the mentioning of PRISMA and funding support as the independent factors potentially affecting the reporting quality score (P<0.05). ConclusionsBoth the methodological and reporting quality of the tranexamic acid meta-analyses published in Chinese journals require improvement.
ObjectivesTo evaluate the reporting quality of individual/focus group interviews published in nursing journals included in the Chinese science citation database (CSCD).MethodsCSCD database was electronically searched to collect qualitative studies published in nursing journals included in CSCD from January 2016 to December 2018. Two researchers independently screened literatures, extracted data, and assessed the quality of included studies by COREQ guidelines, SPSS 25.0 software was then used for statistical analysis.ResultsA total of 223 qualitative researches were included. The results of COREQ evaluation showed that full report rate of 43.8% (14/32) studies were less than 50%, 78.6% (11/14) were less than 20%, and the full report rate of item 4 was even 0%. There were no significant differences between different total cites and the availability of funding in COREQ guidelines.ConclusionThe reporting quality of the qualitative researches published in the four nursing journals included in the CSCD requires further improvement. Therefore, we suggest that domestic nursing journals should introduce COREQ guidelines in contribution and strictly implement it in editorial review and peer review.
ObjectiveTo investigate the application status of survival analysis in studies published in Chinese oncology journals, and assess their reporting quality and summarize the existing problems, so as to promote the application of survival analysis and reporting quality.
MethodsStudies that used survival analysis were collected from 1 492 studies published in Chinese Journal of Oncology, Chinese Journal of Clinical Oncology, Chinese Journal of Radiation Oncology and Chinese Journal of Cancer Prevention and Treatment in 2013. The application status of survival analysis of included studies was analysed and their reporting quality was evaluated.
ResultsA total of 242 survival analysis studies were included. Among them, the utilization rates of Kaplan-Meier method, life table method, log-rank test, Breslow test and Cox proportional hazards model were 91.74%, 3.72%, 78.51%, 0.41% and 46.28%, respectively. 112 studies did multivariate analysis through Cox proportional hazards model. A total of 396 end points and 10 different types of survival time were reported. Overall survival (OS) was reported in 233 studies (92.15%). Survival terms were defined to 158 end points (39.90%) of 103 studies (42.56%). The follow-up rates were mentioned in 155 studies (64.05%), of which 4 studies were under 80% and the lowest was 75.25%, 55 studies were 100%. The main problems of survival analysis studies published in Chinese journals were as follows:None of the studies which used Cox proportional hazards model reported the proportional hazards assumption. None of the studies used the method of parametric survival analysis. 130 studies (53.72%) did not use the method of multiple factor analysis. 139 studies (57.44%) did not define the survival terms. Only 11 of 100 studies which reported loss to follow-up had stated how to treat it in the analysis. None of the studies reported the methods of calculating sample size. None of the studies reported the censoring proportion.
ConclusionThe methods of survival analysis are used in a low rate in studies published in Chinese oncology journals, and the overall reporting quality of survival analyses is poor. So the reporting guideline of survival analysis should be developed and the authors should be encouraged to cooperate with professional statisticians, in order to improve the design, analysis and reporting quality of survival analysis studies.
ObjectiveTo evaluate the reporting quality of randomized controlled trials (RCTs) on acupuncture for neck disorder.
MethodsThree databases including CENTRAL (Issue 3, 2010), MEDLINE and EMbase from January 2006 to December 2010 were searched electronically, and only English articles were included. A manual search for further references was conducted from those references initially identified. We identified 14 RCTs that used acupuncture as an intervention and assessed the quality of these reports against the Consolidated Standards for Reporting of Trials (CONSORT) statement and Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA).
ResultsFinally 14 RCTs were included. Regarding the CONSORT statement, 9 (64.3%) RCTs described the baseline demographic and clinical characteristics in each group. Only 7 (50.0%) studies mentioned how the random sequence was generated. Only 6 (42.9%) RCTs had adequate allocation concealment, with 4 RCTs which described the concealment in detail. Only 8 (57.1%) RCTs used blinding, including 2 described as double-blind. Only two (14.3%) RCTs reported how the sample size was calculated. Corresponding to the items in STRICTA, 5 (35.7%) RCTs reported the numbers of needles inserted. The others just indicated the acu-points. The needle type, model and the thickness of needles were reported in 12 (85.7%) RCTs, but only 4 (28.6%) mentioned the depths of insertion. There were only 4 RCTs (28.6%) that reported the background of the acupuncture practitioners and the duration of their training.
ConclusionThe RCTs of acupuncture for neck disorder meeting the criteria for the CONSORT statement and STRICTA still have room for improvement. Promoting the use of the CONSORT statement and STRICTA should help to improve the reporting quality of acupuncture related research, and hence to elucidate the scientific understanding of acupuncture.
