ObjectiveTo investigate the reporting and methodological quality of systematic reviews/ meta-analyses conducted by hospital pharmacists in China, so as to improve the quality of systematic reviews/ meta-analyses in this field. MethodsThe literatures were retrieved from CNKI, WanFang Data, VIP, CBM, CMCI, PubMed, EMbase, The Cochrane Library from the establishment date to March 17th, 2016. According to the inclusive and exclusive criteria, authors independently screened and extracted the published information. Reporting and methodological quality of included reviews were evaluated by PRIMSA statements and AMSTAR checklists. Data analysis was conducted by using Excel 2013 software and SPSS 20.0 software. ResultsOne thousand and eighteen systematic reviews/ meta-analyses were included, including 871 Chinese literatures and 147 English literatures. The average score of PRIMSA was 18.41±2.84, and the average score of AMSTAR was 7.38±1.28. The main problems of PRIMSA were structured summary, objectives, protocol and registration, additional analyses and funding. The main problems of AMSTAR were priori design, status of publication and list of studies (included and excluded). Univariate analysis showed that some factors could improve the quality of methodology and reporting, including studies in English (P<0.000 1), published after checklists' (P<0.000 1), hospital in higher-level (P<0.000 1), illuminating the funding or interest conflict (P<0.000 1). Pearson analysis indicated that linear correlation were detected between PRISMA scores and AMSTAR scores (P<0.000 1), as well as citations and AMSTAR scores (P=0.045). ConclusionEvidenced-based pharmacy in hospital has developed rapidly, the quality of methodology and reporting have increaseed year by year, but further improvement should be considered in different aspects. The methods to evaluate the clinical application of these systematic reviews/ meta-analyses should be developed in the future.
The PRISMA aims to enhance the transparency and reporting quality of systematic reviews. PRISMA 2020 is an update version of PRISMA 2009, which was published in BMJ in March, 2021. This article compared the PRISMA 2020 and PRISMA 2009, interpreted PRISMA 2020 with representative examples, aiming to help Chinese scholars better understand and apply this reporting guideline, thus to improve the reporting quality of systematic reviews.
ObjectivesTo assess the methodological and reporting quality of surgical meta-analyses published in English in 2014.MethodsAll meta-analyses investigating surgical procedures published in 2014 were selected from PubMed and EMbase. The characteristics of these meta-analyses were collected, and their reporting and methodological quality were assessed by the PRISMA and AMSTAR, respectively. Independent predictive factors associated with these two qualities were evaluated by univariate and multivariate analyses.ResultsA total of 197 meta-analyses covering 10 surgical subspecialties were included. The mean PRISMA and AMSTAR score (by items) were 22.2±2.4 and 7.8±1.2, respectively, and a positive linear correlation was found between them with a R2 of 0.754. Those meta-analyses conducted by the first authors who had previously published meta-analysis was significantly higher in reporting and methodological quality than those who had not (P<0.001). Meanwhile, there were also significant differences in these reporting (P<0.001) and methodological (P<0.001) quality between studies published in Q1 ranked journals and (Q2+Q3) ranked jounals. On multivariate analyses, region of origin (non-Asiavs. Asia), publishing experience of first authors (ever vs. never), rank of publishing journals (Q1 vs. Q2+Q3), and preregistration (presence vs. absence) were associated with better reporting and methodologic quality, independently.ConclusionThe reporting and methodological quality of current surgical meta-analyses remained suboptimal, and first authors' experience and ranking of publishing journals were independently associated with both qualities. Preregistration may be an effective measure to improve the quality of meta-analysis, which deserves more attention from future meta-analysis reviewers.
Objective
To assess the methodological quality and reporting quality of meta-analysis published in Chinese Acupuncture & Moxibustion.
Methods
We searched CNKI database to collect meta-analysis published in Chinese Acupuncture & Moxibustion up to 2015. Methodological quality assessment was carried out using AMSTAR tool, and quality assessment was carried out by PRISMA checklist. Data analysis was performed by using SPSS 19.0 software.
Results
A total of 31 meta-analyses were enrolled. Among all the 31 meta-analyses, the first authors came from 19 institutions, and 21 meta-analysis were supported by fundings. All meta-analyses were about the evaluations of acupuncture intervention, involving 10 disease systems (ICD-10) and sub-health. The mean score of the methodological assessment was 7.42±1.13. In addition, the mean score of reporting quality was 18.79±2.04.
Conclusion
The meta-analyses published in Chinese Acupuncture & Moxibustion have high quality on methodology as well as reporting. Due to the limited quality and quantity of included studies, the above results are needed to be further assessed by more studies.
ObjectivesTo evaluate the methodology quality and report quality of the published systematic reviews/meta-analyses (SRs/MAs) of pediatric tuina domestically and abroad.MethodsCBM, VIP, CNKI, WanFang Data, PubMed, EMbase, and The Cochrane Library were electronically searched to collect published pediatric tuina SRs/MAs from inception to December 10th, 2018. The SRs/MAs which includes scale evaluation used AMSTAR2 and the PRISMA report quality evaluation tool to systematically review methodology, adopts Excel to carry out data collation and statistical analysis. ResultsA total of 18 studies (14 in Chinese and 4 in English) on the SRs/MAs of pediatric tuina were finally included. In terms of methodological quality, 6 studies were of low quality and 12 studies were of very low quality. All studies did not explain the reasons for adopting a particular research design type, and few of them explained the pre-plan, exclusion list, reasons and funding. In terms of report quality, 7 studies were relatively complete, 10 studies had certain defects and one study had serious defects. The existing problems were program and registration, comprehensive retrieval, information sources, financial support and so on. ConclusionsSRs/MAs of pediatric tuina have different degrees of issues in terms of methodological quality and report quality which still require further improvement and continuous strengthening.
ObjectiveTo overview the systematic reviews on efficacy and safety of hyperbaric oxygen in treatment of diabetic foot.MethodsCNKI, CBM, VIP, WanFang Data, The Cochrane Library, PubMed and EMbase databases were searched to collect systematic reviews or meta-analyses on the efficacy and safety of hyperbaric oxygen therapy for diabetic foot from inception to November 17th, 2019. Two researchers independently screened literature and extracted data. Then, AMSTAR 2 tool and PRISMA statement were used to evaluate the methodological quality and reporting quality of included systematic reviews, and the outcome indicators were comprehensively analyzed.ResultsA total of 10 systematic reviews were included. The results of AMSTAR 2 suggested that 6 systematic reviews were of extremely low quality, 3 of low quality, and 1 of high quality. The PRISMA score ranged from 16.5 to 27. The results of the included systematic reviews showed that hyperbaric oxygen therapy might be superior to other interventions in ulcer healing rate and large amputation rate without increasing the risk of adverse events. ConclusionsThe existing systematic reviews/meta-analysis evidence shows that hyperbaric oxygen therapy may have certain curative effect on diabetic foot, however, its methodology and report quality evaluation are insufficient.
ObjectiveTo overview the systematic reviews/meta-analyses (SRs/MAs) of efficacy and safety of dipeptidyl peptidase-4 inhibitors (DPP-4) in treatment of type 2 diabetes mellitus (T2DM).MethodsDatabase including The Cochrane Library, PubMed, EMbase, CBM, WanFang Data and CNKI were searched from inception to December 2016 to collect SRs/MAs of randomized controlled trials (RCTs) of DPP-4 for the treatment of T2DM. Two reviewers independently screened literature, extracted data, and evaluated the reporting and methodological qualities using the PRISMA checklist and the AMSTAR tool.ResultsTwenty-seven SRs/MAs of DPP-4 for the treatment of T2DM were included in this overview. The average score of AMSTAR was 7.04. The worst score were the item 1 (26 studies didn't provide an ‘a priori’ design), item 4 (10 studies didn't provide whether the status of publication used as an inclusion criterion?), item 10 and item 11 (15 studies didn't assess the likelihood of publication bias and the potential conflicts of interest). The PRISMA score ranged from 17.0 to 24.5. The main problems of reporting were protocol and registration, search, additional analyses and funding.ConclusionThe evidence shows that the reporting and methodological quality of the SRs/MAs of DPP-4 inhibitors for type 2 diabetes are not high.
The selection of outcome measurement instruments (OMI) is a prerequisite for accurately collecting health outcome data. Conducting a systematic review of OMI can provide an important reference for researchers and practitioners to select the most appropriate OMI. In order to improve the reporting quality of the systematic review of OMI, foreign researchers published the PRISMA-COSMIN reporting guideline in the J Clin Epidemiol in June 2024. This article introduces the research team, development process, and items of the reporting guideline, and analyzes the items with examples. We hope our attempt could help domestic researchers improve the overall quality of OMI systematic reviews.
ObjectiveTo get known of the application of Preferred Items of Systematic Review and Meta Analysis (PRISMA).
MethodsWe searched PubMed, EMbase, The Cochrane Library (Issue 10, 2013), CBM, WanFang Data and CNKI, to collect relevant literature about the application of PRISMA during 2009-2013. Two reviewers independently screened literature according to the inclusion and exclusion criteria, extracted data, and then bibliometric analysis was performed using Excel software.
ResultsWe finally included 175 papers, including 26 conference abstracts and 149 full texts. The results of bibliometric analysis of full texts showed that, they were published in 118 journals, and PRISMA official website announced that 176 journals endorsed the application of PRISMA. According to study type, there were 111 systematic reviews and meta-analyses (SRs/MAs) for development and reporting, 20 overviews of SRs for reporting quality assessments, 7 versions of PRISMA interpretation, and 11 articles of other kinds. In 131 SRs/MAs as well as overviews, the studies about western medicine accounted for 77.8%, followed by public health (8.4%), and traditional Chinese medicine (4.6%).
ConclusionThe application of PRISMA statement is still at the first phase and mainly confined to the field of western medicine, which needs more attention and understanding. Thus, it's necessary to interpret and disseminate the PRISMA statement.
ObjectiveTo overview the reporting and methodology quality of systematic reviews/meta-analysis on acupuncture in the treatment of primary osteoporosis (POP).MethodsPubMed, EMbase, The Cochrane Library, CBM, WanFang Data, CNKI and VIP databases were electronically searched to collect systematic reviews/meta-analysis on acupuncture in the treatment of POP from inception to July 2018. Two reviewers independently screened literature, extracted data, and assessed the quality of systematic reviews. A Measurement Tool to Assess Systematic Reviews (AMSTAR) methodological quality score and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) were used to assess the methodological quality and reporting quality of the systematic reviews, along with the risk of homogeneity and publication bias.ResultsA total of 11 systematic reviews/meta-analysis were included and multiple evaluations of the radar plot showed that the quality average rank scored 7.68. The major problems in studies were lack of items registration, imperfect search strategies and selection bias and so on.ConclusionThe quality of systematic reviews/meta-analysis of acupuncture in the treatment of POP is insufficient, indicating that the methodological and reporting quality of systematic reviews should be further strengthened.
