Objectives To evaluate the methodological bias and the reliability of the conclusions of systematic reviews on acupuncture for polycystic ovary syndrome. Methods We comprehensively searched PubMed, EMbase, The Cochrane Library, CBM, CNKI and WanFang Data to collect systematic reviews on acupuncture for polycystic ovary syndrome from the establishment time of databases to January 5th, 2018. The AMSTAR tool was applied for methodological quality assessment of included studies and the GRADE system was applied for evidence quality assessment of included outcomes of systematic reviews. Results A total of 11 systematic reviews were included. The results of assessment using AMSTAR showed that, among the 11 items, most problems occurred in Item 5 " Were there any lists of research articles included and excluded”, followed by Item 1" Was an‘a prior’design provided?”and Item 11" Were potential conflict of interest included?”. GRADE grading results showed that quality of evidence for the outcome measure were" low”or" very low”. Conclusions Current acupuncture treatment of polycystic ovary syndrome has a certain effect, however, the quality of evidence is low. Thus, physicians should apply the evidence to make decision on acupuncture for polycystic ovary syndrome with caution in clinical practice and consider the actual situation, combined with the patient’s value preferences and economic factors.
ObjectivesTo conduct an overview of systematic reviews (SRs) on Tuina from 2013 to 2017, and to explore recent research improvements on Tuina.MethodsPubMed, Web of Science, The Cochrane Library, SpringerLink e-book database, CNKI, VIP, WanFang Data and CBM databases were searched to collect SRs including randomized controlled clinical trials on Tuina from January 1st, 2013 to December 31st, 2017. Two reviewers independently screened literature, extracted data, and used AMSTAR 2 tool and PRISMA statement to assess methodology quality and reporting quality of included studies, respectively. The R 3.4.3 software was used to analyze data.ResultsA total of 8 SRs studies were included in the overview. The studied diseases involved radiculopathy cervical spondylotic, myelopathy cervical spondylotic, constipation, child anorexia, child diarrhea and external humeral epicondylitis. The results of above SRs showed that massage might be superior to other interventions in clinical efficacy, curative effects or total effective rate. However, due to the low quality of included studies of SRs, further evidence from high-quality clinical studies is required to verify above conclusions. For the results of AMSTAR 2 assessment, all 8 SRs were rated as very low quality. The quantity of items accomplished for each SR ranged from 7 to 13, 2 SRs had low methodological quality (percentage of accomplishment or partial accomplishment <50.0%) and 6 SRs with high methodological quality (percentage of accomplishment or partial accomplishment ≥50.0%). All 8 SRs did not report item 2 "Whether to declare research methods", item 10 "Whether reports have included funding sources for each study" and item 11 "Whether reports used the correct statistical method". The results of PRISMA assessment showed that all SR had good quality of reporting. The accomplished items number of each SR ranged from 22 to 26. However, there were defects in item 5(0), item 16(25.0%) and item 23(25.0%). All SRs did not report item 5 "Whether to declare research program".ConclusionsThis study finds that Tuina has supportive evidence-based medical evidence for treating anorexia, cervical spondylosis and other diseases, however, the SRs of Tuina are yet needed to be improved in terms of standardized degree. Therefore, establishing a reporting consolidated standard for evidence-based medicine on Tuina in order to improve the quality of clinical studies so as to provide clinicians with high-quality evidence is the focus of our further research.
ObjectivesTo overview the systematic reviews/meta-analyses (SRs/MAs) of effectiveness and safety of spinal manipulation for low back pain or neck pain.
MethodsWe electronically searched databases including PubMed, EMbase, The Cochrane Library (Issue 1, 2015), CBM, CNKI, WanFang Data and VIP to collect SRs/MAs of spinal manipulation for low back pain or neck pain from inception to January 30th, 2015. Two reviewers independently screened literature, extracted data, and then AMSTAR tool was used to assess the methodological quality of included SRs/MAs.
ResultsA total of 21 SRs/MAs were included. Twenty of them assessed the methodological quality of included original randomized controlled trials (RCTs) with different tools:2 used Jadad scale, 5 used PEDro scale, 6 used Cochrane bias risk assessment tool and 7 used other tools. The assessment results of AMSTAR tool suggested that:among 11 items, the item 1 of "Was an ‘a priori’ design provided" (18 SRs/MAs did not provide) and item 4 of "Was a list of studies (included and excluded) provided" (18 SRs/MAs did not provide) appeared to be the most problematic, followed by item 10 of "Was the likelihood of publication bias assessed" (14 SRs/MAs did not assess the publication bias) and item 11 of "Was the conflict of interest stated" (14 SRs/MAs did not provide the conflict of interest and 4 were incomplete).
ConclusionThe methodological quality of included SRs/MAs is poor. The limited evidence showed that spinal manipulation is more effective for acute low back pain than chronic low back pain, and the short term effect is better than the long term one. Different spinal manipulation techniques have various effects but are all safe. Chiropractic manipulation may have the best effect. Due to the limitation of quality and quantity of included SRs/MAs, there may be potential bias in the above conclusion that needs more high quality studies to verify.
ObjectivesTo evaluate the quality of methodology and evidence of the exiting systematic reviews (SRs) of acupuncture therapy for post-stroke spastic paralysis.MethodsCNKI, CBM, The Cochrane Library, PubMed and EMbase databases were electronically searched to collect SRs of acupuncture therapy for post-stroke spastic paralysis from inception to December 16th, 2018. Two reviewers independently screened literature, extracted data, and evaluated the quality of methodology and evidence by AMSTAR 2 scale and GRADE system.ResultsA total of 7 SRs were included. The results showed that acupuncture therapy had obvious advantages in treating post-stroke spastic paralysis without obvious adverse reactions. The results of AMSTAR 2 scale showed that the failure of key items 2 and 7 resulted in extremely low methodological quality. The results of GRADE system showed that 46.15% of which were low-level evidence quality, 42.31% were medium, 11.54% were extremely low, and no evidence quality were high.ConclusionsCurrent evidence shows that acupuncture and moxibustion therapy is effective in treating spastic paralysis after stroke, however, the quality of the SRs is low. The studies are required to be standardized and combined with the characteristics of TCM to obtain high quality evidence in the future.
ObjectivesTo evaluate the methodology quality and report quality of the published systematic reviews/meta-analyses (SRs/MAs) of pediatric tuina domestically and abroad.MethodsCBM, VIP, CNKI, WanFang Data, PubMed, EMbase, and The Cochrane Library were electronically searched to collect published pediatric tuina SRs/MAs from inception to December 10th, 2018. The SRs/MAs which includes scale evaluation used AMSTAR2 and the PRISMA report quality evaluation tool to systematically review methodology, adopts Excel to carry out data collation and statistical analysis. ResultsA total of 18 studies (14 in Chinese and 4 in English) on the SRs/MAs of pediatric tuina were finally included. In terms of methodological quality, 6 studies were of low quality and 12 studies were of very low quality. All studies did not explain the reasons for adopting a particular research design type, and few of them explained the pre-plan, exclusion list, reasons and funding. In terms of report quality, 7 studies were relatively complete, 10 studies had certain defects and one study had serious defects. The existing problems were program and registration, comprehensive retrieval, information sources, financial support and so on. ConclusionsSRs/MAs of pediatric tuina have different degrees of issues in terms of methodological quality and report quality which still require further improvement and continuous strengthening.
ObjectiveTo overview the systematic reviews on efficacy and safety of hyperbaric oxygen in treatment of diabetic foot.MethodsCNKI, CBM, VIP, WanFang Data, The Cochrane Library, PubMed and EMbase databases were searched to collect systematic reviews or meta-analyses on the efficacy and safety of hyperbaric oxygen therapy for diabetic foot from inception to November 17th, 2019. Two researchers independently screened literature and extracted data. Then, AMSTAR 2 tool and PRISMA statement were used to evaluate the methodological quality and reporting quality of included systematic reviews, and the outcome indicators were comprehensively analyzed.ResultsA total of 10 systematic reviews were included. The results of AMSTAR 2 suggested that 6 systematic reviews were of extremely low quality, 3 of low quality, and 1 of high quality. The PRISMA score ranged from 16.5 to 27. The results of the included systematic reviews showed that hyperbaric oxygen therapy might be superior to other interventions in ulcer healing rate and large amputation rate without increasing the risk of adverse events. ConclusionsThe existing systematic reviews/meta-analysis evidence shows that hyperbaric oxygen therapy may have certain curative effect on diabetic foot, however, its methodology and report quality evaluation are insufficient.
Objective
To assess the methodological quality and reporting quality of meta-analysis published in Chinese Acupuncture & Moxibustion.
Methods
We searched CNKI database to collect meta-analysis published in Chinese Acupuncture & Moxibustion up to 2015. Methodological quality assessment was carried out using AMSTAR tool, and quality assessment was carried out by PRISMA checklist. Data analysis was performed by using SPSS 19.0 software.
Results
A total of 31 meta-analyses were enrolled. Among all the 31 meta-analyses, the first authors came from 19 institutions, and 21 meta-analysis were supported by fundings. All meta-analyses were about the evaluations of acupuncture intervention, involving 10 disease systems (ICD-10) and sub-health. The mean score of the methodological assessment was 7.42±1.13. In addition, the mean score of reporting quality was 18.79±2.04.
Conclusion
The meta-analyses published in Chinese Acupuncture & Moxibustion have high quality on methodology as well as reporting. Due to the limited quality and quantity of included studies, the above results are needed to be further assessed by more studies.
ObjectivesTo assess the methodological and reporting quality of surgical meta-analyses published in English in 2014.MethodsAll meta-analyses investigating surgical procedures published in 2014 were selected from PubMed and EMbase. The characteristics of these meta-analyses were collected, and their reporting and methodological quality were assessed by the PRISMA and AMSTAR, respectively. Independent predictive factors associated with these two qualities were evaluated by univariate and multivariate analyses.ResultsA total of 197 meta-analyses covering 10 surgical subspecialties were included. The mean PRISMA and AMSTAR score (by items) were 22.2±2.4 and 7.8±1.2, respectively, and a positive linear correlation was found between them with a R2 of 0.754. Those meta-analyses conducted by the first authors who had previously published meta-analysis was significantly higher in reporting and methodological quality than those who had not (P<0.001). Meanwhile, there were also significant differences in these reporting (P<0.001) and methodological (P<0.001) quality between studies published in Q1 ranked journals and (Q2+Q3) ranked jounals. On multivariate analyses, region of origin (non-Asiavs. Asia), publishing experience of first authors (ever vs. never), rank of publishing journals (Q1 vs. Q2+Q3), and preregistration (presence vs. absence) were associated with better reporting and methodologic quality, independently.ConclusionThe reporting and methodological quality of current surgical meta-analyses remained suboptimal, and first authors' experience and ranking of publishing journals were independently associated with both qualities. Preregistration may be an effective measure to improve the quality of meta-analysis, which deserves more attention from future meta-analysis reviewers.
ObjectivesTo evaluate the methodological bias and the reliability of the conclusions of systematic reviews (SRs) on the treatment for acute gout.MethodsPubMed, EMbase, The Cochrane Library, Epistemonikos, CBM, WanFang Data and CNKI databases were electronically searched to collect published systematic reviews and meta-analyses evaluating drug interventions therapy in acute gout from inception to April 8th 2017. Two reviewers independently screened literature, extracted data, assessed the methodological quality of included SRs by the AMSTAR tool, and assessed the quality of the body of evidence for each outcome by the GRADE approach.ResultsA total of seven relevant SRs were included, which contains three main outcome measures. Four SRs contained non-steroidal anti-inflammatory drugs (NSAIDS), three SRs contained colchicine and two SRs contained glucocorticoids. All SRs assessed risk of bias of included original studies. Two used the Jadad scale or modified Jadad scale in this assessment while others used the " assessing risk of bias” tool recommended by Cochrane Collaboration. The assessment results of AMSTAR tool suggested that: three SRs were considered high quality (scores≥9), and the other four were considered moderate quality. GRADE results showed: the quality of the evidence of 11 outcomes was low or very low, and five outcomes was moderate.ConclusionsThe current evidence confirms the effectiveness and safety of several drug interventions in the treatment of acute gout, however, the priority of these drugs is still unclear. We suggest conducting new SRs and updating relevant SRs, to systematically compare different drug interventions therapy in acute gout with the latest evidence. In addition, we still expect to put more efforts in conducting high-quality original studies, in order to fill the gap of relevant fields and improve the level of evidence quality.
AMSTAR (Assessment of Multiple Systematic Reviews) is currently developed as a measurement tool with extensive application to assess the methodological quality of systematic review/meta-analysis. It has good reliability, validity, and responsibility, and has been widely applied. This paper introduces AMSTAR to researchers and users in China, in view of development procedure, assessment items, and application status.
