Objective To evaluate the methodological and reporting quality of randomized controlled trials involving traditional Chinese medicine in the treatment of cholelithiasis. Methods We searched CNKI (1994 to 2007), CMCC (1994 to 2007), VIP (1989 to 2007), MEDLINE (1966 to April 2007) and The Cochrane Library (Issue 4, 2006). Data from randomized controlled trials (RCTs) and quasi-RCTs were extracted by two reviewers independently. The methodological quality of included trials was assessed by using the quality assessment criteria recommended by The Cochrane Collaboration, and the reporting quality was assessed by using the CONSORT for TCM checklist. Results Seventeen studies including 16 RCTs and one quasi-RCT were included. The methodological and reporting qualities of included studies were generally low. All studies were graded C. The highest score evaluated by the CONSORT for TCM checklist was 18. Conclusion The quality of RCTs and quasi-RCTs involving traditional Chinese medicine for cholelithiasis is generally low, with a high risk of biases. The reporting of these trials is also incomplete, which would affect a reader’s understanding and evaluation of the validity, importance and applicability of the study results. Therefore, new randomized controlled trials of high quality are required to provide reliable evidence.
ObjectiveTo assess the methodological quality of guidelines for bronchoscopic alveolar lavage. MethodsCNKI, VIP, WanFang Data, CBM, Web of Science, PubMed, EMbase databases and medlive.cn, the National Guideline Clearinghouse (NGC), the National Guideline International Network (GIN), the Scottish Intercollegiate Guidelines Network (SIGN), the National Institute for Clinical Excellence (NICE), and the World Health Organization (WHO) websites were electronically searched to collect guidelines of bronchoscopic alveolar lavage from inception to December 2020. Two reviewers independently screened literature, extracted data, and assessed the methodological quality of the guidelines by using AGREE Ⅱ tool. ResultsA total of 19 guidelines were included, with 5 from China, 5 from the USA, 3 from Europe, 2 from the UK, 1 from Australia, 1 from Israel, 1 from Spain, and 1 from India. The average standard score rates of the 19 guidelines in the six fields were 50.73% for scope and purpose, 20.02% for participants, 15.13% for formulation rigor, 36.40% for clarity of presentation, 3.51% for applicability, and 22.37% for editorial independence.ConclusionsThe quality of bronchoalveolar lavage guidelines remains relatively low.
ObjectiveTo investigate the reporting and methodological quality of systematic reviews/ meta-analyses conducted by hospital pharmacists in China, so as to improve the quality of systematic reviews/ meta-analyses in this field. MethodsThe literatures were retrieved from CNKI, WanFang Data, VIP, CBM, CMCI, PubMed, EMbase, The Cochrane Library from the establishment date to March 17th, 2016. According to the inclusive and exclusive criteria, authors independently screened and extracted the published information. Reporting and methodological quality of included reviews were evaluated by PRIMSA statements and AMSTAR checklists. Data analysis was conducted by using Excel 2013 software and SPSS 20.0 software. ResultsOne thousand and eighteen systematic reviews/ meta-analyses were included, including 871 Chinese literatures and 147 English literatures. The average score of PRIMSA was 18.41±2.84, and the average score of AMSTAR was 7.38±1.28. The main problems of PRIMSA were structured summary, objectives, protocol and registration, additional analyses and funding. The main problems of AMSTAR were priori design, status of publication and list of studies (included and excluded). Univariate analysis showed that some factors could improve the quality of methodology and reporting, including studies in English (P<0.000 1), published after checklists' (P<0.000 1), hospital in higher-level (P<0.000 1), illuminating the funding or interest conflict (P<0.000 1). Pearson analysis indicated that linear correlation were detected between PRISMA scores and AMSTAR scores (P<0.000 1), as well as citations and AMSTAR scores (P=0.045). ConclusionEvidenced-based pharmacy in hospital has developed rapidly, the quality of methodology and reporting have increaseed year by year, but further improvement should be considered in different aspects. The methods to evaluate the clinical application of these systematic reviews/ meta-analyses should be developed in the future.
Objective To assess the methodological quality of pediatric COVID-19 guidelines using the AGREE Ⅱ. Methods Domestic and foreign pediatric COVID-19 guidelines from inception to 1st Oct 2021 were electronically searched in PubMed, CBM, CNKI, VIP, WanFang Data, Medlive, NGC, GIN, and NICE databases and relevant websites. Two researchers independently assessed the methodological quality of the guidelines by using AGREE Ⅱ. Results A total of 21 guidelines were included. The AGREE Ⅱ results revealed that the average scores of included guidelines in 6 domains (scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence) were 62.70%, 36.24%, 20.34%, 50.42%, 22.12% and 53.17%, respectively. ConclusionThe methodological quality of pediatric COVID-19 guidelines is poor. Guideline developers should follow the requirements of AGREE Ⅱ in guideline development.
ObjectivesTo evaluate the methodological and reporting quality of clinical guidelines and consensus for esophageal cancer.MethodsDatabases including PubMed, EMbase, Web of Science, CBM, WanFang Data and CNKI were electronically searched and major guideline websites such as GIN, NICE, NGC and Yimaitong were also searched to collect guidelines and consensus for esophageal cancer from inception to August 2018. Two reviewers independently screened the literatures and extracted data according to the inclusion and exclusion criteria and then evaluated the quality of the included guidelines using the AGREE II and RIGHT instruments.ResultsA total of 26 esophageal cancer guidelines and consensus were included. The mean scores for each domain of AGREE II was 49.63% for scope and purpose, 25.16% for stakeholder involvement, 23.42% for rigor of development, 49.25% for clarity of presentation, 16.91% for applicability, and 21.07% for editorial independence. The item with the highest reporting rate among the RIGHT evaluation items was 5 (84.62%), followed by 1a (80.77%), 1c (65.38%), 13a (65.38%), and 4 (61.54%), and the remaining items were all reported below 50%. Results of subgroup analysis showed that the guidelines and consensus developed based on the evidence-based medicine method had higher average scores in the six domains of AGREE II and the RIGHT score than the guidelines and consensus developed based on expert opinions or reviews. The foreign guidelines and consensus had higher average scores in the three domains of AGREE II (formulation rigor, clarity, editorial independence) and the RIGHT score than the domestic guidelines.ConclusionsThe methodological and reporting quality of the guidelines and consensus on esophageal cancer is low, with the guidelines and consensus in China even lower, requiring further improvement. It is suggested that the guideline developers should refer to the standards such as AGREE II and RIGHT to develop high-quality guidelines and promote their application, so as to better guide the standardized diagnosis and treatment of esophageal cancer.
ObjectivesTo assess the methodological quality of clinical practice guidelines of cervical cancer in China published from 2014 to 2018.MethodsCNKI, WanFang Data, CBM, VIP, Medlive.cn, the National Guideline Clearinghouse, PubMed, The Cochrane Library and EMbase were searched for cervical cancer clinical practice guidelines published in China from January 1st, 2014 to December 31st, 2018. Four reviewers searched and selected the literature independently according to the inclusion and exclusion criteria and assessed the methodological quality of the included guidelines by using AGREE Ⅱ.ResultsA total of 9 guidelines were included. The average score for each area was: scope and purpose 75.47%, stakeholders’ involvement 35.09%, the rigor of development 43.70%, clarity of presentation 87.74%, applicability 80.76%, and editorial independence 0%.ConclusionsThe quality of cervical cancer clinical practice guidelines in China requires further improvement.
ObjectivesTo evaluate the quality of guidelines on nutrition in liver disease from 2017 to 2019, and to interpret these guidelines so as to provide references for clinical practice.MethodsComputer-assisted literature searches in CNKI, VIP, WanFang Data, Medline (Ovid), The Cochrane Library, PubMed and Medlive databases were performed by two reviewers for guidelines on nutrition in liver disease from January 2017 to July 2019. Two reviewers extracted data and assessed the methodological quality of the included guidelines using AGREE II, separately. Meanwhile, the intraclass correlation coefficient (ICC) was used to assess the degree of consistency.ResultsFour guidelines were included with 2 from China and 2 from Europe. Their average standardised scores in the 6 domains of scope and purpose, stakeholder involvement, rigour of development, clarity, applicability and independence were 79.17%, 71.53%, 78.13%, 85.42%, 61.98% and 43.75%, respectively. The Chinese and European guidelines had similar recommendations for energy and other nutrients, apart from differences in recommendations for protein intake. The European guidelines considered that restricting protein intake was not beneficial for patients with hepatic encephalopathy, while the Chinese guidelines argued that patients with severe hepatic encephalopathy were required to reduce or limit their protein intake.ConclusionsAll 4 guidelines are of average quality and are required to be strengthened in the ‘independence’ domain. Currently, the only consensus on nutrition therapy for liver disease and guidelines on nutrition in end-stage liver disease are available for references in China, with lower quality scores than that of the European guidelines. Therefore, the evidence-based guidelines on nutrition in liver disease should be developed by Chinese national conditions as soon as possible to provide references for clinicians, nurses and clinical nutritionists, enableing them to implement nutrition screening, evaluation, nutritional therapy and follow-up management for patrents with liver disease.
ObjectivesTo assess the methodological quality of Chinese clinical practice guidelines (CPGs) for respiratory diseases published in 2017, so as to provide evidence for developing and updating CPGs of this field in the future.MethodsWanFang Data, CNKI, VIP, CBM databases, Medlive and other related websites were electronically searched to collect Chinese CPGs for respiratory diseases published from January 2017 to December 2017. Four reviewers independently evaluated the quality of eligible guidelines by using Appraisal of Guidelines for Research and Evaluation Ⅱ (AGREE Ⅱ) instrument.ResultsA total of 37 guidelines were included. The mean scores of the six AGREE Ⅱ domains (scope and purpose, stakeholder involvement, rigor of development, clarity and presentation, applicability, editorial independence) were 59.3%, 25.1%, 10.8%, 59.1%, 25.8%, and 7.3%, respectively. Only 1 guideline (2.7%) was recommended for clinical use, and 2 guidelines (5.4%) were recommended with modification.ConclusionsThe CPGs for respiratory diseases published in China in 2017 have higher quality than CPGs published prior to 2017, however great discrepancies exist when comparing with international guidelines of average level. More attention should be paid on the rigorousness of methodology and the practicality of content in the future development of CPGs.
Objective To investigate the reporting quality of randomized controlled trials (RCT) on laparoscopic surgery for treating colorectal disease in three SCI indexed. Methods We electronically retrieved the Ovid MEDLINE(R) from 1950 to present with Daily Updates for RCTs on laparoscopic surgery published in Diseases of the Colon amp; Rectum, International Journal of Colorectal Disease, or Colorectal Disease. The revised CONSORT statement and additional surgical items were adopted to assess the reporting quality. One point was assigned for each full description of an item, 0 for no description, and 0.5 for a partial description. Results A total of 20 RCTs were included and 8 RCTs were excluded. Their reporting quality was low. The average scores for the following items were relatively lower, 0.150 for settings where data collected; 0.250 for sample size estimation; 0.500 for sequence generation of randomization; 0.325 for allocation concealment; 0.150 for implementation; 0.475 for measurement of outcome; 0.150 for participant flow chart; 0.450 for adverse events; 0.450 for external validity; 0.400 for financial conflicts of interest; 0.250 for perioperative pharmacological treatment; 0.075 for perioperative nonphamacological treatment; 0.000 for participation of a trial methodologist; 0.350 for surgeon’s experience (years or position). Items with the lower scores were mainly in the methods and results section and surgical items. Conclusions The reporting quality of laparoscopic RCTs in these journals is low. Colorectal surgeons should rigorously evaluate reports in these journals before they apply to them in clinical practice.
ObjectivesTo assess the quality of clinical practice guidelines (CPGs) for diagnosis and management of cough in China, and to provide methodological experiences for updating and developing the evidence-based guideline in this field in future.
MethodsWe searched CBM, WanFang Data, VIP and CNKI databases, and Chinese clinical guidelines' website to identify and select CPGs related to cough in China. Four reviewers independently evaluated the quality of eligible guidelines using the Appraisal of Guidelines for Research and Evaluation (AGREE) Ⅱ instrument.
ResultsSix guidelines were included. The mean scores for six AGREE Ⅱ domains were low:scope and purpose 61.1%, stakeholder involvement 26.6%, rigor of development 16.7%, clarity and presentation 58.3%, applicability 11.1%, and editorial independence 0.0%.
ConclusionThe quality of guidelines for cough in China is low. More efforts are urgently needed to develop high quality Chinese guidelines using methodologically rigorous development frameworks and strengthen guideline reporting.
