ObjectivesTo evaluate the methodology quality and report quality of the published systematic reviews/meta-analyses (SRs/MAs) of pediatric tuina domestically and abroad.MethodsCBM, VIP, CNKI, WanFang Data, PubMed, EMbase, and The Cochrane Library were electronically searched to collect published pediatric tuina SRs/MAs from inception to December 10th, 2018. The SRs/MAs which includes scale evaluation used AMSTAR2 and the PRISMA report quality evaluation tool to systematically review methodology, adopts Excel to carry out data collation and statistical analysis. ResultsA total of 18 studies (14 in Chinese and 4 in English) on the SRs/MAs of pediatric tuina were finally included. In terms of methodological quality, 6 studies were of low quality and 12 studies were of very low quality. All studies did not explain the reasons for adopting a particular research design type, and few of them explained the pre-plan, exclusion list, reasons and funding. In terms of report quality, 7 studies were relatively complete, 10 studies had certain defects and one study had serious defects. The existing problems were program and registration, comprehensive retrieval, information sources, financial support and so on. ConclusionsSRs/MAs of pediatric tuina have different degrees of issues in terms of methodological quality and report quality which still require further improvement and continuous strengthening.
ObjectiveTo evaluate the quality of randomized controlled trials (RCTs) of Chinese medicine (TCM) formulated granules published in core journals in China. MethodsComputerized searches were conducted in CNKI, VIP, WanFang Data and CBM databases. The publicly published RCTs of TCM formulated granules were collected, with sources from Peking University Core, CSSCI and EI. The following information was extracted: including title, the first author, the journals name, type of disease, year of publication, and source of drug. The included studies were evaluated using the CONSORT extension for CHM formulas (CONSORT-CHM formulas 2017), which included 25 items from title, abstract and keywords, introduction, research methods, steps, results, discussion, and other information. ResultsA total of 125 papers were included, which mainly included digestive system diseases (n=25), respiratory system diseases (n=17), and circulatory system diseases (n=17). The results showed that the overall reporting quality of RCTs of TCM formulated granules was poor. After the publication of the CONSORT-CHM formulas 2017, the reporting quality of RCTs of TCM formulated granules had no significant changes, while some items were still reported with poor quality. For example, 42.2% of RCTs did not adequately report how to generate allocation sequence, 93.3% of RCTs did not adequately report allocation concealment, and 62.2% of RCTs did not adequately report how to solve the missing data. ConclusionThe quality of RCTs reports on TCM formula granules published in Chinese journals still needs to be improved. It is recommended that researchers, journals and reviewers attach importance to the application of CONSORT-CHM formula throughout the whole process of paper writing. In the future, more scientific and detailed requirements should be put forward for trial design and reporting standards in line with the characteristics of clinical trials of TCM formula granules.
ObjectivesTo assess the characteristics, methodological and reporting qualities of systematic reviews on community interventions in China.MethodsThe Cochrane Library, PubMed, EMbase, Web of Science, CNKI, VIP, WanFang Data and CBM databases were searched for studies of community interventions from inception to August 2017. Two reviewers independently screened literature, extracted data and assessed the methodological and reporting quality by AMSTAR tool and PRISMA checklist. Data analysis was performed by SPSS 20.0 software.ResultsA total of 18 systematic reviews of community interventions were included. The average AMSTAR score was 4.67±1.68, and all studies did not provide the list of included and excluded studies or a statement on conflict of interests. The average PRISMA score was 16.42±3.65, and over 50.0% of the included systematic reviews did not perform protocol and registration, search, additional analyses, risk of bias of included studies and funding.ConclusionsThe evidence shows that the reporting and methodological quality of meta-analyses of community interventions in China is insufficient. The combination of results, quality of individual research and the evaluation of publication bias should be paid more attention to improve methodological quality. The reporting of meta-analyses of community interventions in China should follow the PRISMA checklist.
ObjectiveTo analyze the reporting and methodological quality of tranexamic acid meta-analyses published in Chinese journals. MethodsThe CNKI, WanFang Data, and CBM databases were electronically searched for meta-analyses of tranexamic acid from inception to August 12th, 2021. Two reviewers independently screened literature, extracted data, and used AMSTAR 2 and PRISMA 2009 to assess the methodological and reporting quality of publications. ResultsA total of 68 meta-analyses were included. The identified meta-analyses required improvement for items 2, 3, 4, 7, 8, 10, 12, 15, and 16 in the AMSTAR 2, and items 2, 5, 8, 12, 15, 17, 22, 24, and 27 in the PRISMA 2009 assessments, respectively. The methodological and reporting quality scores were positively correlated (rs=0.36, P=0.002). Linear regression analysis identified the mentioning of PRISMA and funding support as the independent factors potentially affecting the reporting quality score (P<0.05). ConclusionsBoth the methodological and reporting quality of the tranexamic acid meta-analyses published in Chinese journals require improvement.
ObjectivesTo assess the methodological quality and reporting quality of meta-analysis published on The Chinese Journal of Nursing.MethodsCNKI and WanFang Data databases were electronically searched to collect meta-analysis which published on The Chinese Journal of Nursing from inception to December 2017. Two reviewers independently screened literature, extracted data and assessed the methodological quality and the reporting quality by AMSTAR scale and PRISMA statement. Statistical analysis was then performed by using SPSS 19.0 software.ResultsA total of 53 meta-analyses were included, which involved 7 disease systems and sub-health status. The mean score of the methodological assessment by AMSTAR was 7.75±1.32, including 9 high-quality papers (17.0%), 41 middle-quality papers (77.4%), and 3 low-quality papers (5.6%). The mean score of the reporting quality assessment by PRISMA was 22.5±3.08, including 39 relatively complete papers (73.6%), 11 papers with certain defects (20.8%), and 3 papers with serious defects (5.6%).ConclusionsThe methodological and reporting quality of meta-analysis published on The Chinese Journal of Nursing deserves further improvement.
ObjectiveTo evaluate the methodological quality of cross-sectional surveys about Chinese medicine syndrome in a population at potential risk of cerebrovascular diseases. Methods The CNKI, WanFang Data, CBM and PubMed databases were electronically searched to collect cross-sectional surveys about Chinese medicine syndromes in a population at potential risk of cerebrovascular diseases from inception to December, 2022. The methodological quality was assessed using the JBI scale. Results A total of 105 studies were included. The average reporting rate of JBI was 52.06%, and the items with the highest scores included "sufficient coverage of the identified sample in data analysis" (100%), "description of study subjects and setting" (92.38%), and "using valid methods for the identification of the condition" (86.67%). Items with the lowest scores included "adequate sample size" (13.33%), "adequate response rate or low response rate managed appropriately" (14.29%), and "study participants recruited in an appropriate way" (20.95%). Subgroup analysis suggested that type of publication and number of implementation centers were potential factors influencing methodology quality (P<0.05). Conclusion The methods essential to a cross-sectional survey such as sampling, sample size calculation and handling with the response rate, and the syndrome diagnosis scales specific to Chinese medicine require further improvement.
Objective The basic terms of the technical specifications for case-control studies in the field of traditional Chinese medicine (TCM) are formed by expert consensus methods, in order to develop detailed texts of the technical specifications. Methods According to the process of international guidelines, a total of 44 experts participated in the Delphi survey. Results The three rounds of questionnaire response rates were 73.3%, 86.4%, and 86.8%, respectively. The experts' authority coefficients were 0.82, 0.85, and 0.86, respectively; and the expert opinion coordination coefficients were 0.356, 0.349, and 0.422, respectively. Expert enthusiasm, authority, opinion centralization, and degree of coordination were relatively high. There were many opinions raised in the expert consensuses on how to measure TCM syndrome, TCM constitution, the time point of measurement and the selection of new cases. Conclusion The case-control studies in TCM field should pay more attention to the characteristics of TCM. The draft of technical specification involves the study design and reporting, which can improve the methodological and reporting quality of case-control studies.
ObjectiveTo evaluate the methodological quality of systematic reviews and meta-analysis (SRs/MAs) in fields of integrated Chinese-western therapy for non-small cell lung cancer (NSCLC).
MethodsSRs/MAs in fields of integrated Chinese-western therapy for NSCLC were searched inPubMed, EMbase, CBM, CNKI, VIP and WanFang Data from inception to July 10th, 2016. We also handsearched relevant journals such as Chin J Evid-based Med and reference of included studies, and tried to find the grey literature for additional studies. Two researchers independently screened literature and extracted data. Then methodological quality of included SRs/MAs were evaluated by AMSTAR scale.
ResultsA total of 53 SRs/MAs were included, the highest and lowest scores of methodological quality were 9 and 1, respectively. The average score was 5.98±1.50. Results on the qualities of methodology or evaluation showed that 46 SRs/MAs (88.68%) was rated as moderate and 6 (11.32%) as low． The main problems were found in such areas as preliminary design scheme, literature searching, a list of included and excluded studies, etc..
ConclusionThe methodology of SRs/MAs in fields of integrated Chinese-western therapy for NSCLC have quality problems at different levels, further improvement should be expected.
ObjectivesTo assess the methodological and reporting quality of surgical meta-analyses published in English in 2014.MethodsAll meta-analyses investigating surgical procedures published in 2014 were selected from PubMed and EMbase. The characteristics of these meta-analyses were collected, and their reporting and methodological quality were assessed by the PRISMA and AMSTAR, respectively. Independent predictive factors associated with these two qualities were evaluated by univariate and multivariate analyses.ResultsA total of 197 meta-analyses covering 10 surgical subspecialties were included. The mean PRISMA and AMSTAR score (by items) were 22.2±2.4 and 7.8±1.2, respectively, and a positive linear correlation was found between them with a R2 of 0.754. Those meta-analyses conducted by the first authors who had previously published meta-analysis was significantly higher in reporting and methodological quality than those who had not (P<0.001). Meanwhile, there were also significant differences in these reporting (P<0.001) and methodological (P<0.001) quality between studies published in Q1 ranked journals and (Q2+Q3) ranked jounals. On multivariate analyses, region of origin (non-Asiavs. Asia), publishing experience of first authors (ever vs. never), rank of publishing journals (Q1 vs. Q2+Q3), and preregistration (presence vs. absence) were associated with better reporting and methodologic quality, independently.ConclusionThe reporting and methodological quality of current surgical meta-analyses remained suboptimal, and first authors' experience and ranking of publishing journals were independently associated with both qualities. Preregistration may be an effective measure to improve the quality of meta-analysis, which deserves more attention from future meta-analysis reviewers.
This paper summarizes the methodological quality assessment tools of artificial intelligence-based diagnostic test accuracy studies, and introduces QUADAS-AI and modified QUADAS-2. Moreover, this paper summarizes reporting guidelines of these studies as well, and then introduces specific reporting standards in AI-centred research, and checklist for AI in dental research.
