LIAO Mingyu 1,2,3 , WU Mengyao 1,2,3 , ZHAO Peng 1,2,3 , GUO Jin 1,2,3,4 , ZHENG Mengyuan 1,2,3 , LIU Chunrong 1,2,3 , JIA Yulong 1,2,3 , REN Yan 1,2,3 , HUANG Wei 5 , TAN Jing 1,2,3 , SUN Xin 1,2,3,4 , XIONG Yiquan 1,2,3
  • 1. Clinical Epidemiology and Evidence-based Medicine Center, West China Hospital, Sichuan University, Chengdu 610041, P. R. China;
  • 2. NHC Key Laboratory of Clinical Epidemiology and Evidence-based Medicine, West China Hospital, Sichuan University, Chengdu 610041, P. R. China;
  • 3. IDEAL China Center, West China Hospital, Sichuan University, Chengdu 610041, P. R. China;
  • 4. West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, P. R. China;
  • 5. West China Center of Excellence for Pancreatitis, Institute of Integrated Traditional Chinese and Western Medicine, West China Hospital, Sichuan University, Chengdu 610041, P. R. China;
TAN Jing, Email: tanjing84@outlook.com; SUN Xin, Email: sunxin@wchscu.cn; XIONG Yiquan, Email: xiongyq@scu.edu.cn
Export PDF Favorites Scan Get Citation

Objective  To systematically investigate the implementation and reporting quality of statistical analysis methods in observational studies for the clinical evaluation of heart failure treatment and management devices, and to provide references for the standardized design and reporting of statistical analyses in future studies within this field. Methods  A comprehensive search was conducted in the PubMed database for observational studies published between October 2014 and September 2024 that aimed to evaluate the effectiveness and/or safety of heart failure treatment devices with a control group. Two researchers independently screened the literature and extracted data. The basic characteristics of the included studies and the implementation and reporting features of their statistical analysis methods were analyzed. Results  A total of 65 studies were included, comprising 63 (96.92%) cohort studies and 2 (3.08%) case-control studies. Among these, only 39 (60.00%) studies performed multivariable analyses. The median number of confounders included was 9 (IQR 5 to 16), and only 22 (56.41%) studies reported specific methods for identifying confounders. None of the studies considered procedure-related confounders such as operator experience or institutional procedure volume. The most frequently used multivariable method was Cox regression (20, 51.28%), followed by propensity score methods (13, 33.33%). Only 15 (23.08%) studies conducted subgroup analyses and 11 (16.92%) performed sensitivity analyses. Compared with studies published in non-Q1 journals according to the journal citation reports (JCR), studies published in Q1 journals had larger sample sizes and higher proportions of using multivariable analysis. Conclusion  Observational studies on the clinical evaluation of heart failure treatment devices exhibit notable deficiencies in the implementation of statistical analysis methods, including inadequate identification and control of confounding factors and low proportions of subgroup and sensitivity analyses. Addressing these methodological limitations in future research will be essential for generating robust, high-quality evidence to inform clinical decision-making.

Citation: LIAO Mingyu, WU Mengyao, ZHAO Peng, GUO Jin, ZHENG Mengyuan, LIU Chunrong, JIA Yulong, REN Yan, HUANG Wei, TAN Jing, SUN Xin, XIONG Yiquan. Evaluation of statistical methods in observational studies on heart failure treatment devices: a cross-sectional survey. Chinese Journal of Evidence-Based Medicine, 2026, 26(4): 453-460. doi: 10.7507/1672-2531.202511160 Copy

Copyright ? the editorial department of Chinese Journal of Evidence-Based Medicine of West China Medical Publisher. All rights reserved

  • Previous Article

    Effects of tight glucose control on the prognosis of patients after cardiac surgery: an overview of systematic reviews
  • Next Article

    Analysis of the evidence characteristics of recommendations in integrated traditional Chinese and Western medicine