ObjectiveTo evaluate the reliability and validity of Guideline Implementation Success Assessment Tool (A-GIST). MethodsWith the guideline for the prevention and treatment of type 2 diabetes mellitus in China (2020 edition) as the target guideline, health care providers and patients from different hospitals across the country were investigated by questionnaire using A-GIST. Spearman-Brown coefficient and Cronbach's α coefficient were used to evaluate the split-half reliability and internal consistency reliability, while the structural validity, convergent validity and discriminant validity were investigated by confirmatory factor analysis based on structural equation. ResultsThe internal consistency reliability and split half reliability coefficients of the whole tool and each dimension ranged from 0.650 to 0.986. The scale-level content validity index (S-CVI/Ave) of content validity was 0.846. Confirmatory factor analysis showed that, the χ2/df of two sections of the tool were 8.695 and 6.123, respectively. The root mean square residual (RMR), the standard root mean square residual (SRMR) and the root mean square error of approximation (RMSEA) were under or almost under the threshold. Besides, the goodness-of-fit index (GFI) of them were 0.901 and 0.822, the adjusted goodness-of-fit index (AGFI) were 0.836 and 0.787, and the parsimonious normed fit index (PNFI) were 0.545 and 0.788, respectively. ConclusionGuideline Implementation Success Assessment Tool (A-GIST) was proved to be valid and reliable, and it shows that it is necessary to optimize the items under the dimensions of maintenance and evaluation of diagnosis and treatment effect in the future.
Objective
To develop an evaluation tool for the screening of high risk population for oral complications in critically ill patients, which can be performed accurately and scientifically.
Methods
Basing on the related foreign oral assessment scale, combined with the method of brainstorming, expert consultation, method of clinical status and so on, the item pool of the assessment scale was determined. Five nursing experts and two oral experts assessed the content validity and 50 ICU nurses were tested. Then, the screening accuracy of the assessment scale was proved by application in 100 critically ill patients selected randomly.
Results
The Cronbach’s a coefficient of final version of the High Risk Assessment Scale for Oral Complications in Critically Ill Patients (including seven parts contents of oral health assessment and oral pH value test) was 0.815, the content validity index (Sr-CVI/Ave) was 0.932. The results of 50 nurses to the 91.2% assessment items of the assessment scale were very important and important. For screening related indicators of oral complications in high-risk patients, the sensitivity of the assessment scale was 97.53%, the specificity was 94.11%, the positive predictive value was 98.75%, the negative predictive value was 88.89%, and the crude agreement was 95%.
Conclusion
There are good reliability, validity and a high accuracy of screening test in the High Risk Assessment Scale for Oral Complications in Critically Ill Patients. It can be used for screening patients at high risk for oral complications in critically ill patients, and help clinical nurses to complete the oral health status of the critically ill patients quickly.
Patient-reported outcome measures (PROM) measure attribute studies refer to studies conducted by investigators to validate the measurement attributes of PROM. The consensus-based standards for the selection of health measurement instruments (COSMIN), an international consensus standard for the selection of health measurement instruments, divides this attribute into three aspects: reliability, validity and responsiveness, and adds interpretability as an additional important feature for evaluating PROM. The purpose of this paper is to introduce the verification methods and principles of the three major measurement attributes in the COSMIN consensus, as well as the significance and direction of interpretability evaluation, and to provide international methodological experience and reference for the development of high-quality PROM psychometric attribute verification in China.
ObjectiveTo compare the performance of 36-item short form health survey (SF-36) and World Health Organization quality of life-bref (WHOQOL-Bref) in assessing quality of life (QOL) in patients with pulmonary tuberculosis (TB).
MethodsThe WHOQOL-Bref questionnaire and the SF-36 questionnaire were administered to patients with tuberculosis undergoing treatment from July to September 2013. The statistical methods of reliability analysis, factor analysis and the Pearson correlation coefficient analysis were used.
ResultsIt showed that the WHOQOL-Bref and the SF-36 both had good reliability (Cronbach α=0.863 and 0.920, respectively). Constructive validity of the two instruments were checked by factor analysis and the Pearson correlation coefficient analysis, which indicated that both the two instruments had good validity. Among scales measuring similar concepts, many subscales of the SF-36 and the four domains of the WHOQOL-Bref unexpectedly had a fair correlation with one another. For example, the physical QOL, psychological QOL, and social relation QOL domains of the WHOQOL-Bref and physical functioning, mental health, and social functioning of the SF-36 were 0.482, 0.745, and 0.572, respectively.
ConclusionThe WHOQOL-Bref and the SF-36 have an approximately equivalent practicability in assessing the quality of life in patients with TB.
ObjectiveTo evaluate the reliability and validity of the instrument of clinical applicability of guidelines (version 2.0). MethodsThe experts of domestic medical institutions were investigated by questionnaire, and the instrument of clinical applicability of guidelines (version 2.0) were evaluated the guidelines for the diagnosis and treatment of tinea mantis and tinea pedis (revised edition 2017) and the guidelines for the diagnosis and treatment of cerebral hemorrhage in China (2019). Using Cronbach's α coefficient and Spearman-Brown coefficient to evaluate the inherent reliability and split-half reliability. The content validity was evaluated by calculating the content validity index of the item level and the adjusted Kappa value. The correlation coefficient between each item and the dimension and the hypothesis test were used to evaluate the convergent and discriminant validity. The structural validity was evaluated by using structural equation model to evaluate the structural validity of the tool. ResultsThe Cronbach's α coefficient and Spearman-Brown coefficient of the instrument of clinical applicability of guidelines (version 2.0) were both greater than 0.7, the content validity index (S-CVI/Ave) were more than 0.8, the success rates of convergent were 100%, and the success rates of discriminant validity calibration were 100% and 96%. In the second-order confirmatory factor analysis model, the χ2/ df were less than 3, the fitting index (CFI), the goodness of fit index (GFI) and the adjustment goodness of fit index (AGFI) were all greater than 0.9. The root mean square residual (RMR) were all less than 0.05, and approximate error root mean square (RMSEA) were less than 0.09. The P value of RESEA hypothesis test were more than 0.05. ConclusionThe instrument of clinical applicability of guidelines (version 2.0) has good reliability and validity, which can be further verified in practical application in the future.
Objective We aimed to develop a self-management assessment scale for children with epilepsy and test its reliability and validity. Methods A research group was established, and the items were revised through literature review, group discussion and pre-investigation, and 280 patients with epilepsy in children were included, and the reliability and validity of the scale were tested. Results 28 items in 4 dimensions were developed to form the scale, namely, knowledge and belief of diseases and medication, compliance of medication and treatment, self-efficacy of medication and obstacles of medication. Confirmatory factor analysis extracted four common factors with characteristic roots greater than 1, and the cumulative variance explanation rate was 65.639%. The factor load of all items is > 0.5. The overall Cronbach’s alpha is 0.880, and the coefficients in seven measurement dimensions are all greater than 0.8. Conclusion The self-management assessment scale for children’s epilepsy drugs has good reliability and validity, and can provide a measuring tool for the drug management of children’s epilepsy diseases.
ObjectiveTo evaluate the reliability,validity and feasibility of a patient-reported outcomes (PRO) scale in the subjects with respiratory failure.
Methods364 patients with chronic respiratory failure and 97 healthy subjects were face-to-face interviewed by well-trained investigators,and the data of respiratory failure -PRO instrument were collected. The psychometric performance such as reliability,validity,responsiveness and clinical feasibility in the respiratory failure -PRO instrument was evaluated.
ResultsThe Cronbach's alpha coefficient of the respiratory failure -PRO instrument and each dimension were greater than 0.7. Factor analysis showed that the instrument had good construct validity. The scores of each of the facets and total scores between the patients and the healthy subjects were different. The recovery rate and the efficient rate of the questionnaire were more than 95%,and the time required to complete a questionnaire was within 15 minutes,indicating that the scale had a high clinical feasibility.
ConclusionThe respiratory failure -PRO instrument has good reliability,validity,responsiveness and clinical feasibility.
Objective To evaluate the reliability and validity of IBS-QOL scale in irritable bowel syndrome (IBS) patients. Methods IBS-QOL scale was applied to survey the quality of life of 123 IBS patients. The split-half and internal consistency method were used to evaluate the reliability, and with the construct method to evaluate the validity. Results The split-half reliability was 0.86. Cronbach’s α-coefficient of all domains was between 0.71 and 0.89 except body image and food avoidance; In the correlation analysis, the correlations between items and its subscale structure were above 0.60 (except interference with activity), but there were no correlations between items and other subscale structure. Eight components from factorial analysis were in accordance with theoretical structure.The cumulative contribution rate was 72.7%. Conclusions The reliability and validity of IBS-QOL scale are acceptable. It might be useful for us to assess the QOL of IBS patients in China.
Objective To evaluate the reliability and validity of the three-dimensional motion capture analysis system COFT-Motion? in evaluating the active range of motion of upper limbs in healthy subjects, and provide objective basis for its clinical application. Methods From January to March 2022, healthy subjects were publicly recruited for enrollment. The evaluator applied the three-dimensional motion capture analysis system COFT-Motion? and angle ruler to evaluate the active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) in healthy subjects. Pearson correlation analysis was used to evaluate validity, and intraclass correlation coefficient (ICC) was used to evaluate reliability. Results There was a positive correlation between the measurements of COFT-Motion? and the angle ruler of the active range of motion of upper limbs in healthy subjects. The Pearson correlation coefficients for active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) were 0.913, 0.964, 0.961, 0.941, 0.864, and 0.919, respectively (P<0.05). The results of using COFT-Motion? by different evaluators to evaluate the active range of motion of healthy subjects’ shoulder joints (flexion, extension, adduction, abduction) and elbow joints (flexion, extension) showed that the ICC values were 0.892, 0.942, 0.961, 0.988, 0.989, and 0.928, respectively (P<0.05). The results of repeated evaluations by the same evaluator showed that the ICC values were 0.795, 0.916, 0.900, 0.868, 0.918, and 0.911, respectively (P<0.05). Conclusion The application of the three-dimensional motion capture analysis system COFT-Motion? in healthy subjects has good validity and reliability. However, due to the limited sample size and subject of the study, further promotion and application of the system still need to be further explored.
