ObjectiveTo translate the King’s Brief Interstitial Lung Disease (K-BILD) to Chinese, so as to provide an well reliability and validity assessment instrument for health status of patients with interstitial lung disease.MethodsBrislin’s transition model, six expert’s panel and pre-survey were used for initial Chinese version of K-BILD. Items analysis, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), internal consistency reliability and test-retest reliability were used for validity and reliability test with 122 respondents.ResultsTen-item Chinese version of K-BILD were proved to have great psychometric qualities, two factors were extracted by EFA, which could explain 63.35% of the total variance. Furthermore, the CFA demonstrates the fit indices of two-factors mode: χ2/df=0.797, RMSEA=0.000, NFI=0.848, IFI=1.048, CFI=1.000, TLI=1.071. Cronbach’s α and Guttman Split-half were 0.893 and 0.861, respectively. Besides, the test-retest reliability of the scale was 0.805.ConclusionThe Chinese version of K-BILD scale has good validity and reliability, which is applicable for health status assessment in patient with interstitial lung disease.
Evidence synthesis is the process of systematically gathering, analyzing, and integrating available research evidence. The quality of evidence synthesis depends on the quality of the original studies included. Validity assessment, also known as risk of bias assessment, is an essential method for assessing the quality of these original studies. Currently, there are numerous validity assessment tools available, but some of them lack a rigorous development process and evaluation. The application of inappropriate validity assessment tools to assessing the quality of the original studies during the evidence synthesis process may compromise the accuracy of study conclusions and mislead the clinical practice. To address this dilemma, the LATITUDES Network, a one-stop resource website for validity assessment tools, was established in September 2023, led by academics at the University of Bristol, U.K. This Network is dedicated to collecting, sorting and promoting validity assessment tools to improve the accuracy of original study validity assessments and increase the robustness and reliability of the results of evidence synthesis. This study introduces the background of the establishment of the LATITUDES Network, the included validity assessment tools, and the training resources for the use of validity assessment tools, in order to provide a reference for domestic scholars to learn more about the LATITUDES Network, to better use the appropriate validity assessment tools to conduct study quality assessments, and to provide references for the development of validity assessment tools.
Objective We aimed to develop a self-management assessment scale for children with epilepsy and test its reliability and validity. Methods A research group was established, and the items were revised through literature review, group discussion and pre-investigation, and 280 patients with epilepsy in children were included, and the reliability and validity of the scale were tested. Results 28 items in 4 dimensions were developed to form the scale, namely, knowledge and belief of diseases and medication, compliance of medication and treatment, self-efficacy of medication and obstacles of medication. Confirmatory factor analysis extracted four common factors with characteristic roots greater than 1, and the cumulative variance explanation rate was 65.639%. The factor load of all items is > 0.5. The overall Cronbach’s alpha is 0.880, and the coefficients in seven measurement dimensions are all greater than 0.8. Conclusion The self-management assessment scale for children’s epilepsy drugs has good reliability and validity, and can provide a measuring tool for the drug management of children’s epilepsy diseases.
ObjectiveTo compare and evaluate the discrimination, validity, and reliability of different data envelopment analysis (DEA) models for measuring the effectiveness of models by selecting different input and output indicators of the model.MethodsData from health statistical reports and pilot program of diagnosis-related groups of tertiary hospitals in Hubei Province from 2017 to 2018 were used to analyze the discrimination, content and structure validity, and reliability of the models. Six DEA models were established by enriching the details of input and output on the basis of the input and output indicators of the conventional DEA model of hospitals.ResultsFrom the view of discrimination, the results of all models were left-skewed, the cost-efficiency model had the lowest left-skewed degree (skewness coefficient: -0.14) and was the flattest (kurtosis coefficient: -1.02). From the view of structure validity, the results of the cost-efficiency model were positively correlated with total weights, outpatient visits, and inpatient visits (r=0.328, 0.329, 0.315; P<0.05). From the perspective of content validity, the interpretation of model was more consistent with theory of production after revision of input and output indicators. From the view of reliability, the cost efficiency model had the largest correlation coefficient between the data of 2017 and 2018 (r=0.880, P<0.05).ConclusionsAfter refining the input and output indicators of the DEA model, the discrimination, validity, and reliability of the model are higher, and the results are more reasonable. Using indicators such as discrimination, validity, and reliability can measure the effectiveness of the DEA model, and then optimize the model by selecting different input and output indicators.
ObjectiveTo develop a survey questionnaire on preferences and values regarding perineal injury prevention measures during pregnancy and conduct reliability and validity tests. MethodsCombining literature reviews, qualitative interviews, and expert consultations, we summarized key elements of perineal injury prevention during pregnancy and synthesized the best evidence. Through multiple discussions within the core working group, a survey questionnaire on preferences and values regarding perineal injury prevention measures during pregnancy was formulated. Using convenience sampling, pregnant women were recruited, and a pre-survey was conducted using the questionnaire. Pre-survey results were analyzed using item analysis and reliability and validity testing methods to validate and refine the questionnaire. ResultsThe questionnaire was compiled based on the theory of evidence-based decision-making. The initial version of the questionnaire was developed by combining systematic evaluation, network meta-analysis, and semi-structured interviews. The questionnaire was modified and improved through expert consultation, group discussion, and pre-investigation, which ensured that the questionnaire had good reliability, validity, and practicability. The Cronbach's α coefficient was 0.87, the split-half reliability was 0.71, and the content validity index was 0.97 of the survey questionnaire. ConclusionThe present version of the perineal injury preventive measures preference and values questionnaire has good reliability, validity, and practicability. It can serve as a valuable tool for investigating preferences and values related to perineal injury prevention during pregnancy.
Objective
To develop an evaluation tool for the screening of high risk population for oral complications in critically ill patients, which can be performed accurately and scientifically.
Methods
Basing on the related foreign oral assessment scale, combined with the method of brainstorming, expert consultation, method of clinical status and so on, the item pool of the assessment scale was determined. Five nursing experts and two oral experts assessed the content validity and 50 ICU nurses were tested. Then, the screening accuracy of the assessment scale was proved by application in 100 critically ill patients selected randomly.
Results
The Cronbach’s a coefficient of final version of the High Risk Assessment Scale for Oral Complications in Critically Ill Patients (including seven parts contents of oral health assessment and oral pH value test) was 0.815, the content validity index (Sr-CVI/Ave) was 0.932. The results of 50 nurses to the 91.2% assessment items of the assessment scale were very important and important. For screening related indicators of oral complications in high-risk patients, the sensitivity of the assessment scale was 97.53%, the specificity was 94.11%, the positive predictive value was 98.75%, the negative predictive value was 88.89%, and the crude agreement was 95%.
Conclusion
There are good reliability, validity and a high accuracy of screening test in the High Risk Assessment Scale for Oral Complications in Critically Ill Patients. It can be used for screening patients at high risk for oral complications in critically ill patients, and help clinical nurses to complete the oral health status of the critically ill patients quickly.
ObjectiveTo evaluate the reliability and validity of the instrument of clinical applicability of guidelines (version 2.0). MethodsThe experts of domestic medical institutions were investigated by questionnaire, and the instrument of clinical applicability of guidelines (version 2.0) were evaluated the guidelines for the diagnosis and treatment of tinea mantis and tinea pedis (revised edition 2017) and the guidelines for the diagnosis and treatment of cerebral hemorrhage in China (2019). Using Cronbach's α coefficient and Spearman-Brown coefficient to evaluate the inherent reliability and split-half reliability. The content validity was evaluated by calculating the content validity index of the item level and the adjusted Kappa value. The correlation coefficient between each item and the dimension and the hypothesis test were used to evaluate the convergent and discriminant validity. The structural validity was evaluated by using structural equation model to evaluate the structural validity of the tool. ResultsThe Cronbach's α coefficient and Spearman-Brown coefficient of the instrument of clinical applicability of guidelines (version 2.0) were both greater than 0.7, the content validity index (S-CVI/Ave) were more than 0.8, the success rates of convergent were 100%, and the success rates of discriminant validity calibration were 100% and 96%. In the second-order confirmatory factor analysis model, the χ2/ df were less than 3, the fitting index (CFI), the goodness of fit index (GFI) and the adjustment goodness of fit index (AGFI) were all greater than 0.9. The root mean square residual (RMR) were all less than 0.05, and approximate error root mean square (RMSEA) were less than 0.09. The P value of RESEA hypothesis test were more than 0.05. ConclusionThe instrument of clinical applicability of guidelines (version 2.0) has good reliability and validity, which can be further verified in practical application in the future.
Objective To evaluate the reliability and validity of the three-dimensional motion capture analysis system COFT-Motion? in evaluating the active range of motion of upper limbs in healthy subjects, and provide objective basis for its clinical application. Methods From January to March 2022, healthy subjects were publicly recruited for enrollment. The evaluator applied the three-dimensional motion capture analysis system COFT-Motion? and angle ruler to evaluate the active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) in healthy subjects. Pearson correlation analysis was used to evaluate validity, and intraclass correlation coefficient (ICC) was used to evaluate reliability. Results There was a positive correlation between the measurements of COFT-Motion? and the angle ruler of the active range of motion of upper limbs in healthy subjects. The Pearson correlation coefficients for active range of motion of the shoulder joint (flexion, extension, adduction, abduction) and elbow joint (flexion, extension) were 0.913, 0.964, 0.961, 0.941, 0.864, and 0.919, respectively (P<0.05). The results of using COFT-Motion? by different evaluators to evaluate the active range of motion of healthy subjects’ shoulder joints (flexion, extension, adduction, abduction) and elbow joints (flexion, extension) showed that the ICC values were 0.892, 0.942, 0.961, 0.988, 0.989, and 0.928, respectively (P<0.05). The results of repeated evaluations by the same evaluator showed that the ICC values were 0.795, 0.916, 0.900, 0.868, 0.918, and 0.911, respectively (P<0.05). Conclusion The application of the three-dimensional motion capture analysis system COFT-Motion? in healthy subjects has good validity and reliability. However, due to the limited sample size and subject of the study, further promotion and application of the system still need to be further explored.
ObjectivesTo evaluate the reliability and validity on quality criteria for clinical nursing practice guidelines.MethodsFive appraisers were included to assess two clinical nursing practice guidelines using the quality criteria for clinical nursing practice guidelines and AGREE Ⅱ. ICC and coefficient of consistency were adopted to assess the reliability and validity of the appraisal tools.ResultsICC for two guidelines of AIDS and infusion by the quality criteria for clinical nursing practice guidelines were 0.979 and 0.890. ICC for two guidelines of AIDS and infusion by AGREE Ⅱ were 0.957 and 0.887. The coefficient of consistency for guidelines of AIDS and infusion by the two appraisal tools were 0.880 and 0.886, both were highly consistent.ConclusionsThe quality criteria for clinical nursing practice guidelines has good reliability and validity and can be used as appraisal tool for quality evaluation of clinical nursing practice guidelines. It is strongly recommended that the users should understand the appraisal tool or should be trained to decrease the bias.
