ObjectiveTo formulate the Chinese version of Fear of Progression Questionnaire-Short Form/Caregiver Version (FoP-Q-SF/C) and examine the reliability and validity of the scale.MethodsA questionnaire survey of FoP-Q-SF/C was conducted among the caregivers of melanoma out-patients in West China Hospital of Sichuan University from June 2019 to March 2020. Convenient sampling method was adopted. The validity and reliability of the scale were analyzed.ResultsA total of 247 caregivers of melanoma out-patients were investigated by the FoP-Q-SF/C, and 101 valid questionnaires were finally collected. The Cronbach’s α of the FoP-Q-SF/C scale was 0.919, and the Guttman Split-Half coefficient was 0.906. Using exploratory factor analysis to extract 3 common factors, the cumulative explainable total variation was 73.964%. The model fit was as follows: chi-square/degree of freedom was 1.950, standardized root mean square residual was 0.067, goodness of fit index was 0.859, incremental fit index was 0.939, comparative fit index was 0.938, Tucker-Lewis index or non-normed fit index was 0.918, and the root-mean-square error of approximation was 0.097.ConclusionsThe FoP-Q-SF/C scale formulated in this study is divided into three dimensions, which has good reliability and validity, meanwhile, it is relatively simple and can be used to clinically screen melanoma caregivers’ FoP-Q-SF/C levels. However, the application of this scale in other diseases still needs further testing.
ObjectivesTo compare and analyze existing pharmaceutical economic evaluations quality assessment instruments, and to provide suggestions on how to choose the most appropriate instrument.MethodsPubMed, EMbase, ScienceDirect, Web of Science, CNKI, WanFang Data and VIP databases were electronically searched to collect studies on existing pharmaceutical economic evaluations quality assessment instruments from inception to December, 2017. Two reviewers independently screened literature, extracted data and analyzed studies in terms of items, design methods, scopes and characteristics.ResultsTwelve original checklists with good reliability and validity were found. The first quality assessment method was designed in 1987 and the latest one was published in 2013. The number of checklist items ranged from 11 to 61.ConclusionThere is no consolidated method for assessing the quality of pharmaceutical economics evaluations. Evaluators can choose appropriate evaluation tools according to the purpose, type and operability of evaluation.
ObjectiveTo translate the King’s Brief Interstitial Lung Disease (K-BILD) to Chinese, so as to provide an well reliability and validity assessment instrument for health status of patients with interstitial lung disease.MethodsBrislin’s transition model, six expert’s panel and pre-survey were used for initial Chinese version of K-BILD. Items analysis, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), internal consistency reliability and test-retest reliability were used for validity and reliability test with 122 respondents.ResultsTen-item Chinese version of K-BILD were proved to have great psychometric qualities, two factors were extracted by EFA, which could explain 63.35% of the total variance. Furthermore, the CFA demonstrates the fit indices of two-factors mode: χ2/df=0.797, RMSEA=0.000, NFI=0.848, IFI=1.048, CFI=1.000, TLI=1.071. Cronbach’s α and Guttman Split-half were 0.893 and 0.861, respectively. Besides, the test-retest reliability of the scale was 0.805.ConclusionThe Chinese version of K-BILD scale has good validity and reliability, which is applicable for health status assessment in patient with interstitial lung disease.
ObjectiveTo evaluate the reliability and validity of the Quality of Working Life Scale (QWL7-32).
MethodsThe QWL7-32 scale was used to survey 487 drilling workers. The presence of chronic diseases was regarded as an effector for evaluating physical health, and the result of SCL-90 measurement was regarded as an effector for evaluating psychological health. The reliability and validity of the scale were statistically analyzed.
ResultsThe results of the Pearson correlation coefficient was 0.713, the Cronbach's alpha coefficient was 0.920, and the Splithalf reliability coefficient was 0.942. The result of confirmatory factor analysis showed that the construct validity of scale was good, and the accumulative rate of 7 variances was 62.59%. The results of correlation analysis and t test showed that the validity of scale criterion was also good. In QWL7-32 scale, each dimension showed a good correlation with its relevant item but poor correlation with any other items.
ConclusionThe QWL7-32 has a good reliability and validity.
ObjectivesTo evaluate the reliability and validity on quality criteria for clinical nursing practice guidelines.MethodsFive appraisers were included to assess two clinical nursing practice guidelines using the quality criteria for clinical nursing practice guidelines and AGREE Ⅱ. ICC and coefficient of consistency were adopted to assess the reliability and validity of the appraisal tools.ResultsICC for two guidelines of AIDS and infusion by the quality criteria for clinical nursing practice guidelines were 0.979 and 0.890. ICC for two guidelines of AIDS and infusion by AGREE Ⅱ were 0.957 and 0.887. The coefficient of consistency for guidelines of AIDS and infusion by the two appraisal tools were 0.880 and 0.886, both were highly consistent.ConclusionsThe quality criteria for clinical nursing practice guidelines has good reliability and validity and can be used as appraisal tool for quality evaluation of clinical nursing practice guidelines. It is strongly recommended that the users should understand the appraisal tool or should be trained to decrease the bias.
The COSMIN-RoB checklist includes three sections with a total of 10 boxes, which is used to evaluate risk of bias of studies on content validity, internal structure, and other measurement properties. COSMIN classifies reliability, measurement error, criteria validity, hypothesis testing for construct validity, and responsiveness as other measurement properties, which primarily focus on the quality of the (sub)scale as a whole, rather than on the item level. Among the five measurement properties, reliability, measurement error and criteria validity are the most widely used in the studies. Therefore, this paper aims to interpret COSMIN-RoB checklist with examples to guide researchers to evaluate the risk of bias of the studies on reliability, measurement error and criteria validity of PROMs.
Objective We aimed to develop a self-management assessment scale for children with epilepsy and test its reliability and validity. Methods A research group was established, and the items were revised through literature review, group discussion and pre-investigation, and 280 patients with epilepsy in children were included, and the reliability and validity of the scale were tested. Results 28 items in 4 dimensions were developed to form the scale, namely, knowledge and belief of diseases and medication, compliance of medication and treatment, self-efficacy of medication and obstacles of medication. Confirmatory factor analysis extracted four common factors with characteristic roots greater than 1, and the cumulative variance explanation rate was 65.639%. The factor load of all items is > 0.5. The overall Cronbach’s alpha is 0.880, and the coefficients in seven measurement dimensions are all greater than 0.8. Conclusion The self-management assessment scale for children’s epilepsy drugs has good reliability and validity, and can provide a measuring tool for the drug management of children’s epilepsy diseases.
ObjectiveTo compare and evaluate the discrimination, validity, and reliability of different data envelopment analysis (DEA) models for measuring the effectiveness of models by selecting different input and output indicators of the model.MethodsData from health statistical reports and pilot program of diagnosis-related groups of tertiary hospitals in Hubei Province from 2017 to 2018 were used to analyze the discrimination, content and structure validity, and reliability of the models. Six DEA models were established by enriching the details of input and output on the basis of the input and output indicators of the conventional DEA model of hospitals.ResultsFrom the view of discrimination, the results of all models were left-skewed, the cost-efficiency model had the lowest left-skewed degree (skewness coefficient: -0.14) and was the flattest (kurtosis coefficient: -1.02). From the view of structure validity, the results of the cost-efficiency model were positively correlated with total weights, outpatient visits, and inpatient visits (r=0.328, 0.329, 0.315; P<0.05). From the perspective of content validity, the interpretation of model was more consistent with theory of production after revision of input and output indicators. From the view of reliability, the cost efficiency model had the largest correlation coefficient between the data of 2017 and 2018 (r=0.880, P<0.05).ConclusionsAfter refining the input and output indicators of the DEA model, the discrimination, validity, and reliability of the model are higher, and the results are more reasonable. Using indicators such as discrimination, validity, and reliability can measure the effectiveness of the DEA model, and then optimize the model by selecting different input and output indicators.
ObjectiveTo conduct meta-analysis with the reliability of objective structured clinical examination (OSCE), so as to the reliability of OSCE used in the tests for evaluating clinical capacities of medical students.
MethodsArticles about evaluating clinical capacities of medical students using OSCE and using comprehensive coefficient of Cronbach's α to measure the reliability of OSCE were electronically searched in PubMed, ScienceDirect, CNKI, WanFang data and VIP from Jan. 1998 to May. 2013. Two reviewers screened literature according to the inclusion and exclusion criteria, extracted data, and assessed the methodological quality of the included studies. Then meta-analysis was performed using SSPS 17.0 software.
ResultsThirty-four studies involving 53 coefficients of Cronbach's α were included, of which, there were 18 articles written in English involving 28 coefficients of Cronbach's α and 16 articles written in Chinese involving 25 coefficients of Cronbach's α. The results of meta-analysis showed that:the total coefficient of Cronbach's α of OSCE was 0.700 (95%CI 0.660 to 0.737). The coefficient of Cronbach's α of internationally-published literature was 0.745 (95%CI 0.696 to 0.790) and that of nationally-published literature was 0.648 (95%CI 0.584 to 0.705), with a significant difference between two groups.
ConclusionCurrently, the reliability of internationally/nationally-used OSCE is 0.7, which has relatively better reliability when used in the tests for evaluating clinical capacities of medical students at home and aboard. However, the reliability of OSCE at abroad is fairly better than that at home.
Objective Using the evidence-based management to manage the flexible endoscope based on the data collected by information means, to reduce the rate of serious faults and control maintenance costs. Methods From January 2017 to December 2018, we collected and analyzed the flexible endoscope data of the use, leak detection, washing and disinfection, and maintenance between 2015 and 2018 from the Gastroenterology Department of our hospital. Three main causes of flexible endoscope faults were found: delayed leak detection, irregular operation, and physical/chemical wastage. Management schemes (i.e., leak detection supervision, fault tracing, and reliability maintenance) were enacted according to these reasons. These schemes were improved continuously in the implementation. Finally, we calculated the changes of the fault rate of each grade and the maintenance cost. Results By two years management practice, compared with those from 2015 to 2016, the annual rates of grade A and grade C faults of flexible endoscope from 2017 to 2018 decreased by 10.3% and 16.7% respectively, and the annual average maintenance cost fell by 53.2%. Conclusions The maintenance costs of flexible endoscope could be effectively controlled by enacting and implementing a series of targeted management schemes based on the data from the root causes of faults applying the evidence-based management. Evidence-based management based on data has a broad application prospect in the management of medical equipment faults.
