Real-world data (RWD) in clinical research on specific categories of medical devices can generate sufficient quality evidence which will be used in decision making. This paper discusses the limitations of traditional randomized controlled trials in clinical research of medical devices, summarizes and analyses the applicable conditions of real-world evidence (RWE) for medical devices, interprets the new FDA guidance document on the characteristics of RWD for medical devices, in order to provide evidence for the use of RWE in medical devices in our country.
Research of generating real-world evidence using real world data has attracted considerable attention globally. Outcome research of treatment based on existing health and medical data or registries has become one of the most important topics. However, there exists certain confusions in this line of research on how to design and implement appropriate statistical analysis. Therefore, in the fourth chapter of the series technical guidance to develop real world evidence by China REal world data and studies Alliance (ChinaREAL), we aim to provide an guidance on statistical analysis in the study to assess therapeutic outcomes based on existing health and medical data or registries.In this chapter, we first emphasize the significance of pre-specified statistical analysis plan, recommending key components of the statistical analysis plan. We then summarize the issue of sample size calculation in this content and clarify the interpretation of statistical p-value. Secondly, we recommend procedures to be considered to tackle the issue related to the selection bias, information bias and most importantly, confounding bias. We discuss the multivariable regression analysis as well as the popular causal inference models. We also suggest that careful consideration should be made to deal with missing data in real-world databases. Finally, we list core content of the statistical report.
Randomized controlled trials are considered as the gold standard for determining the causality, and are usually used to evaluate the efficacy and safety of medical interventions. However, in some cases it is not feasible to conduct a randomized controlled trial. In recent years, a framework called “target trial emulation study” has been formally established to guide the design and analysis of observational studies based on real-world data. This framework provides an effective method for causal inference based on observational studies. In order to facilitate domestic scholars to understand and apply the framework to solve related clinical problems, this article introduces it from the basic concept, framework structure and implementation steps, development status, and prospects.
A patient registry database is an important source of real-world data, and has been widely used in the assessment of drug and medical devices, as well as disease management. As the second part of the serial technical guidance for real-world data and studies, this paper introduces the concept and scope of potential uses of patient registry databases, proposes recommendations for planning and developing a patient registry database, and compares existing health and medical databases. This paper further develops essential quality indicators for developing a patient registry database, in expect to guide future studies.
The rapid advancement of causal inference is driving a paradigm shift across various disciplines. "Target trial emulation" has emerged as an exceptionally promising framework for observational real-world studies, attracting substantial attention from medical scholars and regulatory agencies worldwide. This article aims to provide an introduction to CERBOT, an online tool that assists in implementing target trial emulation studies, while highlighting the advancements in this domain. Additionally, the article provides an illustrative example to elucidate the operational process of CERBOT. The objectives are to support domestic researchers in conducting target trial emulation studies and enhance the quality of real-world studies in the domestic medical field, as well as improve the medical service level in clinical practice.
With the boom of information technology and data science, real-world evidence (RWE) which is produced using diverse real-world data (RWD) has become an important source for healthcare practice and policy decisions, such as regulatory and coverage decisions, guideline development, and disease management. The production of high-quality RWE requires not only complete, accurate and usable data, but also scientific and sound study designs and data analyses to enable the questions of interest to be reliably answered. In order to improve the quality of production and use of RWE, China REal world data and studies ALliance (ChinaREAL) has developed the first series of technical guidance for developing real-world data and subsequent studies. The efforts are ongoing which would ultimately inform better healthcare practice and policy decisions.
Randomised controlled trials are often difficult to conduct for rare diseases, the treatment of life-threatening and serious diseases with no effective treatment options, and single-arm clinical trials are one of the most common choices. However, single-arm clinical trials lack a control group, making it difficult to determine whether the observed treatment effects stem from the drug itself or are influenced by natural disease progression, placebo effects, or selection bias. In recent years, with the continuous accumulation of real-world data, it is possible to use real-world data to construct an external control for single-arm clinical trials. However, it is necessary to carefully consider how to select appropriate external control data to enhance the credibility of the results. Based on the existing studies and relevant laws and regulations in China and abroad, this study expounds the key considerations of using real-world data to construct the external control of single-arm clinical trials on the source data from the perspective of external control setting model, reference intervention selection, data source, and so on. This study could provide references for relevant researchers to conduct similar studies.
To enhance the quality and transparency of oncology real-world evidence studies, the European Society for Medical Oncology (ESMO) has developed the first specific reporting guidelines for oncology RWE studies in peer-reviewed journals "the ESMO Guidance for Reporting Oncology Real-World Evidence (GROW)". To facilitate readers understanding and application of these reporting standards, this article introduces and interprets the development process and main contents of the ESMO-GROW checklist.
Retrospective chart review (RCR) is a type of research that answers specific research questions based on the existing patient medical records or related databases through a series of research processes including data extraction, data collation, statistical analysis, etc. Relying on the development of medical big data, as well as the relatively simple implementation process and low cost of information acquisition, RCR is increasingly used in the medical research field. In this paper, we conducted the visual analysis of high-quality RCR published in the past five years, and explored and summarized the current research status and hotspots by analyzing the characteristics of the number of publications, national/regional and institutional cooperation networks, author cooperation networks, keyword co-occurrence and clustering networks. We further systematically combed the methodological core of this kind of research from eight aspects: research question and hypothesis, applicability of chart, study design, data collecting, statistical analysis, interpretation of results, and reporting specification. By summarizing the shortcomings, unique advantages and application prospects of RCR, providing guidance and suggestions for the standardized application of RCR in the medical research field in the future.
Given the growing importance of real-world data (RWD) in drug development, efficacy evaluation, and regulatory decision-making, establishing a scientific and systematic data quality regulatory framework has become a strategic priority for global pharmaceutical regulatory authorities. This paper analyzed the European Union's (EU's) advanced practices in RWD quality regulation, compared the RWD quality regulatory systems of China and the EU, and aimed to derive implications for enhancing China's own framework. The EU has made significant progress by promoting the interconnection, intercommunication, and efficient utilization of data resources, implementing a collaborative responsibility mechanism spanning the entire data lifecycle, developing a standardized, tool-based quality assessment system, and facilitating international cooperation and alignment of rules. While China has established an initial regulatory system for RWD quality, it still confronts challenges such as unclear mechanisms for data acquisition and utilization, underdeveloped operational standards, and unclear responsibility delineation. In contrast, by adapting relevant EU experience, China can refine its regulatory framework, establish mechanisms for the interconnection, intercommunication, and efficient utilization of RWD, develop more practical quality assessment toolkits, improve the lifecycle responsibility-sharing mechanism, and promote the alignment of RWD quality regulation with international standards. These enhancements will advance the standardization and refinement of RWD quality regulation in China, ultimately strengthening the scientific rigor and reliability of regulatory decisions.
