The application of minimally invasive surgical tool detection and tracking technology based on deep learning in minimally invasive surgery is currently a research hotspot. This paper firstly expounds the relevant technical content of the minimally invasive surgery tool detection and tracking, which mainly introduces the advantages based on deep learning algorithm. Then, this paper summarizes the algorithm for detection and tracking surgical tools based on fully supervised deep neural network and the emerging algorithm for detection and tracking surgical tools based on weakly supervised deep neural network. Several typical algorithm frameworks and their flow charts based on deep convolutional and recurrent neural networks are summarized emphatically, so as to enable researchers in relevant fields to understand the current research progress more systematically and provide reference for minimally invasive surgeons to select navigation technology. In the end, this paper provides a general direction for the further research of minimally invasive surgical tool detection and tracking technology based on deep learning.
Nowadays, lung cancer is the most common and lethal invasive tumor type in Chinese population, challenging overall health level. However, personalized early-stage treatment is currently still not widely implemented, and the choice of treatment highly depends on experience of physician. Based on deep learning and radiomics principles, deep-radiomics is important for establishing objective and promotable precision medicine plans. Among all aspects, the explainability of a model is critical for its usage in clinical practice. This paper discusses the technical aspects of explainable deep-radiomics in lung cancer, and analyzes challenges we are facing. Non-fully supervised learning methods, as a current hotspot in deep learning technology, can construct more trustworthy and practically valuable deep learning models through the co-design method of performance-interpretability. Medical artificial intelligence faces three core challenges in transitioning from the laboratory to hospitals: high-level cognitive demands, data privacy and generalization capabilities, and regulatory compliance. However, with appropriate design, non-fully supervised learning holds the greatest potential to bridge the gap between design and application, enabling broader adoption.
