Holistic Digital Doctor for X-Ray Reading Using VR-Enhanced 3D Touch Bone Model User Interface

Abstract

The Digital Medical Doctor (DD) platform takes a unique approach by allowing X-ray interpretation through touch devices, eliminating the requirement for medical visits simply to read X-rays. In the context of joint analysis, our suggested joint track methodology departs from the traditional keyboard and mouse matching technique, proposing an image-matching approach employing a joystick instead. However, we innovate this using a touch interface, which is more accurate and effective than joystick-based X-ray picture matching. Given the growing incidence of knee problems among women, a dataset concentrating only on knee examinations is chosen. Our study employs a hybrid image-matching technique, incorporating the Touch Bone Model (TBM) designed on a 3D modeler for knee matching on touch screens. Utilizing the Joint Track dataset, the results of DD are verified by the doctor. The results reveal whether the report is positive or negative. We saw increased efficiency and lower resource usage by incorporating TBM into the mobile version of DD, resulting in time and cost savings. This novel method is in line with the expanding environment of healthcare technology, intending to improve diagnostic processes while encouraging ease and resource efficiency.