Remote mentoring system using HoloLens2

Introduction: Changes required in medical practice

This initiative, which is being carried out jointly with Chiba University Hospital, aims to enable remote communication while sharing video information from neurosurgical angiography examinations*¹ among staff members in real time.
Changes in the medical field are being implemented, including taking into account cases in which patients feel psychologically anxious due to conversations between young doctors and supervising doctors during examinations, preventive measures against new coronavirus infections, streamlining the number of testing personnel, and reducing the burden on doctors. It is desired.

(*¹) Tests to check the condition of blood vessels (stenosis, occlusion, abnormality, etc.) and tumor distribution

Background: Education of young doctors and consideration for patients are seen as issues

On-site education is essential for improving the technique of young doctors who will be responsible for the future of the medical industry. Angiography examinations are no exception, and it is customary for young doctors to improve their technique under the instructions of a supervising physician, but when doing so, care must be taken to ensure that the conversation between the supervising physician and the junior physician does not cause anxiety in the patient. need to do it.
Furthermore, from the perspective of preventing new coronavirus infections and reforming the way doctors work, opportunities for young doctors to continue their training under appropriate guidance are decreasing, creating opportunities for doctors in training to improve their procedures and improving patient care. Now more than ever, it is becoming a challenge to balance these considerations.

Content: Utilizing MR (mixed reality) to share inspection status in real time to remote locations

When a surgeon in the examination room performs a procedure wearing HoloLens2*², the image from the surgeon's perspective is shared with the instructor in a remote location. Supervising doctors can give instructions to junior doctors via earphones based on video information shared in real time, making it possible to provide appropriate treatment and respond to emergencies without causing anxiety to patients.
Video and audio from HoloLens2 will be shared on Microsoft Teams*⁴ via Azure communication Service*³. Additionally, medical record information can be shared at the same time, allowing staff in remote locations to know the testing status in real time as if they were there.
When sharing medical information like this, it is necessary to strictly protect individual patient information, so this initiative was undertaken not only by the staff of the neurosurgery department at Chiba University Hospital, but also by Medtech, which supports the development of new medical devices.・Development is being carried out by a joint team with the Link Center, the Planning and Information Department, which operates the electronic medical record system, and the Integrated Information Center, which oversees the information infrastructure of Chiba University as a whole.

[Image diagram]

(*²) Mixed reality smart glasses developed by Microsoft (*³) Cloud-based communication service that lets you add audio, video, chat, and telephony to apps (*⁴) Microsoft developed for Windows, macOS, Linux, iOS, and Android A collaboration platform developed and provided to

Expectations: Our prospects for reducing the burden on doctors and MR (mixed reality)

This initiative allows instructors to provide guidance in the control room or remotely, leading to emergency response and reducing the burden. Furthermore, by observing these interactions remotely, young doctors can create opportunities for self-improvement.
In addition, through mixed reality (MR), we plan to advance not only telemedicine in medical settings, but also diagnostic issues during the novel coronavirus pandemic and educational issues faced by universities.

*The names of our products and services posted on this page are trademarks or registered trademarks of our company. Other company names, product names, service names, etc. are trade names, trademarks, or registered trademarks of each company.