requirement analysis

XX Hospital plans to establish a smart (digital) operating room system that can achieve in-hospital surgical demonstration, remote teaching for grassroots medical institutions, live surgical lectures, and remote consultations based on hospital management and business needs, and relevant standards. This will comprehensively enhance the hospital's medical technology research, clinical teaching, and market influence.

According to the specific requirements of this project, the main construction contents are as follows:

Deploy surgical teaching carts, surgical teaching interactive terminals, panoramic and surgical field camera systems in the operating room to achieve high-definition surgical live streaming;

The simulation center can observe the panoramic view of the operating room and the images of the surgical field equipment in real time through the surgical teaching interactive terminal, and can have voice communication with the operating room;

The simulation center can freely arrange single screen multi screen or multi screen display observation according to the actual situation of the surgical scene and display equipment;

The system supports multi-point interaction function, allowing for one-on-one or one to many video and audio communication between any operating room and the simulation center;

The operation of the client and management end can be achieved through a simple and user-friendly interface. The operating room and simulation center support one click start function, reducing the workload of operators and lowering system maintenance.

System Overview

The surgical teaching interactive system consists of a surgical teaching cart, a surgical teaching interactive terminal (named 1168), a camera system (with panoramic and surgical field dual camera positions), a voice interaction system, a display system, and other equipment. The device adopts a portable design, small size, simple deployment, convenient and flexible, high reusability, and cost saving.

System topology diagram

As shown in the above figure, the operating room is equipped with one set of surgical teaching carts, which can be installed with portable surgical teaching interactive terminals, high-definition surgical field cameras, and panoramic cameras to collect surgical image signals for different surgical needs. The surgical process information is collected and stored, and the video and audio signals are transmitted through the network to the simulation center conference room inside or outside the hospital for real-time live broadcasting and interactive communication.

In the operating room, through the surgical teaching cart, not only can the audio and video signals of the operating room be collected, such as panoramic cameras, surgical field cameras, medical equipment video signals, and wireless two-way earphones audio signals. After encoding, files can be recorded and saved on a local USB drive or mobile hard drive, and uploaded to a third-party FTP server for file storage and archiving, making it convenient for users to download files, watch and play on demand. It can also engage in real-time remote interaction with personnel at the simulation center, achieving remote teaching observation.

At the simulation center end, the 4K surgical teaching interactive terminal (named 1169) can remotely observe the panoramic view of the operating room and ultra high definition images of surgical field equipment in real time, and can also communicate with the operating room through voice communication; At the same time, personnel at the simulation center can freely choose single screen multi screen or multi screen display to observe the entire surgical process based on the actual situation of the surgical scene and display equipment. In addition, the surgical teaching cart can interact with the family chat room or leadership office by deploying surgical teaching interactive terminals through voice terminals.

Surgical teaching cart

The surgical teaching cart (as shown in the figure below) adopts a modular design, equipped with 4K portable surgical teaching terminal, panoramic camera, surgical field camera, omnidirectional microphone and other modules for easy installation. This product is equipped with an electric lifting structure and ultra quiet medical wheels, making it easy and flexible to move to the operating room.

Surgical demonstration

Deploy one surgical teaching cart in the operating room, which adopts a highly integrated and portable design, integrating video conferencing terminal, video matrix, and environmental control. Support 4K ultra high definition signal acquisition, support H.264 and H.265 encoding; It can achieve audio and video signal interoperability with any classroom/conference room, with a picture quality of up to 4K ultra high definition. Viewers can observe the surgical process from multiple angles and in all directions, and engage in voice communication. A remote teaching platform designed specifically for hospitals, medical schools, and medical training institutions, including a camera system (panoramic and surgical field dual camera positions), voice interaction system, display system, medical image acquisition and coding system, and control management system. The deployment is simple, convenient, flexible, highly reusable, and cost-effective.

Image Resource Management

The audio and video content of the surgical process can be saved locally in the operating room, or uploaded to the cloud control center's image resource management server for centralized storage in the demonstration room. Supports on-demand playback, which can be viewed directly on the HDMI output at the same time.

1) Surgical video recording

Real time recording of the surgical process in all aspects and multiple scenes, providing traceable video files.

2) Real time live streaming

Push the surgery process to the Internet live broadcast platform in real time for users to watch through computers or mobile devices

3) Video on demand

Classify and manage surgical images, provide convenient and fast retrieval, on-demand, and download services, and support multiple platforms

distance learning

Hospital distance education mainly consists of two training modes: real-time live streaming and courseware on-demand. Real time live training ensures the synchronization of audio and video of teaching experts, and supports real-time interaction among training participants. The intelligent medical remote teaching and training system utilizes computers and networks for remote teaching, achieving synchronous images, sounds, and interactive teaching between teaching parties in different locations, achieving goals that traditional distance education cannot achieve.

Intraoperative communication

Through the interactive function of the surgical teaching terminal in the operating room, it is possible to communicate synchronously with pathologists about pathological sampling requirements, resection range, result feedback, and report return, reducing the waiting time for intraoperative pathological examinations.

During the surgical process, if there are special circumstances that require communication with family members, the surgical images and information will be communicated to the patient's family in multimedia format. The surgeon can complete the intraoperative conversation without leaving the operating room. The authorized images of the conversation and family confirmation are saved throughout the surgical demonstration interactive terminal, and can also be uploaded to the control center for centralized storage to avoid postoperative disputes between doctors and patients.

Remote visitation

Establish an ICU visitation room, where family members enter and the visitation task is initiated by the nurse station. After the visitation is completed, the task is stopped to ensure the safe and controllable transmission of images. The visitation terminal has a two-way audio and video visitation function, which can achieve two-way audio and video interaction and visitation through high-definition cameras and audio systems, meeting the needs of patients' families to pay attention to the surgical process and remote visitation, and meeting the difficulties of ICU ward visitation.

Simulation center end

The surgical teaching interactive host (choose a loud device name) supports SIP and H.263 interactive protocols, and can achieve 4-party high-definition video interaction by itself. It can also register and connect to a remote expert consultation platform. Interconnect audio and video signals for remote expert consultations, or conduct remote consultations and centralized consultations with lower level hospitals.

Advantages of the plan

Innovative surgical demonstration method

Real time sharing and observation of 4K ultra high definition surgical operations, remote teaching and guidance, with high-definition images, low latency, and no lag.

Local storage of surgical video recordings

Real time recording of the surgical process in all aspects and multiple scenes, providing traceable video files. Video files support local storage in the operating room.

Easy copying of medical images

The front USB interface of the surgical teaching interactive host can be connected to portable USB storage devices, making it convenient to copy and backup intraoperative videos and image materials.

Real time sharing and observation of 4K ultra high definition surgical operations, remote teaching and guidance, with high-definition images, low latency, and no lag.

Remote consultation and live streaming

The system supports seamless connection with other live broadcast and remote consultation platforms to realize remote medical consultation and Internet live broadcast functions.

Multi purpose machine

One machine for multiple purposes, realizing live broadcasting of daily meetings in the hospital through the system, improving office efficiency. Two way audio and video interaction can also be conducted between demonstration rooms, allowing for discussions and teaching based on operating room videos.

Rich interfaces

Support various professional medical imaging equipment signal acquisition, support composite video, component, VGA, DVI-i, HDMI, SDI/HD-SDI and other signal interfaces, which can meet the needs of synchronous acquisition, recording, and transmission of on-site video and various medical imaging equipment signals for panoramic cameras, surgical field cameras, endoscopes, patient monitors, etc.

Massive storage

For the recording of surgical procedures, not only high image quality and clarity are required, but also long-term storage is required for students to play back and collect medical disputes, which poses a challenge to the storage device capacity. The "Sunshine" remote surgical teaching storage solution can use disk arrays, NAS, and IP-SAN as surgical monitoring data storage devices, which can be deployed as needed in the network, so the storage capacity can be flexibly expanded to achieve massive storage.