requirement analysis

XX Hospital plans to establish a smart (digital) operating room system that can achieve in hospital surgical demonstration, remote teaching for grassroots medical institutions, live surgical lectures, and remote consultations based on hospital management and business needs and relevant standards. This will comprehensively enhance the hospital's medical technology research, clinical teaching, and market influence.

According to the drawing analysis and technical requirements provided in the bidding documents, the main construction content and requirements of this package are as follows:

Deploy panoramic and field camera systems in the operating room to achieve high-quality live streaming in the hospital, while also being able to store and publish through a network system.

Collect images of medical equipment in the operating room and store and publish them through a network system.

The operating room teaching host equipment supports video output interfaces for all medical devices, including mainstream and other video interfaces such as CVBS, DVI, HDMI, SDI, etc., and supports H.264 encoding.

The demonstration classroom can observe the panoramic view of the operating room, surgical field, and medical imaging equipment in real-time through high-definition teaching reception terminals, and can have voice intercoms with the operating room.

The receiving end of the classroom can freely layout and select single screen, multi screen or multi screen display for observation based on the surgical scene and the actual situation of the display equipment.

The system supports multi-point communication function, allowing for one-on-one or one to many video and audio communication with a delay of less than 500ms between any operating room and the classroom.

The operation of the client and management can be achieved through a simple and user-friendly interface. The operating room and teaching receiver support one click start function, reducing the workload of operators and reducing system maintenance.

The server system supports synchronous recording, storage, and on-demand publishing of multiple high-definition video signals, as well as standard protocol interoperability, multi format, and bandwidth compensation.

The system supports seamless connection with other live broadcast and remote consultation platforms to realize remote medical consultation and Internet live broadcast functions.

The system supports data integration with other hospital information systems and provides free communication and data transmission port protocols.

Solution application topology

As shown in the above figure, the operating room collects surgical image signals through high-definition surgical field cameras and panoramic cameras for the collection and storage of surgical process information for operations with different needs, stores the teaching signals to the storage device through the network through the teaching terminal, and carries out real-time rebroadcasting or later on-demand broadcasting for local area network users in the hospital and Internet users outside the hospital through the network. Whether in the classroom, office, or anywhere outside the campus, high-definition teaching activities can be fully received and watched through mobile terminals.

At the same time, the operating room and the family chat room or classroom can interact through voice terminals, and all audio and video files are stored in large capacity through storage servers.

Operation room

The operating room is the information source for the learning system. The scene at the surgical site, surgical results, and the language of the doctor on site are the main elements in teaching. One or more high-definition coding terminals are usually deployed in the operating room, which collect and transmit multi-channel video from the operating room to the display room. And remote consultation rooms. include

1. Panoramic camera, used to capture panoramic video information of the operating room;

2. High definition camera for capturing surgical details;

3. Endoscopic videos;

4. The wireless microphone transmits the voice of the chief surgeon in real-time to the classroom.

5. Optional access to various medical instruments in the operating room, such as cardiac blood pressure monitoring equipment, X-ray machines, etc

In each operating room, the surgical demonstration interactive host is used to achieve audio and video collection. According to the type of surgery and actual needs, video signals from panoramic cameras, surgical field cameras, medical equipment, and wireless two-way earphones are collected. The encoded audio signals can be recorded and saved locally, and uploaded to a third-party FTP server for file storage and archiving, making it convenient for users to download files and watch on-demand playback.

One surgical teaching interactive host can support simultaneous recording of 10 video signals, and multiple operating rooms or classrooms can be centrally managed through a comprehensive management platform, saving costs and facilitating later management and maintenance.

Showroom/Consultation Room

Showroom provides a centralized environment for observation, learning, and interactive Q&A for a large number of customers, usually equipped with large screen display devices such as multiple projectors, flat TVs, etc.

The teaching terminal decodes high-definition audio and video from the network and directly outputs it to large display devices. Users can flexibly switch between on-site surgical video images, control the pan tilt and camera, conveniently combine and display multiple surgical video images, and support bidirectional voice and visual intercom.

The demonstration classroom can have two-way audio interaction with the operating room through the demonstration terminal.

system function

The operation teaching system is to show all the panoramic activities and surgical section activities in the operating room to the large screen in the teaching room through Internet technology, so that observers can watch the whole process of surgery in the teaching room. Of course, this requires the assistance of hardware devices, such as 1080p high-definition surgical field cameras and panoramic cameras, to respectively capture the surgical incision image and the operating room panoramic view.

At the same time, in order to ensure bidirectional intercom between the teaching room and the operating room, the surgical teaching demonstration system also requires the assistance of equipment such as microphones, speakers, and pickups to jointly create a convenient and easy teaching assistance software. The application of this system avoids the infection caused by personally entering the operating room to observe, and greatly improves the efficiency of clinical teaching, ensuring that most people can observe the expert's surgery at once.

Surgical demonstration

A remote teaching platform designed specifically for hospitals, medical schools, and medical training institutions, including a camera system (panoramic and surgical field dual position), voice interaction system, display system, medical image acquisition and coding system, and control management system, with simple deployment, convenience, flexibility, high reusability, and cost savings.

Supports access to multiple signal sources, such as laparoscopes, panoramas, surgical fields, monitors, etc. The endoscope display module supports 4K signal source signal access, display, storage, and transmission. The surgical room can interact with the conference venue on the whiteboard, and cooperate with voice teaching guidance.

The demonstration classroom can be connected to any operating room, achieving audio and video signal interoperability, and the picture quality can reach high-definition 4K. The operating room can connect with various camera equipment and medical equipment video equipment, and surgical viewers can watch the surgical process from multiple angles and all directions.

Image resource management

The audio and video content of the surgical process can be saved locally in the operating room, or can be centrally saved in the classroom or uploaded to the image resource management server of the cloud control center. Supports on-demand playback, which can be viewed directly at the HDMI output simultaneously.

1) Surgical video recording

Real time recording of the surgical process in multiple scenarios and providing traceable video files.

2) Real time live streaming

Push the surgery process to the Internet live broadcast platform in real time for users to watch through computers or mobile devices

3) Video on demand

Classify and manage surgical images, provide convenient and fast retrieval, on-demand, and download services, and support multiple platforms

distance learning

Hospital remote education mainly adopts two training modes: real-time live streaming and courseware on-demand. Real time live training ensures audio and video synchronization among teaching experts, and supports real-time interaction among training participants. The smart medical remote teaching and training system utilizes computers and networks for long-distance teaching, achieving synchronous images, sounds, and interactive teaching between teaching parties in different locations, achieving the goals that traditional remote education cannot achieve.

remote consultation 

The surgical teaching interactive host supports SIP and H.323 interactive protocols, and can achieve 4-party high-definition video interaction. It can also register and connect to a remote expert consultation platform. Communicate and interconnect audio and video signals from remote expert consultations, or conduct remote consultations and centralized consultations with lower level hospitals.

Intraoperative communication

Through the interactive function of the surgical teaching interactive host in the operating room, pathological material requirements, resection range, result feedback, and report feedback can be synchronously communicated with pathologists, reducing the waiting time for intraoperative pathological examinations.

During the surgical process, if there are special circumstances that require communication with family members, the surgical images and information should be communicated to the patient's family members in a multimedia format. The surgeon can complete the intraoperative conversation without leaving the operating room. The authorized images of the conversation and family confirmation are saved throughout the entire process in the surgical teaching interactive host, and can also be uploaded to the control center for centralized storage to avoid postoperative disputes between doctors and patients.

Scene style family talk

Support real-time video transmission, where users request to review a certain period of video before a certain point in time and simultaneously record real-time video. Centralized storage and playback, facilitating communication and conversation with family members.

Remote visitation

Establish an ICU visitation room, where family members enter. The nurse station initiates the visitation task and stops it after the visit to ensure the safe and controllable transmission of images. The visitation terminal has a two-way audio and video visitation function, which can achieve two-way audio and video interaction and visitation through high-definition cameras and audio systems, meeting the needs of patient families to pay attention to the surgical process and remote visitation, and meeting the difficulties of ICU ward visitation.

centralized control

The cloud control center can provide unified management, control, monitoring, content storage, live streaming/on-demand application operations for all operating rooms and classrooms.

Touch control operations are presented on demand, with highly integrated software and hardware, and flexible adaptability to different environmental requirements, ensuring surgical efficiency every second. Centralized control of operating room equipment is achieved through a touch screen, with one click start and one click call. Unified control interface, all device operations only need to be completed on the touch control screen, and can be set up with just one click.

Advantages of the plan

Innovative surgical demonstration methods

Real time sharing and observation of 4K ultra high definition surgical operations, remote teaching and guidance, with high-definition images, low latency, and no lag.

Local storage of surgical videos

Real time recording of the surgical process in multiple scenarios and providing traceable video files. Video files support local storage in the operating room.

Easy copying of medical images

The front USB interface of the surgical teaching interactive host can be connected to a portable USB storage device, making it convenient to copy and backup intraoperative video and image data.

Real time sharing and observation of 4K ultra high definition surgical operations, remote teaching and guidance, with high-definition images, low latency, and no lag.

Remote consultation and live streaming

The system supports seamless connection with other live broadcast and remote consultation platforms to realize remote medical consultation and Internet live broadcast functions

One machine with multiple uses

One machine for multiple purposes, achieving live broadcasting of daily meetings within the hospital through the system, and improving office efficiency. Two way audio and video interaction can also be conducted between classrooms, and discussions and teaching can be conducted based on operating room videos.

Rich interfaces

Supporting signal acquisition from various professional medical imaging equipment, including composite video, component, VGA, DVI-i, HDMI, SDI/HD-SDI and other signal interfaces, it can meet the needs of synchronous acquisition, recording, and transmission of on-site videos and signals from various medical imaging equipment, such as panoramic cameras, surgical field cameras, endoscopes, and patient monitors.

Massive storage

For the recording of surgical processes, not only does it require high image quality and clarity, but it also requires long-term storage for student playback and medical dispute evidence collection, which poses a challenge to the storage device capacity. The "Sunshine" remote surgical teaching storage solution can use disk arrays, NAS, and IP-SAN as surgical monitoring data storage devices, which can be deployed on demand in the network. Therefore, the storage capacity can be flexibly expanded to achieve massive storage.

Core products

Surgical teaching interactive host

The operating room is equipped with HMW-1U6Y surgical teaching and recording series host, mainly used for image acquisition, dynamic image recording, image transmission and processing, image storage management, image teaching and broadcasting, and remote consultation guidance of high-definition signals output by medical imaging equipment.

Unify the collection, encoding, transmission, and storage of audio and video signals in the operating room, and decode and display the classroom signals. Realize integrated embedded real-time guidance, surgical recording, surgical demonstration, surgical interaction and other functions.

Product features:

1. Highly integrated: integrating audio processors, seamless video mixing, programmable central control, recording and decoding, video conferencing terminals, and interactive MCUs into one.

2. Interactive teaching: Single machine 4-point MCU, easy to achieve four-way interactive demonstration. Simultaneously supporting external MCU systems for large-scale interactive demonstrations. Remote access can be achieved with video conferencing, conference rooms, and SIP phones.

3. 4K image quality: 4K high-definition input, output, recording, encoding, truly ultra high definition recording and broadcasting applications.

4. Full streaming protocol: Seamless integration with various resource management systems and video interaction systems.

5. Embedded system: Embedded Linux system, secure, stable, and low-power.

6. Visual management: It has four visual applications, including B/S, C/S, GUI, and centralized management of multiple machines.

Multimedia integrated machine

Technical characteristics

1. Embedded hardware architecture, plug-in modular design, stable and reliable system.

2. Highly integrated, space saving, easy to use, and easy to maintain.

3. Visual management, with streaming media as the technical core, makes the operation clear and easy to use.

4. Interconnection, easy multi-party interaction between audio and video, video conferencing, recording, and cloud live streaming.

Product features

1. High definition image quality: high-definition video input, output, encoding, decoding, recording.

2. Video configuration: Provides multiple options for HDMI/DVI/SDI/HDBaseT/VGA/fiber optic boards, with functions such as subtitles/EDID/HDCP/single layer splicing/multi screen synthesis.

3. Audio processor: Supports AFC, AEC, ANS, sound variation, equalization, mixing grouping, etc.

4. Programmable central control: An open programmable central control that supports multiple interfaces such as RS232/485/IR/IO.

5. HD recording: Multi task recording/live streaming/on-demand/playback/download/special effects switching/2T storage.

6. Interactive terminal: Supports multi protocol hybrid remote interaction modes such as RTSP/RTMP/H.323/SIP.

7. MCU management: Single machine 4-point MCU conference; Seamless integration with mainstream third-party MCUs or terminals.

8. Dual stream: Supports H.239 and BFCP dual stream standards, with a dual stream resolution of 1080P30 frames.

9. Decoding algorithms: H.265/H.264 video compression algorithm, AAC/G711 audio compression algorithm.

10. Streaming protocol: Supports TCP/UDP/RTSP/RTP/RTP/RTMP/ONVIF/H.323/SIP/HTTP protocol.

11. Visual management: The software interface is editable and provides WIN/iOS visual management.

12. Device management: Supports multi-party management architecture platforms such as B/S, C/S, and GUI.

Centralized control management server

The cloud control center is equipped with a centralized management server (VIM) for unified management of all operating room and classroom equipment, including remote device control, signal switching, environmental control, interactive calling, recording management, etc.

Resource Management Server

The center is equipped with a unified resource management server RPS, which is used for unified storage, live streaming on demand, content download, and other management of all operating rooms and classrooms.