Claims for Patent: 11,712,320

Summary for Patent: 11,712,320

Title:	Methods and systems to automate surgical interventions
Abstract:	A surgical system for providing an improved video image of a surgical site including a system controller that receives and processes video images to determine a video signature corresponding to a condition that interferes with a quality of the video images, with the system controller interacting with a video enhancer to enhance the video images from a video capturing device to automatically control the video enhancer to enhance the video images. The surgical system can also review the video images for a trigger event and automatically begin or stop recording of the video images upon occurrence of the trigger event.
Inventor(s):	Amit Mahadik, Jagadish Venkataraman, Ramanan PARAMASIVAN, Brad HUNTER, Afshin JILA, Kundan Krishna, Hannes RAU
Assignee:	Stryker Corp
Application Number:	US15/927,543
Patent Claims:	1. A system for enhancing quality of a video image of a surgical site during a surgical procedure, comprising: a video capturing device and camera control unit for generating and outputting video of the surgical site; a video enhancer configured to enhance at least some of the video output by the camera control unit for passing to an image display; and a system controller configured to receive at least one video frame from the camera control unit, detect a reduction in quality of the at least one video frame, and automatically control the video enhancer to enhance the at least one video frame from the camera control unit for passing to the image display upon detection of the reduction in quality of the at least one video frame so that a user is free from having to control the video enhancer to enhance quality of the at least one video frame of the surgical site for viewing on the image display during the surgical procedure. 2. The system of claim 1, further comprising: an insufflator for providing gas to the surgical site; and a suction system for providing suction at the surgical site for controlling removal of gas from the surgical site; and a tool for manipulating tissue at the surgical site, wherein the tool is a cauterizing tool. 3. The system of claim 2, wherein: the system controller interacts with the tool, the insufflator and the suction system; and the system controller further automatically controls at least one of the tool, the insufflator and the suction system to address a condition at the surgical site that is associated with the reduction in quality of the at least one video frame. 4. The system of claim 3, wherein: the reduction in quality corresponds to the condition of smoke in the at least one video frame, and the system controller operates at least one of the tool, the insufflator and the suction system in response to an amount of smoke sensed. 5. The system of claim 1, wherein: the reduction in quality corresponds to the condition of smoke in the at least one video frame. 6. The system of claim 1, wherein: the reduction in quality corresponds to the condition of blood in the at least one video frame. 7. The system of claim 1, further comprising: a liquid pump system for providing fluid to the surgical site; and a suction system providing suction for controlling removal of fluid from the surgical site; and a tool for manipulating tissue at the surgical site, wherein the tool is a cutting tool. 8. The system of claim 1, wherein the system comprises a light source for providing light to the surgical site. 9. The system of claim 8, wherein the system comprises the image display. 10. A system for enhancing quality of a video image of a surgical site during a surgical procedure, comprising: a tool for manipulating tissue at the surgical site; a suction system for providing suction at the surgical site; a light source for providing light to the surgical site; a video capturing device and camera control unit for generating and outputting video of the surgical site; an image display for displaying the video images; a video enhancer configured to enhance at least some of the video output by the camera control unit for passing to the image display; and a system controller configured to receive at least one video frame from the camera control unit, detect a reduction in quality of the at least one video frame, automatically control the video enhancer to enhance the at least one video frame from the camera control unit for passing to the image display upon detection of the reduction in quality of the at least one video frame, and automatically control at least one of the tool and the suction system to address a condition at the surgical site that interferes with quality of the video images so that a user is free from having to manually control any of the video capturing device, the video enhancer, the tool, and the suction system to respond to the reduction in quality of the video images during the surgical procedure. 11. The system of claim 10, further comprising: an insufflator for providing gas to the surgical site; and wherein the tool is a cauterizing tool. 12. The system of claim 11, wherein: the system controller further automatically controls the insufflator to address the condition at the surgical site. 13. The system of claim 10, wherein: the reduction in quality corresponds to the condition of smoke in the video. 14. The system of claim 10, wherein: the reduction in quality corresponds to the condition of blood in the video. 15. The system of claim 10, further comprising: a liquid pump system for providing fluid to the surgical site; wherein the tool is a cutting tool. 16. A method for controlling a surgical system during a surgical procedure based on imaging of a surgical site, comprising: illuminating the surgical site; obtaining video at the surgical site by a video capturing device and camera control unit; analyzing at least one video frame of the video received by a system controller from the camera control unit to detect a reduction in quality of the at least one video frame; controlling, by the system controller, a video enhancer to enhance the at least one video frame from the camera control unit in response to the system controller detecting a reduction in quality of the at least one video frame without control from an operator; and displaying at least one enhanced video frame during the surgical procedure. 17. The method of claim 16, further comprising: providing gas to the surgical site with an insufflator; and providing suction at the surgical site with a suction system. 18. The method of claim 17, further comprising: automatically controlling at least one of a cauterizing tool, the insufflator and the suction system to address a condition at the surgical site associated with reduction in video image quality. 19. The method of claim 16, further comprising: providing fluid to the surgical site; and providing suction for controlling removal of fluid from the surgical site. 20. The method of claim 16, wherein the video is obtained during lymphatic imaging, blood flow imaging, tissue perfusion imaging, tissue anatomy imaging, or a combination thereof. 21. The method of claim 16, wherein the video is obtained during robotic surgery. 22. An imaging system for viewing a video image of a surgical site, comprising: a video capturing device for obtaining video images at the surgical site; a video recorder receiving the video images; and a system controller configured to receive and process the video images to determine at least one activity captured in the video images that indicates a beginning of a use of the video capturing device to view the surgical site or a pause in use of the video capturing device to view the surgical site; the system controller configured to interact with the video recorder to at least one of automatically record and automatically stop recordation of the video images upon determining that the at least one activity captured in the video images has occurred. 23. The system of claim 22, further including: a tool for manipulating tissue at the surgical site. 24. The system of claim 22, wherein the system comprises a light source for providing light to the surgical site. 25. A method for controlling a surgical system that provides an image of a surgical site, comprising: illuminating the surgical site; obtaining video images at the surgical site; analyzing the video images, by a system controller, to determine an occurrence of at least one activity captured in the video images that indicates a beginning of a use of the video capturing device to view the surgical site or a pause in use of the video capturing device to view the surgical site; and in response to determining that the at least one activity captured in the video images has occurred, automatically controlling a video recorder by the system controller to record or stop recording the video images. 26. The method of claim 25, further including: manipulating tissue at the surgical site with a tool. 27. A system for enhancing the quality of a video image of a surgical site, comprising: a video capturing device for obtaining video at the surgical site; and a system controller configured to maintain or improve quality of the video obtained by the video capturing device and provided to an image display, wherein the system controller is configured to receive and process the video to: determine whether smoke that interferes with a quality of the video images is present in at least one video frame of the video and, when smoke is present in the at least one video frame, determine at least one of changes in smoke intensity and changes in smoke spread in the at least one video frame; wherein the system controller is configured to interact with a video enhancer, a tool, and a suction system and controlling at least one of the video capturing device, the video enhancer, the tool, and the suction system to enhance the video images received from the video capturing device or to address the condition at the surgical site so that a user is free from having to manually control any of the video capturing device, the video enhancer, the tool, and the suction system to respond to the condition that interferes with the quality of the video images; wherein the system controller is configured to determine a type of control of at least one of the video capturing device, the video enhancer, the tool, and the suction system based on (1) the at least one of changes in smoke intensity and changes in smoke spread determined by the system controller and (2) at least one other surgical input provided to the system controller. 28. The system of claim 27, wherein: the at least one other surgical input includes characteristics of at least one of the tool, the suction system, the light source and the video capturing device. 29. The system of claim 27, wherein: the at least one other surgical input includes a surgical procedure type. 30. The system of claim 27, wherein: the at least one other surgical input includes surgeon preferences. 31. The system of claim 27, wherein the system comprises a light source for providing light to the surgical site. 32. The system of claim 31, wherein the system comprises the image display. 33. A kit for imaging tissue in a surgical site, the kit comprising a fluorescence imaging agent and the system of claim 1.