# US 12,010,458 B2 · Single point devices that connect to a display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,458 B2 - Document ID: US12010458B2 - Status: Granted - Kind: B2 - Application number: 18/110,683 - Filed: 2023-02-16 - Published: 2023-08-31 - Granted: 2024-06-11 - Earliest claimed: 2019-08-21 - Assignees: American Well Corporation - Applicants: American Well Corporation - Inventors: Roy Schoenberg - Web page: https://patentgrep.com/patent/US12010458B2 ## CPC - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring - H04L 65/1059: End-user terminal functionalities specially adapted for real-time communication - H04L 65/1069: Session establishment or de-establishment - H04L 65/1089: by adding media; by removing media - H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference} - H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) - H04L 65/60: Network streaming of media packets - H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display} - H04N 7/15: Conference systems - H04N 21/2187: Live feed - H04N 21/42201: {biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user (input arrangements for interaction with the human body based on nervous system activity detection G06F3/015)} - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)} - H04N 21/47: End-user applications - H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} - G16H 40/67: for remote operation - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Single point devices that connect to a display device include a port for establishing a connection to a port on the display device and for switching the display device from a first mode to a second mode; an audio video device configured to capture image data representing one or more images of physical entities in a field of view of the audio video device and further configured to capture acoustic data; a receiver device and a transmitter device configured for dedicated communication with a data processing system. ## Claims ### Claim 1 A device, comprising: a display device configured to render a program and further configured to stream data for a communication session received from a data processing system, wherein the data processing system is configured to receive requests from medical service providers to initiate communication sessions with a user of the display device; a device configured to: capture image data representing at least one physical entity in a field of view of the device, and further configured to capture acoustic data, motion data, or both acoustic and motion data; detect an event associated with the motion data or the acoustic data; based on the motion data or the acoustic data, determine a health status of a patient associated with the device; based on the health status that is determined, determine a type of a medical service that is responsive to a health requirement of the user; based on the type of the medical service that is responsive, authorize establishment of a communication session with a medical service provider that provides the type of the medical service; based on authorizing the communication session, transmit data requesting establishment of the communication session with the medical service provider; based on authorizing the communication session, cause the display device to interrupt a program displayed on the display device to initiate the communication session; and transmit, through the data processing system and to a client device of the medical service provider, image data and additional acoustic data captured by the device. ### Claim 2 (depends on 1) The device of claim 1, wherein the device comprises a microphone. ### Claim 3 (depends on 1) The device of claim 1, wherein the device comprises a speaker device configured to output signals based on the additional acoustic data received. ### Claim 4 (depends on 1) The device of claim 1, wherein the display device comprises a television display. ### Claim 5 (depends on 1) The device of claim 1, wherein the device comprises a camera. ### Claim 6 (depends on 1) The device of claim 1, wherein causing the display device to interrupt the program comprises rendering a graphical user interface and causing display device to cease displaying of the program. ### Claim 7 (depends on 1) The device of claim 1, wherein causing the display device to interrupt the program comprises causing the display device to display a graphical user interface in a first portion of the display device and continue displaying the program in a second portion of the display device. ### Claim 8 (depends on 7) The device of claim 7, wherein the first portion is larger than the second portion. ### Claim 9 (depends on 1) The device of claim 1, wherein the communication session with the data processing system is established through a wireless network. ### Claim 10 (depends on 1) The device of claim 1, further comprising one or more biometric sensors, detecting the event comprises sensing comprise biometric data representing the health status of the patient, the biometric data representing a blood pressure, a heart status, or at least a portion of an electrocardiograph. ### Claim 11 (depends on 1) The device of claim 1, further comprising one or more motion sensors, wherein detecting the event comprises sensing motion data representing motion of a user of the device. ### Claim 12 A method, comprising: rendering a program to stream data for a communication session received from a data processing system, wherein the data processing system is configured to receive requests from medical service providers to initiate communication sessions with a user of a display device; capturing image data representing at least one physical entity in a field of view of a device, and further configured to capture acoustic data, motion data, or both acoustic and motion data; detecting an event associated with the motion data or the acoustic data; based on the motion data or the acoustic data, determining a health status of a patient associated with the display device; based on the health status that is determined, determining a type of a medical service that is responsive to a health requirement of the user; based on the type of the medical service that is responsive, authorizing establishment of a communication session with a medical service provider that provides the type of the medical service; based on authorizing the communication session, transmitting data requesting establishment of the communication session with the medical service provider; based on authorizing the communication session, causing the display device to interrupt a program displayed on the display device to initiate the communication session; and transmitting, through the data processing system and to a client device of the medical service provider, image data and additional acoustic data captured by the device. ### Claim 13 (depends on 12) The method of claim 12, wherein causing the display device to interrupt the program comprises rendering a graphical user interface and causing display device to cease displaying of the program. ### Claim 14 (depends on 12) The method of claim 12, wherein causing the display device to interrupt the program comprises causing the display device to display a graphical user interface in a first portion of the display device and continue displaying the program in a second portion of the display device. ### Claim 15 (depends on 14) The method of claim 14, wherein the first portion is larger than the second portion.