# US 2021/0344871 A1 · Enhanced video interaction for a user interface of a telepresence network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344871 A1
- Document ID: US20210344871A1
- Status: Published application
- Kind: A1
- Application number: 17/148,150
- Filed: 2021-01-13
- Published: 2021-11-04
- Earliest claimed: 2012-11-26
- Assignees: Teladoc Health, Inc.
- Applicants: Teladoc Health, Inc.
- Inventors: Marco Pinter; Charles S. Jordan; Daniel Sanchez; Kevin Hanrahan; Kelton Temby; Christopher Lambrecht
- Web page: https://patentgrep.com/patent/US20210344871A1

## CPC

- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- G11B 27/036: Insert-editing
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- G16H 40/67: for remote operation
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 5/77: between a recording apparatus and a television camera
- H04N 7/142: {Constructional details of the terminal equipment, e.g. arrangements of the camera and the display}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A telepresence device may relay video, audio, and/or measurement data to a user operating a control device. A user interface may permit the user to quickly view and/or understand temporally and/or spatially disparate information. The telepresence device may pre-gather looped video of spatially disparate areas in an environment. A temporal control mechanism may start video playback at a desired point hi a current or historical video segment. Notations may be associated with time spans in a video and recalled by capturing an image similar to a frame in the time span of the video. An area of interest may be selected and video containing the area of interest may be automatically found. Situational data may be recorded and used to recall video segments of interest. The telepresence device may synchronize video playback and movement. A series of videos may be recorded at predetermined time intervals to capture visually trending information.

## Claims

### Claim at position 1

1-41. (canceled)

### Claim 42

A non-transitory computer-readable storage medium including computer-readable instruction code for performing a method of annotating video segments received from a telepresence device, the method comprising:
receiving streaming video from the telepresence device, the streaming video including images of a patient;
displaying the streaming video to a user;
receiving an annotation from the user, the annotation relating to the condition of the patient in at least one of the images of the patient;
storing the received annotation and an identification of the user in association with the video; and
displaying the annotation and the identification of the user when replaying the stored video.

### Claim 43 (depends on 42)

The non-transitory computer-readable storage medium of claim 42, wherein the method further comprises receiving an indication of a desired time span from the user.

### Claim 44 (depends on 43)

The non-transitory computer-readable storage medium of claim 43, wherein receiving an indication of a desired time span comprises:
receiving a user indicated start time; and
automatically selecting an end time based on a default time span length.

### Claim 45 (depends on 43)

The non-transitory computer-readable storage medium of claim 43, wherein the method further comprises:
receiving a drawn object to be overlaid on at least one of the images of the patient; and
displaying the drawn object overlaid on the at least one images of the patient when replaying the stored video.

### Claim 46 (depends on 43)

The non-transitory computer-readable storage medium of claim 43, wherein the method further comprises displaying an interactive indication in a location corresponding to the desired time span, wherein the user may access the received annotation using the interactive indication.

### Claim 47 (depends on 42)

The non-transitory computer-readable storage medium of claim 42, wherein the annotation is received from the user while the streaming video is being received from the telepresence device.

### Claim 48 (depends on 42)

The non-transitory computer-readable storage medium of claim 42, wherein the method further comprises:
receiving a second annotation from a second user; and
stored the second annotation and identification of the second user in association with the video.

### Claim 49 (depends on 42)

The non-transitory computer-readable storage medium of claim 42, wherein the method further comprises storing a title in association with the annotation, the title including text received from the user.

### Claim 50 (depends on 42)

The non-transitory computer-readable storage medium of claim 42, wherein the method further comprises storing a note in association with the annotation, the note including text received from the user.
