# US 2025/0097569 A1 · Interactive multimedia collaboration platform with remote-controlled camera and annotation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097569 A1
- Document ID: US20250097569A1
- Status: Published application
- Kind: A1
- Application number: 18/965,792
- Filed: 2024-12-02
- Published: 2025-03-20
- Earliest claimed: 2023-06-01
- Assignees: Datasya Ltd.
- Applicants: Datasya Ltd.
- Inventors: Moshe Bartov; Gad Terliuc
- Web page: https://patentgrep.com/patent/US20250097569A1

## CPC

- H04M 1/72454: according to context-related or environment-related conditions
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 21/6254: {by anonymising data, e.g. decorrelating personal data from the owner's identification}
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 5/76: Television signal recording
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 23/61: based on recognised objects
- H04N 23/634: {Warning indications}
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- H04M 2250/52: including functional features of a camera
- H04N 21/2187: Live feed
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Systems and methods are provided for facilitating collaboration using visual content or multimedia content with a visual component, and alternative presentation and documentation modes of exchanged discussions, visual content and multimedia content.

## Claims

### Claim 1

A computer-implemented method for remote control of a live stream video field of view, the computer-implemented method comprising:
under control of a handheld computing device comprising a video camera, an output, and one or more processors configured to execute specific computer-executable instructions,
obtaining, using the video camera, video data representing a field of view of the video camera;
sending a substantially live stream of the video data to a remote device;
receiving, from the remote device while continuing to obtain video data representing the field of view, device movement data representing a desired movement of the handheld computing device to change the field of view; and
presenting, using the output, a prompt to move the handheld computing device based on the desired movement.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein receiving the device movement data representing the desired movement comprises receiving data representing a magnitude and direction in which the handheld computing device is to be moved.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein presenting the prompt comprises displaying an arrow indicating a direction in which the handheld computing device is to be moved to satisfy the desired movement.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
generating motion data using an inertial motion sensor;
determining, based on the motion data, that movement of the handheld computing device has satisfied the desired movement; and
ending presentation of the prompt.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
analyzing the video data to determine a movement of the handheld computing device;
determining that movement of the handheld computing device has satisfied the desired movement; and
ending presentation of the prompt.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising presenting a second prompt in response to determining that movement of the handheld computing device has satisfied the desired movement.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein presenting the second prompt comprises generating haptic feedback.

### Claim 8 (depends on 6)

The computer-implemented method of claim 6, wherein presenting the second prompt comprises displaying the second prompt.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving, from the remote device while continuing to obtain video data representing the field of view, capture setting data representing a capture setting of the video camera to be applied; and
applying the capture setting to capture of the video data.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein applying the capture setting comprises changing one of: an exposure setting, a zoom setting, a color temperature setting, a flash setting, or a focus setting.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, further comprising:
receiving, from the remote device while continuing to obtain video data representing the field of view, second capture setting data representing a second capture setting of the video camera to be applied, wherein the second capture setting is different from the capture setting; and
applying the second capture setting to capture of the video data.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving, from the remote device while continuing to obtain video data representing the field of view, capture setting data representing a combination of capture settings of the video camera to be applied; and
applying the combination of capture settings to capture of the video data.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein applying the combination of capture settings comprises changing two or more of: an exposure setting, a zoom setting, a color temperature setting, a flash setting, or a focus setting.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, further comprising:
analyzing a frame of the video data to determine whether a region in the frame of video data comprises potentially sensitive information; and
in response to determining that the region comprises potentially sensitive information, applying a visual mask to the region to generate anonymized video content.

### Claim 15 (depends on 1)

The computer-implemented method of claim 1, further comprising:
storing at least a portion of the video data in a local data store of the handheld computing device;
establishing a bidirectional audio communication connection with the remote device;
receiving, from the remote device:
playback data representing one or more playback commands for presentation of the video data; and
annotation data representing one or more annotations to be presented with the video data; and
presenting the portion of the video data from the local data store onto the output with the one or more annotations, wherein the portion of the video data is presented according to the one or more playback commands while maintaining the bidirectional audio communication connection with the remote device.

### Claim 16 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining an aspect ratio of a display external to the handheld computing device based at least partly on one or more coordinates associated with the display in the video data;
determining an orientation of the display in three-dimensional space at one or more time points in the video data based at least partly on the aspect ratio; and
generating a substantially rectangular two-dimensional representation of the display at each of the one or more time points based on the orientation of the display at the one or more time points.

### Claim 17 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining an aspect ratio of a display external to the handheld computing device based at least partly on one or more coordinates associated with the display in image data;
determining an orientation of the display in three-dimensional space in the image data based at least partly on the aspect ratio;
generating a substantially rectangular two-dimensional representation of the display based on the orientation of the display; and
generate a cropped, perspective-transformed version of the image data based on the substantially rectangular two-dimensional representation of the display.

### Claim 18

A computer-implemented method for remote control of a live stream video field of view, the computer-implemented method comprising:
under control of a handheld computing device comprising a display and one or more processors configured to execute specific computer-executable instructions,
receiving, from a remote device, video data representing a field of view of a video camera of the remote device;
presenting the video data on the display;
generating motion data representing a motion of the handheld computing device during presentation of the video data on the display;
determining, based on the motion data, a movement of the handheld computing device; and
sending, to the remote device, desired movement data representing a desired movement of the remote device.

### Claim 19 (depends on 18)

The computer-implemented method of claim 18, wherein generating the motion data comprises generating the motion data using an inertial motion sensor of the handheld computing device.

### Claim 20 (depends on 18)

The computer-implemented method of claim 18, wherein generating the motion data comprises generating the motion data based on an analysis of second video data obtained from a video camera of the handheld computing device.
