# US 2024/0005014 A1 · Modifying functionality of a real-time communications systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005014 A1
- Document ID: US20240005014A1
- Status: Published application
- Kind: A1
- Application number: 18/368,039
- Filed: 2023-09-14
- Published: 2024-01-04
- Earliest claimed: 2019-06-12
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V.
- Inventors: KARIN KLABUNDE; ZORAN STANKOVIC; ARJAN MICHIEL DRAISMA; MARCEL JOHANNES QUIST
- Web page: https://patentgrep.com/patent/US20240005014A1

## CPC

- G06F 21/62: Protecting access to data via a platform, e.g. using keys or access control rules
- H04M 7/0078: {Security; Fraud detection; Fraud prevention}
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- H04L 63/0414: {during transmission, i.e. party's identity is protected against eavesdropping, e.g. by using temporary identifiers, but is known to the other party or parties involved in the communication}
- H04L 65/1069: Session establishment or de-establishment
- H04L 65/1089: by adding media; by removing media
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04M 2203/6009: Personal information, e.g. profiles or personal directories being only provided to authorised persons
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The invention discloses a method for modifying functionality of a real-time communications system. The method comprises establishing a real-time communication session (100) between a first participant (A) and a second participant (B); responsive to detecting a trigger event, selecting a first redaction algorithm (112) of a plurality of redaction algorithms; and adding the first redaction algorithm to the real-time communication session as a virtual participant (C). The first redaction algorithm is configured to redact data appearing in a data stream to be transmitted from the first participant to the second participant during the real-time communication session.

## Claims

### Claim 1

A method comprising:
establishing a real-time video streaming session between a first participant and a second participant;
responsive to detecting a trigger event, selecting a first redaction algorithm of a plurality of redaction algorithms; and
adding the first redaction algorithm to the real-time video streaming session as a virtual participant;
wherein the first redaction algorithm is configured to redact image data appearing in a data stream to be transmitted from the first participant to the second participant during the real-time video streaming session,
wherein the video streaming session comprises a display screen-sharing data stream,
wherein the first redaction algorithm is configured to apply image processing techniques to the data stream to identify the image data that is to be redacted,
wherein the image data includes two classes of personnel, and
wherein the first redaction algorithm is configured to distinguish between personnel of a first class and personnel of a second class, and to redact some or all of the image data associated with the personnel of the second class.

### Claim 2 (depends on 1)

The method of claim 1, wherein the personnel of the first class are associated with a particular occupation, and the personnel of the second class are not associated with the particular occupation.

### Claim 3 (depends on 1)

The method of claim 1, wherein the personnel of the first class are identified as being authorized to appear in the image data, and the personnel of the second class are not identified as being authorized to appear in the image data.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first redaction algorithm distinguishes between the personnel of the first class and the personnel of the second class based on attire of each person in the image data.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first redaction algorithm distinguishes between the personnel of the first class and the personnel of the second class based on an orientation of each person's body in the image data.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first redaction algorithm distinguishes between the personnel of the first class and the personnel of the second class based on relative locations of each person in the image data.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first redaction algorithm distinguishes between the personnel of the first class and the personnel of the second class based on gestures of each person in the image data.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first redaction algorithm distinguishes between the personnel of the first class and the personnel of the second class based on contextual information associated with the image data.

### Claim 9 (depends on 8)

The method according to claim 8, wherein determining data to be redacted from the data stream comprises predicting, based on the extracted contextual information, the occurrence of an event during the real-time video streaming session that will contain the image data that is to be redacted.

### Claim 10 (depends on 1)

The method according to claim 1, further comprising:
determining, after a defined duration or in response to an indication, whether redaction of the data stream is to be continued; and
responsive to determining that redaction of the data stream is not to be continued, removing the first algorithm as a virtual participant to the real-time video streaming session, such that the data stream is transmitted directly from the first participant to the second participant.

### Claim 11 (depends on 1)

The method according to claim 1, further comprising:
determining an amount by which content in the data stream changes within a defined duration; and
responsive to determining that the content in the data stream has changed by at least a defined threshold amount within the defined duration, continuing to redact the data stream using the first redaction algorithm.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first redaction algorithm is configured to redact facial image data associated with the personnel of the second class.

### Claim 13 (depends on 1)

The method according to claim 1, wherein the trigger event comprises an event selected from a set of events comprising: detecting the performance of a defined action; detecting the initiation of the real-time video streaming session; detecting the initiation of a defined type of data stream sharing; and detecting a defined type of data in a data stream to be transmitted as part of the real-time video streaming session.

### Claim 14 (depends on 1)

A computer program product comprising a non-transitory computer-readable medium, the computer-readable medium having computer-readable code embodied therein, the computer-readable code being configured such that, on execution by a suitable computer or processor, the computer or processor is caused to perform the method of claim 1.

### Claim 15

A method for modifying functionality of a real-time communications system, the method comprising:
establishing a real-time communication session between a first participant and a second participant;
responsive to detecting a trigger event, selecting a first redaction algorithm of a plurality of redaction algorithms; and
adding the first redaction algorithm to the real-time communication session as a virtual participant;
wherein the first redaction algorithm is configured to redact data appearing in a data stream to be transmitted from the first participant to the second participant during the real-time communication session;
wherein the video streaming session comprises a display screen-sharing data stream;
wherein the first redaction algorithm is configured to apply image processing techniques to the data stream to identify the image data that is to be redacted; and
wherein the first redaction algorithm is configured to distinguish between personnel of a first class and personnel of a second class, and to redact some or all of the image data associated with the personnel of the second class;
responsive to detecting a further trigger event during the real-time communication session, selecting a second redaction algorithm of the plurality of redaction algorithms; and
adding the second redaction algorithm to the real-time communication session as a virtual participant;
wherein the second redaction algorithm is configured to redact data appearing in the data stream during the real-time communication session.

### Claim 16 (depends on 15)

The method of claim 15, wherein the personnel of the first class are associated with a particular occupation, and the personnel of the second class are not associated with the particular occupation.

### Claim 17

A method for modifying functionality of a real-time communications system, the method comprising:
establishing a real-time communication session between a first participant and a second participant;
responsive to detecting a trigger event, selecting a first redaction algorithm of a plurality of redaction algorithms; and
adding the first redaction algorithm to the real-time communication session as a virtual participant;
wherein the first redaction algorithm is configured to redact data appearing in a data stream to be transmitted from the first participant to the second participant during the real-time communication session;
wherein the first redaction algorithm is one of a plurality of redaction algorithms stored in an algorithm management module;
wherein the video streaming session comprises a display screen-sharing data stream;
wherein the first redaction algorithm is configured to apply image processing techniques to the data stream to identify the image data that is to be redacted; and
wherein the first redaction algorithm is configured to distinguish between personnel of a first class and personnel of a second class, and to redact some or all of the image data associated with the personnel in the second class.

### Claim 18 (depends on 17)

The method of claim 17, wherein the personnel of the first class are associated with a particular occupation, and the personnel of the second class are not associated with the particular occupation.

### Claim 19

An apparatus comprising:
a processor configured to:
detect a trigger event associated with a data stream to be transmitted from a first participant of a real-time video streaming session to a second participant of the real-time video streaming session;
responsive to detecting the trigger event, initiate a first redaction algorithm;
receive the data stream from the first participant;
apply the first redaction algorithm to redact a portion of data appearing in the received data stream; and
transmit a redacted data stream to the second participant;
wherein the video streaming session comprises a display screen-sharing data stream;
wherein the first redaction algorithm is configured to apply image processing techniques to the data stream to identify the image data that is to be redacted; and
wherein the first redaction algorithm is configured to distinguish between personnel of a first class and personnel of a second class, and to redact some or all of the image data associated with the personnel of the second class.

### Claim 20 (depends on 19)

The method of claim 19, wherein the personnel of the first class are associated with a particular occupation, and the personnel of the second class are not associated with the particular occupation.
