# US 2019/0013038 A1 · Real-Time Privacy Filter

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0013038 A1
- Document ID: US20190013038A1
- Status: Published application
- Kind: A1
- Application number: 16/027,202
- Filed: 2018-07-03
- Published: 2019-01-10
- Earliest claimed: 2017-07-05
- Assignees: Interactions LLC
- Applicants: Interactions LLC
- Inventors: David Thomson; Ethan Selfridge
- Web page: https://patentgrep.com/patent/US20190013038A1

## CPC

- G06F 40/205: Parsing
- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G06F 40/295: Named entity recognition
- G10L 15/063: {Training}
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 25/51: for comparison or discrimination
- H04L 63/0407: {wherein the identity of one or more communicating identities is hidden (cryptographic mechanisms or cryptographic arrangements for anonymous credentials or for identity based cryptographic systems H04L9/00)}
- H04L 63/0414: {during transmission, i.e. party's identity is protected against eavesdropping, e.g. by using temporary identifiers, but is known to the other party or parties involved in the communication}
- H04L 65/1023: Media gateways
- H04M 3/42008: {Systems for anonymous communication between parties, e.g. by use of disposal contact identifiers}
- H04M 3/5175: {Call or contact centers supervision arrangements}
- H04M 3/51: Centralised call answering arrangements requiring operator intervention {, e.g. call or contact centers for telemarketing}
- H04M 2203/6009: Personal information, e.g. profiles or personal directories being only provided to authorised persons
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A masking system prevents a human agent from receiving sensitive personal information (SPI) provided by a caller during caller-agent communication. The masking system includes components for detecting the SPI, including automated speech recognition and natural language processing systems. When the caller communicates with the agent, e.g., via a phone call, the masking system processes the incoming caller audio. When the masking system detects SPI in the caller audio stream or when the masking system determines a high likelihood that incoming caller audio will include SPI, the caller audio is masked such that it cannot be heard by the agent. The masking system collects the SPI from the caller audio and sends it to the organization associated with the agent for processing the caller's request or transaction without giving the agent access to caller SPI.

## Claims

### Claim 1

A computer-implemented method, performed by a computer system, for masking sensitive personal information (SPI) of a caller from an agent, the computer system configured to receive a stream of media from the caller and to provide the stream of media to the agent, the method comprising:
receiving a first portion of the stream of media from the caller;
determining a likelihood that a next portion of the stream of media will include SPI, the determination based on an analysis of content of the first portion of the stream of media; and
responsive to the determined likelihood exceeding a threshold value:
receiving the next portion of the stream of media;
collecting the SPI from the next portion of the stream of media; and
masking the next portion of the stream of media such that the agent does not receive the next portion of the stream of media.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the media stream is an audio stream comprising a conversation between the caller and the agent and wherein determining a likelihood that a next portion of the stream of media will include SPI comprises generating a text version of the received first portion of the stream of media.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving a prompting media stream sent to the caller and originating from the agent;
providing information from the prompting media stream as input to a natural language processor; and
receiving, from the natural language processor, information about contents of the prompting media stream;
wherein determining a likelihood that a next portion of the stream of media will include SPI is further based on the information received from the natural language processor.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
determining a likelihood that the first portion of the stream of media from the caller includes SPI; and
responsive to the determined likelihood that the first portion of the stream of media from the caller includes SPI exceeding a threshold value:
collecting the SPI from the first portion of the stream of media; and
masking the first portion of the stream of media such that the agent does not receive the first portion of the stream of media.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
training a natural language processing computer model to recognize SPI prompts, wherein SPI prompts include an agent asking for a value from a user, or a user announcing an upcoming value.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the media stream is delayed before being provided to the agent, the method further comprising:
playing a delayed portion of the stream of media to the agent at an increased speed.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
analyzing subsequent portions of the stream of media to determine whether the subsequent portions of the stream of media include SPI; and
responsive to determining that a subsequent portion of the stream of media does not include SPI:
resuming transmission of the portions of the stream of media to the agent at an increased speed.

### Claim 8

A non-transitory computer-readable storage medium storing computer program instructions executable by one or more processors of a system, to perform steps for masking sensitive personal information (SPI) of a caller from an agent, the system configured to receive a stream of media from the caller and to provide the stream of media to the agent, the steps comprising:
receiving a first portion of the stream of media from the caller;
determining a likelihood that a next portion of the stream of media will include SPI, the determination based on an analysis of the contents of the first portion of the stream of media; and
responsive to the determined likelihood exceeding a threshold value:
receiving the next portion of the stream of media;
collecting the SPI from the next portion of the stream of media; and
masking the next portion of the stream of media such that the agent does not receive the next portion of the stream of media.

### Claim 9 (depends on 8)

The non-transitory computer-readable storage medium of claim 8 wherein the media stream is an audio stream comprising a conversation between the caller and the agent and wherein determining a likelihood that a next portion of the stream of media will include SPI comprises generating a text version of the received first portion of the stream of media.

### Claim 10 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the steps further comprising:
receiving a prompting media stream sent to the caller and originating from the agent;
providing information from the prompting media stream as input to a natural language processor; and
receiving, from the natural language processor, information about contents of the prompting media stream;
wherein determining a likelihood that a next portion of the stream of media will include SPI is further based on the information received from the natural language processor.

### Claim 11 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the steps further comprising:
determining a likelihood that the first portion of the stream of media from the caller includes SPI; and
responsive to the determined likelihood that the first portion of the stream of media from the caller includes SPI exceeding a threshold value:
collecting the SPI from the first portion of the stream of media; and
masking the first portion of the stream of media such that the agent does not receive the first portion of the stream of media.

### Claim 12 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the steps further comprising:
training a natural language processing computer model to recognize SPI prompts, wherein SPI prompts include an agent asking for a value from a user or a user announcing an upcoming value.

### Claim 13 (depends on 8)

The non-transitory computer-readable storage medium of claim 8 wherein the media stream is delayed before being provided to the agent, the method further comprising:
playing a delayed portion of the stream of media to the agent at an increased speed.

### Claim 14 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the steps further comprising:
analyzing subsequent portions of the stream of media to determine whether the subsequent portions of the stream of media include SPI; and
responsive to determining that a subsequent portion of the stream of media does not include SPI:
resuming transmission of the portions of the stream of media to the agent at an increased speed.

### Claim 15

A computer system comprising:
one or more computer processors for executing computer program instructions; and
a non-transitory computer-readable storage medium storing instructions for masking sensitive personal information (SPI) of a caller from an agent, the system configured to receive a stream of media from the caller and to provide the stream of media to the agent, the instructions executable by the one or more computer processors to perform steps comprising:
receiving a first portion of the stream of media from the caller;
determining a likelihood that a next portion of the stream of media will include SPI, the determination based on an analysis of the contents of the first portion of the stream of media; and
responsive to the determined likelihood exceeding a threshold value:
receiving the next portion of the stream of media;
collecting the SPI from the next portion of the stream of media; and
masking the next portion of the stream of media such that the agent does not receive the next portion of the stream of media.

### Claim 16 (depends on 15)

The computer system of claim 15 wherein the media stream is an audio stream comprising a conversation between the caller and the agent and wherein determining a likelihood that a next portion of the stream of media will include SPI comprises generating a text version of the received first portion of the stream of media.

### Claim 17 (depends on 15)

The computer system of claim 15, the steps further comprising:
receiving a prompting media stream sent to the caller and originating from the agent;
providing information from the prompting media stream as input to a natural language processor; and
receiving, from the natural language processor, information about contents of the prompting media stream;
wherein determining a likelihood that a next portion of the stream of media will include SPI is further based on the information received from the natural language processor.

### Claim 18 (depends on 15)

The computer system of claim 15, the steps further comprising:
determining a likelihood that the first portion of the stream of media from the caller includes SPI; and
responsive to the determined likelihood that the first portion of the stream of media from the caller includes SPI exceeding a threshold value:
collecting the SPI from the first portion of the stream of media; and
masking the first portion of the stream of media such that the agent does not receive the first portion of the stream of media.

### Claim 19 (depends on 15)

The computer system of claim 15, the steps further comprising:
training a natural language processing computer model to recognize SPI prompts, wherein SPI prompts include an agent asking for a value from a user or a user announcing an upcoming value.

### Claim 20 (depends on 15)

The computer system of claim 15 wherein the media stream is delayed before being provided to the agent, the method further comprising:
playing a delayed portion of the stream of media to the agent at an increased speed.
