# US 10,313,713 B2 · Methods, systems, and media for identifying and presenting users with multi-lingual media content items

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,713 B2
- Document ID: US10313713B2
- Status: Granted
- Kind: B2
- Application number: 15/842,266
- Filed: 2017-12-14
- Published: 2018-04-19
- Granted: 2019-06-04
- Earliest claimed: 2016-06-21
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Marcel Phillip Gordon
- Web page: https://patentgrep.com/patent/US10313713B2

## CPC

- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/278: Content descriptor database or directory service for end-user access {(details of content or meta data based information retrieval of video data in video databases G06F16/739)}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/8106: {involving special audio data, e.g. different tracks for different languages}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods, systems, and media for identifying and presenting users with multi-lingual media content items are provided. In some embodiments, the method comprises: receiving a video content item; identifying a first language associated with the video content item; identifying content within the video content item; determining a likelihood that the video content item is a multi-lingual content item that is not language specific based on the identified content within the video content item; receiving a request for media content; determining a second language associated with the request for media content, wherein the second language is different from the first language; in response to determining that the second language that is different from the first language, determining whether to present the video content item based on the determined likelihood; and responsive to the request for media content, causing the video content item to be presented in response to determining that the video content item is deemed to be multi-lingual content that is not language specific.

## Claims

### Claim 1

A method for presenting media content to users, the method comprising:
determining whether a video content item is associated with a first language identifier, wherein the first language identifier indicates a first language associated with content within the video content item;
determining a likelihood that the video content item is a multi-lingual content item that is not language specific based on the content within the video content item;
modifying the first language identifier associated with the video content item to reflect that the video content item is not language specific based on the determined likelihood;
in response to receiving a query, determining a second language identifier associated with a user account associated with the query, wherein the second language identifier is different from the first language identifier;
and
causing the video content item to be presented in response to the request query based on the modified first language identifier reflecting that the video content item is deemed to be multi-lingual content that is not language specific.

### Claim 2 (depends on 1)

The method of claim 1, further comprising identifying the content in the video content segment by identifying words contained in audio content associated with the video content item.

### Claim 3 (depends on 1)

The method of claim 1, further comprising identifying the content in the video content segment by identifying words contained in image content associated with the video content item.

### Claim 4 (depends on 1)

The method of claim 1, further comprising, in response to the query, causing a plurality of video content items to be presented that includes the video content item and concurrently presenting a language indicator, wherein the language indicator associated with the video content item indicates that the video content item is multi-lingual content.

### Claim 5 (depends on 1)

The method of claim 1, further comprising identifying content within the video content item by retrieving metadata associated with the video content item, wherein the metadata includes subtitle metadata.

### Claim 6 (depends on 1)

The method of claim 1, further comprising determining the first language associated with the video content item by determining a location associated with a user device that uploaded the video content item.

### Claim 7 (depends on 1)

The method of claim 1, wherein determining the likelihood that the video content item is multi-lingual content based on a number of words in the content within the video content item.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining the likelihood that the video content item is multi-lingual content based on a density of words in the content within the video content item.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining the likelihood that the video content item is multi-lingual content further comprises comparing the determined likelihood with a multi-lingual threshold score.

### Claim 10 (depends on 1)

The method of claim 1, wherein determining the likelihood that the video content item is multi-lingual content further comprises determining multi-lingual content identifiers associated with content relating to the video content item.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
receiving user reaction metadata to the video content item that was deemed to be multi-lingual content; and
updating the determined likelihood based on the received user reaction metadata.

### Claim 12 (depends on 11)

The method of claim 11, wherein the user reaction metadata includes an amount of time that the video content item was presented before being stopped.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
selecting a portion of the user reaction metadata based on a language identifier associated with the user devices that provided the user reaction metadata; and
updating the determined likelihood based on the selected portion of the user reaction metadata.

### Claim 14 (depends on 1)

The method of claim 1, further comprising causing, while the video content item is being presented, a recommendation prompt that queries whether the video content item is multi-lingual content.

### Claim 15

A system for presenting media content to users, the system comprising:
a hardware processor that is configured to:
determine whether a video content item is associated with a first language identifier, wherein the first language identifier indicates a first language associated with content within the video content item;
determine a likelihood that the video content item is a multi-lingual content item that is not language specific based on the content within the video content item;
modify the first language identifier associated with the video content item to reflect that the video content item is not language specific based on the determined likelihood;
in response to receiving a query, determine a second language identifier associated with a user account associated with the query, wherein the second language identifier is different from the first language identifier; and
cause the video content item to be presented in response to the request query based on the modified first language identifier reflecting that the video content item is deemed to be multi-lingual content that is not language specific.

### Claim 16

A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for presenting media content to users, the method comprising:
determining whether a video content item is associated with a first language identifier, wherein the first language identifier indicates a first language associated with content within the video content item;
determining a likelihood that the video content item is a multi-lingual content item that is not language specific based on the content within the video content item;
modifying the first language identifier associated with the video content item to reflect that the video content item is not language specific based on the determined likelihood;
in response to receiving a query, determining a second language identifier associated with a user account associated with the query, wherein the second language identifier is different from the first language identifier; and
causing the video content item to be presented in response to the request query based on the modified first language identifier reflecting that the video content item is deemed to be multi-lingual content that is not language specific.
