# US 2017/0255633 A1 · System and method for searching based on input multimedia content elements

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255633 A1
- Document ID: US20170255633A1
- Status: Published application
- Kind: A1
- Application number: 15/602,770
- Filed: 2017-05-23
- Published: 2017-09-07
- Earliest claimed: 2005-10-26
- Assignees: Cortica, Ltd.
- Applicants: Cortica, Ltd.
- Inventors: Igal Raichelgauz; Karina Odinaev; Yehoshua Y. Zeevi
- Web page: https://patentgrep.com/patent/US20170255633A1

## CPC

- H04N 21/466: Learning process for intelligent management, e.g. learning user preferences for recommending movies {(services using the results of monitoring in broadcast systems H04H60/61)}
- G06F 16/43: Querying
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/957: Browsing optimisation, e.g. caching or content distillation
- G06N 5/02: Knowledge representation; Symbolic representation
- G06N 20/00: Machine learning
- G06Q 10/40: Business processes related to social networking or social networking services
- G06Q 30/0251: Targeted advertisements
- H04H 60/37: for identifying segments of broadcast information, e.g. scenes or extracting programme ID
- H04H 60/56: Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
- H04H 2201/90: characterised by the use of signatures
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04N 7/17318: {Direct or substantially direct transmission and handling of requests}
- H04N 21/25891: {being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18)}
- H04N 21/2668: Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)}
- H04N 21/8106: {involving special audio data, e.g. different tracks for different languages}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A system and method for searching based on input multimedia content elements. The method includes obtaining at least one signature for each of at least one input multimedia content element, each signature representing a concept, wherein each concept is a collection of signatures and metadata representing the concept; determining, based on the obtained signatures, at least one context of the at least one input multimedia content element; generating, based on the determined at least one context, at least one query; and searching in at least one data source using the generated at least one query.

## Claims

### Claim 1

A method for searching based on input multimedia content elements, comprising:
obtaining at least one signature for each of at least one input multimedia content element, each signature representing a concept, wherein each concept is a collection of signatures and metadata representing the concept;
determining, based on the obtained signatures, at least one context of the at least one input multimedia content element;
generating, based on the determined at least one context, at least one query; and
searching in at least one data source using the generated at least one query.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one query includes a textual representation of the at least one context.

### Claim 3 (depends on 1)

The method of claim 1, wherein searching in the at least one data source further comprises:
sending, to each data source, at least one of the at least one query; and
obtaining, from each data source, search results.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the at least one context:
correlating between at least a portion of the concepts of the obtained signatures, wherein the at least one context is determined based on the correlation.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
optimizing each generated query with respect to at least one of the at least one data source.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
filtering the search results based on at least one parameter related to a user device.

### Claim 7 (depends on 1)

The method of claim 1, wherein obtaining the plurality of signatures further comprises:
sending, to a deep content classification system, the at least one input multimedia content element, wherein the deep content classification system is configured to create concepts for a wide variety of multimedia content elements; and
receiving, from the deep content classification system, the at least one signature for the at least one input multimedia content element, wherein the plurality of signatures includes signature reduced clusters representing concepts related to the multimedia content element to be tagged.

### Claim 8 (depends on 1)

The method of claim 1, wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least partially statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.

### Claim 9 (depends on 8)

The method of claim 8, wherein obtaining the at least one signature for the at least one input multimedia content element further comprises:
obtaining the at least one input multimedia content element; and
generating, by the signature generator system, the at least one signature for each input multimedia content element.

### Claim 10

A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to execute a process, the process comprising:
obtaining at least one signature for each of at least one input multimedia content element, each signature representing a concept, wherein each concept is a collection of signatures and metadata representing the concept;
determining, based on the obtained signatures, at least one context of the at least one input multimedia content element;
generating, based on the determined at least one context, at least one query; and
searching in at least one data source using the generated at least one query.

### Claim 11

A system for recommending tags for a multimedia content element to be tagged, comprising:
a processing circuitry; and
a memory connected to the processing circuitry, the memory containing instructions that, when executed by the processing circuitry, configure the system to:
obtain at least one signature for each of at least one input multimedia content element, each signature representing a concept, wherein each concept is a collection of signatures and metadata representing the concept;
determine, based on the obtained signatures, at least one context of the at least one input multimedia content element;
generate, based on the determined at least one context, at least one query; and
search in at least one data source using the generated at least one query.

### Claim 12 (depends on 11)

The system of claim 11, wherein the at least one query includes a textual representation of the at least one context.

### Claim 13 (depends on 11)

The system of claim 11, wherein the system is further configured to:
send, to each data source, at least one of the at least one query; and
obtain, from each data source, search results.

### Claim 14 (depends on 11)

The system of claim 11, wherein the system is further configured to:
correlate between at least a portion of the concepts of the obtained signatures, wherein the at least one context is determined based on the correlation.

### Claim 15 (depends on 11)

The system of claim 11, wherein the system is further configured to:
optimize each generated query with respect to at least one of the at least one data source.

### Claim 16 (depends on 11)

The system of claim 11, wherein the system is further configured to:
filter the search results based on at least one parameter related to a user device.

### Claim 17 (depends on 11)

The system of claim 11, wherein the system is further configured to:
send, to a deep content classification system, the at least one input multimedia content element, wherein the deep content classification system is configured to create concepts for a wide variety of multimedia content elements; and
receive, from the deep content classification system, the at least one signature for the at least one input multimedia content element, wherein the plurality of signatures includes signature reduced clusters representing concepts related to the multimedia content element to be tagged.

### Claim 18 (depends on 11)

The system of claim 11, wherein each signature is generated by a signature generator system, wherein the signature generator system includes a plurality of at least partially statistically independent computational cores, wherein the properties of each core are set independently of the properties of each other core.

### Claim 19 (depends on 18)

The system of claim 18, wherein the system is further configured to:
obtain the at least one input multimedia content element; and
generate, by the signature generator system, the at least one signature for each input multimedia content element.

### Claim 20 (depends on 11)

The system of claim 11, further comprising:
a signature generator system for generating the at least one signature for the at least one input multimedia content element, wherein the signature generator system includes a plurality of computational cores configured to receive a plurality of unstructured data elements, each computational core of the plurality of computational cores having properties that are at least partly statistically independent of other of the computational cores, the properties are set independently of each other core.