# US 10,313,739 B2 · Terminal device, relay device, information processing method, program, and content identification system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,739 B2
- Document ID: US10313739B2
- Status: Granted
- Kind: B2
- Application number: 15/463,758
- Filed: 2017-03-20
- Published: 2017-10-05
- Granted: 2019-06-04
- Earliest claimed: 2012-03-21
- Assignees: Saturn Licensing LLC
- Applicants: Saturn Licensing LLC
- Inventors: Yasuaki Yamagishi
- Web page: https://patentgrep.com/patent/US10313739B2

## CPC

- H04N 21/4345: {Extraction or processing of SI, e.g. extracting service information from an MPEG stream}
- G06F 16/152: {using file content signatures, e.g. hash values}
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- H04N 21/222: Secondary servers, e.g. proxy server, cable television Head-end {(provisioning of proxy services in data packet switching networks H04L67/56)}
- H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/437: Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server {(flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- H04W 88/04: adapted for relaying to or from another terminal or user
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A terminal device including a transmitter and circuitry. The circuitry is configured to detect a relay device accessible to the terminal device via a communication network, reproduce content, control the transmitter to transmit the content to the relay device via the communication network, generate a request for the relay device to send a query in accordance with the content to one or more of a plurality of servers, control the transmitter to transmit the request to the relay device via the communication network, and acquire a response to the request. The response is received via the communication network from the relay device and includes information from the one or more of the plurality of servers responsive to the query. The circuitry is configured to acquire, responsive to the acquired response, an application. Further, the circuitry is configured to execute the application to display additional information corresponding to the content.

## Claims

### Claim 1

A terminal device comprising:
a transmitter; and
circuitry configured to:
detect a relay device accessible to the terminal device via a communication network;
reproduce content;
generate a request for the relay device to send a query in accordance with the content to one or more of a plurality of servers;
control the transmitter to transmit the request to the relay device via the communication network;
acquire a response to the request, the response received via the communication network from the relay device and including information from the one or more of the plurality of servers responsive to the query;
acquire, responsive to the acquired response, an application; and
execute the application to display additional information corresponding to the content.

### Claim 2 (depends on 1)

The terminal device of claim 1, wherein the acquired response includes an identifier of the application and the additional information.

### Claim 3 (depends on 1)

The terminal device of claim 1, wherein the circuitry is configured to acquire at least one of the application and the additional information from a storage of the terminal device or a server.

### Claim 4 (depends on 1)

The terminal device of claim 1, wherein:
the query includes signature data extracted from the content, and
the acquired response includes an identification of the content.

### Claim 5 (depends on 1)

The terminal device of claim 1, wherein the circuitry is configured to generate the request to include information for designating a server to be used from the plurality of servers.

### Claim 6 (depends on 1)

The terminal device of claim 1, wherein the circuitry is configured to:
receive, from the relay device, capability information of the relay device, the capability information indicating necessary information to be received from the terminal device, the necessary information including at least one of a size of the content, a frame rate of the content, a reproduction time of the content, and a time stamp; and
generate the request to include the necessary information.

### Claim 7

A method of a terminal device, the method comprising:
detecting, by circuitry of the terminal device, a relay device accessible to the terminal device via a communication network:
reproducing, by the circuitry, content;
generating, by the circuitry, a request for the relay device to send a query in accordance with the content to one or more of a plurality of servers;
transmitting, by the circuitry, the request to the relay device via the communication network;
acquiring, by the circuitry, a response to the request, the response received via the communication network from the relay device and including information from the one or more of the plurality of servers responsive to the query;
acquiring, by the circuitry, responsive to the acquired response, an application; and
executing, by the circuitry, the application to display additional information corresponding to the content.

### Claim 8 (depends on 7)

The method of claim 7, wherein the acquired response includes an identifier of the application and the additional information.

### Claim 9 (depends on 7)

The method of claim 7, further comprising:
acquiring, by the circuitry, at least one of the application and the additional information from a storage of the terminal device or a server.

### Claim 10 (depends on 7)

The method of claim 7, wherein:
the query includes signature data extracted from the content, and
the acquired response includes an identification of the content.

### Claim 11 (depends on 7)

The method of claim 7, further comprising:
generating, by the circuitry, the request to include information for designating a server to be used from the plurality of servers.

### Claim 12 (depends on 7)

A non-transitory computer readable medium storing computer executable instructions that, when executed by a terminal device including circuitry, cause the circuitry to carry out the method of claim 7.

### Claim 13

A relay device comprising:
circuitry configured to:
receive, via a communication network, content reproduced by a terminal device and a request from the terminal device, wherein the relay device is accessible to the terminal device via the communication network;
extract signature data from the content;
generate a query including the signature data;
transmit the query to one or more of a plurality of identification servers to request identification of the content;
receive a result of the identification of the content from the one or more of the plurality of identification servers; and
provide a response for the terminal device, the response containing the result of the identification of the content received from the one or more of the plurality of identification servers, wherein
an application to display additional information corresponding to the content is acquired by the terminal device responsive to the response.

### Claim 14 (depends on 13)

The relay device of claim 13, wherein the relay device is configured to include one or more identification clients, each identification client being associated with one of the plurality of identification servers.

### Claim 15 (depends on 13)

The relay device of claim 13, wherein the circuitry is configured to notify the terminal device of information relating to the plurality of identification servers.

### Claim 16 (depends on 13)

The relay device of claim 13, wherein the circuitry is configured to:
convert the response into a data form suitable for the terminal device;
send the response to a server; and
notify the terminal device of information representing the server.

### Claim 17 (depends on 13)

The relay device of claim 13, wherein the circuitry is configured to transmit capability information to the terminal device, the capability information indicating necessary information to be received from the terminal device, the necessary information including at least one of a size of the content, a frame rate of the content, a reproduction time of the content, and a time stamp.

### Claim 18 (depends on 13)

The relay device of claim 13, wherein the circuitry is configured to access the one or more of the plurality of identification servers via a further communication network, including to transmit the query to and receive the response from the one or more of the plurality of identification servers via the further communication network.

### Claim 19

A method of a relay device comprising:
receiving, by circuitry of the relay device, via a communication network, content reproduced by a terminal device and a request from the terminal device, wherein the relay device is accessible to the terminal device via the communication network;
extracting, by the circuitry of the relay device, signature data from the content;
generating, by the circuitry of the relay device, a query including the signature data;
transmitting, by the circuitry of the relay device, the query to one or more of a plurality of identification servers to request identification of the content;
receiving, by the circuitry of the relay device, a result of the identification of the content from the one or more of the plurality of identification servers; and
providing, by the circuitry of the relay device, a response for the terminal device, the response containing the result of the identification of the content received from the one or more of the plurality of identification servers, wherein
an application to display additional information corresponding to the content is acquired by the terminal device responsive to the response.

### Claim 20 (depends on 19)

A non-transitory computer readable medium storing computer executable instructions that, when executed by a relay device including circuitry, cause the circuitry to may out the method of claim 19.

### Claim 21 (depends on 1)

The terminal device of claim 1, wherein the circuitry is configured to control the transmitter to transmit the content to the relay device via the communication network.

### Claim 22 (depends on 7)

The method of claim 7, further comprising:
transmitting, by the circuitry, the content to the relay device via the communication network.