# US 2023/0276105 A1 · Information processing apparatus, information processing apparatus, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0276105 A1
- Document ID: US20230276105A1
- Status: Published application
- Kind: A1
- Application number: 18/313,259
- Filed: 2023-05-05
- Published: 2023-08-31
- Earliest claimed: 2018-03-15
- Assignees: Saturn Licensing LLC
- Applicants: Saturn Licensing LLC
- Inventors: Yasuaki YAMAGISHI
- Web page: https://patentgrep.com/patent/US20230276105A1

## CPC

- H04N 21/488: Data services, e.g. news ticker {(systems specially adapted for using meteorological information in broadcast systems H04H60/71)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- G10L 2015/223: {Execution procedure of a spoken command}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

This information processing apparatus includes: an AV decoder 41 that acquires and reproduces video data including a service object, for which a service that processes a request from a user through voice is available; and an application execution environment 43 that adds an additional image for informing the user about the service object to the reproduced video. The additional image includes a visual feature unique to each service object such that the service object is uniquely determined by voice recognition in the service.

## Claims

### Claim 1

An information processing apparatus, comprising:
a display; and
circuitry configured to
reproduce video data including a plurality of service objects,
acquire metadata for generating an image including a visual feature related to each of the plurality of service objects, and
present the image on a video associated with the video data, wherein the image enables a voice recognition to determine a service object from among the plurality of service objects.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein
the metadata includes resource information of a content, and
the image is presented based on the resource information.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein the circuitry is configured to present the image in accordance with a native application or a web application.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1, wherein
the image is presented at a position attached to the service object.

### Claim 5 (depends on 1)

The information processing apparatus according to claim 1, wherein
the circuitry is configured to restrict the service object in accordance with an attribute of a user.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1, wherein
the circuitry is configured to perform a skip reproduction of the video of a period in which the service object appears.

### Claim 7 (depends on 6)

The information processing apparatus according to claim 6, wherein
the circuitry is configured to
reproduce the video of the period in which the service object appears, at a first speed, and
reproduce the video of a period in which the service object does not appear, at a second speed faster than the first speed.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, wherein
the circuitry is configured to
acquire an MPD file including AdaptationSet of the metadata,
analyze the MPD file,
acquire each of the video data and the metadata as a Media Segment of MPEG-DASH, and
present the video data and the image based on the metadata in synchronization with each other.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, wherein
the circuitry is configured to
determine whether a change in details is present or not between temporally preceding metadata and temporally succeeding metadata on a basis of version information of the metadata, and
in a case where a change in details is absent, add the image, which is added to the video on a basis of the temporally preceding metadata, to a video synchronized with the temporally succeeding metadata, as an additional image based on the temporally succeeding metadata.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, wherein
a visual feature included in the image is provided by any one of a character string regarding at least an element of a set comprising the service object, a color, a shape, and an icon.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein
the information processing apparatus is a television.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein the circuitry is configured to add the image to the video by superimposing the image onto each frame of the video including the service object.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the circuitry is configured to add the image to the video such that the image is positioned in the video in accordance with a position of the service object in the video.

### Claim 14

An information processing method for an information processing apparatus, comprising:
reproducing video data including a plurality of service objects,
acquiring metadata for generating an image including a visual feature related to each of the plurality of service objects, and
presenting the image on a video associated with the video data, wherein the image enables a voice recognition to determine a service object from among the plurality of service objects.

### Claim 15 (depends on 14)

The information processing method according to claim 14, wherein
the metadata includes resource information of a content, and
the image is presented based on the resource information.

### Claim 16 (depends on 14)

The information processing method according to claim 14, wherein the method further comprises presenting the image in accordance with a native application or a web application.

### Claim 17 (depends on 14)

The information processing method according to claim 14, wherein
the image is presented at a position attached to the service object.

### Claim 18 (depends on 14)

The information processing method according to claim 14, wherein
the method further comprises restricting the service object in accordance with an attribute of a user.

### Claim 19 (depends on 14)

The information processing method according to claim 14, wherein
the method further comprises performing a skip reproduction of the video of a period in which the service object appears.

### Claim 20

A non-transitory computer medium having stored thereon a program that when executed by a computer causes the computer to implement a method comprising:
reproducing video data including a plurality of service objects,
acquiring metadata for generating an image including a visual feature related to each of the plurality of service objects, and
presenting the image on a video associated with the video data, wherein the image enables a voice recognition to determine a service object from among the plurality of service objects.
