# US 2021/0240995 A1 · Information processing apparatus, information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240995 A1
- Document ID: US20210240995A1
- Status: Published application
- Kind: A1
- Application number: 17/158,421
- Filed: 2021-01-26
- Published: 2021-08-05
- Earliest claimed: 2020-02-05
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment Inc.
- Inventors: Yuta Murata; Takanori Shimizu; Ryuichi Hayashida
- Web page: https://patentgrep.com/patent/US20210240995A1

## CPC

- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/48: {Matching video sequences}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing apparatus includes a frame image acquisition section adapted to acquire a plurality of consecutive frame images included in a moving image displayed on a screen, and a matching process section adapted to perform, for each of the plurality of acquired frame images, a matching process of detecting an area that matches a template image representing appearance of a display element to be detected. An area in which the display element is being displayed on the screen is identified on a basis of a result of performing the matching process on the plurality of frame images.

## Claims

### Claim 1

An information processing apparatus comprising:
a frame image acquisition section adapted to acquire a plurality of consecutive frame images included in a moving image displayed on a screen; and
a matching process section adapted to perform, for each of the plurality of acquired frame images, a matching process of detecting an area that matches a template image representing appearance of a display element to be detected,
wherein an area in which the display element is being displayed on the screen is identified on a basis of a result of performing the matching process on the plurality of frame images.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein the matching process section further includes
a simplified image generation section adapted to generate, by using each of the plurality of acquired frame images as an original image, a simplified image obtained by simplifying the original image in question,
a first matching process section adapted to perform a first matching process of detecting an area matching the template image from the generated simplified image, and
a second matching process section adapted to perform, for an area in the original image corresponding to the area in the simplified image detected by the first matching process, a second matching process of evaluating a degree of match with the template image, wherein
an area in which the display element is being displayed on the screen is identified on a basis of a result of performing the second matching process.

### Claim 3 (depends on 1)

The information processing apparatus according to claim 1, wherein
the matching process section detects any of a plurality of types of display elements, and
the frame image acquisition section acquires the number of consecutive frame images determined depending on the display element to be detected of the plurality of types of display elements for the matching process for detecting the display element in question to be detected.

### Claim 4

An information processing method comprising:
acquiring a plurality of consecutive frame images included in a moving image displayed on a screen; and
performing, for each of the plurality of acquired frame images, a matching process of detecting an area that matches a template image representing appearance of a display element to be detected,
wherein an area in which the display element is being displayed on the screen is identified on a basis of a result of performing the matching process on the plurality of frame images.

### Claim 5

A non-transitory, computer readable storage medium containing a program, which when executed by a computer, causes the computer to perform an information processing method by carrying out actions, comprising:
acquiring a plurality of consecutive frame images included in a moving image displayed on a screen; and
performing, for each of the plurality of acquired frame images, a matching process of detecting an area that matches a template image representing appearance of a display element to be detected,
wherein an area in which the display element is being displayed on the screen is identified on a basis of a result of performing the matching process on the plurality of frame images.