# US 2021/0241323 A1 · Device and method for detecting display of provided credit, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241323 A1
- Document ID: US20210241323A1
- Status: Published application
- Kind: A1
- Application number: 16/972,238
- Filed: 2019-05-13
- Published: 2021-08-05
- Earliest claimed: 2018-06-05
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Yasunori OISHI; Takahito KAWANISHI; Kaoru HIRAMATSU; Kunio KASHINO
- Web page: https://patentgrep.com/patent/US20210241323A1

## CPC

- G06Q 30/0272: Period of advertisement exposure
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- H04N 17/00: Diagnosis, testing or measuring for television systems or their details
- H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/23424: {involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement}
- H04N 21/2407: {Monitoring of transmitted content, e.g. distribution time, number of downloads (arrangements for monitoring programmes for broadcast or for distribution combined with broadcast H04H20/14)}
- H04N 21/25435: {involving characteristics of content or additional data, e.g. video resolution or the amount of advertising}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention enables detection of a sponsorship credit display segment in a broadcast program with higher precision. A sponsorship credit display detection device 100 according to the present invention includes: a related phrase storage unit 120 that stores related phrases included in announcement of a sponsorship credit display and related to the sponsorship credit display, in association with estimation periods; a voice recognition unit 140 that performs voice recognition on an audio signal of the broadcast program; a related phrase detection unit 150 that detects a stored related phrase from results of the voice recognition; a sponsorship credit display segment estimation unit 160 that, using an appearance time of the detected related phrase as a start point, estimates a period corresponding to the estimation period stored in association with the detected related phrase as a sponsorship credit display segment; and a detection unit 170 that, among estimated sponsorship credit display segments, detects a segment that continues for at least a predetermined time period as a sponsorship credit display segment.

## Claims

### Claim 1

A sponsorship credit display detection device for detecting, in a broadcast program, a sponsorship credit display segment where a sponsorship credit display indicating a sponsor of that broadcast program has been displayed, the device comprising:
a related phrase store configured to store a related phrase included in an announcement of the sponsorship credit display and related to the sponsorship credit display, in association with an estimation period where at least one predetermined period before or after an appearance time of the related phrase is estimated as the sponsorship credit display segment;
a voice recognizer configured to recognize voice on an audio signal of the broadcast program;
a related phrase detector configured to detect a related phrase stored in the related phrase store from results of the voice recognition by the voice recognizer;
a sponsorship credit display segment estimator configured to, using an appearance time of the related phrase detected by the related phrase detector as a start point, estimate a period corresponding to the estimation period stored in the related phrase store in association with the detected related phrase as the sponsorship credit display segment; and
a detector configured to, among sponsorship credit display segments estimated by the sponsorship credit display segment estimator, detect a segment that continues for at least a predetermined time period as the sponsorship credit display segment.

### Claim 2 (depends on 1)

The sponsorship credit display detection device according to claim 1, further comprising:
an image recognizer configured to estimate the sponsorship credit display segment based on a video signal of the broadcast program,
wherein the detector, among segments obtained by a logical sum operation or a logical product operation of the sponsorship credit display segment estimated by the sponsorship credit display segment estimator and the sponsorship credit display segment estimated by the image recognizer, is configured to estimate a segment that continues for at least a predetermined time period as the sponsorship credit display segment.

### Claim 3 (depends on 1)

The sponsorship credit display detection device according to claim 1, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 4 (depends on 1)

The sponsorship credit display detection device according to claim 1, wherein the detector outputs time information of the detected sponsorship credit display segment.

### Claim 5

A sponsorship credit display detection method in a sponsorship credit display detection device that detects, in a broadcast program, a sponsorship credit display segment where a sponsorship credit display indicating a sponsor of that broadcast program has been displayed, the method comprising:
storing a related phrase included in an announcement of the sponsorship credit display and related to the sponsorship credit display, in association with an estimation period where at least one predetermined period before or after an appearance time of the related phrase is estimated as the sponsorship credit display segment;
performing voice recognition on an audio signal of the broadcast program;
detecting the stored related phrase from results of the voice recognition;
using an appearance time of the detected related phrase as a start point, estimating a period corresponding to the estimation period stored in association with the detected related phrase as the sponsorship credit display segment where the sponsorship credit display has been displayed; and
detecting a segment where the estimated sponsorship credit display segment continues for at least a predetermined time period as the sponsorship credit display segment.

### Claim 6 (depends on 5)

The sponsorship credit display detection method according to claim 5, the method further comprising:
estimating the sponsorship credit display segment based on a video signal of the broadcast program,
estimating, among segments obtained by a logical sum operation or a logical product operation of the sponsorship credit display segment estimated in the first estimation step and the sponsorship credit display segment estimated in the second estimation step, a segment that continues for at least a predetermined time period as the sponsorship credit display segment.

### Claim 7

A computer program causing a computer to function as the sponsorship credit display detection device, the device comprising:
a related phrase store configured to store a related phrase included in an announcement of the sponsorship credit display and related to the sponsorship credit display, in association with an estimation period where at least one predetermined period before or after an appearance time of the related phrase is estimated as the sponsorship credit display segment;
a voice recognizer configured to recognize voice on an audio signal of the broadcast program;
a related phrase detector configured to detect a related phrase stored in the related phrase store from results of the voice recognition by the voice recognizer;
a sponsorship credit display segment estimator configured to, using an appearance time of the related phrase detected by the related phrase detector as a start point, estimate a period corresponding to the estimation period stored in the related phrase store in association with the detected related phrase as the sponsorship credit display segment; and
a detector configured to, among sponsorship credit display segments estimated by the sponsorship credit display segment estimator, detect a segment that continues for at least a predetermined time period as the sponsorship credit display segment.

### Claim 8 (depends on 2)

The sponsorship credit display detection device according to claim 2, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 9 (depends on 2)

The sponsorship credit display detection device according to claim 2, wherein the detector outputs time information of the detected sponsorship credit display segment.

### Claim 10 (depends on 5)

The sponsorship credit display detection method of claim 5, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 11 (depends on 5)

The sponsorship credit display detection method of claim 5, the method further comprising: providing time information of the detected sponsorship credit display segment.

### Claim 12 (depends on 6)

The sponsorship credit display detection method of claim 6, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 13 (depends on 6)

The sponsorship credit display detection method of claim 6, the method further comprising: providing time information of the detected sponsorship credit display segment.

### Claim 14 (depends on 7)

The computer program according claim 7, causing a computer to function as the sponsorship credit display detection device, the device further comprising:
an image recognizer configured to estimate the sponsorship credit display segment based on a video signal of the broadcast program,
wherein the detector is configured to, among segments obtained by a logical sum operation or a logical product operation of the sponsorship credit display segment estimated by the sponsorship credit display segment estimator and the sponsorship credit display segment estimated by the image recognizer, estimate a segment that continues for at least a predetermined time period as the sponsorship credit display segment.

### Claim 15 (depends on 7)

The computer program according claim 7, causing a computer to function as the sponsorship credit display detection device, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 16 (depends on 7)

The computer program according claim 7, causing a computer to function as the sponsorship credit display detection device, wherein the detector outputs time information of the detected sponsorship credit display segment.

### Claim 17 (depends on 14)

The computer program according claim 14, causing a computer to function as the sponsorship credit display detection device, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 18 (depends on 14)

The computer program according claim 14, causing a computer to function as the sponsorship credit display detection device, wherein the estimation period of the related phrase is set according to a position where the related phrase is likely to appear in the announcement of the sponsorship credit display.

### Claim 19 (depends on 1)

The sponsorship credit display detection device according to claim 1, wherein the related phrase includes a name of a sponsor of the broadcast program.

### Claim 20 (depends on 5)

The sponsorship credit display detection method according to claim 5, wherein the related phrase includes a name of a sponsor of the broadcast program.
