# US 2016/0261929 A1 · Broadcast receiving apparatus and method and controller for providing summary content service

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0261929 A1
- Document ID: US20160261929A1
- Status: Published application
- Kind: A1
- Application number: 14/420,259
- Filed: 2014-08-06
- Published: 2016-09-08
- Earliest claimed: 2014-04-11
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Ji-hyo LEE; Sang-jin CHOI; Ji-hong KANG; Yong-hoon LEE; Seung-won KIM; Joo-youn KIM; Jong-uk YOO
- Web page: https://patentgrep.com/patent/US20160261929A1

## CPC

- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- G06V 20/42: {of sport video content}
- G06V 20/47: {Detecting features for summarising video content}
- H04N 21/233: Processing of audio elementary streams {(monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)}
- G06V 20/44: {Event detection}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for providing a summary content of the broadcast receiving apparatus including: receiving a content comprising video and audio data; analyzing at least one of the video and audio data and detecting at least one event section corresponding to a predetermined condition; and generating a summary content based on the at least one detected event section.

## Claims

### Claim 1

A method for providing a summary content service of a broadcast receiving apparatus, the method comprising:
receiving audio/visual content comprising video data and audio data;
analyzing at least one of the video and the audio data;
detecting at least one event section corresponding to a predetermined condition based on the analyzed at least one of the video data and the audio data; and
generating summary content based on the detected at least one event section.

### Claim 2 (depends on 1)

The method of claim 1, wherein the audio/visual content is a sports content, and
wherein the method further comprises the broadcast receiving apparatus storing a play situation condition related to a summary content of the sports content, and
wherein the detecting comprises analyzing the video data in the audio/visual content and detecting an image section corresponding to the stored play situation condition as the at least one event section.

### Claim 3 (depends on 1)

The method of claim 1, wherein the detecting comprises analyzing the audio data and detecting an image section having an audio signal level which is greater than or equal to a predetermined threshold level as the at least one event section.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
the broadcast receiving apparatus storing a predetermined term related to a summary content of the content, and
wherein the detecting comprises:
generating text data by performing speech to text (STT) analysis of the audio data; and
detecting an image section comprising the predetermined term as the at least one event section using the generated text data.

### Claim 5 (depends on 1)

The method of claim 1, wherein the at least one detected event section comprises an image section comprising image information and time information corresponding to a timing of the at least one detected event, and
wherein the generating comprises:
determining whether the content is sports content corresponding to a sporting event based on a proportion value of colors included in image information; and
determining, in response to determining that the content is sports content, a content summary section on the basis of the time information.

### Claim 6 (depends on 5)

The method of claim 5, wherein the determining whether the content is a sports content comprises determining that the content is sports content in response to a proportion of a color in the image information of the image section corresponding to a predetermined field color being equal to a predetermined first threshold value.

### Claim 7 (depends on 6)

The method of claim 6, wherein the determining whether the content is sports content further comprises determining whether the sporting event is being played according to whether a proportion value of the color corresponding to the field color in image information of an image section adjacent to the image section of the at least one detected event section is equal to a predetermined second threshold value.

### Claim 8 (depends on 6)

The method of claim 6, wherein the determining whether the content is sports content further comprises:
extracting a guide area that indicates a play situation condition from an image of the image section; and
determining whether the sporting event is being played on the basis of the extracted guide area, and
wherein the guide area is an area indicating at least one of a score and a duration of the sporting event.

### Claim 9 (depends on 5)

The method of claim 5, wherein the determining the content summary section comprises:
acquiring previous and subsequent image sections which exist within a predetermined fixed time period before and after the at least one detected event section; and
determining the acquired previous and subsequent image sections and the image section of the at least one event section as the content summary section.

### Claim 10 (depends on 9)

The method of claim 9, wherein the determining the content summary section further comprises changing the predetermined fixed time according to whether a scene change occurs in at least one of the acquired previous and subsequent image sections.

### Claim 11 (depends on 5)

The method of claim 5, further comprising:
acquiring, in response to detecting the at least one event section, a corresponding thumbnail image from the image section of the at least one detected event section;
matching and storing the summary content with the corresponding thumbnail image; and
outputting the summary content and the matched thumbnail image in accordance with a user command.

### Claim 12 (depends on 11)

The method of claim 11, wherein the acquiring comprises, in response to determining a plurality of thumbnail images, acquiring the corresponding thumbnail image having least color corresponding to a predetermined field color corresponding to the sporting event or a thumbnail image comprising a largest object with respect to a same object comprised in each of the thumbnail images from among the plurality of thumbnail images.

### Claim 13

A broadcast receiving apparatus comprising:
a receiver configured to receive a-audio/visual content comprising video data and audio data;
an outputter configured to output the content; and
a controller configured to analyze at least one of the video data and the audio data, detect at least one event section corresponding to a predetermined condition based on the analyzed at least one of the video data and the audio data, generate summary content based on the detected at least one event section, and control the outputter to output the summary content.

### Claim 14

A method for providing a summary content service of a broadcast receiving apparatus, the method comprising:
detecting an event region for a summary content service by comparing pixel values of a plurality of image frames;
detecting, in response to an image frame being input, a region corresponding to the detected event region from the input image frame;
sensing a generation of an event by detecting a character change within the region corresponding to the detected event region; and
generating a summary content based on the generated event.

### Claim 15 (depends on 14)

The method of claim 14, wherein the detecting the event region comprises:
comparing pixel differences of corresponding pixel regions of a first image frame and a second image frame among the plurality of image frames with a preset threshold value;
calculating a number of pixel regions having a pixel difference of lower than the threshold value,
determining, in response to the number of pixel regions having the pixel difference of lower than the threshold value being less than a preset threshold number pixels, whether the pixel region having the pixel difference of lower than the threshold value is continuously detected a preset number of times; and
in response to the pixel region having the pixel difference of lower than the threshold value being continuously detected the preset number of times, detecting the event region on the basis of the pixel region having the pixel difference of lower than the threshold value, and storing the detected event region.

### Claim 16

A summary content controller comprising:
a receiver configured to receive media content;
at least one processor; and
at least one memory, the at least one memory configured to store and the at least one processor being configured to implement:
an event detector configured to analyze the received media content, detect an occurrence of an event corresponding to a predetermined condition in the media content, generate a highlight image corresponding to the detected event, and generate a summary content comprising the highlight image.

### Claim 17 (depends on 16)

The summary content controller according to claim 16, wherein the event detector is further configured to generate the highlight image by extracting a portion of the media content surrounding the detected event as the highlight image.

### Claim 18 (depends on 16)

The summary content controller according to claim 16, wherein the event detector is further configured to:
record the received media content;
extract timing information corresponding to the detected event as the highlight image; and
store bookmarking information comprising the timing information with the recorded media content.

### Claim 19 (depends on 18)

The summary content controller according to claim 18, wherein the timing information comprises a start-time and an end-time of the event with respect to the stored media content.

### Claim 20 (depends on 19)

The summary content controller according to claim 19, wherein the event detector is further configured to generate a plurality of highlight images corresponding to a plurality of events detected in the received media content, and to store, with the stored media content, bookmarking information comprising a plurality of timing information corresponding to the detected plurality of events.

### Claim 21 (depends on 20)

A broadcast receiving apparatus comprising:
a memory;
an input/output (I/O) interface; and
a summary content controller according to claim 20,
wherein the at least one processor of the summary content controller is further configured to control, in response to a user command, the IO interface to output only the stored media content corresponding to the detected plurality of events based on the stored bookmarking information.
