# US 2024/0205509 A1 · Display device and operating method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205509 A1
- Document ID: US20240205509A1
- Status: Published application
- Kind: A1
- Application number: 18/419,175
- Filed: 2024-01-22
- Published: 2024-06-20
- Earliest claimed: 2021-08-06
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Byounghyun KIM; Sanghee KIM; Younho CHOI; Cheulhee HAHM
- Web page: https://patentgrep.com/patent/US20240205509A1

## CPC

- H04N 21/4884: {for displaying subtitles}
- G06N 3/08: Learning methods
- G06T 7/62: of area, perimeter, diameter or volume
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/82: using neural networks
- G06V 20/635: {Overlay text, e.g. embedded captions in a TV programme}
- H04N 21/466: Learning process for intelligent management, e.g. learning user preferences for recommending movies {(services using the results of monitoring in broadcast systems H04H60/61)}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/488: Data services, e.g. news ticker {(systems specially adapted for using meteorological information in broadcast systems H04H60/71)}
- G06V 2201/07: Target detection
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An embodiment of the present disclosure relates to a display device including a display, a memory storing at least one instruction, and a processor configured to execute the at least one instruction stored in the memory to receive an image and a closed caption corresponding to the image, detect at least one region of interest (ROI) included in the image by using a neural network, generate at least one integrated region by grouping the at least one ROI into at least one group of adjacent ROIs, determine a closed caption output region among at least one preset candidate closed caption region, based on whether the at least one preset candidate closed caption region overlaps at least one of the at least one ROI and the at least one integrated region, and control the display to display the closed caption in the closed caption output region.

## Claims

### Claim 1

A display device comprising:
a display;
a memory storing at least one instruction; and
a processor configured to execute the at least one instruction stored in the memory to receive an image and a closed caption corresponding to the image,
detect at least one region of interest (ROI) included in the image by using a neural network,
generate at least one integrated region by grouping the at least one ROI into at least one group of adjacent ROIs,
determine a closed caption output region among at least one preset candidate closed caption region, based on whether the at least one preset candidate closed caption region overlaps at least one of the at least one ROI and the at least one integrated region, and
control the display to display the closed caption in the closed caption output region.

### Claim 2 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to determine the closed caption output region based on the at least one preset candidate closed caption region that do not overlap at least one of the at least one ROI and the at least one integrated region.

### Claim 3 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to identify at least one object included in the image by using the neural network, and determine the at least one ROI by obtaining information about a location and a size of the at least one object.

### Claim 4 (depends on 3)

The display device of claim 3, wherein the at least one object comprises at least one of a text, a person, an animal, and an object.

### Claim 5 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to, when a distance between a first ROI and a second ROI adjacent in a vertical direction among the at least one ROI is less than or equal to a first threshold distance, integrate the first ROI and the second ROI to generate an integrated region.

### Claim 6 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to, when a distance between a first ROI and a third ROI adjacent in a horizontal direction among the at least one ROI is less than or equal to a second threshold distance, integrate the first ROI and the third ROI to generate an integrated region.

### Claim 7 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to detect the at least one ROI based on whether a function for automatically adjusting a display position of the closed caption is activated.

### Claim 8 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to, when a plurality of candidate closed caption regions that do not overlap at least one of the at least one ROI and the at least one integrated region, determine the closed caption output region based on at least one of contiguity information and location information of the plurality of candidate closed caption regions that do not overlap at least one of the at least one ROI and the at least one integrated region.

### Claim 9 (depends on 8)

The display device of claim 8, wherein the processor is further configured to execute the at least one instruction stored in the memory to, when the plurality of candidate closed caption regions that do not overlap at least one of the at least one ROI and the at least one integrated region include a first candidate region, a second candidate region, and a third candidate region, wherein the first candidate region and the second candidate region are located contiguously and the third candidate region is located separately from the first candidate region and the second candidate region, determine the first candidate region and the second candidate region as the closed caption output region.

### Claim 10 (depends on 8)

The display device of claim 8, wherein the processor is further configured to execute the at least one instruction stored in the memory to, when the plurality of candidate closed caption regions that do not overlap the at least one of the at least one ROI and the at least one integrated region include a first candidate region, a second candidate region, and a third candidate region, wherein the third candidate region is located below the first candidate region and the second candidate region, determine the third candidate region as the closed caption output region.

### Claim 11 (depends on 1)

The display device of claim 1, wherein the processor is further configured to execute the at least one instruction stored in the memory to, if all of the at least one preset candidate closed caption regions overlap at least one of the at least one ROI and the at least one integrated region, determine, as the closed caption output region, a region in which the closed caption was displayed in an image corresponding to a first frame preceding a second frame corresponding to the image.

### Claim 12 (depends on 11)

The display device of claim 11, wherein the processor is further configured to execute the at least one instruction stored in the memory to, if all of the at least one preset candidate closed caption region overlaps at least one of the at least one ROI and the at least one integrated region, determine the closed caption output region among the at least one preset candidate closed caption region, based on at least one of a size of a portion of each of the at least one preset candidate closed caption region overlapping at least one of the at least one ROI and the at least one integrated region, a position of an overlapping portion, and importance of information displayed in the overlapping portion.

### Claim 13 (depends on 11)

The display device of claim 11, wherein the processor is further configured to execute the at least one instruction stored in the memory to adjust at least one of a color of the closed caption displayed in the closed caption output region and a transparency of a background of the closed caption.

### Claim 14

An operation method of a display device, the operation method comprising:
receiving an image and a closed caption corresponding to the image;
detecting at least one region of interest (ROI) included in the image by using a neural network;
generating at least one integrated region by grouping the at least one ROI into at least one group of adjacent ROIs;
determining a closed caption output region among at least one preset candidate closed caption region, based on whether the at least one preset candidate closed caption region overlaps at least one of the at least one ROI and the at least one integrated region; and
displaying the closed caption in the closed caption output region.

### Claim 15 (depends on 14)

A computer-readable recording media having stored therein a program for performing the operation method of claim 14.
