# US 2023/0276099 A1 · Image display apparatus and operating method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0276099 A1
- Document ID: US20230276099A1
- Status: Published application
- Kind: A1
- Application number: 18/012,872
- Filed: 2020-06-24
- Published: 2023-08-31
- Earliest claimed: 2020-06-24
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hyeseung LEE; Seongwoon SEOL; Obong AN; Eunyoung CHO; Sangjin AHN
- Web page: https://patentgrep.com/patent/US20230276099A1

## CPC

- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4722: for requesting additional data associated with the content
- H04N 21/254: Management at additional data server, e.g. shopping server, rights management server {(arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53)}
- H04N 21/26283: {for associating distribution time parameters to content, e.g. to generate electronic programme guide data}
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/47815: {Electronic shopping (payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12)}
- H04N 21/4826: {using recommendation lists, e.g. of programmes or channels sorted out according to their score}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure relates to an image display apparatus and an operating method thereof. The image display apparatus according to an embodiment of the present disclosure includes a display; a network interface unit that performs communication through a network; and a controller, wherein the controller checks an expected end time of content output through the display, obtains frame data for a screen output through the display at a first time point prior to a preset time from the expected end time, calculates an actual end time point of the content based on the obtained frame data, and outputs a user interface (UI) recommending at least one product related to the content, at the calculated actual end time point, through the display. Various other embodiments are possible.

## Claims

### Claim 1

An image display apparatus comprising:
a display;
a network interface unit that performs communication through a network; and
a controller,
wherein the controller checks an expected end time of content output through the display,
obtains frame data for a screen output through the display at a first time point prior to a preset time from the expected end time,
calculates an actual end time point of the content based on the obtained frame data, and
outputs a user interface (UI) recommending at least one product related to the content, at the calculated actual end time point, through the display.

### Claim 2 (depends on 1)

The image display apparatus of claim 1, wherein the controller captures a screen output through the display at the first time point, and obtains a hash value of an image corresponding to the captured screen as the frame data.

### Claim 3 (depends on 2)

The image display apparatus of claim 2, wherein the controller checks the expected end time from an electronic program guide (EPG) corresponding to the content.

### Claim 4 (depends on 3)

The image display apparatus of claim 3, further comprising a storage unit for storing database for use history of user,
wherein the controller determines a recommendation criteria for at least one of a type of the product, detailed information, manufacturer, and related person, based on the database, and
determines at least one product related to the content, based on the recommendation criteria.

### Claim 5 (depends on 4)

The image display apparatus of claim 4, wherein the controller outputs a first UI including at least one image corresponding to a playback time point to which a product related to the content is mapped, through the display, at the calculated actual end time point,
outputs a frame of the content at a playback time point corresponding to the selected image, through the display, when a user input for selecting one of the images included in the first UI is received, and
outputs a second UI including information on at least one product mapped to a playback time point corresponding to the selected image, through the display, along with the frame of the content.

### Claim 6 (depends on 5)

The image display apparatus of claim 5, wherein if there exists a thumbnail output through the display for a certain time or more among thumbnail images of product output through the second UI, the controller adds data including at least one of a type of product, detailed information, manufacturer, and related person corresponding to the thumbnail output for the certain time or more, to the database.

### Claim 7 (depends on 4)

The image display apparatus of claim 4, wherein the controller receives a first metadata for the entire content from a server through the network interface unit,
checks a first hash value corresponding to the frame data among hash values included in the first metadata, and
calculates the actual end time point, based on a playback time point corresponding to the first hash value.

### Claim 8 (depends on 7)

The image display apparatus of claim 7, wherein the first metadata comprises data for entire products related to the content,
wherein the controller determines a product corresponding to the recommendation criteria among products included in the first metadata, as a product related to the content.

### Claim 9 (depends on 4)

The image display apparatus of claim 4, wherein the controller transmits a signal including the frame data to a server through the network interface unit,
receives a second metadata, corresponding to the frame data, for a part of the content from the server through the network interface, and
calculates the actual end time point, based on a playback time point corresponding to the second metadata.

### Claim 10 (depends on 9)

The image display apparatus of claim 9, wherein the controller transmits a signal including the recommendation criteria to the server through the network interface unit,
receives a third metadata including data for a product corresponding to the recommendation criteria from the server through the network interface unit, and
determines a product included in the third metadata as a product related to the content.

### Claim 11

A method of operating an image display apparatus, the method comprising:
checking an expected end time of content output through a display of the image display apparatus,
obtaining frame data for a screen output through the display at a first time point prior to a preset time from the expected end time,
calculating an actual end time point of the content based on the frame data, and
outputting a user interface (UI) recommending at least one product related to the content, at the calculated actual end time point, through the display.

### Claim 12 (depends on 11)

The method of claim 11, wherein obtaining the frame data comprises capturing a screen output through the display at the first time point, and obtaining a hash value of an image corresponding to the captured screen as the frame data.

### Claim 13 (depends on 12)

The method of claim 12, wherein checking an expected end time comprises checking the expected end time from an electronic program guide (EPG) corresponding to the content.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
determining a recommendation criteria for at least one of a type of product preferred by a user, detailed information, a manufacturer, and a used actor, based on database for use history of the user; and
determining at least one product related to the content, based on the recommendation criteria.

### Claim 15 (depends on 14)

The method of claim 14, wherein outputting a user interface (UI) further comprises:
outputting a first UI including at least one image corresponding to a playback time point to which a product related to the content is mapped, at the calculated actual end time point;
outputting a frame of the content at a playback time point corresponding to the selected image, when a user input for selecting one of the images included in the first UI is received; and
outputting a second UI including information on at least one product mapped to a playback time point corresponding to the selected image, along with the frame of the content.

### Claim 16 (depends on 15)

The method of claim 15, further comprising, if there exists a thumbnail output through the display for a certain time or more among thumbnail images of product output through the second UI, adding data including at least one of a type of product, detailed information, a manufacturer, and a used actor corresponding to the thumbnail output for the certain time or more, to the database.

### Claim 17 (depends on 13)

The method of claim 13, wherein calculating an actual end time point comprises:
receiving a first metadata for the entire content from a server through a network interface unit of the image display apparatus;
checking a first hash value corresponding to the frame data among hash values included in the first metadata; and
calculating the actual end time point, based on a playback time point corresponding to the first hash value.

### Claim 18 (depends on 17)

The method of claim 17, wherein the first metadata comprises data for entire products related to the content,
wherein determining at least one product related to the content comprises determining a product corresponding to the recommendation criteria among products included in the first metadata, as a product related to the content.

### Claim 19 (depends on 14)

The method of claim 14, wherein determining at least one product related to the content comprises:
transmitting a signal including the frame data to a server through a network interface unit of the image display apparatus;
receiving a second metadata, corresponding to the frame data, for a part of the content from the server through the network interface; and
calculating the actual end time point, based on a playback time point corresponding to the second metadata.

### Claim 20 (depends on 19)

The method of claim 19, wherein determining at least one product related to the content comprises:
transmitting a signal including the recommendation criteria to the server through the network interface unit;
receiving a third metadata including data for a product corresponding to the recommendation criteria from the server through the network interface unit; and
determining a product included in the third metadata as a product related to the content.
