# US 2012/0256823 A1 · Transparent display apparatus and method for operating the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0256823 A1
- Document ID: US20120256823A1
- Status: Published application
- Kind: A1
- Application number: 13/418,604
- Filed: 2012-03-13
- Published: 2012-10-11
- Earliest claimed: 2011-03-13
- Assignees: LG Electronics Inc.
- Inventors: Byunghun LEE; Grami RYU; Hyunmin KIM; Jisuk CHAE; Kyunghee YOO
- Web page: https://patentgrep.com/patent/US20120256823A1

## CPC

- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A transparent display apparatus and a method for operating the same are disclosed. The method may include detecting an object located proximate to the transparent image display apparatus; determining a position of the detected object relative to the transparent image display apparatus; and selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus. A first augmented object display may be selected based on the determined position being a first position relative to the transparent image display apparatus, and a second augmented object display may be selected based on the determined position being a second position relative to the transparent image display apparatus. Display of the selected augmented object display is controlled on the transparent image display apparatus.

## Claims

### Claim 1

A method for operating a transparent image display apparatus, the method comprising:
detecting an object located proximate to the transparent image display apparatus;
determining a position of the detected object relative to the transparent image display apparatus;
selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus, the selecting comprising:
selecting a first augmented object display associated with the detected object based on the determined position being a first position relative to the transparent image display apparatus, and
selecting a second augmented object display associated with the detected object based on the determined position being a second position relative to the transparent image display apparatus that is different than the first position relative to the display, the second augmented object display including different information or menu data than the first augmented object display; and
controlling display of the selected augmented object display on the transparent image display apparatus.

### Claim 2 (depends on 1)

The method according to claim 1, wherein selecting the first augmented object display associated with the detected object comprises selecting a first augmented object display in which the information or menu associated with the first augmented object display is different from the information or menu associated with the second augmented object display in terms of at least one of display position, size, color, luminance and transparency.

### Claim 3 (depends on 1)

The method according to claim 1:
wherein selecting the first augmented object display associated with the detected object comprises selecting a first augmented object display that includes at least one of product information or state information of the detected object; and
wherein selecting the second augmented object display associated with the detected object comprises selecting a second augmented object display that includes an associated menu for remotely controlling the detected object.

### Claim 4 (depends on 1)

The method according to claim 1:
wherein detecting the object located proximate to the transparent image display apparatus comprises detecting a first object located on a first side of the transparent image display apparatus, and
wherein determining the position of the detected object relative to the transparent image display apparatus comprises determining that the first object is located on the first side of the transparent image display apparatus, further comprising:
detecting a second object located on a second side of the transparent image display apparatus, the second side of the transparent image display apparatus being opposite of the first side of the transparent image display apparatus and the transparent image display apparatus being positioned between the first object and the second object; and
controlling display of an appropriate augmented object display for the second object simultaneously with the selected augmented object display for the first object.

### Claim 5 (depends on 1)

The method according to claim 1, wherein controlling display of the selected augmented object display on the transparent image display apparatus comprises controlling display of the information or menu associated with the selected augmented object at a location that does not to overlap with a view of the detected object through the transparent image display apparatus.

### Claim 6 (depends on 1)

The method according to claim 1:
wherein determining the position of the detected object relative to the transparent image display apparatus comprises determining a side of the transparent image display apparatus on which the detected object is located, and
wherein selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus comprises selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined side of the transparent image display apparatus on which the detected object is located.

### Claim 7 (depends on 6)

The method according to claim 6,
wherein selecting the first augmented object display associated with the detected object based on the determined position being the first position relative to the transparent image display apparatus comprises selecting the first augmented object display associated with the detected object based on the determined side being a first side of the transparent image display apparatus on which a user is located, and
wherein selecting the second augmented object display associated with the detected object based on the determined position being the second position relative to the transparent image display apparatus that is different than the first position relative to the display comprises selecting the second augmented object display associated with the detected object based on the determined side being a second side of the transparent image display apparatus that is opposite of the first side of the transparent image display apparatus on which the user is located, at least one of a size, luminance and transparency of the information or menu associated with the first augmented object display is greater than that of the information or menu associated with the second augmented object display.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising detecting a user position relative to the transparent image display apparatus,
wherein selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus comprises selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus and the detected user position relative to the transparent image display apparatus.

### Claim 9 (depends on 1)

The method according to claim 1:
wherein determining the position of the detected object relative to the transparent image display apparatus comprises determining a distance of the detected object from the transparent image display apparatus, and
wherein selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus comprises selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined distance of the detected object from the transparent image display apparatus.

### Claim 10 (depends on 1)

The method according to claim 1, wherein detecting the object located proximate to the transparent image display apparatus comprises detecting the object in an image captured from a camera of the transparent image display apparatus or detecting the object based on near field communication with the object.

### Claim 11 (depends on 1)

The method according to claim 1:
wherein selecting the first augmented object display associated with the detected object based on the determined position being the first position relative to the transparent image display apparatus comprises selecting the first augmented object display associated with the detected object based on the determined position being a first position in which the detected object is perceived through a first surface of the transparent image display apparatus, and
wherein selecting the second augmented object display associated with the detected object based on the determined position being the second position relative to the transparent image display apparatus that is different than the first position relative to the display comprises selecting the second augmented object display associated with the detected object based on the determined position being a second position in which the detected object is perceived through a second surface of the transparent image display apparatus that is opposed to the first surface.

### Claim 12 (depends on 1)

The method according to claim 1, further comprising:
detecting a change in orientation of the detected object in a state in which a distance between the transparent image display apparatus and the detected object is maintained; and
based on the detected change in orientation, controlling display of different information or different menus than displayed prior to the detected change in orientation.

### Claim 13 (depends on 1)

The method according to claim 1, further comprising:
detecting a change in distance between the detected object and the transparent image display apparatus; and
based on detecting the change in distance between the detected object and the transparent image display apparatus, changing display size of information or menu data associated with the detected object, or changing an amount of information or a number of kinds of display menus.

### Claim 14

A transparent image display apparatus comprising:
a transparent display panel configured to display an augmented object display; and
a controller configured to control the transparent display panel,
wherein the controller is configured to perform operations comprising:
detecting an object located proximate to the transparent image display apparatus;
determining a position of the detected object relative to the transparent image display apparatus;
selecting, from among multiple, different augmented object displays associated with the detected object, an augmented object display based on the determined position of the detected object relative to the transparent image display apparatus, the selecting comprising:
selecting a first augmented object display associated with the detected object based on the determined position being a first position relative to the transparent image display apparatus, and
selecting a second augmented object display associated with the detected object based on the determined position being a second position relative to the transparent image display apparatus that is different than the first position relative to the display, the second augmented object display including different information or menu data than the first augmented object display; and
controlling display of the selected augmented object display on the transparent image display panel.

### Claim 15 (depends on 14)

The transparent image display apparatus according to claim 14, wherein selecting the first augmented object display associated with the detected object comprises selecting a first augmented object display in which the information or menu associated with the first augmented object display is different from the information or menu associated with the second augmented object display in terms of at least one of display position, size, color, luminance and transparency.

### Claim 16 (depends on 14)

The transparent image display apparatus according to claim 14:
wherein selecting the first augmented object display associated with the detected object comprises selecting a first augmented object display that includes at least one of product information or state information of the detected object; and
wherein selecting the second augmented object display associated with the detected object comprises selecting a second augmented object display that includes an associated menu for remotely controlling the detected object.

### Claim 17 (depends on 14)

The transparent image display apparatus according to claim 14, wherein controlling display of the selected augmented object display on the transparent image display panel comprises controlling display of the information or menu associated with the selected augmented object at a location that does not to overlap with a view of the detected object through the transparent image display panel.

### Claim 18 (depends on 14)

The transparent image display apparatus according to claim 14, wherein the controller is configured to perform operations comprising:
detecting a change in orientation of the detected object in a state in which a distance between the transparent image display apparatus and the detected object is maintained; and
based on the detected change in orientation, controlling display of different information or different menus than displayed prior to the detected change in orientation.

### Claim 19 (depends on 14)

The transparent image display apparatus according to claim 14, wherein the controller is configured to perform operations comprising:
detecting a change in distance between the detected object and the transparent image display apparatus; and
based on detecting the change in distance between the detected object and the transparent image display apparatus, changing display size of information or menu data associated with the detected object, or changing an amount of information or a number of kinds of display menus.

### Claim 20

A method for operating a transparent image display apparatus for penetrating a real object and displaying an augmented object, the method comprising:
displaying information or menu associated with a first real object as a first augmented object if the first real object is located in a first direction of the transparent image display apparatus; and
displaying information or menu associated with a second real object as a second augmented object if the second real object is located in a second direction opposed to the first direction of the transparent image display apparatus,
wherein the information or menu associated with the first augmented object is different from the information or menu associated with the second augmented object.
