# US 11,113,857 B2 · Display method and apparatus and electronic device thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,113,857 B2
- Document ID: US11113857B2
- Status: Granted
- Kind: B2
- Application number: 16/457,342
- Filed: 2019-06-28
- Published: 2020-01-02
- Granted: 2021-09-07
- Earliest claimed: 2018-06-29
- Assignees: Lenovo (Beijing) Limited
- Applicants: Lenovo (Beijing) Co., Ltd.
- Inventors: Yanyan Tong
- Web page: https://patentgrep.com/patent/US11113857B2

## CPC

- H04N 21/816: {involving special video data, e.g 3D video}
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04N 13/332: Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- G06T 5/73: Deblurring; Sharpening
- H04N 21/80: Generation or processing of content or additional data by content creator independently of the distribution process; Content per se {(arrangements for generating broadcast information H04H60/02)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present disclosure provides a display method. The display method includes displaying a first image based on a first scene; detecting whether a first condition is satisfied; and displaying a second image based on the first condition being satisfied. The first image is an image corresponding to a first portion of the first scene, the second image includes a character image of a viewer and an image of a second portion of the first scene, and the first portion is different from the second portion.

## Claims

### Claim 1

A display method for an electronic device, comprising:
displaying, by a display of the electronic device, a first image based on a first scene;
detecting, by a processor of the electronic device, whether a first condition with respect to a viewer in the first scene is satisfied;
in response to the first condition being satisfied, switching the first image in a first direction of the first scene to a second image in a second direction in the first scene, wherein:
the first image corresponds to a first portion of the first scene;
the second image includes a character image of the viewer and an image corresponding to a second portion of the first scene, the second portion being different from the first portion; and
the first direction is different from the second direction;
obtaining the character image of the viewer, including one of:
obtaining a real image of the viewer captured by a camera to obtain the character image;
obtaining the real image of the viewer captured by the camera and modifying the real image to compose the character image;
obtaining an account image of a user account of the viewer to obtain the character image; or,
obtaining the account image of the user account of the viewer and modifying the account image to compose the character image; and
displaying, by the display, the second image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first direction and the second direction are opposite directions of a same position.

### Claim 3 (depends on 1)

The method of claim 1, wherein detecting whether the first condition is satisfied comprises:
detecting whether an input action of the viewer is a preset action; or,
detecting whether the viewer is observing a virtual object with a light reflecting function in the first image; or,
detecting whether the viewer is observing a virtual device with an image collection and display function in the first image.

### Claim 4 (depends on 1)

The method of claim 1, wherein displaying the second image comprises:
obtaining an orientation of character indicating the orientation of viewer in the first scene; and
integrating the character image into a position of the image corresponding to the second portion of the first scene based on the orientation of character and the first direction to obtain the second image.

### Claim 5 (depends on 1)

The method of according to claim 1, wherein displaying the second image comprises:
displaying the second image in a second area of a display area, the second area being a full screen area or a partial area of the display area.

### Claim 6 (depends on 5)

The method of claim 5, wherein displaying the second image in the second area of the display area comprises:
displaying the first image in a first area of the display area and displaying the second image in the second area of the display area, wherein the first area and the second area are different partial areas in the display area, or the second area is a partial area in the first area, or the first area is a partial area in the second area.

### Claim 7

A display apparatus of an electronic device, comprising:
a processor; and
a memory for storing instructions, when executed, causing the processor to:
control a first display module to display a first image in a display of the electronic device based on a first scene;
control a detecting module to detect whether a first condition with respect to a viewer in the first scene is satisfied;
in response to the first condition being satisfied, control a switching module to switch the first image in a first direction of the first scene to a second image in a second direction in the first scene, wherein:
the first image corresponds to a first portion of the first scene;
the second image includes a character image of the viewer and an image corresponding to a second portion of the first scene, the second portion being different from the first portion; and
the first direction is different from the second direction;
control an acquisition module to obtain the character image of the viewer, including one of:
obtaining a real image of the viewer captured by a camera to obtain the character image;
obtaining the real image of the viewer captured by the camera and modify the real image to compose the character image;
obtaining an account image of a user account of the viewer to obtain the character image; or
obtaining the account image of the user account of the viewer and modify the account to compose the character image; and
control a second display module to display the second image in the display.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the instructions, when executed, further cause the processor to:
control a triggering module to trigger an image switching operation in response to the first condition being satisfied.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the first direction and the second direction are opposite directions of a same position.

### Claim 10 (depends on 7)

The apparatus of claim 7, wherein detecting whether the first condition is satisfied comprises:
detecting whether an input action of the viewer is a preset action; or,
detecting whether the viewer is observing a virtual object with a light reflecting function in the first image; or,
detecting whether the viewer is observing a virtual device with an image collection and display function in the first image.

### Claim 11 (depends on 7)

The apparatus of claim 7, wherein displaying the second image comprises:
obtaining an orientation of character indicating the orientation of viewer in the first scene; and
integrating the character image into a position of the image corresponding to the second portion of the first scene based on the orientation of character and the first direction to obtain the second image.

### Claim 12 (depends on 7)

The apparatus of claim 7, wherein displaying the second image comprises:
displaying the second image in a second area of a display area, the second area being a full screen area or a partial area of the display area.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein displaying the second image in the second area of the display area comprises:
displaying the first image in a first area of the display area and displaying the second image in the second area of the display area, wherein the first area and the second area are different partial areas in the display area, or the second area is a partial area in the first area, or the first area is a partial area in the second area.

### Claim 14

An electronic device comprising:
a display unit for displaying an image in a display of the electronic device;
a memory for storing computer executable instructions;
a processor for executing the computer executable instructions to:
control the display unit to display a first image in the display based on a first scene;
detect whether a first condition with respect to a viewer in the first scene is satisfied;
in response to the first condition being satisfied, switch the first image in a first direction of the first scene to a second image in a second direction of the first scene, wherein:
the first image corresponds to a first portion of the first scene;
the second image includes a character image of a viewer and an image corresponding to a second portion of the first scene, the second portion being different from the first portion; and
the first direction is different from the second direction;
obtain the character image of the viewer, including one of:
obtain a real image of the viewer captured by a camera to obtain the character image;
obtain the real image of the viewer captured by the camera and modify the real image to compose the character image;
obtain an account image of a user account of the viewer to obtain the character image; or
obtain the account image of the user account of the viewer and modify the account to compose the character image; and
control the display unit to display the second image in the display.

### Claim 15 (depends on 14)

The electronic device of claim 14, wherein the processor further executes the computer executable instructions to:
trigger an image switching operation in response to the first condition being satisfied.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein the first direction and the second direction are opposite directions of a same position.

### Claim 17 (depends on 14)

The electronic device of claim 14, wherein detecting whether the first condition is satisfied comprises:
detecting whether an input action of the viewer is a preset action; or,
detecting whether the viewer is observing a virtual object with a light reflecting function in the first image; or,
detecting whether the viewer is observing a virtual device with an image collection and display function in the first image.