# US 11,308,702 B2 · Method and apparatus for displaying an image, electronic device and computer-readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,702 B2 - Document ID: US11308702B2 - Status: Granted - Kind: B2 - Application number: 16/953,937 - Filed: 2020-11-20 - Published: 2021-12-02 - Granted: 2022-04-19 - Earliest claimed: 2020-05-29 - Assignees: Beijing Xiaomi Mobile Software Co., Ltd. - Applicants: Beijing Xiaomi Mobile Software Co., Ltd. - Inventors: Huixia Wu; Qian Wang - Web page: https://patentgrep.com/patent/US11308702B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N 1/3871: {the composed originals being of different kinds, e.g. low- and high-resolution originals} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method for displaying an image is applied to an electronic device including a first camera and a second camera. The method includes: acquiring a first real-time image collected by the first camera and a second real-time image collected by the second camera, the first real-time image being different from the second real-time image; determining a target object in the first real-time image; generating a real-time virtual image corresponding to the target object; and displaying the real-time virtual image on the second real-time image. ## Claims ### Claim 1 A method for displaying an image, applied to an electronic device comprising a first camera and a second camera, the method comprising: acquiring a first real-time image collected by the first camera and a second real-time image collected by the second camera, the first real-time image being different from the second real-time image; determining a target object in the first real-time image; generating a real-time virtual image corresponding to the target object; and superimposing and displaying the real-time virtual image on the second real-time image, wherein when the target object is a user of the electronic device, the method further comprises: determining a limb joint of the target object and adding an anchor point to the limb joint; and converting a two-dimensional image of the target object into a virtual three-dimensional image based on a movement of the anchor point to generate the real-time virtual image of the target object, thereby to replicate actions of the user in a real scene and display the real-time virtual image in the second real-time image corresponding to the real scene. ### Claim 2 (depends on 1) The method of claim 1, further comprising: recording a timestamp for collecting the first real-time image and a timestamp for collecting the second real-time image; and setting a timestamp of the real-time virtual image based on the timestamp of the first real-time image where the target object is located; wherein the superimposing and displaying the real-time virtual image on the second real-time image comprises: superimposing and displaying the real-time virtual image on the second real-time image having the same timestamp as the real-time virtual image. ### Claim 3 (depends on 1) The method of claim 1, further comprising: recording the second real-time image on which the real-time virtual image is displayed. ### Claim 4 (depends on 1) The method of claim 1, wherein the real-time virtual image is a three-dimensional image or a two-dimensional image. ### Claim 5 (depends on 1) The method of claim 1, wherein the first camera is a front camera, and the second camera is a rear camera. ### Claim 6 (depends on 1) The method of claim 1, wherein the first camera is a front camera or a rear camera, and the second camera is a rotatable camera, wherein the rotatable camera comprises a telescopic camera for being extended from and retracted to a frame of the electronic device, and when the telescopic camera is extended from the frame, the telescopic camera is rotated with an extension direction as an axis. ### Claim 7 An electronic device, comprising: a first camera and a second camera; a processor; and a memory for storing instructions executable by the processor, wherein the processor is configured to: acquire a first real-time image collected by the first camera and a second real-time image collected by the second camera, the first real-time image being different from the second real-time image; determine a target object in the first real-time image; generate a real-time virtual image corresponding to the target object; and superimpose and display the real-time virtual image on the second real-time image, wherein when the target object is a user of the electronic device, the processor is further configured to: determine a limb joint of the target object and add an anchor point to the limb joint; and convert a two-dimensional image of the target object into a virtual three-dimensional image based on a movement of the anchor point to generate the real-time virtual image of the target object, thereby to replicate actions of the user in a real scene and display the real-time virtual image in the second real-time image corresponding to the real scene. ### Claim 8 (depends on 7) The electronic device of claim 7, wherein the processor is further configured to: record a timestamp for collecting the first real-time image and a timestamp for collecting the second real-time image; and set a timestamp of the real-time virtual image based on the timestamp of the first real-time image where the target object is located; wherein in superimposing and displaying the real-time virtual image on the second real-time image, the processor is further configured to: superimpose and display the real-time virtual image on the second real-time image having the same timestamp as the real-time virtual image. ### Claim 9 (depends on 7) The electronic device of claim 7, wherein the processor is further configured to: record the second real-time image on which the real-time virtual image is displayed. ### Claim 10 (depends on 7) The electronic device of claim 7, wherein the real-time virtual image is a three-dimensional image or a two-dimensional image. ### Claim 11 (depends on 7) The electronic device of claim 7, wherein the first camera is a front camera, and the second camera is a rear camera. ### Claim 12 (depends on 7) The electronic device of claim 7, wherein the first camera is a front camera or a rear camera, and the second camera is a rotatable camera, wherein the rotatable camera comprises a telescopic camera for being extended from and retracted to a frame of the electronic device, and when the telescopic camera is extended from the frame, the telescopic camera is rotated with an extension direction as an axis. ### Claim 13 A non-transitory computer-readable storage medium having stored thereon instructions that, when executed by a processor of an electronic device comprising a first camera and a second camera, cause the electronic device to perform a method for displaying an image, the method comprising: acquiring a first real-time image collected by the first camera and a second real-time image collected by the second camera, the first real-time image being different from the second real-time image; determining a target object in the first real-time image; generating a real-time virtual image corresponding to the target object; and superimposing and displaying the real-time virtual image on the second real-time image, wherein when the target object is a user of the electronic device, the method further comprises: determining a limb joint of the target object and adding an anchor point to the limb joint; and converting a two-dimensional image of the target object into a virtual three-dimensional image based on a movement of the anchor point to generate the real-time virtual image of the target object, thereby to replicate actions of the user in a real scene and display the real-time virtual image in the second real-time image corresponding to the real scene. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium of claim 13, the method further comprising: recording a timestamp for collecting the first real-time image and a timestamp for collecting the second real-time image; and setting a timestamp of the real-time virtual image based on the timestamp of the first real-time image where the target object is located; wherein superimposing and displaying the real-time virtual image on the second real-time image comprises: superimposing and displaying the real-time virtual image on the second real-time image having the same timestamp as the real-time virtual image. ### Claim 15 (depends on 13) The non-transitory computer-readable storage medium of claim 13, the method further comprising: recording the second real-time image on which the real-time virtual image is displayed. ### Claim 16 (depends on 13) The non-transitory computer-readable storage medium of claim 13, wherein the real-time virtual image is a three-dimensional image or a two-dimensional image. ### Claim 17 (depends on 13) The non-transitory computer-readable storage medium of claim 13, wherein the first camera is a front camera, and the second camera is a rear camera. ### Claim 18 (depends on 13) The non-transitory computer-readable storage medium of claim 13, wherein the first camera is a front camera or a rear camera, and the second camera is a rotatable camera, wherein the rotatable camera comprises a telescopic camera for being extended from and retracted to a frame of the electronic device, and when the telescopic camera is extended from the frame, the telescopic camera is rotated with an extension direction as an axis.