# US 12,003,697 B2 · Wearable electronic device and method of outputting three-dimensional image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,003,697 B2 - Document ID: US12003697B2 - Status: Granted - Kind: B2 - Application number: 17/747,089 - Filed: 2022-05-18 - Published: 2022-11-10 - Granted: 2024-06-04 - Earliest claimed: 2021-05-06 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Sungbin Hong - Web page: https://patentgrep.com/patent/US12003697B2 ## CPC - H04N 13/334: using spectral multiplexing - H04N 13/398: Synchronisation thereof; Control thereof - G02B 27/01: Head-up displays - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597) - H04N 13/128: Adjusting depth or disparity - H04N 13/139: Format conversion, e.g. of frame-rate or size - H04N 13/15: for colour aspects of image signals - H04N 13/156: Mixing image signals - H04N 13/324: Colour aspects - H04N 13/344: with head-mounted left-right displays - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N 2013/0077: {Colour aspects} - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - H04N 2013/0092: {Image segmentation from stereoscopic image signals} - H04N 2013/0096: {Synchronisation or controlling aspects} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A wearable electronic device includes a left-eye display configured to output light of a first color corresponding to a 3D left-eye image, a right-eye display configured to output light of a second color corresponding to a 3D right-eye image, a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color, a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color, a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display, a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display, a communication module configured to communicate with a mobile electronic device, and a second control circuit configured to supply a driving power and a control signal to the communication module. ## Claims ### Claim 1 A wearable electronic device comprising: a left-eye display configured to output light of a first color corresponding to a three-dimensional (3D) left-eye image; a right-eye display configured to output light of a second color corresponding to a 3D right-eye image; a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color; a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color; a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display; a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display; a communication module configured to communicate with a mobile electronic device; and a second control circuit configured to supply a driving power and a control signal to the communication module, wherein the mobile electronic device is configured to extract depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image, generate a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information, generate an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image, generate a 3D left-eye image and a 3D right-eye image by performing color anaglyph with the first color on the aligned left-eye image and performing color anaglyph with the second color on the aligned right-eye image, and display the 3D left-eye image and the 3D right-eye image using a display of the mobile electronic device, and wherein the communication module is configured to receive information about the first color and information about the second color from the mobile electronic device. ### Claim 2 (depends on 1) The wearable electronic device of claim 1, wherein: the left-eye display further comprises a left-eye auxiliary light source, the right-eye display further comprises a right-eye auxiliary light source, the left-eye display is configured to output the light of the first color using the left-eye auxiliary light source, and the right-eye display is configured to output the light of the second color using the right-eye auxiliary light source. ### Claim 3 (depends on 1) The wearable electronic device of claim 1, wherein: the left-eye display and the right-eye display are each a self-luminous display, and the left-eye display is configured to output the light of the first color using a micro light-emitting diode (LED) of the left-eye display, and the right-eye display is configured to output the light of the second color using a micro-LED of the right-eye display. ### Claim 4 (depends on 1) The wearable electronic device of claim 1, wherein the communication module is configured to receive the information about the first color and the information about the second color from the mobile electronic device, using a wired communication scheme. ### Claim 5 (depends on 1) The wearable electronic device of claim 1, wherein the communication module is configured to receive the information about the first color and the information about the second color from the mobile electronic device, using a wireless communication scheme. ### Claim 6 (depends on 1) The wearable electronic device of claim 1, wherein the mobile electronic device is configured to: superimpose the converted left-eye image and the converted right-eye image to generate a composite image; divide the composite image into one or more window areas; calculate a sum of absolute differences (SAD) in each of the one or more window areas; and align the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image. ### Claim 7 A wearable electronic device comprising: a left-eye display configured to output light of a first color corresponding to a three-dimensional (3D) left-eye image; a right-eye display configured to output light of a second color corresponding to a 3D right-eye image; a left-eye optical waveguide configured to adjust a path of the light of the first color and output the light of the first color; a right-eye optical waveguide configured to adjust a path of the light of the second color and output the light of the second color; a left-eye display control circuit configured to supply a driving power and a control signal to the left-eye display; a right-eye display control circuit configured to supply a driving power and a control signal to the right-eye display; a communication module configured to communicate with a mobile electronic device; and a second control circuit configured to supply a driving power and a control signal to the communication module, wherein the second control circuit is configured to extract depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image, generate a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information, generate an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image, and generate a 3D left-eye image and a 3D right-eye image by performing color anaglyph with the first color on the aligned left-eye image and performing color anaglyph with the second color on the aligned right-eye image, and wherein the communication module is configured to transmit the 3D left-eye image and the 3D right-eye image to the mobile electronic device. ### Claim 8 (depends on 7) The wearable electronic device of claim 7, wherein: the left-eye display further comprises a left-eye auxiliary light source, the right-eye display further comprises a right-eye auxiliary light source, the left-eye display is configured to output the light of the first color using the left-eye auxiliary light source, and the right-eye display is configured to output the light of the second color using the right-eye auxiliary light source. ### Claim 9 (depends on 7) The wearable electronic device of claim 7, wherein: the left-eye display and the right-eye display are each a self-luminous display, and the left-eye display is configured to output the light of the first color using a left-eye auxiliary light source of the left-eye display, and the right-eye display is configured to output the light of the second color using a right-eye auxiliary light source of the right-eye display. ### Claim 10 (depends on 7) The wearable electronic device of claim 7, wherein the second control circuit is configured to: superimpose the converted left-eye image and the converted right-eye image to generate a composite image; divide the composite image into one or more window areas; calculate a sum of absolute differences (SAD) in each of the one or more window areas; and align the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image. ### Claim 11 A method of outputting a three-dimensional (3D) image, the method comprising: extracting, by a mobile electronic device, depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image; generating, by the mobile electronic device, a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information; generating, by the mobile electronic device, an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image; generating, by the mobile electronic device, a 3D left-eye image and a 3D right-eye image by performing color anaglyph with a first color on the aligned left-eye image and performing color anaglyph with a second color on the aligned right-eye image; receiving, by a wearable electronic device, information about the first color and information about the second color from the mobile electronic device; outputting light of the first color using a left-eye display of the wearable electronic device; and outputting light of the second color using a right-eye display of the wearable electronic device. ### Claim 12 (depends on 11) The method of claim 11, wherein: the outputting of the light of the first color further comprises outputting the light of the first color using a left-eye auxiliary light source of the left-eye display, and the outputting of the light of the second color further comprises outputting the light of the second color using a right-eye auxiliary light source of the right-eye display. ### Claim 13 (depends on 11) The method of claim 11, wherein: The outputting of the light of the first color further comprises outputting the light of the first color using a micro light-emitting diode (LED) of the left-eye display, and the outputting of the light of the second color further comprises outputting the light of the second color using a micro-LED of the right-eye display. ### Claim 14 (depends on 11) The method of claim 11, wherein the receiving of the information about the first color and the information about the second color further comprises receiving the information about the first color and the information about the second color from the mobile electronic device, using a wired communication scheme. ### Claim 15 (depends on 11) The method of claim 11, wherein the receiving of the information about the first color and the information about the second color further comprises receiving the information about the first color and the information about the second color from the mobile electronic device, using a wireless communication scheme. ### Claim 16 (depends on 11) The method of claim 11, wherein the generating of the aligned left-eye image and the aligned right-eye image further comprises: superimposing, by the mobile electronic device, the converted left-eye image and the converted right-eye image to generate a composite image; dividing, by the mobile electronic device, the composite image into one or more window areas; calculating, by the mobile electronic device, a sum of absolute differences (SAD) in each of the one or more window areas; and aligning, by the mobile electronic device, the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image. ### Claim 17 A method of outputting a three-dimensional (3D) image, the method comprising: extracting, by a wearable electronic device, depth information from a two-dimensional (2D) left-eye image and a 2D right-eye image; generating, by the wearable electronic device, a converted left-eye image and a converted right-eye image by converting the 2D left-eye image and the 2D right-eye image based on the depth information; generating, by the wearable electronic device, an aligned left-eye image and an aligned right-eye image by performing vertical alignment on the converted left-eye image and the converted right-eye image; generating, by the wearable electronic device, a 3D left-eye image and a 3D right-eye image by performing color anaglyph with a first color on the aligned left-eye image and performing color anaglyph with a second color on the aligned right-eye image; transmitting, by the wearable electronic device, the 3D left-eye image and the 3D right-eye image to a mobile electronic device; outputting light of the first color using a left-eye display of the wearable electronic device; and outputting light of the second color using a right-eye display of the wearable electronic device. ### Claim 18 (depends on 17) The method of claim 17, wherein: the outputting of the light of the first color further comprises outputting the light of the first color using a left-eye auxiliary light source of the left-eye display, and the outputting of the light of the second color further comprises outputting the light of the second color using a right-eye auxiliary light source of the right-eye display. ### Claim 19 (depends on 17) The method of claim 17, wherein: the outputting of the light of the first color further comprises outputting the light of the first color using a micro light-emitting diode (LED) of the left-eye display, and the outputting of the light of the second color further comprises outputting the light of the second color using a micro-LED of the right-eye display. ### Claim 20 (depends on 17) The method of claim 17, wherein the generating of the aligned left-eye image and the aligned right-eye image comprises: superimposing, by the wearable electronic device, the converted left-eye image and the converted right-eye image to generate a composite image; dividing, by the wearable electronic device, the composite image into one or more window areas; calculating, by the wearable electronic device, a sum of absolute differences (SAD) in each of the one or more window areas; and aligning, by the wearable electronic device, the converted left-eye image and the converted right-eye image such that an SAD for at least one of the one or more window areas is minimized to generate the aligned left-eye image and the aligned right-eye image.