# US 10,122,929 B2 · Digital image processing device which creates and displays an augmented reality (AR) image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,122,929 B2 - Document ID: US10122929B2 - Status: Granted - Kind: B2 - Application number: 15/324,199 - Filed: 2014-10-06 - Published: 2017-07-13 - Granted: 2018-11-06 - Earliest claimed: 2014-10-06 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Sihwa Park; Sinae Chun; Doyoung Lee - Web page: https://patentgrep.com/patent/US10122929B2 ## CPC - H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay - G06T 7/73: using feature-based methods - G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration - G06T 11/60: Creating or editing images; Combining images with text - H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} - H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability} - H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices - H04N 23/95: Computational photography systems, e.g. light-field imaging systems - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Disclosed are a digital image processing device and a digital image controlling method. A digital image processing device comprises: a camera unit for capturing an object; a communication unit for receiving information of a first camera unit from a first terminal device having the first camera unit; a control unit for generating an augmented reality (AR) image on the basis of the received information of the first camera unit; and an output unit for outputting the generated AR image, wherein the control unit can detect the location of the first camera unit from the image of the first camera unit captured by means of the camera unit, generates in three dimensions a viewing angle AR image, of the first camera unit, indicating the range being captured by means of the first camera unit, and control the output unit so as to output the viewing angle AR image, of the first camera unit, generated on the basis of the detected location of the first camera unit. ## Claims ### Claim 1 An apparatus for processing a digital image, comprising: a camera unit configured to capture a subject; a communication unit configured to transceive data using at least one protocol; an output unit including at least one display module; and a controller coupled with the camera unit, the communication unit and the output unit, the controller configured to: receive, via the communication unit, information of a first camera unit from a first terminal device including the first camera unit, create an augmented reality (AR) image based on the received information of the first camera unit, and output, via the output unit, the created AR image, wherein the controller is further configured to: detect a location of the first camera unit from an image of the first camera unit captured by the camera unit, create a view angle AR image of the first camera unit indicating a range captured by the first camera unit 3-dimensionally, and control the output unit to output the created view angle AR image of the first camera unit based on the detected location of the first camera unit. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the communication unit is further configured to receive the information of the first camera unit updated according to a motion of the first camera unit, and wherein the controller is further configured to amend the view angle AR image of the first camera unit based on the received updated information of the first camera unit. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the information of the first camera unit comprises view angle information, focal distance information, direction information and angle information. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the controller is further configured to: if the view angle information of the first camera unit is updated, amend the view angle AR image of the first camera unit based on the updated view angle information, if the direction information of the first camera unit is updated, amend the view angle AR image of the first camera unit based on the updated direction information, and if the angle information of the first camera unit is updated, amend the view angle AR image of the first camera unit based on the updated angle information. ### Claim 5 (depends on 3) The apparatus of claim 3, wherein the information of the first camera unit further comprises at least one of distance information from a subject and distance information from a focused subject. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the controller is further configured to, when the first terminal device is detected by the camera unit, create the view angle AR image of the first camera unit. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the controller is further configured to control the output unit to display a control user interface (UI) for controlling the first camera unit. ### Claim 8 (depends on 7) The apparatus of claim 7, wherein the controller is further configured to control the output unit to display the control UI outside the view angle AR image of the first camera unit. ### Claim 9 (depends on 7) The apparatus of claim 7, wherein the first terminal device comprises a wearable device, and wherein the controller is further configured to control the output unit to display the control UI in a direction opposite to a direction having the first terminal device installed therein by detecting the direction having the first camera unit installed therein. ### Claim 10 (depends on 7) The apparatus of claim 7, wherein the controller is further configured to, if a motion of the first camera unit stops over a preset time, control the output unit to display the control UI. ### Claim 11 (depends on 7) The apparatus of claim 7, wherein the controller is further configured to control the output unit to make the control UI disappear if a capturing ends. ### Claim 12 (depends on 7) The apparatus of claim 7, wherein the control UI comprises at least one of a capture button, a zoom menu, a timer menu, a shutter preferred mode menu, and an aperture preferred mode menu. ### Claim 13 (depends on 1) The apparatus of claim 1, wherein the communication unit is further configured to receive a preview video captured by the first camera unit, and wherein the controller is further configured to control the output unit to output the received preview video. ### Claim 14 (depends on 1) The apparatus of claim 1, wherein the controller is further configured to control the output unit to display the view angle AR image of the first camera unit if a capturing ends. ### Claim 15 (depends on 1) The apparatus of claim 1, wherein the first terminal device is detachably attached to the apparatus. ### Claim 16 (depends on 1) The apparatus of claim 1, wherein the controller is further configured to control the camera unit and the first camera unit to simultaneously capture a subject. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein the controller is further configured to create a plurality of images simultaneously captured by the camera unit and the first camera unit into a single file. ### Claim 18 (depends on 17) The apparatus of claim 17, wherein the controller is further configured to, when displaying the single file containing the plurality of images, display one of the plurality of images and add a flipping mark on the displayed image. ### Claim 19 A digital image processing system, comprising: a first terminal device including a first camera unit; and a digital image processing device configured to receive, via a communication unit, information of the first camera unit from the first terminal device, create, via a controller, an augmented reality (AR) image based on the received information of the first camera unit, and output, via an output unit, the created AR image, wherein the digital image processing device is further configured to: capture the first camera unit, detect a location of the first camera unit from an image of the captured first camera unit, create a view angle AR image of the first camera unit indicating a range captured by the first camera unit 3-dimensionally, and output the created view angle AR image of the first camera unit based on the detected location of the first camera unit. ### Claim 20 A method of controlling a digital image processing device, comprising: receiving, via a communication unit, information of a first camera unit from a first terminal device including the first camera unit; creating, via a controller, an augmented reality (AR) image based on the received information of the first camera unit; and outputting, via an output unit, the created AR image, wherein the creating the AR image comprises detecting a location of the first camera unit from an image of the first camera unit captured by a camera unit and creating a view angle AR image of the first camera unit indicating a range captured by the first camera unit 3-dimensionally and wherein the outputting the created AR image comprises outputting the created view angle AR image of the first camera unit based on the detected location of the first camera unit.