# US 2014/0152696 A1 · Glass type mobile terminal > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0152696 A1 - Document ID: US20140152696A1 - Status: Published application - Kind: A1 - Application number: 13/904,871 - Filed: 2013-05-29 - Published: 2014-06-05 - Earliest claimed: 2012-12-05 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Juyung JUNG; Hyunghun SONG - Web page: https://patentgrep.com/patent/US20140152696A1 ## CPC - G06V 20/20: in augmented reality scenes - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06Q 10/109: Time management, e.g. calendars, reminders, meetings or time accounting - G06V 30/1423: {the instrument generating sequences of position coordinates corresponding to handwriting (preprocessing or recognising digital ink G06V30/32)} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract A glass type mobile terminal including a transparent screen; a frame configured to secure the transparent screen in front of a user's eyes wearing the glass type mobile terminal; a camera mounted to the frame and configured to photograph an image in front of the user's eyes; a memory; an image recognition unit configured to extract information from the image photographed by the camera; and a controller configured to compare the extracted information with related information stored in the memory, and display the related information to the transparent screen on the transparent screen along with the captured image. ## Claims ### Claim 1 A glass type mobile terminal comprising: a transparent screen; a frame configured to secure the transparent screen in front of a user's eyes wearing the glass type mobile terminal; a camera mounted to the frame and configured to photograph an image in front of the user's eyes; a memory; an image recognition unit configured to extract information from the image photographed by the camera; and a controller configured to: compare the extracted information with related information stored in the memory, and display the related information to the transparent screen on the transparent screen along with the captured image. ### Claim 2 (depends on 1) The glass type mobile terminal according to claim 1, wherein the controller is further configured to only store the extracted information from the image photographed by the camera. ### Claim 3 (depends on 1) The glass type mobile terminal according to claim 1, further comprising: an audio output module configured to output sound information, wherein the controller is further configured to output the related information via the audio output module. ### Claim 4 (depends on 1) The glass type mobile terminal according to claim 1, wherein the image recognition unit is further configured to extract the information when the camera photographs the image for more than a preset time period, or when one object occupies a preset range of areas included in the image. ### Claim 5 (depends on 1) The glass type mobile terminal according to claim 1, wherein the image includes a calendar, the extracted information includes at least one of a year, month and date of the calendar and a memo written on the calendar, and the related information in the memory corresponds to at least one of the year, month, data and memo written on the calendar, and wherein the controller is further configured to superimpose the related information on the calendar. ### Claim 6 (depends on 5) The glass type mobile terminal according to claim 5, wherein the controller is further configured to zoom in/out and move the related information on the transparent screen according to the user's movement. ### Claim 7 (depends on 5) The glass type mobile terminal according to claim 5, further comprising: a wireless communication unit connected with the internet, wherein the controller is further configured to search the internet for the related information related to the calendar and superimpose the related information on the transparent screen. ### Claim 8 (depends on 1) The glass type mobile terminal according to claim 1, wherein the image is a memo and the extracted information is a character written on the memo. ### Claim 9 (depends on 8) The glass type mobile terminal according to claim 8, wherein the controller is further configured to display at least part of stored-information corresponding to the written character on the transparent screen. ### Claim 10 (depends on 9) The glass type mobile terminal according to claim 9, wherein the controller is further configured to display the stored-information as a thumbnail image. ### Claim 11 (depends on 9) The glass type mobile terminal according to claim 9, wherein the controller is further configured to select whether to merge or group the information extracted from the memo with the related information or store the extracted information as independent information. ### Claim 12 (depends on 8) The glass type mobile terminal according to claim 8, wherein the image recognition unit is further configured to perform a character recognition process for recognizing a character newly written in real time on the memo, convert the recognized character into a text, and display the converted text on the transparent screen. ### Claim 13 (depends on 8) The glass type mobile terminal according to claim 8, wherein the controller is further configured to prompt the user to store the memo as a new document or a new page. ### Claim 14 (depends on 8) The glass type mobile terminal according to claim 8, further comprising: a wireless communication unit connected to the internet, wherein the controller is further configured to search the internet for a characteristic of a character selected from the memo and display information about the searched characteristic on the transparent screen. ### Claim 15 (depends on 1) The glass type mobile terminal according to claim 1, wherein the image includes an object, and the related information stored in the memory includes at least one image of the object photographed at one or more angles, and wherein the controller is further configured to compare the photographed image with the related information stored in the memory and determine whether the object in the photographed image corresponds to the object included in the related information. ### Claim 16 (depends on 15) The glass type mobile terminal according to claim 15, further comprising: a location information module configured to recognize a location of the mobile terminal, wherein the controller is further configured to record the location in the memory as a log record for the object, when the object in the photographed image corresponds to the object included in the related information. ### Claim 17 (depends on 15) The glass type mobile terminal according to claim 15, wherein the controller is further configured to display additional information of the object on the transparent screen or output the additional information via the audio output module, when the object in the photographed image corresponds to the object included in the related information. ### Claim 18 (depends on 17) The glass type mobile terminal according to claim 17, wherein the additional information includes a designated time when a current time is approaching the designated time. ### Claim 19 (depends on 1) The glass type mobile terminal according to claim 1, further comprising: a microphone configured to convert a voice of a cashier indicating an amount of money needed to be paid into a digital signal, wherein the image includes an image of money the user is paying, and wherein the controller is further configured to: compare the converted voice with the image of the money the user is paying, calculate an amount of change due to the user, and output the calculated amount of change on the transparent screen or the audio output module. ### Claim 20 (depends on 1) The glass type mobile terminal according to claim 1, wherein the image is a receipt, and the extracted information corresponds to individual items included in the receipt, and wherein the controller is further configured to update an account book stored in the memory to include the extracted information.