# US 2018/0024640 A1 · Electronic device and method for controlling the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0024640 A1 - Document ID: US20180024640A1 - Status: Published application - Kind: A1 - Application number: 15/621,911 - Filed: 2017-06-13 - Published: 2018-01-25 - Earliest claimed: 2016-07-22 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Jungho YEOM; Darae KIM; Youngwoo KIM; Dami CHOE - Web page: https://patentgrep.com/patent/US20180024640A1 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/211: {producing three-dimensional [3D] effects, e.g. stereoscopic images} - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - B60Q 1/085: {due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers (B60Q1/10, B60Q1/12, B60Q1/1423 take precedence)} - G02B 27/18: for optical projection, e.g. combination of mirror and condenser and objective {(photographic, cine and overhead projectors G03B21/00; photographic projection printing G03B27/32; photolithographic projectors G03F7/20; projection television H04N5/74; colour projection television H04N9/31)} - G05D 1/0248: {in combination with a laser (lasers per se H01S)} - G06F 3/0425: {using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected (tracking a projected light spot to determine a position on a display surface G06F3/0386)} - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06V 10/143: Sensing or illuminating at different wavelengths - G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle - G08G 1/09626: {where the origin of the information is within the own vehicle, e.g. a local storage device, digital map} - G08G 1/096725: {where the received information generates an automatic action on the vehicle control} - G08G 1/165: {for passive traffic, e.g. including static obstacles, trees} - B60K 35/25: using haptic output - B60K 35/26: using acoustic output - B60K 2360/178: Warnings - B60K 2360/179: Distances to obstacles or vehicles - B60K 2360/334: Projection means - B60K 2360/797: at the vehicle exterior - B60Q 2300/112: Vehicle speed - B60Q 2300/21: Manual control - B60Q 2300/32: Road surface or travel path - B60Q 2400/50: Projected symbol or information, e.g. onto the road or car body - G02B 27/20: for imaging minute objects, e.g. light-pointer - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) ## Abstract The present invention relates to an electronic device and a method of operating the same. The electronic device can project an infrared (IR) grid to a road and capture the projected IR grid. The electronic device can determine a road status of the road based on the captured IR grid and project information on the road status based on the determined road status. ## Claims ### Claim 1 A method of operating an electronic device, comprising the steps of: projecting an infrared (IR) grid on a road; capturing the projected IR grid; determining a road status of the road based on the captured IR grid; and projecting road status information on the road based on the determined road status. ### Claim 2 (depends on 1) The method of claim 1, wherein the determining the road status further comprises determining a bump status of the road based on a grid shape of the captured IR grid. ### Claim 3 (depends on 2) The method of claim 2, wherein the projecting the road status information on the road further comprises projecting an image containing at least one of predetermined color, brightness, and flickering to a dangerous area where the bump status of the road is equal to or greater than a reference based on the determined bump status. ### Claim 4 (depends on 1) The method of claim 1, wherein the determining the road status of the road further comprises determining the road status of the road based on performance of a mobility device on which the electronic device is mounted, a driving history of the mobility device, and body information of a user on the mobility device. ### Claim 5 (depends on 1) The method of claim 1, further comprising detecting a moving speed of the electronic device, wherein the projecting the road status information on the road comprises projecting the information on the road status to a distance corresponding to the detected moving speed. ### Claim 6 A method of operating an electronic device configured to project an image on a road, comprising the steps of: sensing a moving speed of a mobility device on which the electronic device is mounted; and projecting information related to the driving of the mobility device to a distance corresponding to the detected moving speed on the road. ### Claim 7 (depends on 6) The method of claim 6, wherein projecting the information related to the driving of the mobility device to the road comprises the steps of: if the detected speed is less than a first reference speed, projecting the information on the road of a distance shorter than a first distance from the electronic device; and if the detected speed is equal to or greater than the first reference speed and less than a second reference speed, projecting the information on the road of a distance longer than the first distance from the electronic device, wherein the second reference speed is faster than the first reference speed. ### Claim 8 (depends on 7) The method of claim 7, if the detected speed is equal to or greater than the second reference speed, further comprising the step of not projecting the information related to the driving of the mobility device on the road. ### Claim 9 (depends on 7) The method of claim 7, further comprising the steps of: determining a braking distance of the mobility device based on performance of the mobility device and body information of a user on the mobility device; and projecting the information related to the driving of the mobility device to a distance corresponding to the determined braking distance on the road. ### Claim 10 (depends on 7) The method of claim 7, wherein the projecting the information related to the driving of the mobility device comprises the step of projecting at least one of a moving path of the mobility device, a moving speed, and information on a dangerous area of the road on the road. ### Claim 11 An electronic device, comprising: a projector configured to project an image; a light emitting module configured to project an infrared (IR) grid on a road; a camera configured to capture the projected IR grid; and a controller configured to determine a road status of the road based on the captured IR grid, the controller is further configured to control the projector to project information on the road status on the road based on the determined road status. ### Claim 12 (depends on 11) The electronic device of claim 11, a bump status of the road is determined based on a grid shape of the captured IR grid. ### Claim 13 (depends on 12) The electronic device of claim 12, wherein the controller is further configured to control the projector to project an image containing at least one of predetermined color, brightness, and flickering to a dangerous area where the bump status of the road is equal to or greater than a reference based on the determined bump status. ### Claim 14 (depends on 11) The electronic device of claim 11, wherein the controller is further configured to determine the road status of the road based on performance of a mobility device on which the electronic device is mounted, a driving history of the mobility device, and body information of a user on the mobility device. ### Claim 15 (depends on 11) The electronic device of claim 11, further comprising a sensor module configured to detect a moving speed of the electronic device, wherein the controller is further configured to control the projector to project the information on the road status to a distance corresponding to the detected moving speed. ### Claim 16 An electronic device configured to project an image on a road, comprising: a projector configured to project an image; a sensing module configured to sense a moving speed of a mobility device to which the electronic device is mounted; and a controller configured to control the projector to project information related to the driving of the mobility device to a distance corresponding to the detected moving speed on the road. ### Claim 17 (depends on 16) The electronic device of claim 16, wherein if the detected speed is less than a first reference speed, the controller is configured to control the projector to project the information to the road of a distance shorter than a first distance from the electronic device, wherein if the detected speed is equal to or greater than the first reference speed and less than a second reference speed, the controller is configured to control the projector to project the information to the road of a distance longer than the first distance from the electronic device, and wherein the second reference speed is faster than the first reference speed. ### Claim 18 (depends on 17) The electronic device of claim 17, wherein if the detected speed is equal to or greater than the second reference speed, the controller is configured to control the projector not to project the information related to the driving of the mobility device to the road. ### Claim 19 (depends on 17) The electronic device of claim 17, wherein the controller is configured to determine a braking distance of the mobility device based on performance of the mobility device and body information of a user on the mobility device and wherein the controller is configured to control the projector to project the information related to the driving of the mobility device to a distance corresponding to the determined braking distance on the road. ### Claim 20 (depends on 17) The electronic device of claim 17, wherein the controller is configured to control the projector to project at least one of a moving path of the mobility device, a moving speed, and information on a dangerous area of the road to the road.