# US 2023/0056501 A1 · Device and method for providing information for vehicle using road surface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0056501 A1 - Document ID: US20230056501A1 - Status: Published application - Kind: A1 - Application number: 17/808,715 - Filed: 2022-06-24 - Published: 2023-02-23 - Earliest claimed: 2021-08-23 - Assignees: Hyundai Mobis Co., Ltd. - Applicants: Hyundai Mobis Co., Ltd. - Inventors: Han Seong YU - Web page: https://patentgrep.com/patent/US20230056501A1 ## CPC - G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads - B60W 40/06: Road conditions - B60W 2420/403: Image sensing, e.g. optical camera - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT ## Abstract A device and method for providing information for a vehicle. The device includes an object recognition module that photographs a front image of the vehicle and recognizes an object located outside the vehicle, a processor that recognizes a road surface as a road irradiation area, a sidewalk irradiation area, and a boundary area between the road irradiation area and the sidewalk irradiation area based on the photographed front image, and separately generates a driving information image and a walking information image based on the photographed front image, and an image output module that irradiates the driving information image adjusted to a size corresponding to the road irradiation area to the road irradiation area and irradiates the walking information image adjusted to a size corresponding to the sidewalk irradiation area to the sidewalk irradiation area. ## Claims ### Claim 1 A device for providing information for a vehicle, the device comprising: an object recognition module configured to take a front image of the vehicle and to recognize an object located outside the vehicle; a processor configured to recognize a road surface as a road irradiation area, a sidewalk irradiation area, and a boundary area between the road irradiation area and the sidewalk irradiation area, based on the front image, and to generate a driving information image and a walking information image based on the front image; and an image output module configured to irradiate the driving information image adjusted to a size corresponding to the road irradiation area to the road irradiation area, and to irradiate the walking information image adjusted to a size corresponding to the sidewalk irradiation area to the sidewalk irradiation area. ### Claim 2 (depends on 1) The device of claim 1, wherein the object recognition module includes: a TOF (Time of Flight) module configured to obtain the front image of the vehicle; and a first actuator configured to control a rotational operation of the TOF module, wherein the image output module includes: a DMD (Digital Micromirror Device) module configured to irradiate the walking information image and the driving information image onto the road surface; and a second actuator configured to control a rotational operation of the DMD module. ### Claim 3 (depends on 2) The device of claim 2, wherein at least one of the TOF module or the DMD module rotates toward the road surface corresponding to a driving direction when the driving direction of the vehicle is selected as a left turn or a right turn by a driver. ### Claim 4 (depends on 3) The device of claim 3, wherein the processor detects the driving direction of the left turn or the right turn based on information on a blinking of a turn indicator. ### Claim 5 (depends on 2) The device of claim 2, wherein the first actuator controls the rotational operation of the TOF module while following the object when the vehicle is traveling forward, and the processor corrects the walking information image depending on a changed distance between the vehicle and the object. ### Claim 6 (depends on 5) The device of claim 5, wherein the first actuator controls the rotational operation of the TOF module such that a rotational angle of the TOF module increases as a distance between the vehicle and the object becomes closer. ### Claim 7 (depends on 2) The device of claim 2, further comprising: a vehicle height sensor configured to detect a tilt of the vehicle and to generate a tilt sensing signal, wherein the TOF module detects a recognition area ratio with respect to the road surface when the vehicle is traveling, and the first actuator determines whether the vehicle is traveling on a slope based on the tilt sensing signal and the recognition area ratio, and rotates the TOF module such that the TOF module faces the road surface of the slope when it is determined that the vehicle is traveling on the slope. ### Claim 8 (depends on 1) The device of claim 1, wherein the object recognition module recognizes a protruding obstacle of the road surface, and the image output module outputs the driving information image for mapping at least two surfaces of the protruding obstacle with complementary colors. ### Claim 9 (depends on 1) The device of claim 1, wherein the object recognition module recognizes a recessed obstacle of the road surface, and the image output module outputs the driving information image for dividing the recessed obstacle into a plurality of areas and mapping the divided obstacle with at least two colors. ### Claim 10 (depends on 1) The device of claim 1, wherein the vehicle includes at least one lamp module emitting light to a front of the vehicle, and at least one of the object recognition module or the image output module is built into the lamp module. ### Claim 11 A method for providing information for a vehicle, the method comprising: taking a front image of the vehicle and recognizing an object located outside the vehicle; recognizing a road surface as a road irradiation area, a sidewalk irradiation area, and a boundary area between the road irradiation area and the sidewalk irradiation area, based on the front image; separately generating a driving information image and a walking information image based on the front image; and irradiating the driving information image adjusted to a size corresponding to the road irradiation area to the road irradiation area, and irradiating the walking information image adjusted to a size corresponding to the sidewalk irradiation area to the sidewalk irradiation area. ### Claim 12 (depends on 11) The method of claim 11, wherein: the front image of the vehicle is obtained through a TOF (Time of Flight) module, a rotational operation of the TOF module is controlled through a first actuator connected to the TOF module, the walking information image and the driving information image are irradiated onto the road surface through a DMD (Digital Micromirror Device) module, and a rotational operation of the DMD module is controlled through a second actuator connected to the DMD module. ### Claim 13 (depends on 12) The method of claim 12, further comprising: selecting, by a driver of the vehicle, a driving direction of the vehicle as one of a left turn or a right turn; and rotating at least one of the TOF module or the DMD module toward the road surface of a sidewalk corresponding to a rotation direction of the vehicle. ### Claim 14 (depends on 12) The method of claim 12, wherein recognizing of the object includes: rotating the TOF module while following the object when the vehicle is traveling forward, and wherein the separately generating of the driving information image and a walking information image includes: correcting the walking information image depending on a changed distance between the vehicle and the object. ### Claim 15 (depends on 14) The method of claim 14, wherein rotating of the TOF module while following the object includes: rotating the TOF module such that a rotational angle of the TOF module increases as a distance between the traveling vehicle and the object becomes closer. ### Claim 16 (depends on 12) The method of claim 12, wherein recognizing of the object further includes: generating a tilt sensing signal by detecting a tilt of the vehicle using a vehicle height sensor; detecting a recognition area ratio with respect to the road surface using the TOF module when the vehicle is traveling; determining whether the vehicle is traveling on a slope based on the tilt sensing signal and the recognition area ratio; and rotating the TOF module such that the TOF module faces the road surface of the slope when it is determined that the vehicle is traveling on the slope. ### Claim 17 (depends on 11) The method of claim 11, wherein recognizing of the object includes: recognizing a protruding obstacle of the road surface, and wherein the irradiating of the driving information image to the road irradiation area includes outputting the driving information image for mapping at least two surfaces of the protruding obstacle with complementary colors. ### Claim 18 (depends on 11) The method of claim 11, wherein recognizing of the object includes: recognizing a recessed obstacle of the road surface, and wherein the irradiating of the driving information image to the road irradiation area includes outputting the driving information image obtained for dividing the recessed obstacle into a plurality of areas and mapping the divided obstacle with at least two colors.