# US 10,766,417 B2 · Imaging system for vehicle > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,766,417 B2 - Document ID: US10766417B2 - Status: Granted - Kind: B2 - Application number: 15/790,172 - Filed: 2017-10-23 - Published: 2018-03-01 - Granted: 2020-09-08 - Earliest claimed: 2007-09-11 - Assignees: Magna Electronics Inc. - Applicants: Magna Electronics Inc. - Inventors: Yuesheng Lu; Joel S. Gibson; Michael J. Higgins-Luthman; Steven V. Byrne; Richard D. Shriner - Web page: https://patentgrep.com/patent/US10766417B2 ## CPC - B60R 1/002: {specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like (integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08)} - B60C 9/005: {Reinforcements made of different materials, e.g. hybrid or composite cords} - B60Q 9/005: {using a video camera} - B60R 1/26: to the rear of the vehicle - B62D 15/0275: {by overlaying a vehicle path based on present steering angle over an image without processing that image} - G06T 11/00: Two-dimensional [2D] image generation - B60R 2300/305: merging camera image with lines or icons - B60R 2300/307: virtually distinguishing relevant parts of a scene from the background of the scene - B60R 2300/806: for aiding parking - B60R 2300/8066: for monitoring rearward traffic - B60R 2300/8086: for vehicle path indication - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - B60C: VEHICLE TYRES; TYRE INFLATION; TYRE CHANGING; CONNECTING VALVES TO INFLATABLE ELASTIC BODIES IN GENERAL; DEVICES OR ARRANGEMENTS RELATED TO TYRES - B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL - B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An imaging system for a vehicle includes a rear backup camera and a video display screen for displaying video images derived from image data captured by the rear backup camera. The imaging system generates a backup overlay and an alignment overlay that are electronically superimposed on the displayed video images to assist a driver of the vehicle when executing a backup maneuver. The backup overlay includes a pair of side overlays superimposed on the displayed video images and the alignment overlay is superimposed on the displayed video images between the side overlays. The video display screen displays the video images and the backup overlay is generated responsive to the vehicle being shifted into reverse gear. The alignment overlay is generated responsive to a user input. ## Claims ### Claim 1 An imaging system for a vehicle, said imaging system comprising: a rear backup camera, wherein said rear backup camera comprises a two-dimensional array of light sensing photosensor elements, and wherein said rear backup camera has a rearward field of view when mounted at a vehicle equipped with said imaging system; a display device comprising a video display screen for displaying video images derived from image data captured by said rear backup camera; wherein said imaging system generates a backup overlay that is electronically superimposed on the displayed video images to assist a driver of the equipped vehicle when executing a backup maneuver; wherein said backup overlay comprises a pair of side overlays, and wherein said side overlays of said backup overlay are superimposed on the displayed video images so as to extend rearward from respective sides of the rear of the equipped vehicle displayed in the displayed video images; wherein said imaging system generates an alignment overlay that is electronically superimposed on the displayed video images to assist the driver of the equipped vehicle when backing the equipped vehicle towards a trailer hitch of a trailer, and wherein said alignment overlay is superimposed on the displayed video images between said side overlays, and wherein said alignment overlay extends longitudinally along and centrally between said side overlays and is separate and spaced from said side overlays; wherein said alignment overlay is adjusted responsive to a steering angle of the equipped vehicle; wherein said video display screen displays the video images derived from image data captured by said rear backup camera responsive to the equipped vehicle being shifted into reverse gear; wherein said backup overlay is generated and electronically superimposed on the displayed video images responsive to the equipped vehicle being shifted into reverse gear; and wherein said alignment overlay is generated and electronically superimposed on the displayed video images responsive to actuation of an input by the driver of the vehicle to aid back up of the vehicle to the trailer, and wherein the input comprises an actuatable input other than the equipped vehicle being shifted into reverse gear. ### Claim 2 (depends on 1) The imaging system of claim 1, wherein said side overlays of said backup overlay are adjusted responsive to the steering angle of the equipped vehicle. ### Claim 3 (depends on 2) The imaging system of claim 2, wherein said alignment overlay is superimposed along a centerline between said side overlays superimposed on the displayed video images when the steering angle of the equipped vehicle is straight. ### Claim 4 (depends on 2) The imaging system of claim 2, wherein said alignment overlay is superimposed on the displayed video images so as to extend upward toward the focal point of expansion of the displayed video images when the steering angle of the equipped vehicle is straight. ### Claim 5 (depends on 1) The imaging system of claim 1, wherein said alignment overlay comprises a three dimensional alignment overlay. ### Claim 6 (depends on 5) The imaging system of claim 5, wherein said three dimensional alignment overlay is superimposed on the displayed video images so as to appear to be a virtual three dimensional element at the rear of the equipped vehicle. ### Claim 7 (depends on 1) The imaging system of claim 1, wherein said side overlays of said backup overlay comprise three dimensional side overlays. ### Claim 8 (depends on 1) The imaging system of claim 1, wherein said alignment overlay is superimposed on the displayed video images so as to appear as having a different virtual height dimension than said backup overlay to enhance the driver's cognitive awareness of said alignment overlay. ### Claim 9 (depends on 1) The imaging system of claim 1, wherein said rear backup camera is offset from the centerline of the equipped vehicle, and wherein said alignment overlay is superimposed on the displayed video images as a sideward perspective view of a virtual three dimensional alignment overlay to enhance the driver's cognitive awareness of said alignment overlay. ### Claim 10 (depends on 1) The imaging system of claim 1, wherein said alignment overlay is generated and electronically superimposed on the displayed video images responsive to detection, via image processing of image data captured by said rear backup camera, of the trailer rearward of the equipped vehicle during a reversing maneuver of the equipped vehicle. ### Claim 11 (depends on 1) The imaging system of claim 1, wherein each of said side overlays comprises first, second and third overlay zones, and wherein said first overlay zone of said side overlays is indicative of a first distance range from the rear of the equipped vehicle to a first distance from the rear of the equipped vehicle as displayed at said video display screen, and wherein said second overlay zone of said side overlays is indicative of a second distance range from the first distance to a second distance from the rear of the equipped vehicle as displayed at said video display screen, and wherein said third overlay zone of said side overlays is indicative of a third distance range beyond the second distance from the rear of the equipped vehicle as displayed at said video display screen, and wherein, as indicated to the driver viewing the displayed video images at said video display screen when executing a backup maneuver, the first distance is closer to the rear of the equipped vehicle than the second distance and the second distance is closer to the rear of the equipped vehicle than the third distance. ### Claim 12 (depends on 11) The imaging system of claim 11, wherein said first overlay zone of said backup overlay comprises a first color and said second overlay zone comprises a second color and said third overlay zone comprises a third color, and wherein said first color is a different color than said second color and said second color is a different color than said third color. ### Claim 13 (depends on 11) The imaging system of claim 11, wherein said imaging system adjusts said first overlay zone in response to an object being detected rearward of the equipped vehicle and within a first distance threshold from the rear of the equipped vehicle, and wherein said imaging system adjusts said second overlay zone in response to an object being detected rearward of the equipped vehicle and within a second distance threshold from the rear of the equipped vehicle, and wherein said second distance threshold is a larger distance than said first distance threshold. ### Claim 14 (depends on 11) The imaging system of claim 11, wherein, as seen by the driver viewing the displayed video images at said video display screen when executing a backup maneuver, said side overlays of said backup overlay comprise spaced-apart lines extending rearward from the rear of the equipped vehicle, and wherein said first overlay zone comprises a first segment of said spaced-apart lines, said second overlay zone comprises a second segment of said spaced-apart lines, and said third overlay zone comprises a third segment of said spaced-apart lines. ### Claim 15 (depends on 14) The imaging system of claim 14, wherein said backup overlay comprises a first mark where said first overlay zone generally joins with said second overlay zone, and wherein said backup overlay comprises a second mark where said second overlay zone generally joins with said third overlay zone. ### Claim 16 An imaging system for a vehicle, said imaging system comprising: a rear backup camera, wherein said rear backup camera comprises a two-dimensional array of light sensing photosensor elements, and wherein said rear backup camera has a rearward field of view when mounted at a vehicle equipped with said imaging system; a display device comprising a video display screen for displaying video images derived from image data captured by said rear backup camera; wherein said imaging system generates a backup overlay that is electronically superimposed on the displayed video images to assist a driver of the equipped vehicle when executing a backup maneuver; wherein said backup overlay comprises a pair of side overlays, and wherein said side overlays of said backup overlay are superimposed on the displayed video images so as to extend rearward from respective sides of the rear of the equipped vehicle displayed in the displayed video images; wherein said side overlays of said backup overlay comprise three dimensional side overlays; wherein said imaging system generates an alignment overlay that is electronically superimposed on the displayed video images to assist the driver of the equipped vehicle when backing the equipped vehicle towards a trailer hitch of a trailer, and wherein said alignment overlay is superimposed on the displayed video images between said side overlays and is separate and spaced from said side overlays; wherein said alignment overlay comprises a three dimensional alignment overlay; wherein said alignment overlay is superimposed along a centerline of the displayed video images when a steering angle of the equipped vehicle is straight; wherein said side overlays of said backup overlay and said alignment overlay are adjusted responsive to the steering angle of the equipped vehicle; wherein said video display screen displays the video images derived from image data captured by said rear backup camera responsive to the equipped vehicle being shifted into reverse gear; wherein said backup overlay is generated and electronically superimposed on the displayed video images responsive to the equipped vehicle being shifted into reverse gear; and wherein said alignment overlay is generated and electronically superimposed on the displayed video images responsive to actuation of an input by the driver of the vehicle to aid back up of the vehicle to the trailer, and wherein the input comprises an actuatable input other than the equipped vehicle being shifted into reverse gear. ### Claim 17 (depends on 16) The imaging system of claim 16, wherein said alignment overlay is superimposed on the displayed video images so as to appear as having a different virtual height dimension than said backup overlay to enhance the driver's cognitive awareness of said alignment overlay. ### Claim 18 (depends on 16) The imaging system of claim 16, wherein said rear backup camera is offset from the centerline of the equipped vehicle, and wherein said three dimensional alignment overlay is superimposed on the displayed video images as a sideward perspective view of said three dimensional alignment overlay to enhance the driver's cognitive awareness of said three dimensional alignment overlay. ### Claim 19 An imaging system for a vehicle, said imaging system comprising: a rear backup camera, wherein said rear backup camera comprises a two-dimensional array of light sensing photosensor elements, and wherein said rear backup camera has a rearward field of view when mounted at a vehicle equipped with said imaging system; a display device comprising a video display screen for displaying video images derived from image data captured by said rear backup camera; wherein said imaging system generates a backup overlay that is electronically superimposed on the displayed video images to assist a driver of the equipped vehicle when executing a backup maneuver; wherein said backup overlay comprises a pair of side overlays, and wherein said side overlays of said backup overlay are superimposed on the displayed video images so as to extend rearward from respective sides of the rear of the equipped vehicle displayed in the displayed video images; wherein said imaging system generates an alignment overlay that is electronically superimposed on the displayed video images to assist the driver of the equipped vehicle when backing the equipped vehicle towards a trailer hitch of a trailer, and wherein said alignment overlay is superimposed on the displayed video images between said side overlays and is separate and spaced from said side overlays; wherein said alignment overlay is superimposed along a centerline between said side overlays of the displayed video images when a steering angle of the equipped vehicle is straight; wherein said side overlays of said backup overlay and said alignment overlay are adjusted responsive to the steering angle of the equipped vehicle; wherein said alignment overlay is superimposed on the displayed video images so as to appear as having a different virtual height dimension than said backup overlay to enhance the driver's cognitive awareness of said alignment overlay; wherein said video display screen displays the video images derived from image data captured by said rear backup camera responsive to the equipped vehicle being shifted into reverse gear; wherein said backup overlay is generated and electronically superimposed on the displayed video images responsive to the equipped vehicle being shifted into reverse gear; and wherein said alignment overlay is generated and electronically superimposed on the displayed video images responsive to detection, via image processing of image data captured by said rear backup camera, of the trailer rearward of the equipped vehicle during a reversing maneuver of the equipped vehicle; and wherein said alignment overlay is generated and electronically superimposed on the displayed video images responsive to actuation of an input by the driver of the vehicle to aid back up of the vehicle to the trailer, and wherein the input comprises an actuatable input other than the equipped vehicle being shifted into reverse gear. ### Claim 20 (depends on 19) The imaging system of claim 19, wherein the input comprises an input selected from the group consisting of (i) a button in the equipped vehicle, (ii) a control input and (iii) a voice recognition system.