# US 10,479,370 B2 · System and method for authorizing a user to operate a vehicle > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,479,370 B2 - Document ID: US10479370B2 - Status: Granted - Kind: B2 - Application number: 16/256,552 - Filed: 2019-01-24 - Published: 2019-08-29 - Granted: 2019-11-19 - Earliest claimed: 2018-02-23 - Assignees: Ford Global Technologies, LLC - Applicants: Ford Global Technologies LLC - Inventors: Wenger Gong - Web page: https://patentgrep.com/patent/US10479370B2 ## CPC - B60W 40/08: related to drivers or passengers - G07C 9/00309: {operated with bidirectional data transmission between data carrier and locks} - B60K 28/00: Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions (electric safety devices on electrically-propelled vehicles B60L3/00) - B60R 25/25: using biometry - B60W 50/10: Interpretation of driver requests or demands - B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention - G06V 40/172: {Classification, e.g. identification} - G07C 9/00563: {using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns} - G07C 9/37: using biometric data, e.g. fingerprints, iris scans or voice recognition - B60R 2325/205: Mobile phones - B60W 2040/0809: {Driver authorisation; Driver identity check} - B60W 2050/146: {Display means} - B60W 2540/041: Potential occupants - B60W 2540/043: Identity of occupants - B60W 2556/10: Historical data - B60W 2556/45: External transmission of data to or from the vehicle - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A system for authorizing a user to operate a vehicle comprises first and second image capturing devices disposed inside and outside the vehicle to capture first and second images of the user, respectively; an identification device to compare the first image with a first stored user image, generate a first output, and upload the first image to the database as a second stored user image if a matching degree of the first image with the first stored user image is greater than a first threshold. The identification device further compares the second image with the second stored user image and generates a second output if a matching degree of the second image and the second stored user image is larger than a second threshold. The system further comprises first and second operation execution devices to perform first and second vehicle operations upon the first and second outputs, respectively. ## Claims ### Claim 1 A system for authorizing a user to operate a vehicle, comprising: a first image capturing device disposed outside the vehicle to capture a first image of the user; a second image capturing device disposed inside the vehicle to capture a second image of the user; an identification device to compare the first image with a first stored user image in a database, generate a first output, and upload the first image to the database as a second stored user image if a matching degree of the first image with the first stored user image is greater than a first threshold, compare the second image with the second stored user image, and generate a second output if a matching degree of the second image and the second stored user image is larger than a second threshold; and a first operation execution device to perform a first vehicle operation upon the first output and a second operation execution device to perform a second vehicle operation upon the second output. ### Claim 2 (depends on 1) The system of claim 1, wherein the first image capturing device is located on an exterior door frame of the vehicle at a driver side, and the second image capturing device is located on a steering wheel or a dash board by the driver side. ### Claim 3 (depends on 1) The system of claim 1, wherein the database is in a server in communication with the vehicle or a storage medium in the identification device. ### Claim 4 (depends on 1) The system of claim 1, wherein the first threshold is smaller than the second threshold. ### Claim 5 (depends on 1) The system of claim 1, wherein the identification device is configured to compare the first image with the first stored user image via facial recognition. ### Claim 6 (depends on 5) The system of claim 5, wherein the identification device is further configured to compare the second image with the second stored user image based on auxiliary feature identification, wherein the auxiliary feature includes one of clothes colors, collars, accessories, hairstyles of the user in the second image and the second stored user image. ### Claim 7 (depends on 6) The system of claim 6, wherein the matching degree of the second image and the second stored user image is calculated based on a weighted matching degree of facial recognition and auxiliary features identification. ### Claim 8 (depends on 1) The system of claim 1, wherein the first vehicle operation includes unlocking a vehicle door, and the second vehicle operation includes starting an engine of the vehicle. ### Claim 9 (depends on 1) The system of claim 1, further comprising a mobile device, wherein the mobile device has a user interface for receiving inputs from a user to initiate the system, outputting notifications of vehicle operations to be performed to users, receiving inputs of confirmation on the vehicle operations from users, and outputting notifications of completed vehicle operations to users. ### Claim 10 (depends on 9) The system of claim 9, wherein the user interface is further configured to receive instruction to update the database, and the identification device is further configured to upload the second stored user image to the database and replace the first stored user image based on the instruction. ### Claim 11 (depends on 1) The system of claim 1, wherein a plurality of first images corresponding to a plurality of users are stored in the database, and the identification device is further configured to identify a current user is one of the plurality of users. ### Claim 12 (depends on 11) The system of claim 11, wherein the second vehicle operation further includes setting a group of vehicle functions to those associated with the one of the plurality of users. ### Claim 13 A method for authorizing a user to operate a vehicle, comprising: receiving a first image of a user outside the vehicle with a first image capture device; comparing the first image with a first stored user image in a database to determine a first matching degree between the first image and the first stored user image; performing a first vehicle operation by a first operation execution device and uploading the first image to the database as a second stored user image if it is determined that the first matching degree is greater than a first threshold; receiving a second image of the user inside the vehicle with a second image capture device; comparing the second image with the second stored user image to determine a second matching degree between the second image and the second stored user image; and performing a second vehicle operation by a second operation execution device if it is determined that the second matching degree is greater than a second threshold. ### Claim 14 (depends on 13) The method of claim 13, wherein the first matching degree is determined based on facial recognition, and the second matching degree is determined based on facial recognition and auxiliary feature identification. ### Claim 15 (depends on 14) The method of claim 14, wherein the second matching degree is a weighted average of matching degree of the facial recognition and the auxiliary feature identification. ### Claim 16 (depends on 13) The method of claim 13, wherein performing the first vehicle operation includes unlocking a vehicle door, and performing the second vehicle operation includes starting an engine of the vehicle. ### Claim 17 (depends on 13) The method of claim 13, further including: receiving inputs of initiating the system from users; outputting notifications of vehicle operations to be performed to users; receiving inputs of confirmation of the vehicle operation from users; and outputting notifications of completed vehicle operations to users. ### Claim 18 (depends on 17) The method of claim 17, wherein the notifications are output to users via a text or an audio message. ### Claim 19 (depends on 13) The method of claim 13, further comprising: receiving inputs of updating the database, uploading the second stored user image to the database and replacing the first stored user image. ### Claim 20 (depends on 13) The method of claim 13, further comprising pre-storing a plurality of first stored user images corresponding to a plurality of users in the database to determine whether a current user is one of the plurality of users, wherein performing the second vehicle operation includes setting a group of vehicle functions to those associated with the one of the plurality users.