Helmet inside trunk detection system for mobility sharing service
AssigneeReby, Inc.
InventorsJulio Gonzalez Lopez, Elisabet Bayo Puxan, Akash Kadechkar, Xiaolei Song, Ricard Comas Xanco, Eugeni Llagostera Saltor
Life of this patent
Estimating the term…
Abstract
An image classification system and method are used to determine the status of equipment completeness of the rental two-wheeled vehicles, such as electric scooters. The system and method use deep learning models to analyze and classify ambiguous states of the rental vehicle when the user finishes the ride. These states are likely to be encountered by rental vehicles, to protect helmets, trunks or other equipment from loss or damage.
Claims18
A method of checking the equipment completeness of the rental two-wheeled vehicle, comprising the steps of:
- a. training image classification deep learning models for equipment completeness of the vehicle determination, further comprising the steps of:
- obtaining multiple training images of the vehicle with a trunk, wherein each of the training image is associated with a known state of helmet completeness in the trunk mounted on the vehicle;
- loading the training images with associated known vehicle equipment completeness states into a vehicle completeness training module as training data;
- generating an object detection model for detecting the trunk and the helmet based on the training data using the vehicle completeness training module;
- and
- generating a state determination model for determining equipment completeness of the vehicle using vehicle completeness training module;
- and
- b. determining an equipment completeness of the vehicle, further comprising the steps of:
- receiving a photo image of the vehicle from the client device, wherein the photo image captures the trunk and was made with a client device camera;
- analyzing the photo image using object detection model for detecting the trunk and the helmet on the photo image;
- and
- classifying the photo image using state determination model for determining a class of the photo image associated with equipment completeness state of the vehicle;
- and
- c. forming an instruction in accordance with determined state of equipment completeness of the vehicle related to a class of the photo image and verdict of the object detection on the photo image.
A system for checking the equipment completeness of the rental two-wheeled vehicle, the system comprising:
- a processor, connected to the network and configured to receive photo images from the users of vehicles;
- a vehicle completeness training module, configured to load training images with associated known vehicle equipment completeness states;
- an object detection model for detecting the trunk and the helmet on the photo image based on the training data from the vehicle completeness training module;
- a state determination model for classifying the photo image to determine a class of the photo image associated with equipment completeness state of the vehicle;
- a vehicle completeness image classification module that determines the state of the equipment completeness of the vehicle based on the verdict of object detection model and the verdict of the state determination model;
- and
- an automated ride completion processing unit that structs the user of the vehicle in response to the determined state of the equipment completeness of the vehicle.
Dependencies are inferred from the claim text.