Back to results
US 12,714,015 B2Granted
System and method for autonomous lawn care
AssigneeEuchron, Inc.
InventorAndrew Simpson
Life of this patent
Estimating the term…
Abstract
Systems and methods may include an unmanned lawn mower that includes a predictive model service. The predictive model service may be trained by a machine learning system and may serve to autonomously control the unmanned lawn mower. In this way, the unmanned lawn mower may navigate throughout a lawn and may cut the lawn and/or perform other lawn maintenance procedures during the navigation. The system may also include a variety of sensors and cameras to detect image data and environmental data of an area surrounding the unmanned lawn mower. The image data and the environmental data may be provided to the predictive model service in order to control the operation of the unmanned lawn mower in real-time.
Claims23
A method for operating an autonomous lawnmower using low-bandwidth communication, the method comprising:
- receiving first data from a camera mounted to the autonomous lawnmower, the first data comprising at least one frame taken during a recent time period;
- receiving second data, the second data comprising at least one of a position or a speed of the autonomous lawnmower;
- determining a latency between the autonomous lawnmower and a client device communicatively coupled to the autonomous lawnmower;
- predicting, based on the first data, the second data, and the latency, a future environmental state of the autonomous lawnmower, the future environmental state comprising a predicted location of an object with respect to the autonomous lawnmower at a future time;
- generating an environmental map based on the future environmental state;
- causing displaying of the environmental map on the client device;
- and
- in response to receiving an operational command while the environmental map is displayed on the client device, causing the autonomous lawnmower to perform at least one of steering the autonomous lawnmower or changing a velocity of the autonomous lawnmower.
5 more elements
An autonomous lawnmower system comprising:
- an autonomous lawnmower comprising:
- a camera system configured to capture image data;
- a steering mechanism;
- a cutting mechanism;
- a drive train;
- and
- a navigation system configured to generate position data;
- and
- a controller communicatively coupled with the camera system and the drive train, the controller configured to:
- receive image data from the camera system, the image data comprising a timestamp;
- receive position data from the navigation system;
- calculate a latency between the controller and a client device communicatively coupled to the controller;
- predict a future environmental state at a first time, the prediction based on the image data, the position data, and the latency;
- generate an environmental map based on the future environmental state;
- cause rendering of the environmental map on the client device, the environmental map including a predicted position of the autonomous lawnmower transmitted to the client device at a second time before the first time, wherein a difference between the first time and the second time is greater than or equal to the latency;
- and
- cause the autonomous lawnmower to control at least one of the steering mechanism, the cutting mechanism, or the drive train of the autonomous lawnmower in response to a control command received at the client device.
14 more elements
A method for operating an autonomous lawnmower, the method comprising:
- extracting, from a camera system mounted to the autonomous lawnmower, visual data of an area;
- determining a steering direction of the autonomous lawnmower;
- determining an average latency between the autonomous lawnmower and a client device communicatively coupled to the autonomous lawnmower;
- using a deep neural network, predicting a future environmental state of the area at a first time, the prediction based at least in part on the visual data and the steering direction;
- generating an environmental map based on the predicted future environmental state;
- transmitting, to the client device, the environmental map including the future environmental state, the environmental map transmitted in accordance to the average latency such that the future environmental state is displayed at the first time when the first time corresponds to a current time;
- and
- in response to a user input received at the client device, controlling a mowing operation of the autonomous lawnmower.
5 more elements
An autonomous lawnmowing system comprising:
- a controller configured to communicatively couple with an autonomous lawnmower, the autonomous lawnmower comprising:
- a camera system configured to capture image data;
- a steering mechanism;
- a cutting mechanism;
- a drive train;
- and
- a navigation system configured to generate position data, the controller further configured to:
- receive image data from the camera system, the image data comprising a timestamp;
- receive position data from the navigation system;
- calculate a latency between the controller and a client device communicatively coupled to the controller;
- predict a future environmental state at a first time, the prediction based on the image data, the position data, and the latency;
- generate an environmental map based on the future environmental state;
- and
- cause rendering of the environmental map on the client device, the environmental map including a predicted position of the autonomous lawnmower transmitted to the client device at a second time before the first time, wherein a difference between the first time and the second time is greater than or equal to the latency;
- and
- cause the autonomous lawnmower to control at least one of the steering mechanism, the cutting mechanism, or the drive train of the autonomous lawnmower in response to a control command received at the client device.
13 more elements
Dependencies are inferred from the claim text.