Method of using augmented reality and in-situ camera for machine learning inside a plant environment

Abstract

A system and a method for analyzing a plant environment. The system comprises an augmented reality (AR) camera configured to capture video of a plant while an operator manipulates the first plant and to provide the video to a processor; an image database configured to store images and/or video of the plant collected by the AR camera, a processor having a training module and configured to execute instructions to analyze the video and to provide instructions regarding how to manipulate a second plant. Real-time validation of classifications by the system are used to continuously train the system. Movements made to perform said validation, to acquire visual data on the plant or to act on the plant are recorded for training on movement replication. These instructions to replicate a movement of plant manipulation can be provided to an AR apparatus of a second operator or to a robotic manipulator.

Dependencies are inferred from the claim text.