US 2023/0419729 A1 · PREDICTING NEED FOR GUEST ASSISTANCE BY DETERMINING GUEST BEHAVIOR BASED ON MACHINE LEARNING MODEL ANALYSIS OF VIDEO DATA

Abstract

A behavior detection platform may obtain video data of an environment including a guest and may determine a set of normal guest behaviors associated with the environment. The platform may analyze, using a first machine learning model, the video data to identify features of the guest and analyze, using a second machine learning model, the video data and the features to determine an actual guest behavior of the guest. The platform may predict, using the second machine learning model, a predicted guest behavior of the guest based on the actual guest behavior. The behavior detection platform may determine that at least one of the actual guest behavior or the predicted guest behavior is not included in the set of normal guest behaviors. The platform may cause assistance to be provided to the guest based on determining that the actual guest behavior or the predicted guest behavior are not included.

Claims20

Dependent claims

A method performed by a behavior detection platform, the method comprising:

obtaining video data of an environment that includes a guest;
determining a set of normal guest behaviors associated with the environment;
analyzing, using a first machine learning model, the video data to identify keypoints of the guest;
analyzing, using a second machine learning model, the video data and the keypoints to determine an actual guest behavior of the guest;
predicting, using the second machine learning model, a predicted guest behavior of the guest,
wherein the predicted guest behavior is predicted based on the actual guest behavior;
determining that at least one of the actual guest behavior or the predicted guest behavior is not a normal guest behavior of the set of normal guest behaviors;
and
responding to the at least one of the actual guest behavior or the predicted guest behavior based on determining that the at least one of the actual guest behavior or the predicted guest behavior is not a normal guest behavior of the set of normal guest behaviors.

6 more elements

A non-transitory computer-readable medium storing a set of instructions, the set of instructions comprising:

one or more instructions that, when executed by one or more processors of a device, cause the device to:
obtain video data of an environment that includes a guest;
analyze the video data using one or more object recognition techniques;
determine an actual guest behavior of the guest based on analyzing the video data using the one or more object recognition techniques;
determine that the actual guest behavior is not part of a set of normal guest behaviors of guests in the environment;
determine that assistance is to be provided to the guest based on determining that the actual guest behavior is not part of the set of normal guest behaviors;
and
cause an action to be performed to provide assistance to the guest.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application

18/465,153Filed 11 Sep 2023

Priority

12 Apr 2017

Published

28 Dec 2023

Term ends

Not estimatedThe source records don’t support an estimate.

Classification10 codes

G06V 40/20
Recognition of biometric, human-related or animal-related patterns in image or video data: movements or behaviour, e.g. gesture recognition
G06V 40/28
Movements or behaviour, e.g. gesture recognition: recognition of hand or arm movements, e.g. recognition of deaf sign language
G06V 20/41
In video content: higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian…
G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects

Family

Application15/485,896Continuation in part · filed 12 Apr 2017

Application16/531,930Continuation · filed 5 Aug 2019

Application17/901,687Continuation in part · filed 1 Sep 2022

Application63/511,177Us provisional application · filed 29 Jun 2023

Application18/465,153Continuation in part

Application17/901,687Continuation

Application16/531,930Continuation in part

US 10,417,896 B2Related patent

US 11,450,145 B2Related patent

US 12,639,982 B2Related patent

US 12,755,575 B2Related patent