# US 10,372,997 B2 · Updating a behavioral model for a person in a physical space

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,372,997 B2
- Document ID: US10372997B2
- Status: Granted
- Kind: B2
- Application number: 15/544,321
- Filed: 2015-01-30
- Published: 2018-01-11
- Granted: 2019-08-06
- Earliest claimed: 2015-01-30
- Assignees: Longsand Limited
- Applicants: Longsand Limited
- Inventors: Sean Blanchflower
- Web page: https://patentgrep.com/patent/US10372997B2

## CPC

- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06Q 10/067: Enterprise or organisation modelling
- G06Q 20/20: Point-of-sale [POS] network systems
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- G06Q 30/0201: Market modelling; Market analysis; Collecting market data
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

Examples disclosed herein relate to a person moving in a physical space. In one aspect, a method is disclosed. The method may include obtaining at least two images of a person from at least two cameras directed at a physical space, where the physical space may include a plurality of designated areas. The method may also include obtaining metadata associated with the images, based on the images and the metadata determining within the plurality of designated areas a set of designated areas visited by the person, for each designated area within the set of designated areas, determining an area information, and updating a database based on the set of designated areas and based on at least a portion of the area information associated with each designated area within the set of designate areas.

## Claims

### Claim 1

A computing device comprising:
a processor; and
a memory storing instructions that when executed cause the processor to:
obtain a plurality of images of a physical space,
identify, within the plurality of images, a set of images of a same first person within the physical space, wherein at least two of the set of images are captured by different cameras having different fields of view,
based on the set of images, determine a first path taken by the first person within the physical space,
obtain a behavioral model including data representing a plurality of historical paths taken by a plurality of people within the physical space, wherein the behavioral model includes different path categories associated with the plurality of people, including a path category associated with browsers in the physical space and a path category associated with focused shoppers in the physical space,
determine a path category associated with the first person based on metadata of the first path taken by the first person, and
update the behavioral model with information of the first person and data that represents the first path taken by the first person within the physical space and the path category associated with the first person.

### Claim 2 (depends on 1)

The computing device of claim 1, wherein determining the first path comprises determining, based on the set of images, a set of one or more designated areas visited by the first person, and determining, for each designated area within the set of designated areas, at least one of:
a description of the designated area;
a set of objects located at the designated area;
a time at which the first person visited the designated area;
an amount of time spent by the first person at the designated area;
whether the first person inspected a product at the designated area; and
whether the first person left the designated area with the product.

### Claim 3 (depends on 2)

The computing device of claim 2, wherein each of the set of images is associated with metadata, and wherein the instructions are executable to cause the processor to use the metadata to determine, for each of the designated areas, at least one of:
the description of the designated area;
the set of objects located at the designated area;
the time at which the first person visited the designated area; and
the amount of time spent by the first person at the designated area.

### Claim 4 (depends on 1)

The computing device of claim 1, wherein the behavioral model comprises analytical data statistically representing the plurality of paths.

### Claim 5 (depends on 1)

The computing device of claim 1, wherein the instructions are executable to cause the processor to execute a statistical analysis on the data representing the historical paths taken by the plurality of people to generate the path categories shared by the plurality of people, including the path category associated with browsers in the physical space and the path category associated with focused shoppers in the physical space.

### Claim 6 (depends on 1)

The computing device of claim 1, wherein the instructions are executable to cause the processor to:
obtain purchase data from an electronic point-of-sale (EPOS) system;
determine whether the purchase data is associated with the first person; and
if the purchase data is associated with the first person, update the behavioral model based on the purchase data.

### Claim 7 (depends on 1)

The computing device of claim 1, wherein the different fields of view do not overlap, and wherein exact orientation of the different cameras is unknown.

### Claim 8

A method comprising:
obtaining at least two images of a first person from at least two cameras located in a plurality of designated areas of a physical space;
obtaining, by a processor of a computing device, metadata associated with the images of the first person;
based on the images and the metadata, determining, by the processor, within the plurality of designated areas a set of designated areas visited by the first person;
for each designated area within the set of designated areas, determining, by the processor, an area information of a first path taken by the first person in the physical space, wherein the area information comprises at least one of:
a description of the designated area,
a set of objects located at the designated area,
a time at which the first person visited the designated area,
an amount of time spent by the first person at the designated area,
whether the first person inspected a product at the designated area, and
whether the first person left the designated area with the product; and
executing, by the processor, a statistical analysis on data that represents historical paths taken by a plurality of people in the physical space to generate different path categories shared by the plurality of people;
classifying, by the processor, the first person according to one of the different path categories based on the area information of the first path taken by the first person;
updating, by the processor, a database with information related to the first person, including the path category associated with the first person in the physical space and data associated with the set of designated areas visited by the first person and the area information associated with each designated area within the set of designate areas.

### Claim 9 (depends on 8)

The method of claim 8, wherein the metadata identifies which of the two cameras are directed at which of the plurality of designated areas.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
obtaining purchase data from an electronic point-of-sale (EPOS) system;
determining whether the purchase data corresponds to the first person; and
if the purchase data corresponds to the first person, updating the database based on the purchase data.

### Claim 11 (depends on 10)

The method of claim 10, wherein the purchase data comprises a timestamp, and wherein determining whether the purchase data corresponds to the first person comprises:
identifying, within the set of designated areas, a first designated area associated with the EPOS system; and
comparing the timestamp to the time at which the first person visited the first designated area.

### Claim 12

A non-transitory machine-readable storage medium storing instructions executable by a processor of a computing device to cause the computing device to:
obtain a plurality of images of a physical space comprising a plurality of designated areas;
identify, within the plurality of images, a set of images of a same first person, wherein at least two of the set of images are captured by different cameras having different fields of view;
from the set of images, determine a set of designated areas visited by the first person and a set of timestamps on the set of images, respectively;
generate path data associated with the first person based on the set of timestamps and the set of the designated areas;
classify the first person according to one of a plurality of different path categories in a behavioral model based on the path data associated with the first person, wherein the behavioral model incorporates data that represents historical paths taken by a plurality of people in the physical space; and
update the behavioral model based on information related to the first person, including the path data associated with the first person and the path category associated with the first person in the physical space.

### Claim 13 (depends on 12)

The non-transitory machine-readable storage medium of claim 12, wherein the instructions are further to cause the computing device to:
determine, based on at least one of the set of images, personal data associated with the first person, wherein the personal data comprises at least one of an age and a gender; and
update the behavioral model based on the characteristic of the first person.

### Claim 14 (depends on 12)

The non-transitory machine-readable storage medium of claim 12, wherein the behavioral model comprises analytical data indicating at least one of:
a most visited designated area among the plurality of designated areas;
a least visited designated area among the plurality of designated areas; and
a correlation between visits to a first area from the plurality of designated areas and visits to a second area from the plurality of designated areas.

### Claim 15 (depends on 14)

The non-transitory machine-readable storage medium of claim 14, wherein the instructions are further to cause the computing device to:
obtain purchase data from an electronic point-of-sale (EPOS) system;
determine whether the purchase data is associated with the first person; and
if the purchase data is associated with the first person, update the behavioral model based on the purchase data.

### Claim 16 (depends on 12)

The non-transitory machine-readable storage medium of claim 12, wherein the instructions are further to cause the computing device to:
execute a statistical analysis on the data representing the historical paths taken by the plurality of people in the physical space to generate the different path categories in the behavioral model.

### Claim 17 (depends on 12)

The non-transitory machine-readable storage medium of claim 12, wherein the different path categories in the behavioral model include a path category associated with browsers and a path category associated with focused shoppers.

### Claim 18 (depends on 8)

The method of claim 8, wherein the different path categories include a path category associated with browsers in the physical space and a path category associated with focused shoppers in the physical space.