# US 11,568,546 B2 · Method and system for detecting occupant interactions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,568,546 B2
- Document ID: US11568546B2
- Status: Granted
- Kind: B2
- Application number: 16/882,560
- Filed: 2020-05-25
- Published: 2020-12-10
- Granted: 2023-01-31
- Earliest claimed: 2016-11-20
- Assignees: Pointgrab Ltd.
- Applicants: Pointgrab Ltd.
- Inventors: Itamar Roth; Haim Perski; Udi Benbaron; Dan Bechar
- Web page: https://patentgrep.com/patent/US11568546B2

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G08B 21/22: responsive to presence or absence of persons
- G06F 16/219: {Managing data history or versioning (querying versioned data G06F16/2474; querying temporal data G06F16/2477)}
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G08B 21/182: {Level alarms, e.g. alarms responsive to variables exceeding a threshold}
- H04N 7/183: {for receiving images from a single remote source}
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Determining occupants' interactions in a space by applying a computer vision algorithm to track an occupant in a set of images of a space to obtain locations in the space of the occupant over time, where a history log of the occupant includes the locations of the occupant in the space over time is created and history logs of a plurality of occupants are compared to extract interaction points between the plurality of occupants.

## Claims

### Claim 1

A method for determining occupants' interactions in a space, the method comprising:
applying a computer vision algorithm to obtain locations of an occupant, in the space, over time; and
using a processor to
compare locations of a plurality of occupants to extract interaction points between the plurality of occupants, wherein the interaction points comprise any one of:
i) locations in the space in which at least two occupants are located within a defined time period, in a repetitive pattern,
ii) locations in the space in which a sitting body position of an occupant is detected,
iii) locations in the space in which a plurality of occupants are located for a time period over a specified threshold,
iv) locations in the space in which a number of occupants above a specified threshold are located within a defined time period, and
generate a signal indicative of compliance with physical distancing rules, based on the interaction points.

### Claim 2 (depends on 1)

The method of claim 1 wherein the computer vision algorithm comprises detecting a shape of the occupant and tracking the shape of the occupant to obtain the location of the occupant.

### Claim 3 (depends on 1)

The method of claim 1 wherein the interaction points comprise locations in the space in which at least two occupants are situated at a distance within a pre-determined range, from each other.

### Claim 4 (depends on 3)

The method of claim 3 wherein the interaction points comprise locations in the space in which the at least two occupants are located for a time period over a specified threshold.

### Claim 5 (depends on 1)

The method of claim 1 wherein the interaction points comprise locations in the space in which a number of occupants above a specified threshold are located within a defined time period.

### Claim 6

A system comprising:
a processor configured to
receive images of a space,
create a history log of an occupant based on tracking of the occupant through the images of the space to obtain locations in the space of the occupant over time,
maintain a database of the history logs,
create a map of occupant interaction in the space based on comparison of history logs, the map comprising locations in which at least two occupants are situated at a distance, which is within a pre-determined range, from each other, and
generate a signal indicative of compliance with physical distancing rules.

### Claim 7 (depends on 6)

The system of claim 6 comprising an image sensor to obtain the images of the space.

### Claim 8 (depends on 7)

The system of claim 7 wherein the image sensor is configured to obtain top view images of the space.

### Claim 9 (depends on 6)

The system of claim 6 wherein the processor is configured to create a map of occupant interactions comprising locations in the space in which the at least two occupants are located for a time period over a specified threshold.

### Claim 10 (depends on 6)

The system of claim 6 wherein the processor is configured to create a map of occupant interactions comprising locations in the space in which a number of occupants above a specified threshold are located.

### Claim 11 (depends on 10)

The system of claim 10 wherein the processor is configured to generate a signal to issue an alarm when the number of occupants in the location are above the specified threshold.

### Claim 12

A system comprising:
a camera configured to obtain images of a space; and
a processor in communication with the camera, the processor configured to
obtain locations of an occupant in the space, over time, from the images of the space,
compare locations of a plurality of occupants to extract interaction points between the plurality of occupants, the interaction points comprising any one of:
i) locations in the space in which at least two occupants are located within a defined time period, in a repetitive pattern,
ii) locations in the space in which a sitting body position of an occupant is detected,
iii) locations in the space in which a plurality of occupants are located for a time period over a specified threshold,
iv) locations in the space in which a number of occupants above a specified threshold are located within a defined time period, and
generate a signal indicative of compliance with physical distancing rules, based on the interaction points.

### Claim 13 (depends on 12)

The system of claim 12 wherein the interaction points comprise locations in the space in which at least two occupants are situated at a distance within a pre-determined range, from each other.

### Claim 14 (depends on 12)

The system of claim 12 wherein the processor is configured to cause a change in a display based on the interaction points.
