# US 2020/0388039 A1 · Method and system for detecting occupant interactions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0388039 A1
- Document ID: US20200388039A1
- Status: Published application
- Kind: A1
- Application number: 16/882,560
- Filed: 2020-05-25
- Published: 2020-12-10
- Earliest claimed: 2016-11-20
- Assignees: Pointgrab Ltd.
- Applicants: Pointgrab Ltd.
- Inventors: ITAMAR ROTH; HAIM PERSKI; UDI BENBARON; DAN BECHAR
- Web page: https://patentgrep.com/patent/US20200388039A1

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G08B 21/22: responsive to presence or absence of persons
- G06F 16/219: {Managing data history or versioning (querying versioned data G06F16/2474; querying temporal data G06F16/2477)}
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G08B 21/182: {Level alarms, e.g. alarms responsive to variables exceeding a threshold}
- H04N 7/183: {for receiving images from a single remote source}
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Determining occupants' interactions in a space by applying a computer vision algorithm to track an occupant in a set of images of a space to obtain locations in the space of the occupant over time, where a history log of the occupant includes the locations of the occupant in the space over time is created and history logs of a plurality of occupants are compared to extract interaction points between the plurality of occupants.

## Claims

### Claim 1

A method for determining occupants' interactions in a space, the method comprising:
applying a computer vision algorithm to obtain locations of an occupant, in the space, over time; and
using a processor to
compare locations of a plurality of occupants to extract interaction points between the plurality of occupants, the interaction points fulfilling a pre-determined condition, and
generate an alarm based on the interaction points.

### Claim 2 (depends on 1)

The method of claim 1 wherein the computer vision algorithm comprises detecting a shape of the occupant and tracking the shape of the occupant to obtain the location of the occupant.

### Claim 3 (depends on 1)

The method of claim 1 wherein the interaction points comprise locations in the space in which at least two occupants are situated at a distance within a pre-determined range, from each other.

### Claim 4 (depends on 3)

The method of claim 3 wherein the interaction points comprise locations in the space in which the at least two occupants are located for a time period over a specified threshold.

### Claim 5 (depends on 1)

The method of claim 1 wherein the interaction points comprise locations in the space in which a number of occupants above a specified threshold are located within a defined time period.

### Claim 6 (depends on 1)

The method of claim 1 wherein interaction points comprise locations in the space in which at least two occupants are located within a defined time period, in a repetitive pattern.

### Claim 7 (depends on 1)

The method of claim 1 comprising using a shape detection algorithm to detect if a body position of the occupant is sitting or standing and wherein interaction points comprise locations in the space in which a sitting body position of an occupant is detected.

### Claim 8

A system comprising:
a processor configured to
receive images of a space,
create a history log of an occupant based on tracking of the occupant through the images of the space to obtain locations in the space of the occupant over time,
maintain a database of the history logs, and
create a map of occupant interaction in the space based on comparison of history logs, the map comprising locations in which at least two occupants are situated at a distance, which is within a pre-determined range, from each other.

### Claim 9 (depends on 8)

The system of claim 8 comprising an image sensor to obtain the images of the space.

### Claim 10 (depends on 9)

The system of claim 9 wherein the image sensor is configured to obtain top view images of the space.

### Claim 11 (depends on 8)

The system of claim 8 wherein the processor is configured to generate a signal indicative of compliance with physical distancing rules.

### Claim 12 (depends on 8)

The system of claim 8 wherein the processor is configured to create a map of occupant interactions comprising locations in the space in which the at least two occupants are located for a time period over a specified threshold.

### Claim 13 (depends on 8)

The system of claim 8 wherein the processor is configured to create a map of occupant interactions comprising locations in the space in which a number of occupants above a specified threshold are located.

### Claim 14 (depends on 13)

The system of claim 13 wherein the processor is configured to generate a signal to issue an alarm when the number of occupants in the location are above the specified threshold.

### Claim 15

A system comprising:
a camera configured to obtain images of a space; and
a processor in communication with the camera, the processor configured to
obtain locations of an occupant in the space, over time, from the images of the space,
compare locations of a plurality of occupants to extract interaction points between the plurality of occupants, the interaction points fulfilling a pre-determined condition, and
generate an alarm based on the interaction points.

### Claim 16 (depends on 15)

The system of claim 15 wherein the interaction points comprise locations in the space in which at least two occupants are situated at a distance within a pre-determined range, from each other.

### Claim 17 (depends on 16)

The system of claim 16 wherein the interaction points comprise locations in the space in which the at least two occupants are located for a time period over a specified threshold.

### Claim 18 (depends on 15)

The system of claim 15 wherein the interaction points comprise locations in the space in which a number of occupants above a specified threshold are located within a defined time period.

### Claim 19 (depends on 15)

The system of claim 15 wherein the processor is configured to cause a change in a display based on the interaction points.
