# US 2017/0287104 A1 · Dynamic memory allocation in a behavioral recognition system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287104 A1
- Document ID: US20170287104A1
- Status: Published application
- Kind: A1
- Application number: 15/090,346
- Filed: 2016-04-04
- Published: 2017-10-05
- Earliest claimed: 2016-04-04
- Assignees: Omni Al, Inc.
- Applicants: Omni Al, Inc.
- Inventors: Lon W. RISINGER; Kishor Adinath SAITWAL
- Web page: https://patentgrep.com/patent/US20170287104A1

## CPC

- G06T 1/60: Memory management
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 20/44: {Event detection}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Techniques are disclosed for dynamic memory allocation in a behavioral recognition system. According to one embodiment of the disclosure, input data is received from each of a plurality of data streams. A composite of the input data is generated from each of the data streams in a host memory. The composite of the input data is transferred to a device memory. The composite of the input data is processed in parallel via the host memory on the CPU and the device memory on the GPU.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving input data from each of a plurality of data streams;
generating a composite of the input data from each of the data streams in a host memory;
transferring the composite of the input data to a device memory; and
processing the composite of the input data in parallel via the host memory and the device memory.

### Claim 2 (depends on 1)

The method of claim 1, wherein processing the composite of the input data comprises:
performing, in a plurality of successive phases, one or more tasks on each of the streams of data via the host memory and the device memory.

### Claim 3 (depends on 1)

The method of claim 1, wherein the host memory is allocated in a central processing unit (CPU) and the device memory is allocated in a graphics processing unit (GPU).

### Claim 4 (depends on 3)

The method of claim 3, further comprising, prior to generating the composite of the input data:
allocating the host memory from a memory pool associated with the CPU; and
allocating the device memory from a memory pool associated with the GPU.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
releasing the host memory and device memory to the respective memory pools.

### Claim 6 (depends on 1)

The method of claim 1, wherein the data streams correspond to a plurality of video feeds to be analyzed in a behavioral recognition system.

### Claim 7 (depends on 1)

The method of claim 1, wherein the composite of the input data is generated using a bin-packing technique on each of the data streams.

### Claim 8

A non-transitory computer-readable storage medium having instructions, which, when executed on a processor, performs an operation, comprising:
receiving input data from each of a plurality of data streams;
generating a composite of the input data from each of the data streams in a host memory;
transferring the composite of the input data to a device memory; and
processing the composite of the input data in parallel via the host memory and the device memory.

### Claim 9 (depends on 8)

The computer-readable storage medium of claim 8, wherein processing the composite of the input data comprises:
performing, in a plurality of successive phases, one or more tasks on each of the streams of data via the host memory and the device memory.

### Claim 10 (depends on 8)

The computer-readable storage medium of claim 8, wherein the host memory is allocated in a central processing unit (CPU) and the device memory is allocated in a graphics processing unit (GPU).

### Claim 11 (depends on 10)

The computer-readable storage medium of claim 10, wherein the operation further comprises, prior to generating the composite of the input data:
allocating the host memory from a memory pool associated with the CPU; and
allocating the device memory from a memory pool associated with the GPU.

### Claim 12 (depends on 11)

The computer-readable storage medium of claim 11, wherein the operation further comprises:
releasing the host memory and device memory to the respective memory pools.

### Claim 13 (depends on 8)

The computer-readable storage medium of claim 8, wherein the data streams correspond to a plurality of video feeds to be analyzed in a behavioral recognition system.

### Claim 14 (depends on 8)

The computer-readable storage medium of claim 8, wherein the composite of the input data is generated using a bin-packing technique on each of the data streams.

### Claim 15

A system, comprising:
a processor; and
a memory storing code, which, when executed on the processor, performs an operation, comprising:
receiving input data from each of a plurality of data streams,
generating a composite of the input data from each of the data streams in a host memory;
transferring the composite of the input data to a device memory; and
processing the composite of the input data in parallel via the host memory and the device memory.

### Claim 16 (depends on 15)

The system of claim 15, wherein processing the composite of the input data comprises:
performing, in a plurality of successive phases, one or more tasks on each of the streams of data via the host memory and the device memory.

### Claim 17 (depends on 15)

The system of claim 15, wherein the host memory is allocated in the processor and the device memory is allocated in a graphics processing unit (GPU).

### Claim 18 (depends on 17)

The system of claim 17, wherein the operation further comprises, prior to generating the composite of the input data:
allocating the host memory from a memory pool associated with the CPU; and
allocating the device memory from a memory pool associated with the GPU.

### Claim 19 (depends on 18)

The system of claim 18, wherein the operation further comprises:
releasing the host memory and device memory to the respective memory pools.

### Claim 20 (depends on 15)

The system of claim 15, wherein the data streams correspond to a plurality of video feeds to be analyzed in a behavioral recognition system.
