# US 2011/0235914 A1 · Invariant pulse latency coding systems and methods systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2011/0235914 A1
- Document ID: US20110235914A1
- Status: Published application
- Kind: A1
- Application number: 12/869,583
- Filed: 2010-08-26
- Published: 2011-09-29
- Earliest claimed: 2010-03-26
- Assignees: Brain Corporation
- Inventors: Eugene M. Izhikevich; Botond Szatmary; Csaba Petre
- Web page: https://patentgrep.com/patent/US20110235914A1

## CPC

- H04N 19/00: Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- G06N 3/049: Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/40: Analysis of texture (depth or shape recovery from texture G06T7/529)
- G06T 9/002: {using neural networks}
- G06V 10/40: Extraction of image or video features
- H04B 14/026: {using pulse time characteristics modulation, e.g. width, position, interval}
- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- G06T 2207/10016: Video; Image sequence
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04B: TRANSMISSION

## Abstract

Systems and methods for processing image signals are described. One method comprises obtaining a generator signal based on an image signal and determining relative latencies associated with two or more pulses in a pulsed signal using a function of the generator signal that can comprise a logarithmic function. The function of the generator signal can be the absolute value of its argument. Information can be encoded in the pattern of relative latencies. Latencies can be determined using a scaling parameter that is calculated from a history of the image signal. The pulsed signal is typically received from a plurality of channels and the scaling parameter corresponds to at least one of the channels. The scaling parameter may be adaptively calculated such that the latency of the next pulse falls within one or more of a desired interval and an optimal interval.

## Claims

### Claim 1

A method of processing an image signal comprising the steps of:
obtaining a generator signal based on the image signal; and
determining relative latencies associated with two or more pulses in a pulsed signal using a function of the generator signal, wherein
information is encoded in the pattern of relative latencies.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the relative latencies includes determining the latency of a next pulse using a scaling parameter that is calculated from a history of the image signal.

### Claim 3 (depends on 2)

The method of claim 2, wherein the pulsed signal is received from a plurality of channels, wherein the scaling parameter corresponds to at least one of the channels.

### Claim 4 (depends on 3)

The method of claim 3, wherein the scaling parameter corresponds to at least two of the channels.

### Claim 5 (depends on 3)

The method of claim 3, wherein the scaling parameter is adaptively calculated such that the latency of the next pulse falls within one or more of a desired interval and an optimal interval.

### Claim 6 (depends on 3)

The method of claim 3, wherein the function of the generator signal is the absolute value of its argument.

### Claim 7 (depends on 1)

The method of claim 1, further comprising scaling the generator signal using a parameter that is calculated by applying a low-pass filter to a function representative of prior generator signals.

### Claim 8 (depends on 1)

The method of claim 1, further comprising scaling the image signal using a scaling parameter based on a history of the image signal.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining the relative latencies includes determining the latency of a next pulse using a parameter that is calculated from a low-pass filter of a function of the latencies of a plurality of preceding pulses.

### Claim 10 (depends on 1)

The method of claim 1, wherein the function of the generator signal comprises a logarithmic function.

### Claim 11 (depends on 10)

The method of claim 10, further comprising scaling the generator signal using a parameter that is calculated from a history of the image signal.

### Claim 12 (depends on 10)

The method of claim 10, further comprising scaling the generator signal using a parameter that is calculated from a history of the generator signal.

### Claim 13 (depends on 12)

The method of claim 12, wherein the parameter is adaptively calculated such that the latency of the next pulse falls within one or more of a desired interval and an optimal interval.

### Claim 14 (depends on 10)

The method of claim 10, wherein the image signal comprises a plurality of signal channels, and further comprising scaling the image signal using one or more parameters, each parameter calculated using a history of one of the signal channels.

### Claim 15 (depends on 14)

The method of claim 14, wherein at least two of the plurality of signal channels have a common channel parameter, the common channel parameter being calculated using a history of the image signal.

### Claim 16 (depends on 14)

The method of claim 14, wherein the step of scaling the image signal includes adaptively maintaining the image signal within a desired range.

### Claim 17 (depends on 14)

The method of claim 14, wherein the one or more parameters includes a parameter obtained by low-pass filtering a function derived from the image signal.

### Claim 18 (depends on 14)

The method of claim 14, wherein the step of scaling the image signal includes scaling the signal multiplicatively.

### Claim 19 (depends on 14)

The method of claim 14, wherein one of the one or more parameters represents an average of a function derived from the input signal over a time window.

### Claim 20 (depends on 1)

The method of claim 1, wherein the pattern of relative latencies is insensitive to image luminance.

### Claim 21 (depends on 20)

The method of claim 20, further comprising the step of determining latencies associated with the two or more pulses using one or more parameters calculated from a history of the image signal.

### Claim 22 (depends on 20)

The method of claim 20, further comprising the step of determining latencies associated with the two or more pulses by time-shifting the pulses by magnitudes determined by one or more channel parameters.

### Claim 23 (depends on 20)

The method of claim 20, further comprising the steps of:
receiving the pulsed signal from a plurality of channels; and
extracting the information from the pulsed signal by decoding the pattern of relative latencies.

### Claim 24 (depends on 23)

The method of claim 23, wherein the one or more processors include a processor embodied in one or more of a prosthetic device and an autonomous robot.

### Claim 25 (depends on 20)

The method of claim 20, further comprising the step of scaling the generator signal using a parameter that is calculated as the average of a function representing generator signals observed over a certain time period.

### Claim 26

An image processing system comprising:
an input signal representative of an element of an image;
a filter that provides a generator signal based on the input signal;
a processor configured to receive the input signal and to determine relative latencies associated with two or more pulses in a pulsed output signal using a function of the generator signal, wherein latencies of pulses in the pulsed output signal are calculated using a scaling parameter that is calculated from a history of the image signal; and
a plurality of channels that communicate the pulsed output signal, wherein the information is encoded in a pattern of relative pulse latencies between the channels, wherein the pattern of relative pulse latencies is insensitive to changes in at least one of image luminance and image contrast.

### Claim 27 (depends on 26)

The system of claim 26, wherein the scaling parameter corresponds to at least one of the channels.

### Claim 28 (depends on 26)

The system of claim 26, wherein the function of the generator signal comprises a logarithmic function.

### Claim 29 (depends on 28)

The system of claim 28, wherein the logarithmic function is applied to a rectified version of the generator signal, and wherein the logarithmic function has an offset and a base that are optimized to obtain a range of the generator signal that matches the dynamic range of the latency values and the dynamic range of the image signal.

### Claim 30 (depends on 26)

The system of claim 26, wherein the filter is spatially and temporally balanced and characterized by an integral along all dimensions of the filter that is substantially zero.

### Claim 31 (depends on 26)

The system of claim 26, wherein the filter is motion sensitive.

### Claim 32 (depends on 26)

The system of claim 26, wherein the filter is direction sensitive.
