# US 2014/0193066 A1 · Contrast enhancement spiking neuron network sensory processing apparatus and methods > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0193066 A1 - Document ID: US20140193066A1 - Status: Published application - Kind: A1 - Application number: 13/710,042 - Filed: 2012-12-10 - Published: 2014-07-10 - Earliest claimed: 2012-12-10 - Assignees: Brain Corporation - Inventors: Micah Richert - Web page: https://patentgrep.com/patent/US20140193066A1 ## CPC - G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining - G06N 3/049: Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs - G06V 10/451: {with interaction between the filter responses, e.g. cortical complex cells} - G06V 10/955: {using specific electronic processors} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Apparatus and methods for contrast enhancement and feature identification. In one implementation, an image processing apparatus utilizes latency coding and a spiking neuron network to encode image brightness into spike latency. The spike latency is compared to a saliency window in order to detect early responding neurons. Salient features of the image are associated with the early responding neurons. A inhibitory neuron receives salient feature indication and provides inhibitory signal to the other neurons within an area of influence of the inhibitory neuron. The inhibition signal reduces probability of responses by the other neurons to stimulus that is proximate to the feature thereby increasing contrast within the encoded data. The contrast enhancement may facilitate feature identification within the image. Feature detection may be used for example for image compression, background removal and content distribution. ## Claims ### Claim 1 A computerized apparatus comprising a plurality of computer-readable instructions configured to, when executed, detect an object in a sensory input by at least: based on at least one feed-forward signal, generating an inhibitory signal configured to suppress generation of a secondary feed-forward signal, thereby enabling the object detection; wherein: the at least one feed-forward signal comprises one or more pulses generated based on a portion of the sensory input comprising a representation of the object; the secondary signal corresponds to a portion of the sensory input proximate the object representation; and the representation of the object being characterized by a parameter having a value that is different from the parameter value associated with the portion of the sensory input. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein: the sensory input comprises an image comprising the representation of the object; the feed-forward signal comprises one or more pulses having first range of latencies associated therewith; and the secondary feed-forward signal is configured based on a second range of latencies, latencies within the second range being greater than latencies within the first range. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein: the parameter is configured to characterize luminance of pixels within the image; and individual latencies within the first range of latencies are encoded based on a logarithmic function of the pixel luminance. ### Claim 4 (depends on 2) The apparatus of claim 2, wherein the inhibition indication is effectuated at least by an inhibition trace, the inhibition trace being incremented responsive to an occurrence of a pulse latency of the first plurality of pulses, the second plurality of pulses being within the latency window. ### Claim 5 (depends on 2) The apparatus of claim 2, wherein: the one or more pulses comprise first and second pulses associated with first and second pixels, respectively, each characterized by a pixel luminance being within the object luminance range; and a pixel luminance of the portion of the image is outside the object luminance range. ### Claim 6 (depends on 2) The apparatus of claim 2, wherein: the inhibition signal is generated based on another feed-forward signal being generated based on another image comprising another representation of the object, the another image preceding the image; and a time interval between the image and the another image is greater than the first range. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein: the sensory input comprises an image comprising the representation of the object; the inhibitory signal is configured to transform the image into a spiking representation comprising the at least one feed-forward signal; the inhibitory signal is characterized by an inhibition area within the image; the representation of the object is characterized by an object area; and the spiking representation is characterized by absence of spikes corresponding to pixels of the image that are outside the object area and within the inhibition area. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein: the sensory input comprises two or more frames characterized by an inter-frame interval, individual ones of the two or more frames comprising a representation of the object and an object surrounding area; and the suppression of the generation of the secondary feed-forward signal is characterized by an absence of spikes associated with the pixels within the object surrounding area during at least two inter-frame intervals. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein: the sensory input comprises two or more frames characterized by an inter-frame interval, individual ones of the two or more frames comprising a representation of the object and an object surrounding area; and the suppression of the generation of the secondary feed-forward signal is configured to reduce number of spikes associated with the pixels within the object surrounding area during at least two inter-frame intervals. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein: the sensory input comprises first and second frames characterized by an inter-frame interval, individual ones of the first and the second frames comprising first and second representation of the object, respectively, and a representation of a surrounding area; at least one feed-forward signal comprises first feed-forward signal and second feed-forward signal generated based on the first and the second representation, respectively; the inhibition signal is configured based on the first and second feed-forward signal. ### Claim 11 A computerized method of increasing a contrast of an image comprising a plurality of pixels using at least a spiking neuron network, the method comprising: based on a feed-forward stimulus representative of an object within the image, generating a spike output by one or more excitatory neurons of the network; and based on the spike output, generating an inhibitory signal by an inhibitory neuron; wherein: individual ones of the plurality of pixels are characterized by a pixel parameter; the object is characterized by at least: (i) an object spatial extent having an object pixel parameter associated therewith, and (ii) a surround spatial extent having a surround pixel parameter associated therewith, the surround parameter being different from the object parameter; and the inhibitory signal is configured to suppress surround spike output associated with pixels within the surround spatial extent, thereby effectuating the contrast increase. ### Claim 12 (depends on 11) The method of claim 11, wherein the pixel parameter comprises a pixel brightness range, and the inhibitory signal is configured to increase a difference between network response to pixels of the plurality of pixels within the object spatial extent and pixels within the surround spatial extent. ### Claim 13 (depends on 11) The method of claim 11, wherein: the pixel parameter comprises pixel color; the object pixel parameter corresponds to a first color; and the surround pixel parameter corresponds to a second color being different from the first color. ### Claim 14 (depends on 11) The method of claim 11, wherein: the inhibitory neuron is characterized by an area of influence corresponding to an area of the image, the area of influence spatially overlapping the surround area; and the inhibition signal is configured suppress spiking output based on pixels of the plurality of pixels within the area of influence. ### Claim 15 (depends on 11) The method of claim 11, further comprising, based on another feed-forward stimulus representative of another object within the image, generating a spike output by another one or more excitatory neurons of the network; wherein the another object is characterized by another object spatial extent having another object pixel parameter associated therewith; the another object spatial extent is configured to be non-overlapping the surround spatial extent; and the another object pixel parameter and the surround pixel parameter fall in a parameter value range from the object pixel parameter. ### Claim 16 (depends on 15) The method of claim 15, wherein a difference between the another object pixel parameter and the surround pixel parameter is smaller in value as compared to a difference between the another object pixel parameter and the object pixel parameter. ### Claim 17 (depends on 11) The method of claim 11, wherein the suppression of the surround spike output is configured based at least in part on a number of spikes in the spike output. ### Claim 18 A spiking neuron network sensory processing system, comprising: a plurality of excitatory neurons configured to encode sensory stimulus into a plurality of pulses; and at least one inhibitory neuron configured to provide an inhibitory indication to at least a portion of the plurality of excitatory neurons via one or more inhibitory connections; and wherein: the inhibitory indication is based at least in part on two or more of the plurality of pulses being received by the at least one inhibitory neuron over one or more feed-forward connections; and the inhibitory indication is configured to prevent at least one neuron within the portion from generating a response during a stimulus interval subsequent to the provision of the inhibitory indication. ### Claim 19 (depends on 18) The system of claim 18, wherein: the sensory stimulus comprises two or more frames of pixels, at least one of the two or more frames comprising a representation of an object; individual ones of the two or more frames comprised of pixels characterized by a parameter; and the inhibitory indication is being generated based on pixel parameter within the representation of the object being different from pixel parameter outside the object representation. ### Claim 20 (depends on 18) The system of claim 18, wherein: the inhibitory indication is characterized by an inhibition trace, the inhibition trace configured to be: incremented responsive to the receipt of the two or more of the plurality of pulses; decayed with time subsequent to the increment; and wherein the suppression of the pulse generation is based at least in part on a value of the trace exceeding an inhibitory threshold. ### Claim 21 (depends on 18) The system of claim 18, wherein: the feed-forward sensory stimulus comprises a background portion comprising uncorrelated sensory input component; the feed-forward sensory stimulus farther comprises a coherent signal component; the plurality of pulses constitute an encoded input; and the inhibitory indication is capable of preventing the uncorrelated sensory input component from being encoded into the plurality of pulses, thereby effectuating an increased signal-to-noise ratio of the encoded input.