# US 9,438,867 B2 · Digital picture taking optical reader having hybrid monochrome and color image sensor array > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,867 B2 - Document ID: US9438867B2 - Status: Granted - Kind: B2 - Application number: 14/690,653 - Filed: 2015-04-20 - Published: 2016-01-07 - Granted: 2016-09-06 - Earliest claimed: 2005-06-03 - Assignees: Hand Held Products, Inc. - Applicants: Hand Held Products, Inc. - Inventors: Ynjiun Wang - Web page: https://patentgrep.com/patent/US9438867B2 ## CPC - H04N 25/13: characterised by the spectral characteristics of the filter elements - G06K 7/0004: {Hybrid readers} - G06K 7/10722: {Photodetector array or CCD scanning} - G06K 7/14: using light without selection of wavelength, e.g. sensing reflected white light {(G06K7/10831 - G06K7/1097 take precedence)} - H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils - H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters} - H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values} - H04N 25/133: including elements passing panchromatic light, e.g. filters passing white light - H04N 2209/042: having a single pick-up sensor - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS ## Abstract A portable hand held optical reader having a specially constructed two-dimensional image sensor array is operational in a bar code decoding mode and in a picture taking mode. The specially constructed image sensor array, in one embodiment, is a hybrid monochrome and color image sensor pixel array, wherein a first subset of the pixels are monochrome pixels devoid of wavelength selective color filter elements and a second subset of the pixels are color sensitive pixels including wavelength selective color filter elements. ## Claims ### Claim 1 A portable data collection device comprising: (a) an imaging assembly comprising a two-dimensional solid state image sensor array and an imaging lens configured to focus an image onto an active surface of said two-dimensional solid state image sensor array, said two-dimensional solid state image sensor array having a plurality of pixels, said two-dimensional solid state image sensor array being a hybrid monochrome and color sensitive image sensor array constructed such that a first subset of pixels of said image sensor array are monochrome pixels without color filter elements and a second subset of pixels of said image sensor array that are color sensitive pixels, each of which includes a wavelength selective filter element; (b) an operator interface configured to enable selection by an operator between an indicia decode mode of operation and a picture taking mode of operation; (c) wherein said portable data collection device, when said indicia decode mode of operation is selected and a trigger signal is received, is configured to control said solid state image sensor array to obtain a decode frame of image data and is configured to automatically transfer said decode frame of image data to an indicia decode circuit; and (d) wherein said portable data collection device, when said picture taking mode is selected and a trigger signal is received, is configured to control said two-dimensional solid state image sensor array to obtain a visual display color frame of image data, and is configured to automatically output said visual display color frame of image data. ### Claim 2 (depends on 1) The portable data collection device of claim 1, wherein said image sensor array is constructed so that said monochrome pixels are selectively addressable independent of said color sensitive pixels such that image data corresponding to said monochrome pixels are configured to be selectively read out independent of image data corresponding to said color sensitive pixels. ### Claim 3 (depends on 1) The portable data collection device of claim 1, wherein said plurality of pixels are selectively addressable, and wherein said portable data collection device, when in said indicia decode mode, is configured to selectively address said monochrome pixels and is configured to selectively read out image data from said monochrome pixels. ### Claim 4 (depends on 1) The portable data collection device of claim 1, wherein said plurality of pixels are selectively addressable, and wherein said portable data collection device when in said picture taking mode selectively addresses said monochrome pixels and selectively reads out image data from said color sensitive pixels. ### Claim 5 (depends on 1) The portable data collection device of claim 1, wherein said color sensitive pixels of said two-dimensional solid state image sensor array are uniformly distributed throughout said two-dimensional solid state image sensor array. ### Claim 6 (depends on 1) The portable data collection device of claim 1, wherein said image sensor array includes a checkerboard pattern of pixels, and wherein pixels of said color sensitive second subset of pixels are at spaced apart positions of said image sensor array and uniformly or substantially uniformly distributed throughout said image sensor array. ### Claim 7 (depends on 1) The portable data collection device of claim 1, wherein said wavelength selective filter elements of said color sensitive pixels are selected from the group consisting of cyan filter elements and magenta filter elements. ### Claim 8 (depends on 1) The portable data collection device of claim 1, wherein said portable data collection device includes a display device, and wherein said portable data collection device in outputting said frame of image data sends said frame of image data to said display device. ### Claim 9 (depends on 1) The portable data collection device of claim 1, wherein said portable data collection device in outputting said frame of image data in said picture taking mode is configured to output said frame of image data to an output destination selected from the group consisting of a display device, a memory address, or a spaced apart device. ### Claim 10 (depends on 1) The portable data collection device of claim 1, wherein said portable data collection device is configured so that said portable data collection device is both configured to operate in said indicia decode mode and to receive said trigger signal when a single control button of said portable data collection device is actuated. ### Claim 11 (depends on 1) The portable data collection device of claim 1, wherein said image sensor array is configured so that said monochrome pixels can be driven into reset while said color sensitive pixels are exposed for image data read out. ### Claim 12 (depends on 1) The portable data collection device of claim 1, wherein a subset of said plurality of pixels of said two dimensional solid state image sensor array are light polarizing pixels, each of said light polarizing pixels having a light polarizing filter element. ### Claim 13 (depends on 1) The portable data collection device of claim 1, wherein said wavelength selective filter elements are provided in a plurality of different color designations. ### Claim 14 (depends on 1) The portable data collection device of claim 1, wherein said color sensitive pixels include a plurality of pixels having red color filter elements. ### Claim 15 A portable bar code reading device comprising: (a) an imaging assembly including an area solid state image sensor array and an imaging lens focusing an image onto said solid state image sensor array, wherein said solid state image sensor array includes a plurality of color sensitive pixels, each of said plurality of color sensitive pixels having an optically shielded charge storage region and a wavelength selective filter element, wherein said image sensor array is integrated onto an image sensor integrated circuit chip; (b) a memory; (c) circuitry configured to read out image data from said area solid state image sensor array and capture frames of image data into said memory; (d) an operator interface configured to enable selection by an operator between an indicia decode mode of operation and a picture taking mode of operation; (e) wherein said portable bar code reading device is configured so that in response to receipt of a trigger signal with said portable bar code reading device in said indicia decode mode of operation, said portable bar code reading device is configured to obtain a decode frame of image data and transfer said decode frame of image data to a bar code decode circuit; (f) wherein said portable bar code reading device is further configured so that in response to receipt of a trigger signal with said portable bar code reading device in said picture taking mode of operation, said portable bar code reading device is configured to obtain a visual display color frame of image data; and (g) wherein said portable bar code reading device in at least one operating mode is configured to selectively address and selectively read out a windowed frame of image data from a subset of pixels of said area solid state image sensor array, and wherein said portable bar code reading device in at least one operating mode is configured to apply an exposure control timing pulse to said area solid state image sensor array to expose pixels from a plurality of rows of said solid state image sensor array simultaneously. ### Claim 16 (depends on 15) The portable bar code reading device of claim 15, wherein said image area solid state sensor array includes a first subset of pixels each having a first surface area dimension, and a second subset of pixels having a second surface area dimension, said first surface area dimension not equal to said second surface area dimension. ### Claim 17 (depends on 15) The portable bar code reading device of claim 15, wherein a plurality of pixels of said area solid state image sensor array include light polarizing filter elements. ### Claim 18 (depends on 15) The portable bar code reading device of claim 15, wherein a plurality of pixels of said area solid state image sensor array are monochrome pixels without wavelength selective color filter elements, and wherein said portable bar code reading device when obtaining said decode frame of image data is configured to read out monochrome image data from said monochrome pixels of said area solid state image sensor array. ### Claim 19 (depends on 15) The portable bar code reading device of claim 15, wherein said portable bar code reading device is configured so that said portable bar code reading device receives a trigger signal and is driven into said indicia decode mode when a single actuator of said portable bar code reading device is actuated. ### Claim 20 (depends on 15) The portable bar code reading device of claim 15, wherein said wavelength selective filter elements of said plurality of color sensitive pixels include wavelength selective filter elements in a plurality of different color designations. ### Claim 21 (depends on 15) The portable bar code reading device of claim 15, wherein said plurality of color sensitive pixels include pixels having red color filter elements. ### Claim 22 A portable bar code reading device comprising: (a) an imaging assembly comprising a two-dimensional solid state image sensor array and an imaging lens focusing an image onto an active surface of said two-dimensional solid state image sensor array, said two-dimensional solid state image sensor array having a plurality of pixels, said two-dimensional solid state image sensor array being a hybrid monochrome and color sensitive image sensor array constructed such that a first subset of pixels of said image sensor array are monochrome pixels without wavelength selective color filter elements and a second subset of pixels of said two-dimensional solid state image sensor array are color sensitive pixels, each of which includes a wavelength selective color filter element; (b) first circuitry coupled to said imaging assembly configured to transfer image data to a bar code decode circuit; and (c) second circuitry coupled to said imaging assembly configured to obtain a visual display color frame of image data utilizing said two-dimensional solid state image sensor array. ### Claim 23 (depends on 22) The portable bar code reading device of claim 22, wherein said plurality of pixels are selectively addressable, and wherein said portable bar code reading device is configured to, in at least one operating mode, selectively address said monochrome pixels and selectively read out image data from said monochrome pixels. ### Claim 24 (depends on 22) The portable bar code reading device of claim 22, wherein said plurality of pixels are selectively addressable, and wherein said portable bar code reading device is configured to, in at least one operating mode, selectively address said color sensitive pixels and selectively read out image data from said color sensitive pixels. ### Claim 25 (depends on 22) The portable bar code reading device of claim 22, wherein said color sensitive pixels of said two-dimensional solid state image sensor array are uniformly or substantially uniformly distributed throughout said two-dimensional solid state image sensor array at spaced apart pixel positions. ### Claim 26 (depends on 22) The portable bar code reading device of claim 22, wherein said image sensor array is configured so that said monochrome pixels can be driven into reset while said color sensitive pixels are exposed for image data readout. ### Claim 27 (depends on 22) The portable bar code reading device of claim 22, wherein said monochrome pixels of said first subset are smaller dimensioned than said color sensitive pixels of said second subset. ### Claim 28 (depends on 22) The portable bar code reading device of claim 22, wherein said monochrome pixels of said first subset are formed in a monochrome zone of pixels extending at least one complete row of pixels of said solid state image sensor array. ### Claim 29 (depends on 22) The portable bar code reading device of claim 22, wherein a subset of said plurality of pixels of said two dimensional solid state image sensor array are light polarizing pixels, each of said light polarizing pixels having a light polarizing filter element. ### Claim 30 (depends on 22) The portable bar code reading device of claim 22, wherein said wavelength selective color filter elements of said color sensitive pixels include wavelength selective filter elements in a plurality of different color designations. ### Claim 31 (depends on 22) The portable bar code reading device of claim 22, wherein said color sensitive pixels include pixels having red color filter elements. ### Claim 32 A bar code reading device comprising: (a) an imaging assembly including an imaging lens and a solid state image sensor array having a plurality of pixels, said imaging lens focusing an image of a bar code symbol onto said solid state image sensor array, said solid state image sensor array including a first set of reset control lines for controlling a first subset of said plurality of pixels and a second set of reset control lines for use in resetting a second subset of said plurality of pixels, wherein said bar code reading device is configured to operate in a mode in which said bar code reading device resets said first subset of said plurality of pixels without resetting said second subset of said plurality of pixels; (b) wherein said bar code reading device is configured so that in response to receipt of a trigger signal by said bar code reading device, said bar code reading device is configured to obtain a decode frame of image data and transfer said decode frame to an indicia decode circuit. ### Claim 33 (depends on 32) The bar code reading device of claim 32, wherein said bar code reading device is configured to operate in a mode in which said bar code reading device is configured to expose selectively addressed pixels of said second subset of said plurality of pixels for read out of said second subset of said plurality of pixels while resetting said first subset of said plurality of pixels. ### Claim 34 (depends on 32) The bar code reading device of claim 32, wherein said solid state image sensor array includes a plurality of color sensitive pixels having wavelength selective filter elements and a plurality of monochrome pixels without wavelength selective filter elements. ### Claim 35 (depends on 32) The bar code reading device of claim 32, wherein said solid state image sensor array includes a plurality of light polarizing pixels, each of said light polarizing pixels having a light polarizing filter element. ### Claim 36 A portable optical reader having a plurality of user-selectable operating modes including an indicia decode mode of operation and a picture taking mode of operation, said portable optical reader comprising: (a) an imaging assembly having a two-dimensional solid state image sensor array and an imaging lens focusing an image onto an active surface of said two-dimensional solid state image sensor array, said two-dimensional solid state image sensor array having a plurality of pixels, said two-dimensional solid state image sensor array being constructed such that a first subset of said plurality of pixels have a first transistor count, and a second subset of said plurality of pixels have a second transistor count, and wherein said first transistor count is different from said second transistor count; (b) an operator interface configured to enable selection by an operator between an indicia decode mode of operation and a picture taking mode of operation; (c) wherein said portable optical reader is configured to, when operating in said decode mode, control said two-dimensional solid state image sensor array to obtain a frame of image data and automatically transfer said frame of image data to an indicia decode circuit; and (d) wherein said portable optical reader is configured to, when operating in said picture taking mode, control said solid state two-dimensional image sensor array to obtain a visual display color frame of image data, and automatically output said frame of image data to an output destination selected from the group consisting of a display device a memory address location or a spaced apart device. ### Claim 37 (depends on 36) The portable optical reader of claim 36, wherein said pixels of said second subset of said plurality of pixels having said smaller transistor count are color sensitive pixels including wavelength selective color filters. ### Claim 38 (depends on 36) The portable optical reader of claim 36, wherein said pixels of said second subset of said plurality of pixels having said smaller transistor count are color sensitive pixels including wavelength selective color filters, said wavelength selective filters being selected from the group consisting of cyan filters and magenta filters. ### Claim 39 A multimode portable optical reader having an indicia decode mode of operation and a picture taking mode of operation, said portable optical reader comprising: (a) an imaging assembly having a two-dimensional solid state image sensor array and an imaging lens focusing an image onto an active surface of said two-dimensional solid state image sensor array, said two-dimensional solid state image sensor array having a plurality of pixels, said two-dimensional solid state image sensor array being constructed such that a first subset of said plurality of pixels consume a first larger surface area, and a second subset of said plurality of pixels consume a second smaller surface area that is smaller relative a surface area consumed by said pixels of said first subset of said plurality of pixels; (b) an operator interface configured to enable selection by an operator between an indicia decode mode of operation and a picture taking mode of operation; (c) wherein said portable optical reader is configured to, when said indicia decode mode of operation is selected and a trigger signal is received, control said two-dimensional solid state image sensor array to capture a frame of image data and automatically transfer said frame of image data to an indicia decode circuit; (d) wherein said portable optical reader is configured to, when said picture taking mode is selected and a trigger signal is received, control said two-dimensional solid-state image sensor array to capture a frame of image data, and automatically output said frame of image data. ### Claim 40 (depends on 39) The portable optical reader of claim 39, wherein said pixels of said second subset of said plurality of pixels having said smaller surface area are color sensitive pixels including wavelength selective color filters. ### Claim 41 (depends on 39) The portable optical reader of claim 39, wherein said pixels of said second subset of said plurality of pixels having said smaller surface area are color sensitive pixels including wavelength selective color filters, said wavelength selective filters being selected from the group consisting of cyan filters and magenta filters. ### Claim 42 A portable bar code reading device comprising: (a) a solid state area image sensor array including a first subset of selectively addressable monochrome pixels being devoid of wavelength selective filter elements and a second subset of color sensitive pixels including wavelength selective filter elements, the monochrome pixels being formed in a monochrome zone of pixels, wherein the monochrome pixels of the monochrome zone of pixels define a line of pixels: (b) an imaging lens focusing an image onto said solid state area image sensor array; (c) a trigger; (d) a control circuit communicatively coupled to said solid state area image sensor array and said trigger; (e) wherein said control circuit is configured to operate in a mode of operation in which said control circuit is configured to selectively read out a decode frame of image data from said monochrome zone of pixels and automatically transfer said decode frame of image data to a bar code decoding indicia decode circuit. ### Claim 43 (depends on 42) The portable bar code reading device of claim 42 wherein said line of pixels comprises pixels of a horizontal row of pixels. ### Claim 44 (depends on 42) The portable bar code reading device of claim 42, wherein said line of pixels comprises pixels from at least one of a top or bottom of said solid state area image sensor array. ### Claim 45 (depends on 42) The portable bar code reading device of claim 42, wherein said line of pixels comprise pixels from at least one row of pixels at or approximately at a center of said solid state area image sensor array. ### Claim 46 (depends on 42) The portable bar code reading device of claim 42, wherein said wavelength selective filter elements of said color sensitive pixels include wavelength selective filter elements in a plurality of different color designations. ### Claim 47 (depends on 42) The portable bar code reading device of claim 42, wherein said color sensitive pixels include pixels having red color filter elements.