# US 12,003,845 B2 · Sensor apparatus having array sensor for sensor-equipped device, sensor equipped device provided with sensor apparatus having array sensor, and contol method for sensor apparatus having array sensor for sensor-equipped device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,003,845 B2 - Document ID: US12003845B2 - Status: Granted - Kind: B2 - Application number: 17/912,063 - Filed: 2021-02-15 - Published: 2023-04-13 - Granted: 2024-06-04 - Earliest claimed: 2020-03-31 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Susumu Takatsuka; Hiroki Tetsukawa - Web page: https://patentgrep.com/patent/US12003845B2 ## CPC - G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining - H04N 23/61: based on recognised objects - G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) - G06V 10/764: using classification, e.g. of video objects - G06V 10/82: using neural networks - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - H04N 23/60: Control of cameras or camera modules - H04N 23/611: where the recognised objects include parts of the human body - H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image} - H04N 23/65: Control of camera operation in relation to power supply - H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes - H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A sensor apparatus includes an array sensor in which a plurality of detection elements are arranged one-dimensionally or two-dimensionally, a signal processing unit which performs signal processing on a detected signal obtained by the array sensor, and an arithmetic operation unit which performs object detection from the detected signal obtained by the array sensor, performs operation control of the signal processing unit based on object detection, and performs switching processing for changing processing contents based on device information input from a sensor-equipped device on which the sensor apparatus is mounted. ## Claims ### Claim 1 A sensor apparatus comprising: an array sensor in which a plurality of detection elements are arranged one-dimensionally or two-dimensionally; signal processing circuitry configured to perform signal processing on a detected signal obtained by the array sensor; and arithmetic operation circuitry configured to perform object detection from the detected signal obtained by the array sensor, to perform operation control of the signal processing circuitry based on the object detection, and to perform switching processing for changing processing contents of the signal processing circuitry based on device information input from a sensor-equipped device on which the sensor apparatus is mounted, wherein the arithmetic operation circuitry is further configured to identify a class of an object detected from the detected signal obtained by the array sensor and, to select parameters used for the signal processing on the detected signal by the signal processing circuitry based on the class of the object, as processing related to the switching processing, the class of the object representing a category of the object recognized by image recognition of the object. ### Claim 2 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to perform processing for generating sensor operation information based on the object detection or the processing operation of the signal processing circuitry, and to transmit the generated sensor operation information to the sensor-equipped device. ### Claim 3 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to perform the switching processing based on previously registered registration information on the sensor-equipped device or registration information as operation switching conditions. ### Claim 4 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to acquire power supply information as the device information. ### Claim 5 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to acquire communication status information as the device information. ### Claim 6 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to acquire information on a hardware or application of the sensor-equipped device as the device information. ### Claim 7 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to perform the object detection from the detected signal obtained by the array sensor and to give an instruction for region information generated based on the object detection to the signal processing circuitry as region information relating to acquisition of the detected signal from the array sensor or signal processing of the detected signal, as processing related to the switching processing. ### Claim 8 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to perform the object detection from the detected signal obtained by the array sensor, to give an instruction for region information generated based on the object detection to the signal processing circuitry as region information relating to acquisition of the detected signal from the array sensor or signal processing of the detected signal, and generating region information corresponding to the object using a template corresponding to the class of the object, as processing related to the switching processing. ### Claim 9 (depends on 8) The sensor apparatus according to claim 8, wherein the arithmetic operation circuitry is further configured to set threshold values for all or some of the parameters used for the signal processing on the detected signal by the signal processing circuitry or used for detection processing of the array sensor, and to set parameters of processing for region information indicated by the template based on the threshold values, as processing related to the switching processing. ### Claim 10 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to perform the object detection from the detected signal obtained by the array sensor and to give an instruction for region information generated based on the object detection to the signal processing circuitry as region information relating to acquisition of the detected signal from the array sensor or signal processing of the detected signal, as processing related to the switching processing, and the signal processing circuitry is further configured to perform compression processing at a compression ratio different for each region on the detected signal obtained by the array sensor based on the region information received from the arithmetic operation circuitry. ### Claim 11 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to set an active area for the detected signal acquired from the array sensor based on information on past region information, to perform the object detection from a detected signal of the active area, and to give an instruction for region information generated based on the object detection to the signal processing circuitry as region information relating to acquisition of the detected signal from the array sensor or signal processing of the detected signal, as processing related to the switching processing. ### Claim 12 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to perform the object detection from the detected signal obtained by the array sensor and to give an instruction for changing a frame rate of the detected signal obtained by the array sensor based on the object detection, as processing related to the switching processing. ### Claim 13 (depends on 12) The sensor apparatus according to claim 12, wherein the arithmetic operation circuitry is further configured to set a threshold value of the frame rate in accordance with the class of the object detected from the detected signal obtained by the array sensor, and to perform the signal processing using a frame rate set based on the threshold value, as processing related to the switching processing. ### Claim 14 (depends on 1) The sensor apparatus according to claim 1, wherein the arithmetic operation circuitry is further configured to set, based on the device information, a threshold value for all or some of the parameters used for the signal processing on the detected signal by the signal processing circuitry or used for detection processing of the array sensor, and to perform the signal processing using parameters set based on the threshold value, as processing related to the switching processing. ### Claim 15 A sensor apparatus comprising: an array sensor in which a plurality of detection elements are arranged one-dimensionally or two-dimensionally; signal processing circuitry configured to perform signal processing on a detected signal obtained by the array sensor; and arithmetic operation circuitry configured to perform object detection from the detected signal obtained by the array sensor, to perform operation control of the signal processing circuitry based on the object detection, and to perform switching processing for changing processing contents of the signal processing circuitry based on device information input from a sensor-equipped device on which the sensor apparatus is mounted, wherein the arithmetic operation circuitry is further configured to identify a class of an object detected from the detected signal obtained by the array sensor and, to select parameters used for the signal processing on the detected signal by the signal processing circuitry based on the class of the object, as processing related to the switching processing, the class of the object representing a category of the object recognized by image recognition of the object, and the arithmetic operation circuitry is further configured to set, based on the device information, a threshold value for all or some of the parameters used for the signal processing on the detected signal by the signal processing circuitry or detection processing of the array sensor, and to perform the signal processing using parameters set based on the threshold value, as processing related to the switching processing. ### Claim 16 A sensor-equipped device comprising: a sensor apparatus; and control circuitry configured to communicate with the sensor apparatus, wherein the sensor apparatus includes an array sensor in which a plurality of detection elements are arranged one-dimensionally or two-dimensionally, signal processing circuitry configured to perform signal processing on a detected signal obtained by the array sensor, and arithmetic operation circuitry configured to perform object detection from the detected signal obtained by the array sensor, to perform operation control of the signal processing circuitry based on the object detection, and to perform switching processing of operation setting of the signal processing circuitry based on device information input from the control circuitry, and further wherein the arithmetic operation circuitry is further configured to identify a class of an object detected from the detected signal obtained by the array sensor and to select parameters used for the signal processing on the detected signal by the signal processing circuitry based on the class of the object, as processing related to the switching processing, the class of the object representing a category of the object recognized by image recognition of the object. ### Claim 17 (depends on 16) The sensor-equipped device according to claim 16, wherein the arithmetic operation circuitry is further configured to perform processing for generating sensor operation information based on a state of the signal processing of the signal processing circuitry or a state of the object detection and to transmit the sensor operation information to the control circuitry, and the control circuitry is further configured to control a device operation based on the sensor operation information. ### Claim 18 A processing method executed by a sensor apparatus including an array sensor in which a plurality of detection elements are arranged one-dimensionally or two-dimensionally, and a signal processing circuitry configured to perform signal processing on a detected signal obtained by the array sensor, the processing method comprising: performing object detection from the detected signal obtained by the array sensor; performing operation control of the signal processing circuitry based on the object detection; performing switching processing for changing processing contents of the signal processing circuitry based on device information input from a sensor-equipped device on which the sensor apparatus is mounted; identifying a class of an object detected from the detected signal obtained by the array sensor, the class of the object representing a category of the object recognized by image recognition of the object; and selecting parameters used for the signal processing on the detected signal by the signal processing circuitry based on the class of the object, as processing related to the switching processing.