# US 11,122,223 B2 · Imaging element, imaging apparatus, image data processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,223 B2 - Document ID: US11122223B2 - Status: Granted - Kind: B2 - Application number: 17/176,176 - Filed: 2021-02-15 - Published: 2021-06-03 - Granted: 2021-09-14 - Earliest claimed: 2018-08-31 - Assignees: FUJIFILM Corporation - Applicants: Fujifilm Corporation - Inventors: Ryo Hasegawa; Tomoyuki Kawai; Hitoshi Sakurabu - Web page: https://patentgrep.com/patent/US11122223B2 ## CPC - G06T 7/254: involving subtraction of images - H04N 25/42: by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - H04N 25/40: Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled - H04N 25/445: by skipping some contiguous pixels within the read portion of the array - H04N 25/771: comprising storage means other than floating diffusion - H04N 25/78: Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters - H04N 25/79: Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors - G06T 2207/10016: Video; Image sequence - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An imaging element includes a reading circuit, a memory that is capable of storing read captured image data, and an output circuit that outputs output image data based on the captured image data to an outside, in which the reading circuit reads out the captured image data using a first reading method or a second reading method having a smaller read data amount than the first reading method, in a case of the first reading method, a first frame rate corresponds to a second frame rate, in a case of the second reading method, the first frame rate is a frame rate lower than in the case of the first reading method, and the first and second reading methods are switched in accordance with a motion of a subject. ## Claims ### Claim 1 An imaging element comprising: a reading circuit that reads out, from a photoelectric conversion element, captured image data obtained by imaging a subject by the photoelectric conversion element and is incorporated in the imaging element; a memory that is capable of storing the captured image data read out from the photoelectric conversion element by the reading circuit and is incorporated in the imaging element; and an output circuit that outputs output image data based on the captured image data stored in the memory to an outside of the imaging element and is incorporated in the imaging element, wherein the output circuit outputs the output image data to the outside at a first frame rate, the reading circuit reads out the captured image data from the photoelectric conversion element at a second frame rate, the reading circuit reads out the captured image data from the photoelectric conversion element using a first reading method or a second reading method having a smaller read data amount than the first reading method, in a case of the first reading method, the first frame rate is a frame rate corresponding to the second frame rate, and in a case of the second reading method, the first frame rate is a frame rate lower than in the case of the first reading method, and the first reading method and the second reading method are switched in accordance with a detection result of a detection circuit that detects a motion of the subject. ### Claim 2 (depends on 1) The imaging element according to claim 1, wherein the memory is capable of storing the captured image data in a plurality of frames adjacent in imaging timing. ### Claim 3 (depends on 2) The imaging element according to claim 2, wherein the detection circuit detects the motion of the subject based on the captured image data of the plurality of frames stored in the memory. ### Claim 4 (depends on 1) The imaging element according to claim 1, wherein the first frame rate is changed in accordance with switching between the first reading method and the second reading method. ### Claim 5 (depends on 1) The imaging element according to claim 1, wherein the second frame rate is fixed regardless of switching between the first reading method and the second reading method. ### Claim 6 (depends on 1) The imaging element according to claim 1, wherein in the second reading method, one frame of the captured image data is a thinned image frame in which pixels are thinned out compared to a case where the subject is imaged by the photoelectric conversion element under a predetermined imaging condition. ### Claim 7 (depends on 1) The imaging element according to claim 1, wherein in a case where the captured image data is read out by the reading circuit using the second reading method, the captured image data is a plurality of thinned image frames in which pixels are thinned out compared to a case where the subject is imaged by the photoelectric conversion element under a predetermined imaging condition, and in which the pixels at different locations are thinned out, and the output image data is image data obtained by combining the plurality of thinned image frames. ### Claim 8 (depends on 6) The imaging element according to claim 6, wherein in the second reading method, the subject is imaged by the photoelectric conversion element in a state where the pixels are thinned out. ### Claim 9 (depends on 6) The imaging element according to claim 6, wherein in the second reading method, the reading circuit reads out the captured image data from the photoelectric conversion element in a state where the pixels are thinned out. ### Claim 10 (depends on 1) The imaging element according to claim 1, wherein in the second reading method, the captured image data is a plurality of pieces of thinned image data obtained by thinning out pixels at different locations for each frame, the memory stores the plurality of pieces of thinned image data, and the detection circuit detects the motion of the subject based on the plurality of pieces of thinned image data stored in the memory. ### Claim 11 (depends on 1) The imaging element according to claim 1, wherein the first reading method is used in a case where the motion of the subject is detected by the detection circuit, and the second reading method is used in a case where the motion of the subject is not detected by the detection circuit. ### Claim 12 (depends on 1) The imaging element according to claim 1, further comprising: the detection circuit. ### Claim 13 (depends on 1) The imaging element according to claim 1, wherein the imaging element is a laminated imaging element that includes the photoelectric conversion element and in which the photoelectric conversion element is laminated with the memory. ### Claim 14 (depends on 1) An imaging apparatus comprising: the imaging element according to claim 1; and a control portion that performs a control for displaying, on a display portion, an image based on the output image data output by the output circuit included in the imaging element. ### Claim 15 An image data processing method for an imaging element incorporating a reading circuit that reads out, from a photoelectric conversion element, captured image data obtained by imaging a subject by the photoelectric conversion element, a memory that is capable of storing the captured image data read out from the photoelectric conversion element by the reading circuit, and an output circuit that outputs output image data based on the captured image data stored in the memory to an outside of the imaging element, the image data processing method comprising: outputting the output image data to the outside at a first frame rate by the output circuit included in the imaging element; reading out the captured image data from the photoelectric conversion element at a second frame rate by the reading circuit; reading out the captured image data from the photoelectric conversion element using a first reading method or a second reading method having a smaller read data amount than the first reading method by the reading circuit; in a case of the first reading method, setting the first frame rate to a frame rate corresponding to the second frame rate; in a case of the second reading method, setting the first frame rate to a frame rate lower than in the case of the first reading method; and switching between the first reading method and the second reading method in accordance with a detection result of a detection circuit that detects a motion of the subject. ### Claim 16 A non-transitory computer-readable storage medium storing a program for an imaging element incorporating a reading circuit that reads out, from a photoelectric conversion element, captured image data obtained by imaging a subject by the photoelectric conversion element, a memory that is capable of storing the captured image data read out from the photoelectric conversion element by the reading circuit, and an output circuit that outputs output image data based on the captured image data stored in the memory to an outside of the imaging element, the program for causing a computer to function as the reading circuit and the output circuit, wherein the output circuit outputs the output image data to the outside at a first frame rate, the reading circuit reads out the captured image data from the photoelectric conversion element at a second frame rate, the reading circuit reads out the captured image data from the photoelectric conversion element using a first reading method or a second reading method having a smaller read data amount than the first reading method, in a case of the first reading method, the first frame rate is a frame rate corresponding to the second frame rate, and in a case of the second reading method, the first frame rate is a frame rate lower than in the case of the first reading method, and the first reading method and the second reading method are switched in accordance with a detection result of a detection circuit that detects a motion of the subject.