# US 11,308,991 B2 · Image capture device, recording device, and display control device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,991 B2 - Document ID: US11308991B2 - Status: Granted - Kind: B2 - Application number: 16/943,863 - Filed: 2020-07-30 - Published: 2020-11-12 - Granted: 2022-04-19 - Earliest claimed: 2018-02-16 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Hidenobu Akiyoshi; Toru Kobayashi; Akihiro Tanabe - Web page: https://patentgrep.com/patent/US11308991B2 ## CPC - G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)} - G11B 20/12: Formatting, e.g. arrangement of data block or words on the record carriers {(within interface between computers and data recorders G06F3/06)} - G11B 20/00007: {Time or data compression or expansion (audio compression based on psychoacoustics G10L19/00; data processing for reproducing audio data at different playback speeds G10L21/04; video compression H04N19/00; data compression per se H03M7/30)} - G11B 20/1217: {on discs} - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/326: {used signal is a video-frame or a video-field (P.I.P.)} - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 5/91: Television signal processing therefor - H04N 9/8042: {involving data reduction} - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/85: using pre-processing or post-processing specially adapted for video compression - H04N 23/80: Camera processing pipelines; Components thereof - G11B 2020/00072: {the compressed signal including a video signal} - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/433: Content storage operation, e.g. storage operation in response to a pause request, caching operations - H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image capture device for recording HDR (high dynamic range) image data obtained through image capture performs control so as to, when encoding HDR image data obtained by capturing an image with an image sensor, divide part of the HDR image data corresponding to a coding area to be encoded into a plurality of divided HDR image data, encode each of the plurality of divided HDR image data by using encoding means, and record the plurality of divided HDR image data that are encoded on a recording medium in a predetermined recording format. ## Claims ### Claim 1 An image capture device for recording HDR (high dynamic range) image data obtained through image capture, comprising: an image sensor; a memory and at least one processor which functions as: encoding means for encoding HDR image data obtained by capturing an image data with the image sensor; and recording control means for dividing a part of the HDR image data captured by the image sensor, corresponding to a coding area to be encoded, into a plurality of divided HDR image data, encoding each of the divided HDR image data by using the encoding means, and recording the plurality of encoded divided HDR image data on a recording medium in a predetermined recording format, wherein the recording control means performs control to record, as a single image file, the plurality of divided HDR image data that are encoded on the recording medium in the predetermined recording format, and wherein the recording control means performs control to record, as a derived image item, image structure information which is used to combine the plurality of divided HDR image data into HDR image data before being divided in the single image file together with the plurality of divided HDR image data. ### Claim 2 (depends on 1) The image capture device according to claim 1, wherein the encoding means compression-encodes the plurality of divided HDR image data in accordance with the HEVC (High Efficiency VideoCoding) standard. ### Claim 3 (depends on 1) The image capture device according to claim 1, wherein the predetermined recording format is HEIF (High Efficiency Image File Format). ### Claim 4 (depends on 3) The image capture device according to claim 3, wherein the recording control means performs control so as to record each of the plurality of divided HDR image data as an image item of the HEIF standard and record the image structure information used to combine the plurality of divided HDR image data into the HDR image data before being divided as the derived image item of the HEIF standard. ### Claim 5 (depends on 4) The image capture device according to claim 4, wherein the recording control means performs control to record the HDR image data constituted by the plurality of divided HDR image data in an overlay format by recording location information regarding each of the plurality of divided HDR image data as the image structure information such that a location relationship is that the plurality of divided HDR image data are arranged to correspond to the coding area. ### Claim 6 (depends on 5) The image capture device according to claim 5, wherein the recording control means records, as the image item, each of the plurality of divided HDR image data while adding, to the divided HDR image data, hidden information that indicates a hidden image item, and wherein the recording control means does not add the hidden information to the overlay information. ### Claim 7 (depends on 4) The image capture device according to claim 4, wherein the recording control means performs control to record the HDR image data constituted by the plurality of divided HDR image data in a grid format. ### Claim 8 (depends on 1) The image capture device according to claim 1, wherein when capturing and recording the HDR image data, the recording control means performs control to divide the HDR image data corresponding to the coding area that is larger than a playback area to be played back into a plurality of divided HDR image data, encode each of the plurality of divided HDR image data by using the encoding means, and record the plurality of divided HDR image data that are encoded in the predetermined recording format. ### Claim 9 (depends on 8) The image capture device according to claim 8, wherein the at least one processor further function as: setting means for setting a recording size, wherein the recording control means determines the playback area and the coding area in accordance with the recording size set by the setting means, and wherein the size of the playback area is a size of an area corresponding to the set recording size. ### Claim 10 (depends on 8) The image capture device according to claim 8, wherein the recording control means determines the coding area on the basis of the playback area, a readout startable location and a readout endable location of the image data captured by the image sensor. ### Claim 11 (depends on 8) The image capture device according to claim 8, wherein the predetermined recording format is a format capable of specifying an area to be played back, and wherein the recording control means specifies the playback area smaller than the coding area to be recorded as an area to be played back. ### Claim 12 (depends on 8) The image capture device according to claim 8, wherein when a coding area to be encoded by the encoding means is set in the image data captured by the image sensor, a predetermined constraint is imposed. ### Claim 13 (depends on 12) The image capture device according to claim 12, wherein encoding startable and endable locations are predetermined in the image data captured by the image sensor, and encoding is not allowed to start and end at locations other than the encoding startable and endable locations, respectively. ### Claim 14 (depends on 1) The image capture device according to claim 1, wherein the recording control means performs control to encode thumbnail image data corresponding to the HDR image data in a playback area by using the encoding means and record, as the single image file, the encoded thumbnail image data in the predetermined recording format together with the plurality of divided HDR image data that are encoded. ### Claim 15 (depends on 1) The image capture device according to claim 1, wherein when recording an HDR image data, the recording control means performs control to divide the HDR image data captured by the image sensor into a plurality of divided HDR image data, compression-encode each of the plurality of divided HDR image data into an HEVC (High Efficiency VideoCoding) format by using the encoding means, and record, in the predetermined recording format, the plurality of divided HDR image data that are compression-encoded, and wherein when recording an SDR image data, the recording control means performs control to compression-encode the SDR image data captured by the image sensor in a JPEG format without dividing the SDR image data into a plurality of SDR image data and record the SDR image data as a JPEG file. ### Claim 16 (depends on 1) The image capture device according to claim 1, wherein the HDR image data is a 10-bit image in a bit depth. ### Claim 17 A method for controlling an image capture device, the image capture device including an image sensor for capturing an image data and recording HDR (high dynamic range) image data obtained through image capture, the method comprising: dividing a part of the HDR image data captured by the image sensor corresponding to a coding area to be encoded into a plurality of divided HDR image data; encoding each of the plurality of divided HDR image data by using the encoding means; and recording, as a single image file, the plurality of encoded divided HDR image data on a recording medium in a predetermined recording format, wherein, in the recording, image structure information which is used to combined the plurality of divided HDR image data into HDR image data before being divided is recorded as a derived image item in the single image file together with the plurality of divided HDR image data. ### Claim 18 (depends on 17) A non-transitory computer-readable recording medium storing a program for causing a computer to perform the method for controlling an image capture device according to claim 17. ### Claim 19 An image capture device for recording HDR (high dynamic range) image data obtained through image capture, comprising: an image sensor; a memory and at least one processor which function as: encoding means for encoding HDR image data obtained by capturing an image data with the image sensor; and recording control means for dividing a part of the HDR image data captured by the image sensor, corresponding to a coding area to be encoded, into a plurality of divided HDR image data, encoding each of the divided HDR image data by using the encoding means, and recording the plurality of encoded divided HDR image data on a recording medium in a predetermined recording format, wherein when recording an HDR image data, the recording control means performs control to divide the HDR image data captured by the image sensor into the plurality of divided HDR image data, compression-encode each of the plurality of divided HDR image data into an HEVC (High Efficiency VideoCoding) format by using the encoding means, and record, in the predetermined recording format, the plurality of divided HDR image data that are compression-encoded, and wherein when recording an SDR image data, the recording control means performs control to compression-encode the SDR image data obtained by capturing an image data with the image sensor in a JPEG format without dividing the SDR image data into a plurality of the SDR image data and record the compression-encoded SDR image data as a JPEG file. ### Claim 20 (depends on 19) The image capture device according to claim 19, wherein, when recording the HDR image data, the recording control means determines whether or not to divide the HDR image data into the plurality of divided HDR image data in accordance with a size of the HDR image data to be recorded, and when recording the SDR image data, the recording control means records the SDR image data without dividing the SDR image data into the plurality of data. ### Claim 21 (depends on 20) The image capture device according to claim 20, wherein the size of the HDR image data is determined in response to an instruction from a user. ### Claim 22 (depends on 20) The image capture device according to claim 20, wherein, when recording the HDR image data, the recording control means determines to divide the HDR image data into the plurality of divided HDR image data in a case where a vertical size or a horizontal size of the HDR image data exceeds a predetermined size. ### Claim 23 (depends on 22) The image capture device according to claim 22, wherein, in the case where the vertical size or the horizontal size of the HDR image data exceeds the predetermined size, the recording control means divides the HDR image data into the plurality of divided HDR image data such that each of the plurality of divided HDR image data has a horizontal size and a vertical size which do not exceed the predetermined size. ### Claim 24 (depends on 19) The image capture device according to claim 19, wherein the HDR image data is a 10-bit image in a bit depth. ### Claim 25 A method for controlling an image capture device, the image capture device including an image sensor for capturing an image data and recording the image data obtained through image capture, the method comprising: when the recording is performed for HDR (high dynamic range) image data, dividing a part of HDR image data captured by the image sensor corresponding to a coding area to be encoded into a plurality of divided HDR image data; encoding each of the plurality of divided HDR image data into a High Efficiency Video Coding (HEVC) format; and recording the plurality of encoded divided HDR image data on a recording medium in a predetermined recording format, and when the recording is performed for SDR image data, compression-encoding for SDR image data captured by the image sensor into a JPEG format without dividing the SDR image data into a plurality of divided SDR image data, and recording the compression-encoded SDR image data as a JPEG file.