# US 11,122,234 B2 · Image output apparatus, control method thereof and computer-readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,234 B2 - Document ID: US11122234B2 - Status: Granted - Kind: B2 - Application number: 16/829,335 - Filed: 2020-03-25 - Published: 2020-10-01 - Granted: 2021-09-14 - Earliest claimed: 2019-03-26 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Satoshi Aoyama - Web page: https://patentgrep.com/patent/US11122234B2 ## CPC - G09G 5/395: Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen (G09G5/399 takes precedence) - H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits} - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - G09G 2320/0626: for control of overall brightness - G09G 2370/04: Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller - G09G 2370/12: Use of DVI or HDMI protocol in interfaces along the display data pipeline - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An image output apparatus, which outputs data for a multiple playback displaying one frame in which two or more images are arranged, reads a set number of images in the multiple playback from a recording unit, generates an image for display for the multiple playback by using the set number of images read from the recording unit, sets a maximum luminance information of the image for display to a highest luminance among luminance indicated by a maximum luminance information of an HDR image included in the set number of images, and adds the set maximum luminance information to the generated image for display and output the image for display. ## Claims ### Claim 1 An image output apparatus configured to output data for a multiple playback, the multiple playback displaying two or more images arranged in one frame, the image output apparatus comprising: one or more processors; and at least one memory coupled to the one or more processors, the at least one memory having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations of following units: a reading unit configured to read a set number of images in the multiple playback from a recording unit; a generation unit configured to generate an image for display for the multiple playback by using the set number of images read by the reading unit; a setting unit configured to set a maximum luminance information of the image for display to a highest luminance among luminance indicated by a maximum luminance information of an HDR image included in the set number of images read by the reading unit; and an output unit configured to add the maximum luminance information set by the setting unit to the image for display generated by the generation unit and to output the image for display. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein, in a case where the set number of images read by the reading unit include no HDR image, the setting unit sets the maximum luminance information of the image for display to a predetermined luminance. ### Claim 3 (depends on 2) The apparatus according to claim 2, wherein the predetermined luminance is a luminance for an SDR. ### Claim 4 (depends on 1) The apparatus according to claim 1, wherein, in a case where a change frequency of a combination of images constituting the set number of images exceeds a predetermined frequency, the setting unit fixes the luminance indicated by the maximum luminance information of the image for display to a predetermined value. ### Claim 5 (depends on 1) The apparatus according to claim 1, wherein a user can designate the set number, and in a case where the set number exceeds a predetermined number, the setting unit fixes the luminance indicated by the maximum luminance information associated with the image for display to a predetermined value. ### Claim 6 (depends on 4) The apparatus according to claim 4, wherein the setting unit uses, as the predetermined value, a highest luminance among luminance indicated by the maximum luminance information of all HDR images recorded in the recording unit. ### Claim 7 (depends on 4) The apparatus according to claim 4, wherein the setting unit uses, as the predetermined value, the luminance indicated by the maximum luminance information added to the image for display at an instant when the change frequency exceeds the predetermined frequency. ### Claim 8 An image output apparatus configured to output data for a multiple playback, the multiple playback displaying two or more images arranged in one frame, the image output apparatus comprising: one or more processors; and at least one memory coupled to the one or more processors, the at least one memory having instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to perform operations of following units: a reading unit configured to read a set number of images in the multiple playback from a recording unit; a generation unit configured to generate an image for display for the multiple playback by using the set number of images read by the reading unit; a setting unit configured to set, in a case where an image designated by a user operation among the set number of images is an HDR image, a luminance indicated by a maximum luminance information of the HDR image for a display region of the designated image in the image for display; and an output unit configured to add information indicating the luminance and the display region set by the setting unit to the image for display generated by the generation unit and to output the image for display. ### Claim 9 (depends on 8) The apparatus according to claim 8, wherein the setting unit sets a predetermined luminance for a region other than the display region for the image for display. ### Claim 10 (depends on 8) The apparatus according to claim 8, wherein, in a case where the image designated by the user operation is not an HDR image, the setting unit sets the maximum luminance information to a predetermined luminance and sets the display region to the entire image for display. ### Claim 11 (depends on 10) The apparatus according to claim 10, wherein the predetermined luminance is a luminance for an SDR. ### Claim 12 (depends on 8) The apparatus according to claim 8, wherein, in reading the set number of images, the reading unit reads a reduced image and a metadata of image recorded in the recording unit. ### Claim 13 A control method for an image output apparatus configured to output data for a multiple playback, the multiple playback displaying two or more images arranged in one frame, the control method comprising: reading a set number of images in the multiple playback from a recording unit; generating an image for display for the multiple playback by using the set number of images; setting a maximum luminance information of the image for display to a highest luminance among luminance indicated by a maximum luminance information of an HDR image included in the set number of images; and adding the maximum luminance information to the image for display and outputting the image for display. ### Claim 14 A control method for an image output apparatus configured to output data for a multiple playback displaying two or more images arranged in one frame, the control method comprising: reading a set number of images in the multiple playback from a recording unit; generating an image for display for the multiple playback by using the set number of images; setting, in a case where an image designated by a user operation among the set number of images is an HDR image, a luminance indicated by a maximum luminance information of the HDR image, for a display region of the designated image in the image for display; and adding information indicating the luminance and the display region to the image for display and outputting the image for display. ### Claim 15 A non-transitory computer-readable storage medium including a program stored therein, the program being used to cause a computer to execute a control method for an image output apparatus configured to output data for a multiple playback displaying two or more images arranged in one frame, the control method comprising: reading a set number of images in the multiple playback from a recording unit; generating an image for display for the multiple playback by using the set number of images; setting a maximum luminance information of the image for display to a highest luminance among luminance indicated by a maximum luminance information of an HDR image included in the set number of images; and adding the set maximum luminance information to the image for display and outputting the image for display. ### Claim 16 A non-transitory computer-readable storage medium including a program stored therein, the program being used to cause a computer to execute a control method for an image output apparatus configured to output data for a multiple playback displaying two or more images arranged in one frame, the control method comprising: reading a set number of images in the multiple playback from a recording unit; generating an image for display for the multiple playback by using the set number of images; setting, in a case where an image designated by a user operation among the set number of images is an HDR image, a luminance indicated by a maximum luminance information of the HDR image, for a display region of the designated image in the image for display; and adding information indicating the set luminance and the display region to the image for display and outputting the image for display. ### Claim 17 (depends on 1) The apparatus according to claim 1, wherein, in reading the set number of images, the reading unit reads a reduced image and a metadata of image recorded in the recording unit.