# US 12,182,194 B2 · Information processing apparatus, control method of information processing apparatus, and non-transitory computer-readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,194 B2 - Document ID: US12182194B2 - Status: Granted - Kind: B2 - Application number: 17/338,403 - Filed: 2021-06-03 - Published: 2021-12-09 - Granted: 2024-12-31 - Earliest claimed: 2020-06-08 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Masanori Fukada - Web page: https://patentgrep.com/patent/US12182194B2 ## CPC - G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums} - G06F 16/51: Indexing; Data structures therefor; Storage structures - G06F 16/583: using metadata automatically derived from the content - G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An information processing apparatus determines whether or not one or more image groups for which it is necessary to perform predetermined display in a case where display is performed on a display unit are stored in an image file, selects, in a case where it is determined that one or more such image groups are stored in the image file, (i) a representative image or (ii) an image group of the stored one or more image group based on a user operation, and causes the display unit to display the selected representative image or images included in the selected image group. ## Claims ### Claim 1 An information processing apparatus comprising: one or more processors; and one or more memories storing instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising: accepting designation of an image file that conforms to a ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroup Box defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on a display unit; in accordance with a determination that one or more such image groups are stored in the image file, selecting, either (i) the representative image stored in the image file or (ii) an image group of the determined one or more such image groups stored in the image file, to display on the display unit; and causing the display unit to display either (i) the selected representative image or (ii) the images included in the selected image group, depending on whether the representative image or an image group is selected by the selecting. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the image file is an image file designated by a user operation. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the predetermined display process is an image switching display process. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the determining determines whether or not one or more such image groups are stored in the image file, based on the metadata. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the determining determines whether or not one or more such image groups are stored, based on settings of the information processing apparatus. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the image file is compliant with HEIF (High Efficiency Image File Format). ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the representative image is an image identified with pitm of the metadata. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, wherein the one or more such image groups are image groups identified with slid, iaug, favc, albc or ster, which is the grouping type described in the EntityToGroupBox. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein the one or more such image groups are image groups identified with a grouping type of the metadata which indicates (1) a slide show, (2) an image and an audio track are associated with each other, (3) a favorite image collection, (4) an album collection or (5) two entities constitute a three-dimensional pair. ### Claim 10 An information processing apparatus comprising: one or more processors; and one or more memories storing instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising: accepting designation of an image file that conforms to ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file, wherein in a case where the image file is an image file designated by a first predetermined user operation, causing, in a first displaying, a display unit to display the representative image; in a case where the image file is an image file designated by a second predetermined user operation, determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on the display unit; in accordance with a determination that one or more such image groups are stored in the image file, selecting, either (i) the representative image stored in the image file or (ii) an image group of the determined one or more such image groups stored in the image file, to display on the display unit; and causing the display unit to display either (i) the selected representative image or (ii) the images in a selected image group, depending on whether the representative image or an image group is selected by the selecting. ### Claim 11 (depends on 10) The information processing apparatus according to claim 10, wherein the image file stores one or more image groups for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on the display unit, in a case where the image file is an image file designated by the second predetermined user operation, the selecting unit selects the representative image or an image group of the one or more image groups, based on a user operation, and the display control unit causes the display unit to display the selected representative image or images included in the selected image group. ### Claim 12 (depends on 10) The information processing apparatus according to claim 10, wherein the image file is compliant with HEIF (High Efficiency Image File Format). ### Claim 13 An information processing apparatus comprising: one or more processors; and one or more memories storing instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising: accepting designation of an image file that conforms to ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; in a first displaying, causing a display unit to display the representative image; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on the display unit, upon accepting a predetermined user operation on the representative image that is being displayed on the display unit; selecting, in accordance with a determination that one or more such image groups are stored in the image file, an image group of the determined one or more image groups based on a user operation; and causing, in a second displaying, the display unit to display images included in the selected image group. ### Claim 14 (depends on 13) The information processing apparatus according to claim 13, wherein the image file is compliant with HEIF (High Efficiency Image File Format). ### Claim 15 (depends on 13) The information processing apparatus according to claim 13, wherein the image file format is HEIF (High Efficiency Image File Format). ### Claim 16 A control method of an information processing apparatus, the method comprising: accepting designation of an image file that conforms to a ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on a display unit; in accordance with a determination that one or more such image groups are stored in the image file, selecting, either (i) the representative image stored in the image file or (ii) an image group of the determined one or more such image groups stored in the image file, to display on the display unit; and causing the display unit to display either (i) the selected representative image or (ii) to perform displaying of images included in the selected image group, depending on whether the representative image or an image group is selected. ### Claim 17 A control method of an information processing apparatus, the method comprising: accepting designation of an image file that conforms to ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; in a first displaying, causing a display unit to display the representative image; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on the display unit, upon accepting a predetermined user operation on the representative image that is being displayed on the display unit; selecting, in accordance with a determination that one or more such image groups are stored in the image file, an image group of the determined one or more image groups based on a user operation; and causing, in a second displaying, the display unit to perform displaying of images included in the selected image group. ### Claim 18 A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute a control method of an information processing apparatus, the method comprising: accepting designation of an image file that conforms to a ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on a display unit; in accordance with a determination that one or more such image groups are stored in the image file, selecting, either (i) the representative image stored in the image file or (ii) an image group of the determined one or more such image groups stored in the image file, to display on the display unit; and causing the display unit to display either (i) the selected representative image or (ii) to perform displaying of images included in the selected image group, depending on whether the representative image or an image group is selected. ### Claim 19 A non-transitory computer-readable storage medium storing a computer program for causing a computer to execute a control method of an information processing apparatus, the method comprising: accepting designation of an image file that conforms to ISOBMFF (ISO base media file format) standard, the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; in a first displaying, causing a display unit to display the representative image; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on the display unit, upon accepting a predetermined user operation on the representative image that is being displayed on the display unit; selecting, in accordance with a determination that one or more such image groups are stored in the image file, an image group of the determined one or more image groups based on a user operation; and causing, in a second displaying, the display unit to perform displaying of images included in the selected image group. ### Claim 20 An information processing apparatus comprising: one or more processors; and one or more memories storing instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising: accepting designation of an image file that conforms to a ISOBMFF (ISO base media file format), the image file including an image data area for storing one or more images and a metadata area for storing metadata information regarding the one or more images, and a first image in the image file that is designated as a representative image for the image file; determining whether or not any image group, which is designated using a grouping type described in a EntityToGroupBox defined by the ISOBMFF, is stored in the image file for which it is necessary to perform a predetermined display process when displaying is performed of the images in the image group on a display unit; and in accordance with a determination that one or more such image groups are stored in the image file, causing the display unit to display the images included in the image group.