# US 12,008,052 B2 · Method and apparatus for encapsulating images in a file > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,052 B2 - Document ID: US12008052B2 - Status: Granted - Kind: B2 - Application number: 17/044,763 - Filed: 2019-04-04 - Published: 2021-04-15 - Granted: 2024-06-11 - Earliest claimed: 2018-04-05 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Naël Ouedraogo; Frédéric Maze; Franck Denoual; Hervé Ruellan; Masahiko Takaku - Web page: https://patentgrep.com/patent/US12008052B2 ## CPC - G06F 16/908: using metadata automatically derived from the content - G06F 16/71: Indexing; Data structures therefor; Storage structures - G06F 16/906: Clustering; Classification - G06F 16/93: Document management systems - H04N 21/8153: {comprising still images, e.g. texture, background image} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract The present invention concerns a method of encapsulating images in a file, wherein the method comprises determining a grouping type based on a capture mode of the images; generating a grouping data structure describing the images as a group, the grouping data structure comprising image identifiers of the images of the group; and embedding the grouping data structure, the grouping type and the images in the file. ## Claims ### Claim 1 A method of encapsulating images in a file, wherein the method comprises: generating grouping type information data identifying a capture mode or a collection mode of the images; generating data structures describing a plurality of image items or samples from the images; generating a grouping data structure describing a group of image items or samples from the plurality of image items or samples, the grouping data structure comprising data for identifying the image items or samples of the group and the grouping type information data; and embedding the grouping data structure, the data structures describing the plurality of image items or samples, and the images in the file, wherein the grouping data structure and the data structures describing the plurality of image items or samples are embedded in a meta data part of the file. ### Claim 2 (depends on 1) The method of claim 1, wherein a first property data structure associated with the grouping data structure is further embedded within the file. ### Claim 3 (depends on 2) The method of claim 2, wherein the first property data structure is one of a SampleEntry box, a VisualSampleGroupEntry, a ItemFullProperty box or a ItemProperty box as defined in ISO Base Media File Format. ### Claim 4 (depends on 1) The method according to claim 1, wherein data structures are boxes as defined in ISO Base Media File Format. ### Claim 5 (depends on 1) The method of claim 1, wherein grouping type information data are defined for at least one of the capture modes or collection modes comprising auto exposure bracketing mode, white balance bracketing mode, focus bracketing mode, flash exposure bracketing mode, depth of field bracketing mode, iso bracketing mode, time lapse mode, panorama mode, image burst mode, user-defined collection mode, super resolution mode, multi-exposure mode, noise reduction mode, long-exposure noise reduction mode, vignetting compensation mode, and/or HDR capture mode. ### Claim 6 (depends on 1) The method of claim 1, wherein the grouping data structure is one of an EntityToGroup box, a SampleToGroup box, or a TrackGroup box as defined in ISO Base Media File Format. ### Claim 7 (depends on 1) A computer-readable storage medium storing instructions of a computer program for implementing the method according to claim 1. ### Claim 8 (depends on 1) The method of claim 1, wherein the method further comprising generating a second property data structure comprising the grouping type information data and property information based on the capture mode or collection mode, the second property data structure being associated with at least one of the images. ### Claim 9 (depends on 8) The method of claim 8, wherein the second property data structure is one of a SampleEntry box, a VisualSampleGroupEntry, a ItemFullProperty box or a ItemProperty box as defined in ISO Base Media File Format. ### Claim 10 A method of encapsulating images in a file, wherein the method comprises: determining a label parameter describing information comprising a human-readable name to annotate images; generating a plurality of image items describing the images, the image items comprising an item identifier; generating a grouping data structure describing a group of image items from the plurality of image items, the grouping data structure comprising a group identifier and item identifiers of image items of the group; generating a property data structure comprising the label parameter and a data structure associating the property data structure with the grouping data structure using the group identifier and/or with an image item of the group using the item identifier of the image item; and embedding the grouping data structure, the plurality of image items, the property data structure and the images in the file, wherein the grouping data structure and the property data structure are embedded in a meta data part of the file. ### Claim 11 (depends on 10) The method according to claim 10, wherein data structures are boxes as defined in ISO Base Media File Format or High Efficiency. ### Claim 12 (depends on 10) A computer-readable storage medium storing instructions of a computer for implementing the method according to claim 10. ### Claim 13 A device for encapsulating images in a file, wherein the device comprises circuitry configured for: generating grouping type information data identifying a capture mode or a collection mode of the images; generating data structures describing a plurality of image items or samples from the images; generating a grouping data structure describing a group of image items or samples from the plurality of image items or samples, the grouping data structure comprising data for identifying the image items or samples of the group and the grouping type information data; and embedding the grouping data structure, the data structures describing the plurality of image items or samples, and the images in the file, wherein the grouping data structure and the data structures describing the plurality of image items or samples are embedded in a meta data part of the file. ### Claim 14 A device for encapsulating images in a file, wherein the device comprises a processor configured for: determining a label parameter describing information comprising a human readable name to annotate images; generating a plurality of image items describing the images, the image items comprising an item identifier; generating a grouping data structure describing a group of image items from the plurality of image items, the grouping data structure comprising a group identifier and item identifiers of image items of the group; generating a property data structure comprising the label parameter and a data structure associating the property data structure with the grouping data structure using the group identifier and/or with an image item of the group using the item identifier of the image item; and embedding the grouping data structure, the plurality of image items, the property data structure and the images in the file, wherein the grouping data structure and the property data structure are embedded in a meta data part of the file. ### Claim 15 A device for encapsulating media data in a file, wherein the device comprises circuitry configured for: generating a grouping data structure describing a group of entities, each entity corresponding to at least a portion of media data, the grouping data structure comprising a group identifier; generating a property container data structure containing a property associated with a group of entities; generating an association data structure comprising association information between the property and the grouping data structure using the group identifier; generating a property data structure comprising the property container data structure and the association data structure; and embedding the grouping data structure, the property data structure, and the media data in the file, wherein the property of the media data in the file is more compact by avoiding repetition of association information between the property and the group of entities. ### Claim 16 A method of encapsulating media data in a file, wherein the method comprises: generating a grouping data structure describing a group of entities, each entity corresponding to at least a portion of media data, the grouping data structure comprising a group identifier; generating a property container data structure containing a property associated with a group of entities; generating an association data structure comprising association information between the property and the grouping data structure using the group identifier; generating a property data structure comprising the property container data structure and the association data structure; and embedding the grouping data structure, the property data structure, and the media data in the file, wherein the property of the media data in the file is more compact by avoiding repetition of association information between the property and the group of entities. ### Claim 17 (depends on 16) The method of claim 16, further comprising: generating a text property in the property container data structure comprising at least one text attribute associated with a group of entities and a language attribute associated with the at least one text attribute. ### Claim 18 (depends on 17) The method of claim 17, wherein the text property comprises a plurality of the same text attribute associated with a respective plurality of language attributes. ### Claim 19 (depends on 17) The method of claim 17, wherein the property container data structure comprises a first and second text properties, the first text property comprising a text attribute associated with a first language attribute, and the second text property comprising the text attribute associated with a second language attribute, the first language attribute being different from the second language attribute, and wherein the association data structure comprises association information between the first and second text properties, and the grouping data structure. ### Claim 20 (depends on 16) The method of claim 16, wherein the text property comprises a plurality of text attributes comprising a name text attribute, a description text attribute, and a tag text attribute. ### Claim 21 (depends on 16) The method of claim 16, wherein the method comprises: generating at least one of a name text property, a description text property, and/or a tag text property in the property container data structure, each of the text properties comprising at least a text attribute associated with a group of entities and a language attribute associated with the text attribute. ### Claim 22 (depends on 21) The method of claim 21, wherein each text property comprises a plurality of the same text attribute associated with a respective plurality of language attributes. ### Claim 23 (depends on 16) The method of claim 16, wherein the property container data structure comprises a first and second text properties, the first text property comprising a text attribute associated with a first language attribute, and the second text property comprising the text attribute associated with a second language attribute, the first language attribute being different from the second language attribute, and wherein the association data structure comprises association information between the first and second text properties, and the grouping data structure. ### Claim 24 (depends on 16) The method of claim 16, wherein the association data structure further comprises at least an association of a property with an entity. ### Claim 25 (depends on 16) A computer-readable storage medium storing instructions of a computer program for implementing the method according to claim 16.