# US 8,571,338 B2 · Image file generation device, image processing device, image file generation method, and image processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,571,338 B2 - Document ID: US8571338B2 - Status: Granted - Kind: B2 - Application number: 13/384,880 - Filed: 2010-03-12 - Published: 2012-07-26 - Granted: 2013-10-29 - Earliest claimed: 2009-07-28 - Assignees: Sony Corporation; Sony Computer Entertainment Inc. - Applicants: Tetsugo Inada; Akio Ohba; Hiroyuki Segawa - Inventors: Tetsugo Inada; Akio Ohba; Hiroyuki Segawa - Web page: https://patentgrep.com/patent/US8571338B2 ## CPC - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06T 11/40: Filling planar surfaces by adding surface attributes, e.g. adding colours or textures - G09G 2340/02: Handling of images in compressed format, e.g. JPEG, MPEG - G09G 2340/0407: Resolution change, inclusive of the use of different resolutions for different screen areas - G09G 2350/00: Solving problems of bandwidth in display systems - H04N 19/33: in the spatial domain - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image hierarchy generation unit reads image data stored in a hard disk drive, generate images with a plurality of resolutions, and hierarchizes the images. An image dividing unit divides the image in each layer into tile images. A redundancy detection unit analyzes the image in each layer so as to detect redundancy between images within the same layer or images from different layers. A tile image reference table creates a tile image reference table that maps area numbers to tile numbers, in view of the redundancy. An image file generation unit creates an image file that should be ultimately output and includes image data and the tile image reference table. ## Claims ### Claim 1 An image file generation device comprising: an image hierarchy generation unit configured to generate a plurality of pieces of image data with different resolutions from input image data and generate hierarchical data formed by hierarchizing the plurality of pieces of data as layers according to resolution; an image division unit configured to divide image data at each layer of the hierarchical data into tile images of predetermined sizes; a tile image reference table creation unit configured to create a tile image reference table that maps post-division areas in the image data at each layer of the hierarchical data to data for tile images used to render the areas; and an image file generation unit configured to generate an image file that includes data for the tile image and the tile image reference table. ### Claim 2 (depends on 1) The image file generation device according to claim 1, wherein the tile image reference table maps data for a given tile image to a plurality of areas, and the image file does not include data for a tile image that is not mapped in the tile image reference table. ### Claim 3 (depends on 1) The image file generation device according to claim 1, further comprising: a redundancy detection unit configured to analyze an image in a layer of a given resolution so as to identify an area in an image in a layer of a higher resolution that can be rendered using data for a tile image included in the image of the given resolution, wherein the tile image reference table creation unit maps the area identified by the redundancy detection unit to the data for the tile image used for rendering. ### Claim 4 (depends on 3) The image file generation device according to claim 3, wherein the redundancy detection unit refers to the tile images forming the image subject to analysis so as to identify a tile image comprising a single color, and identifies an area in the image in the layer of the higher resolution corresponding to the identified tile image as an area that can be rendered by using the data for the identified tile image. ### Claim 5 (depends on 3) The image file generation device according to claim 3, wherein the redundancy detection unit compares an enlarged version of the image subject to analysis enlarged to an image size of the layer of the higher resolution with the image in the layer of the higher resolution, and identifies an area in the image in the layer of the higher resolution producing a difference that is less than or equal to a threshold value as an area that can be rendered by using the data for the tile image of the image subject to analysis. ### Claim 6 (depends on 1) The image file generation device according to claim 1, wherein the tile image reference table creation unit organizes the post-division areas into a plurality of groups comprising images from different layers, and compresses, for each group, data that maps the areas to data for tile images used to render the areas. ### Claim 7 An image processing device comprising: a storage device configured to store an image file that includes data for tile images produced by dividing image data into a predetermined size, the image data representing a single image with different resolutions, and includes a tile image reference table that maps post-division areas in the image data in a hierarchical structure produced by hierarchizing the image data according to resolution, to data for tile images used to render the post-division areas; an input information acquisition unit configured to acknowledge a user request to change a display area including shift on an image plane and change in resolution; a tile image identification unit configured to identify data for a tile image necessary to render an area that should be newly displayed in response to the request to change a display area, by referring to the tile image reference table; and a displayed image processing unit configured to read the data for the identified tile image from the storage device and to render the area that should be newly displayed. ### Claim 8 (depends on 7) The image processing device according to claim 7, wherein the image file does not include data for a tile image that is not mapped in the tile image reference table. ### Claim 9 (depends on 7) The image processing device according to claim 7, wherein the tile image reference table maps an area in an image of a given resolution to data for a tile image that can be used to render the area and included in an image of a resolution lower than the given resolution. ### Claim 10 (depends on 9) The image processing device according to claim 9, wherein the tile image reference table maps an area in an image of a given resolution to the data for the tile image included in the image of the lower resolution and further defines a magnification factor referred to when the tile image is used to render the area, and the displayed image processing unit renders the area by enlarging the tile image by the magnification factor. ### Claim 11 (depends on 7) The image processing device according to claim 7, wherein the input information acquisition unit acknowledges a request to change a part of an image that should be displayed, the device further comprising: a tile image generation unit configured to newly generate data for a tile image for an area that should be updated and store resultant data in a storage area in the storage device different from an area for pre-update tile image data included in the image file; and a tile image reference table update unit configured to update data for a tile image mapped in the tile image reference table to the area that should be updated with the newly generated data for the tile image, wherein the displayed image processing unit reads the newly generated data for the tile image in accordance with the updating of the tile image reference table and refreshes the displayed image. ### Claim 12 (depends on 11) The image processing device according to claim 11, wherein the input information acquisition unit acknowledges a request to cancel the request to update a part of an image, the tile image reference table update unit returns the newly-generated data for the tile image mapped in the tile image reference table to the area that should be updated to the data for the tile image previously mapped to the area that should be updated, and the displayed image processing unit renders the displayed image afresh in accordance with the updating of tile image reference table. ### Claim 13 An image file generation method comprising: reading image data from a memory, generating a plurality of pieces of image data with different resolutions, and generate hierarchical data formed by hierarchizing the plurality of pieces of data as layers according to resolution; dividing image data at each layer of the hierarchical data into tile images of a predetermined size; creating a tile image reference table that maps post-division areas in the image data at each layer of the hierarchical data to data for tile images used to render the areas; and generating an image file that includes data for the tile image and the tile image reference table and outputting the table to the memory. ### Claim 14 (depends on 13) The image file generation method according to claim 13, wherein the tile image reference table maps data for a given tile image to a plurality of areas, and the image file does not include data for a tile image that is not mapped in the tile image reference table. ### Claim 15 An image processing method comprising: reading, from a memory, an image file that includes data for tile images produced by dividing image data into a predetermined size, the image data representing a single image with different resolutions, and includes a tile image reference table that maps post-division areas in the image data in a hierarchical structure produced by hierarchizing the image data according to resolution, to data for tile images used to render the post-division areas; acknowledging a user request to change a display area including shift on an image plane and change in resolution; identifying data for a tile image necessary to render an area that should be newly displayed in response to the request to change a display area, by referring to the tile image reference table; and rendering the area that should be newly displayed based on the data for the identified tile image. ### Claim 16 (depends on 15) The image processing method according to claim 15, wherein the image file does not include data for a tile image that is not mapped in the tile image reference table. ### Claim 17 (depends on 15) The image processing method according to claim 15, further comprising: acknowledging a request to change a part of an image that should be displayed; newly generating data for a tile image for an area that should be updated and storing resultant data in a storage area in the memory different from an area for pre-update tile image data included in the image file; updating data for a tile image mapped in the tile image reference table to the area that should be updated with the newly generated data for the tile image; and reading the newly generated data for the tile image in accordance with the updating of the tile image reference table and refreshing the displayed image. ### Claim 18 A non-transitory computer readable recording medium containing a computer program, the computer program comprising: a module configured to read image data from a memory, generate a plurality of pieces of image data with different resolutions, and generate hierarchical data formed by hierarchizing the plurality of pieces of data as layers according to resolution; a module configured to divide image data at each layer of the hierarchical data into tile images of a predetermined size; a module configured to create a tile image reference table that maps post-division areas in the image data at each layer of the hierarchical data to data for tile images used to render the post-division areas; and a module configured to generate an image file that includes data for the tile image and the tile image reference table and output the table to the memory. ### Claim 19 A non-transitory computer readable recording medium containing a computer program, the computer program comprising: a module configured to read, from a memory, an image file that includes data for tile images produced by dividing image data into a predetermined size, the image representing a single image with different resolutions, and includes a tile image reference table that maps post-division areas in the image data in a hierarchical structure produced by hierarchizing the image data according to resolution, to data for tile images used to render the post-division areas; a module configured to acknowledge a user request to change a display area including shift on an image plane and change in resolution; a module configured to identify data for a tile image necessary to render an area that should be newly displayed in response to the request to change a display area, by referring to the tile image reference table; and a module configured to render the area that should be newly displayed based on the data for the identified tile image. ### Claim 20 A data structure of an image file read from a storage device to display at least a part of an image on a display, the data structure mapping data for tile images to a tile image reference table, the data for tile images being produced by dividing image data into a predetermined size, the image data representing a single image with different resolutions, and the tile image reference table mapping post-division areas in the image data in a hierarchical structure produced by hierarchizing the image data according to resolution to data for tile images used to render the post-division areas, wherein the tile image reference table maps data for a given tile image to a plurality of areas, and the image file does not include data for a tile image that is not mapped in the tile image reference table.