# US 9,519,660 B2 · Information processing apparatus, clustering method, and recording medium storing clustering program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,519,660 B2 - Document ID: US9519660B2 - Status: Granted - Kind: B2 - Application number: 14/064,484 - Filed: 2013-10-28 - Published: 2014-05-29 - Granted: 2016-12-13 - Earliest claimed: 2012-11-26 - Assignees: Ricoh Company, Ltd. - Applicants: Satoshi Nakamura - Inventors: Satoshi Nakamura - Web page: https://patentgrep.com/patent/US9519660B2 ## CPC - G06F 16/583: using metadata automatically derived from the content - G06F 16/355: Creation or modification of classes or clusters - G06F 18/23213: with fixed number of clusters, e.g. K-means clustering - G06F 18/24137: {Distances to cluster centroïds} - G06V 10/763: {Non-hierarchical techniques, e.g. based on statistics of modelling distributions} - G06V 10/764: using classification, e.g. of video objects - G06V 20/35: {Categorising the entire scene, e.g. birthday party or wedding scene} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An information processing apparatus, a clustering method, and a clustering program stored on a recording medium, each of which determines an initial value of model parameter of an input data set based on a model parameter of a reference data set that is similar to the input data set and is previously clustered, modifies the initial value so as to match the input data set, and to obtain a clustering result of the input data set using the updated initial value of model parameter. ## Claims ### Claim 1 An information processing apparatus that clusters an input data set, comprising: a memory having stored thereon (i) a plurality of reference data sets that were previously clustered, the plurality of reference data sets correspond to a plurality of reference images, and (ii) a first reference parameter for clustering a first reference data set of the plurality of reference data sets, the first reference data set of the plurality of reference data sets including a plurality of clusters corresponding to a region of a respective one of the plurality of reference images, the first reference parameter being a model parameter of mixture distribution, the first reference parameter corresponding to at least one of a number of clusters in the first reference data set, and a centroid of data points in each of the plurality of clusters; and at least one processor configured to execute computer readable instructions to, search the memory to obtain the first reference parameter of at least one of the plurality of reference data sets that is similar to the input data set, determine an initial value of the model parameter of mixture distribution of the input data set by combining (a) the first reference parameter of the first reference data set with (b) a second reference parameter of a second reference data set based on similarity between the input data set and the combined first and second reference data sets, at least one of the first reference parameter and the second reference parameter are obtained from the plurality of reference images, modify the initial value of the model parameter of mixture distribution of the input data set to match a probability density distribution of the input data set to generate an updated initial value, and cluster the probability density distribution of the input data set on a feature space of the input data set using the updated initial value of the model parameter of mixture distribution. ### Claim 2 (depends on 1) The information processing apparatus of claim 1, wherein the first reference parameter and the second reference parameter included in a plurality of reference parameters, and the at least one processor is further configured to execute the computer readable instructions to, obtain the plurality of reference parameters based on a degree of similarity between the input data set and the plurality of reference data sets as the at least one of the plurality of reference data sets is similar to the input data set, and combine the plurality of reference parameters based on the degree of similarity to determine the initial value of the model parameter of mixture distribution of the input data set. ### Claim 3 (depends on 2) The information processing apparatus of claim 2, wherein the at least one processor is further configured to execute the computer readable instructions to, calculate the degree of similarity based on a feature of the input data set and a feature of the plurality of reference data sets, and search the at least one of the plurality of reference data sets based on the degree of similarity. ### Claim 4 (depends on 3) The information processing apparatus of claim 3, wherein the feature of the input data set and the feature of the plurality of reference data sets differs from a feature for clustering the input data set. ### Claim 5 (depends on 4) The information processing apparatus of claim 4, wherein the feature for calculating the input data set and the feature of the plurality of reference data sets includes at least one of (i) a feature indicating a shape information of at least one data point in the plurality of reference data sets and (ii) a feature indicating a texture information of the at least one data point in the plurality of reference data sets. ### Claim 6 (depends on 4) The information processing apparatus of claim 4, wherein the feature for clustering the input data set includes a feature indicating a color information of at least one data point in the plurality of reference data sets. ### Claim 7 (depends on 1) The information processing apparatus of claim 1, wherein the model of mixture distribution is a Gaussian mixture distribution model. ### Claim 8 (depends on 1) The information processing apparatus of claim 1, wherein the input data set is an image, and each data point in the input data set is a pixel or a set of a plurality of pixels in the image. ### Claim 9 A method of clustering an input data set, comprising: storing, in a memory, for each of a plurality of reference data sets corresponding to a respective one of the plurality of reference images that were previously clustered, a first reference parameter for clustering a first reference data set of the plurality of reference data sets, the reference data set of the plurality of reference data sets including a plurality of clusters corresponding to a region of the respective one of the plurality of reference images, the first reference parameter being a model parameter of mixture distribution, the first reference parameter corresponding to at least one of a number of clusters in the first reference data set, and a centroid of data points in each of the plurality of clusters; searching, using at least one processor, the memory to obtain the first reference parameter of at least one of the plurality of reference data sets that is similar to the input data set; determining, using the at least one processor, an initial value of the model parameter of mixture distribution of the input data set by combining the first reference parameter of the first reference data set with a second reference parameter of a second reference data set based on similarity between the input data set and the combined first and second reference data sets, the first reference parameter and the second reference parameter included in a plurality of reference parameters, at least one of the first reference parameter and the second reference parameter are obtained from the plurality of reference images; modifying, using the at least one processor, the initial value of the model parameter of mixture distribution of the input data set to match a probability density distribution of the input data set to generate an updated initial value; and clustering, using the at least one processor, the probability density distribution of the input data set on a feature space of the input data set using the updated initial value of the model parameter of mixture distribution. ### Claim 10 (depends on 9) The method of claim 9, further comprising: obtaining, using the at least one processor, the plurality of reference parameters based on a degree of similarity between the input data set and the plurality of reference data sets as the at least one of the plurality of reference data sets is similar to the input data set; and combining, using the at least one processor, the plurality of reference parameters based on the degree of similarity to determine the initial value of the model parameter of mixture distribution of the input data set. ### Claim 11 (depends on 10) The method of claim 10, further comprising: calculating, using the at least one processor, the degree of similarity based on a feature of the input data set and a feature of the plurality of reference data sets; and searching, using the at least one processor, the at least one of the plurality of reference data sets based on the degree of similarity. ### Claim 12 (depends on 11) The method of claim 11, wherein the calculating, using the at least one processor, the feature of the input data set and the feature of the plurality of reference data sets differs from a feature for clustering the input data set. ### Claim 13 (depends on 12) The method of claim 12, wherein the calculating, using the at least one processor, the feature of the input data set and the feature of the plurality of reference data sets includes at least one of (i) a feature indicating a shape information of at least one data point in the plurality of reference data sets and (ii) a feature indicating a texture information of the at least one data point in the plurality of reference data sets. ### Claim 14 (depends on 12) The method of claim 12, wherein the calculating, using the at least one processor, the feature for clustering the input data set includes a feature indicating a color information of at least one data point in the plurality of reference data sets. ### Claim 15 (depends on 9) The method of claim 9, wherein the storing in the memory of the first reference parameter is the model of mixture distribution which is a Gaussian mixture distribution model. ### Claim 16 (depends on 9) The method of claim 9, wherein the input data set is an image, and each data point in the input data set is a pixel or a set of a plurality of pixels in the image. ### Claim 17 A non-transitory computer readable recording medium having computer readable instructions stored thereon, that when executed by at least one processor, configure the at least one processor to: store, in a memory, for each of a plurality of reference data sets corresponding to a respective one of the plurality of reference images that were previously clustered, a first reference parameter for clustering a first reference data set of the plurality of reference data sets, the first reference data set of the plurality of reference data sets including a plurality of clusters corresponding to a region of the respective one of the plurality of reference images, the first reference parameter being a model parameter of mixture distribution, the first reference parameter corresponding to at least one of a number of clusters in the first reference data set, and a centroid of data points in each of the plurality of clusters; search the memory to obtain the first reference parameter of at least one of the plurality of reference data sets that is similar to an input data set; determine an initial value of the model parameter of mixture distribution of the input data set by combining the first reference parameter of the first reference data set with a second reference parameter of a second reference data set based on similarity between the input data set and the combined first and second reference data sets, at least one of the first reference parameter and the second reference parameter are obtained from the plurality of reference images; modify the initial value of the model parameter of mixture distribution of the input data set to match a probability density distribution of the input data set to generate an updated initial value; and cluster the probability density distribution of the input data set on a feature space of the input data set using the updated initial value of the model parameter of mixture distribution. ### Claim 18 (depends on 1) The information processing apparatus of claim 1, wherein the at least one processor is further configured to execute the computer readable instructions to use an EM algorithm to modify the initial value. ### Claim 19 (depends on 9) The method of claim 9, wherein the modifying, using the at least one processor, of the initial value is based on an EM algorithm. ### Claim 20 (depends on 17) The non-transitory computer readable recording medium of claim 17, wherein the at least one processor is further configured to execute the computer readable instructions to use an EM algorithm to modify the initial value.