# US 2017/0286522 A1 · Data file grouping analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0286522 A1
- Document ID: US20170286522A1
- Status: Published application
- Kind: A1
- Application number: 15/090,001
- Filed: 2016-04-04
- Published: 2017-10-05
- Earliest claimed: 2016-04-04
- Assignees: Shutterstock, Inc.
- Applicants: Shutterstock, Inc.
- Inventors: Heath HOHWALD; Kevin Scott LESTER; Manor LEV-TOV; Xinyu LI
- Web page: https://patentgrep.com/patent/US20170286522A1

## CPC

- G06F 16/285: {Clustering or classification}
- G06F 16/438: Presentation of query results
- G06F 16/54: Browsing; Visualisation therefor
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods for analyzing data files to identify similar files to group for display within a limited visual space of a graphical user interface are provided. In one aspect, a method includes receiving a search query for a collection of media files, and identifying a subset of the media files from the collection that is responsive to the search query. The method also includes grouping the subset of the media files into a plurality of groups based on their visual similarity, wherein the visual similarity of each media file in the subset of media files is determined using an image vector corresponding to each media file, and providing the subset of the media files for display in their respective groups. Systems and machine-readable media are also provided.

## Claims

### Claim 1

A computer-implemented method for analyzing data files to identify similar files to group for display within a limited visual space of a graphical user interface, the method comprising:
receiving a search query for a collection of media files;
identifying a subset of the media files from the collection that is responsive to the search query;
grouping the subset of the media files into a plurality of groups based on their visual similarity, wherein the visual similarity of each media file in the subset of media files is determined using an image vector corresponding to each media file; and
providing the subset of the media files for display in their respective groups.

### Claim 2 (depends on 1)

The method of claim 1, wherein each media file in the collection of media files has an associated unique index value mapping each media file to a corresponding dense image vector for the media file capturing the visual nature of the media file.

### Claim 3 (depends on 2)

The method of claim 2, wherein the plurality of groups are clusters, and wherein the subset of the media files are grouped into a predetermined number of the clusters using a k means clustering algorithm.

### Claim 4 (depends on 3)

The method of claim 3, wherein grouping the subset of media files into the predetermined number of the clusters using the k means clustering algorithm comprises applying a cosine similarity algorithm to the dense image vectors corresponding to the subset of media files.

### Claim 5 (depends on 4)

The method of claim 4, further comprising normalizing each of the dense image vectors prior to applying the cosine similarity algorithm to each of the dense image vectors.

### Claim 6 (depends on 2)

The method of claim 2, wherein the subset of the media files is grouped into the plurality of groups using thresholding, the thresholding comprising assigning a first media file from the subset of media files to a cluster for the first media file, and for each of the remaining media files in the subset of media files calculating a distance between the corresponding media file and an existing cluster centroid, and if the calculated distance is greater than a predefined threshold, adding the corresponding media file to the existing cluster centroid, otherwise adding the corresponding media file to a new cluster centroid.

### Claim 7 (depends on 1)

The method of claim 1, wherein providing the subset of the media files for display in their respective groups comprises, for each group to be displayed, displaying a first media file in the group at a first size, and displaying at least one other file in the group at a second size smaller than the first size.

### Claim 8 (depends on 1)

The method of claim 1, wherein providing the subset of the media files for display in their respective groups comprises, for each media file in a group to be displayed, displaying each of the displayed media files in the group at equal sizes.

### Claim 9 (depends on 1)

The method of claim 1, wherein providing the subset of the media files for display in their respective groups comprises, for media files not displayed in a displayed group of media files, providing an interface for a user to select additional media files from the displayed group to be displayed.

### Claim 10 (depends on 1)

The method of claim 1, wherein the respective groups are ordered according to a responsiveness value to the search query of the most responsive media file in the respective group, or wherein the respective groups are ordered according to an average of the responsiveness values to the search query of each of the media files in the respective group.

### Claim 11

A system for analyzing data files to identify similar files to group for display within a limited visual space of a graphical user interface, the system comprising:
a memory comprising instructions; and
a processor configured to execute the instructions to:
receive a search query for a collection of media files, each media file in the collection of media files having an associated unique index value mapping each media file to a corresponding dense image vector for the media file capturing the visual nature of the media file;
identify a subset of the media files from the collection that is responsive to the search query;
group the subset of the media files into a plurality of groups based on their visual similarity, wherein the visual similarity of each media file in the subset of media files is determined using an image vector corresponding to each media file; and
provide the subset of the media files for display in their respective groups.

### Claim 12 (depends on 11)

The system of claim 11, wherein the plurality of groups are clusters, and wherein the subset of the media files are grouped into a predetermined number of the clusters using a k means clustering algorithm.

### Claim 13 (depends on 12)

The system of claim 12, wherein grouping the subset of media files into the predetermined number of the clusters using the k means clustering algorithm comprises applying a cosine similarity algorithm to the dense image vectors corresponding to the subset of media files.

### Claim 14 (depends on 13)

The system of claim 13, wherein the processor is further configured to normalize each of the dense image vectors prior to applying the cosine similarity algorithm to each of the dense image vectors.

### Claim 15 (depends on 11)

The system of claim 11, wherein the subset of the media files is grouped into the plurality of groups using thresholding, the thresholding comprising assigning a first media file from the subset of media files to a cluster for the first media file, and for each of the remaining media files in the subset of media files calculating a distance between the corresponding media file and an existing cluster centroid, and if the calculated distance is greater than a predefined threshold, adding the corresponding media file to the existing cluster centroid, otherwise adding the corresponding media file to a new cluster centroid.

### Claim 16 (depends on 11)

The system of claim 11, wherein providing the subset of the media files for display in their respective groups comprises, for each group to be displayed, displaying a first media file in the group at a first size, and displaying at least one other file in the group at a second size smaller than the first size.

### Claim 17 (depends on 11)

The system of claim 11, wherein providing the subset of the media files for display in their respective groups comprises, for each media file in a group to be displayed, displaying each of the displayed media files in the group at equal sizes.

### Claim 18 (depends on 11)

The system of claim 11, wherein providing the subset of the media files for display in their respective groups comprises, for media files not displayed in a displayed group of media files, providing an interface for a user to select additional media files from the displayed group to be displayed.

### Claim 19 (depends on 11)

The system of claim 11, wherein the respective groups are ordered according to a responsiveness value to the search query of the most responsive media file in the respective group, or wherein the respective groups are ordered according to an average of the responsiveness values to the search query of each of the media files in the respective group.

### Claim 20

A non-transitory machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for analyzing data files to identify similar files to group for display within a limited visual space of a graphical user interface, the method comprising:
receiving a search query for a collection of media files, each media file in the collection of media files having an associated unique index value mapping each media file to a corresponding dense image vector for the media file capturing the visual nature of the media file;
identifying a subset of the media files from the collection that is responsive to the search query;
clustering the subset of the media files into predetermined number of groups based on their visual similarity using a k means clustering algorithm by applying a cosine similarity algorithm to the dense image vectors corresponding to the subset of media files; and
providing the subset of the media files for display in their respective groups ordered according to a responsiveness value to the search query of the most responsive media file in the respective group, or ordered according to an average of the responsiveness values to the search query of each of the media files in the respective group,
wherein providing the subset of the media files for display in their respective groups comprises, for each group to be displayed, displaying a first media file in the group at a first size, and displaying at least one other file in the group at a second size smaller than the first size, or for each media file in a group to be displayed, displaying each of the displayed media files in the group at equal sizes, and for media files not displayed in a displayed group of media files, providing an interface for a user to select additional media files from the displayed group to be displayed.
