# US 10,120,883 B2 · User interface for viewing clusters of images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,120,883 B2 - Document ID: US10120883B2 - Status: Granted - Kind: B2 - Application number: 15/183,712 - Filed: 2016-06-15 - Published: 2016-12-08 - Granted: 2018-11-06 - Earliest claimed: 2006-01-23 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Feng Jing; Lei Zhang; Ming Jing Li; Wei-Ying Ma; Kefeng Deng - Web page: https://patentgrep.com/patent/US10120883B2 ## CPC - G06F 16/51: Indexing; Data structures therefor; Storage structures - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/0485: Scrolling or panning - G06F 16/24578: {using ranking} - G06F 16/54: Browsing; Visualisation therefor - G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Method and system for providing a user interface for presenting images of clusters of an image search result is provided. The user interface system displays the search result in a cluster/view form using a cluster panel and a view panel. The cluster panel contains a cluster area for each cluster. The view panel may contain thumbnails of images of the search result in a list view or a mix view. When a user selects a cluster area from the cluster panel, the user interface system displays a list view of thumbnails for that cluster in the view panel. The user interface system may display a thumbnail list near a cluster area of the cluster panel. The thumbnail list contains mini-thumbnails of the images of the selected cluster. The user interface system may also display a detail view of an image in the view panel when a user selects an image. ## Claims ### Claim 1 A computing device for presenting an image search result having clusters of images, the computing device comprising: a memory storing computer-executable instructions that when executed: receive an image search query; identify an image search result of images that are relevant to the image search query, each image having a relevance score indicating relevance of the image to the image search query; the images being organized into clusters; display in a cluster panel a cluster indication of each cluster, the cluster indication for a cluster including thumbnails of multiple images from the cluster, the cluster indications being ordered based on relevance of the images in the cluster to the image search query; and display in a view panel thumbnails of images from multiple clusters of the image search result, the thumbnails of images displayed in the view panel being ordered based on relevance of the images to the image search query, wherein the respective thumbnails include functionality to display an image corresponding to a respective thumbnail in a detail view in the view panel upon user selection of the respective thumbnail; wherein the cluster panel and the view panel are displayed simultaneously, and a processor that executes the computer-executable instructions stored in the memory. ### Claim 2 (depends on 1) The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed: when in list view, when a user selects a cluster indication, display in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication. ### Claim 3 (depends on 1) The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed: when in list view, when a user selects a cluster indication, display adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication. ### Claim 4 (depends on 1) The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed: when in list view, when a user selects a cluster indication using a first selection, display in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication; and when a user selects a cluster indication using a second selection, display adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication. ### Claim 5 (depends on 4) The computing device of claim 4 wherein the computer-executable instructions further include instructions that when executed: display along with the detail view a thumbnail scroll list of the thumbnails of the view panel when the user selected the thumbnail. ### Claim 6 (depends on 1) The computing device of claim 1 wherein the computer-executable instructions further include instructions that when executed: when in a mix view, display in the view panel thumbnails of the images of the clusters in which the images of all the clusters are ordered into a combined ordering such that the most relevant image taken from each cluster are listed first in the combined ordering followed by a listing of the second most relevant image taken from each cluster in the combined ordering, wherein the other images of all the clusters are further listed in the combined ordering in an order based on relevance of each image within its cluster. ### Claim 7 A method performed by a computing device to present an image search result having clusters of images, the method comprising: receiving an image search query; identifying an image search result of images that are relevant to the image search query, each image having a relevance score indicating relevance of the image to the image search query, the images being organized into clusters; displaying in a cluster panel a cluster indication of each cluster, the cluster indication for each cluster including thumbnails of multiple images from that cluster, the cluster indications being ordered based on relevance of the images in the cluster to the image search query; and displaying in a view panel thumbnails of images of one or more clusters wherein the cluster panel and the view panel are displayed simultaneously, wherein the respective thumbnails include functionality to display an image corresponding to a respective thumbnail in a detail view in the view panel upon user selection of the respective thumbnail. ### Claim 8 (depends on 7) The method of claim 7 wherein when in list view and, when a user selects a cluster indication, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication. ### Claim 9 (depends on 7) The method of claim 7 wherein when in a mix view, displaying in the view panel thumbnails of the images of the clusters in which the images of all the clusters are ordered into a combined ordering such that the most relevant image taken from each cluster are listed first in the combined ordering followed by a listing of the second most relevant image taken from each cluster in the combined ordering, wherein the other images of all the clusters are further listed in the combined ordering in an order based on relevance of each image within its cluster. ### Claim 10 (depends on 7) The method of claim 7 wherein when in list view, when a user selects a cluster indication using a first selection, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication; and when a user selects a cluster indication using a second selection, displaying adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication. ### Claim 11 (depends on 10) The method of claim 10 wherein including displaying along with the detail view a thumbnail scroll list of the thumbnails of the view panel when the user selected the thumbnail. ### Claim 12 (depends on 7) The method of claim 7 wherein when in list view and; when a user selects a cluster indication, displaying adjacent to the selected duster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication. ### Claim 13 (depends on 11) The method of claim 11 wherein the thumbnails of the view panel are ordered based on relevance of the images to the image search query. ### Claim 14 A method performed by a computing device for presenting an image search result having clusters of images, the method comprising: storing in a store an image search result of images that are relevant to an image search query, each image having a relevance score indicating relevance of the image to the image search query, the images being organized into clusters; displaying in a cluster panel a cluster indication of each cluster, the cluster indication of a cluster including thumbnails of multiple images from the cluster, the cluster indications are ordered based on relevance of the images in the cluster to the image search query; and when in a mix view, displaying in the view panel thumbnails of the images of the clusters in which the images of all the clusters are ordered in a combined ordering such that the most relevant image of each cluster is listed first in the combined ordering followed by a listing of the second most relevant image of each cluster. ### Claim 15 (depends on 14) The method of claim 14 including when in list view and when a user selects a cluster indication, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication. ### Claim 16 (depends on 14) The method of claim 14 including when in list view and when a user selects a cluster indication, displaying adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication. ### Claim 17 (depends on 14) The method of claim 14 including when in list view, when a user selects a cluster indication using a first selection, displaying in the view panel thumbnails of images of the cluster corresponding to the selected cluster indication; and when a user selects a cluster indication using a second selection, displaying adjacent to the selected cluster indication a mini-thumbnail of images of the cluster corresponding to the selected cluster indication. ### Claim 18 (depends on 14) The method of claim 14 including when in list view, when a user selects a thumbnail of an image, displaying in the view panel a detailed view of that image. ### Claim 19 (depends on 18) The method of claim 18 including displaying along with the detail view a thumbnail scroll list of the thumbnails of the view panel when the user selected the thumbnail. ### Claim 20 (depends on 14) The method of claim 14 wherein the cluster indications are ordered based on relevance of the images in the cluster to the image search query and the thumbnails of the view panel are ordered based on relevance of the images to the image search query.