# US 8,572,109 B1 · Query translation quality confidence > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,572,109 B1 - Document ID: US8572109B1 - Status: Granted - Kind: B1 - Application number: 12/481,421 - Filed: 2009-06-09 - Granted: 2013-10-29 - Earliest claimed: 2009-05-15 - Assignees: Google Inc. - Applicants: Vanessa Hodge; Kevin Law; Gaurav Garg; Radhika Malpani - Inventors: Vanessa Hodge; Kevin Law; Gaurav Garg; Radhika Malpani - Web page: https://patentgrep.com/patent/US8572109B1 ## CPC - G06F 16/58: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods, systems, and apparatus, including computer program products, for generating visual media search results are provided. A first search query in a first language and a second search query in a different second language are received. The first search query is a translation of the second search query into the second language. A quality of results statistic for the second search query is obtained. A final search query is created using the first search query, the second search query, and the quality of results statistic. The final search query is sent to a search engine and a final group of visual media search results responsive to the final search query are received from the search engine, where visual media search results in the final group that are responsive to the second visual media search query are assigned a ranking based in part on the quality of result statistic. ## Claims ### Claim 1 A computer implemented method, comprising: receiving a first visual media search query in a first language and a second visual media search query in a different second language, where the second visual media search query is determined to be a translation of the first visual media search query into the second language; obtaining a quality of results statistic for the second visual media search query, wherein the quality of results statistic is an estimate of expected relevance of results responsive to the second visual media search query in the second language; creating a final visual media search query comprising the first visual media search query in the first language, the second visual media search query in the different second language, and information corresponding to the quality of results statistic for the second visual media search query; and sending the final visual media search query to a search engine; and receiving a final group of visual media search results responsive to the final visual media search query from the search engine, wherein the final group of visual media search results comprises visual media search results satisfying a part of the final visual media search query corresponding to the first visual media search query in the first language and visual media search results satisfying a part of the final visual media search query corresponding to the second visual media search query in the second language, wherein each of the visual media search results in the final group is assigned a score based in part on the quality of results statistic for the second visual media search query in the second language, wherein each of the visual media search results in the final group is assigned with one of a plurality of confidence bins based on the quality of results statistic and wherein the visual media search results satisfying the part of the final visual media search query corresponding to the second visual media search query are assigned a score based in part on the confidence bin. ### Claim 2 (depends on 1) The method of claim 1, wherein the quality of results statistic is a click through rate for queries similar to the second query. ### Claim 3 (depends on 2) The method of claim 2, wherein the quality of results statistic is a click through rate for the second query. ### Claim 4 (depends on 1) The method of claim 1, wherein the quality of results statistic reflects a dwell time for search results selected by users after submitting a query similar to the second visual media search query. ### Claim 5 (depends on 1) The method of claim 1, further comprising: presenting the final group of one or more visual media search results. ### Claim 6 (depends on 1) The method of claim 1, wherein visual media is an image, a video, an image embedded in a file, or a video embedded in file. ### Claim 7 A computer program product stored on a non-transitory computer readable medium which, when executed by data processing apparatus, causes the data processing apparatus to perform operations comprising: receiving a first visual media search query in a first language and a second visual media search query in a different second language, where the second visual media search query is determined to be a translation of the first visual media search query into the second language; obtaining a quality of results statistic for the second visual media search query, wherein the quality of results statistic is an estimate of expected relevance of results responsive to the second visual media search query in the second language; creating a final visual media search query comprising the first visual media search query in the first language, the second visual media search query in the different second language, and information corresponding to the quality of results statistic for the second visual media search query; and sending the final visual media search query to a search engine; and receiving a final group of visual media search results responsive to the final visual media search query from the search engine, wherein the final group of visual media search results comprises visual media search results satisfying a part of the final visual media search query corresponding to the first visual media search query in the first language and visual media search results satisfying a part of the final visual media search query corresponding to the second visual media search query in the second language, wherein each of the visual media search results in the final group is assigned a score based in part on the quality of results statistic for the second visual media search query in the second language, wherein each of the visual media search results in the final group is assigned with one of a plurality of confidence bins based on the quality of results statistic and wherein the visual media search results satisfying the part of the final visual media search query corresponding to the second visual media search query are assigned a score based in part on the confidence bin. ### Claim 8 (depends on 7) The computer program product of claim 7, wherein the quality of results statistic is a click through rate for queries similar to the second visual media search query. ### Claim 9 (depends on 8) The computer program product of claim 8, wherein the quality of results statistic is a click through rate for the second visual media search query. ### Claim 10 (depends on 7) The computer program product of claim 7, wherein the quality of results statistic further reflects a dwell time for search results selected by users after submitting a query similar to the second visual media search query. ### Claim 11 (depends on 7) The computer program product of claim 7, further comprising: presenting the final group of one or more visual media search results. ### Claim 12 (depends on 7) The computer program product of claim 7, wherein visual media is an image, a video, an image embedded in a file, or a video embedded in file. ### Claim 13 A system comprising data processing apparatus programmed to perform operations comprising: receiving a first visual media search query in a first language and a second visual media search query in a different second language, where the second visual media search query is determined to be a translation of the first visual media search query into the second language; obtaining a quality of results statistic for the second visual media search query, wherein the quality of results statistic is an estimate of expected relevance of results responsive to the second visual media search query in the second language; creating a final visual media search query comprising the first visual media search query in the first language, the second visual media search query in the different second language, and information corresponding to the quality of results statistic for the second visual media search query; and sending the final visual media search query to a search engine; and receiving a final group of visual media search results responsive to the final visual media search query from the search engine, wherein the final group of visual media search results comprises visual media search results satisfying a part of the final visual media search query corresponding to the first visual media search query in the first language and visual media search results satisfying a part of the final visual media search query corresponding to the second visual media search query in the second language, wherein each of the visual media search results in the final group is assigned a score based in part on the quality of results statistic for the second visual media search query in the second language, wherein each of the visual media search results in the final group is assigned with one of a plurality of confidence bins based on the quality of results statistic and wherein the visual media search results satisfying the part of the final visual media search query corresponding to the second visual media search query are assigned a score based in part on the confidence bin. ### Claim 14 (depends on 13) The system of claim 13, wherein the quality of results statistic is a click through rate for queries similar to the second visual media search query. ### Claim 15 (depends on 14) The system of claim 14, wherein the quality of results statistic is a click through rate for the second visual media search query. ### Claim 16 (depends on 13) The system of claim 13, wherein the quality of results statistic reflects a dwell time for search results selected by users after submitting a query similar to the second visual media search query. ### Claim 17 (depends on 13) The system of claim 13, further operable to perform operations comprising: presenting the final group of search results. ### Claim 18 (depends on 13) The system of claim 13, wherein visual media is an image, a video, an image embedded in a file, or a video embedded in file.