# US 2019/0377741 A1 · Ranking search result documents > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0377741 A1 - Document ID: US20190377741A1 - Status: Published application - Kind: A1 - Application number: 16/550,918 - Filed: 2019-08-26 - Published: 2019-12-12 - Earliest claimed: 2016-10-24 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Mike Bendersky; Marc Alexander Najork; Donald Metzler; Xuanhui Wang - Web page: https://patentgrep.com/patent/US20190377741A1 ## CPC - G06F 16/24578: {using ranking} - G06F 16/248: Presentation of query results - G06F 16/252: {between a Database Management System and a front-end application} - G06F 16/337: {Profile generation, learning or modification} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods and apparatus related to using document feature(s) of a document that is responsive to a query, and optionally query feature(s) of the query, to determine a presentation characteristic for presenting a search result that corresponds to the document. In some implementations, measures associated with the document feature(s) and/or query feature(s) may be used to determine the presentation characteristic. The measures may be based on past interactions, by corresponding users, with other documents that share one or more of the document features with the document, where a plurality of the other documents are different from the document (and optionally each different from one another). In some implementations, the document and/or the other documents include, or are restricted to, documents that are access restricted. ## Claims ### Claim 1 A method implemented by one or more processors, comprising: receiving a query, the query being entered by a user via a user interface input device of a computing device of the user; identifying responsive documents that are responsive to the query, wherein the responsive documents are access restricted documents of the user, and wherein the access restricted documents are accessible to only the user and any restricted group of additional users designated by the user; identifying one or more query features for the query; for each of a plurality of the responsive documents: identifying one or more document features, and generating a query independent measure for the responsive document based on measures for one or more of the document features, wherein each of the measures is based at least in part on past interactions, by corresponding users, with other documents, that are different from the responsive document but have one or more of the document features, when the other documents were presented in response to additional queries that do not include any of the query features, wherein the other documents include access restricted documents, of the corresponding users, that are not accessible to the user; determining, based on the query independent measures for the responsive documents, a presentation order for the responsive documents; and providing, in response to the query, one or more of the responsive documents for presentation based on the presentation order, the presentation being via a user interface output device of the computing device. ### Claim 2 (depends on 1) The method of claim 1, wherein at least one of the responsive documents has never been presented in response to any prior submission of the query. ### Claim 3 (depends on 1) The method of claim 1, wherein the query independent measure for a given document, of the responsive documents, is generated without reference to any past interactions that are specifically directed to the given document. ### Claim 4 (depends on 1) The method of claim 1, wherein a given document feature, of the document features, is a template that includes one or more terms and one or more placeholders, wherein the one or more placeholders each indicate a particular type of string. ### Claim 5 (depends on 1) The method of claim 1, wherein the access restricted documents are accessible to only the user and are not accessible to any of the restricted group of the additional users. ### Claim 6 (depends on 1) The method of claim 1, wherein determining, based on the query independent measures for the responsive documents, the presentation order for the responsive documents, comprises: determining scores for the responsive documents based on the query independent measures; ranking the responsive documents based on the scores; and determining the presentation order based on the ranking. ### Claim 7 (depends on 6) The method of claim 6, further comprising: for each of the responsive documents: generating a query dependent measure based on additional measures of additional past interactions with the document features in response to additional queries having one or more of the query features; and further using the query dependent measures for the access restricted documents to determine the presentation order for the responsive documents. ### Claim 8 (depends on 1) The method of claim 1, wherein the past interactions include document selections. ### Claim 9 A method implemented by one or more processors, comprising: selecting a plurality of document features, wherein selecting a given document feature of the document features is based on occurrence of the given document feature in at least a threshold quantity of access restricted documents; selecting a plurality of query features, wherein selecting a given query feature of the query features is based on occurrence of the given query feature in at least a threshold quantity of access restricted queries, and wherein the access restricted queries are queries for which at least one of the access restricted documents was presented in response to each of the queries; for each of a plurality of query feature, document feature tuples that each include at least one of the query features and at least one of the document features: generating a past interaction measure between the at least one of the query features and the at least one of the document features of the query feature, document feature tuple, wherein generating the past interaction measure is based on a quantity of past interactions with corresponding documents of the access restricted documents when the corresponding documents were presented in response to corresponding queries of the access restricted queries, wherein the corresponding documents have the at least one of the document features of the query feature, document feature tuple, and wherein the corresponding queries have the at least one query features of the query feature, document feature tuple; and storing, in one or more computer-readable media, each of the past interaction measures in association with a corresponding query feature, document feature tuple. ### Claim 10 (depends on 9) The method of claim 9, further comprising: identifying a new document that is responsive to a new query of a given user and that includes a new query group of the document features; and generating a measure for the new document based on a group of the past interaction measures, wherein the group of past interaction measures is selected, for the new document, based on the past interaction measures of the group being stored in association with the query feature, document feature tuples that each include at least one of the document features of the new query group. ### Claim 11 (depends on 10) The method of claim 10, further comprising: providing the new document in response to the new query based on the generated measure for the new document. ### Claim 12 (depends on 11) The method of claim 11, wherein the group of the past interaction measures is further selected based on the past interaction measures of the group being stored in association with the query feature, document feature tuples that each include at least one query feature of the new query. ### Claim 13 (depends on 12) The method of claim 12, wherein the new document is omitted from the access restricted documents used in generating the past interaction measures. ### Claim 14 A method implemented by one or more processors, comprising: selecting a plurality of document features; selecting a plurality of query features; for each of a plurality of query feature, document feature tuples that each include at least one of the query features and at least one of the document features: generating a past interaction measure between the at least one of the query features and the at least one of the document features of the query feature, document feature tuple, wherein generating the past interaction measure is based on a quantity of past interactions with corresponding documents of the access restricted documents when the corresponding documents were presented in response to corresponding queries wherein the corresponding documents have the at least one of the document features of the query feature, document feature tuple, and wherein the corresponding queries have the at least one query features of the query feature, document feature tuple; and storing, in one or more computer-readable media, each of the past interaction measures in association with a corresponding query feature, document feature tuple. ### Claim 15 (depends on 14) The method of claim 14, further comprising: identifying a new document that is responsive to a new query of a given user and that includes a new query group of the document features; and generating a measure for the new document based on a group of the past interaction measures, wherein the group of past interaction measures is selected, for the new document, based on the past interaction measures of the group being stored in association with the query feature, document feature tuples that each include at least one of the document features of the new query group. ### Claim 16 (depends on 15) The method of claim 15, further comprising: providing the new document in response to the new query based on the generated measure for the new document. ### Claim 17 (depends on 16) The method of claim 16, wherein providing the new document based on the generated measure for the new document comprises determining a presentation order, for the new document, based on the generated measure. ### Claim 18 (depends on 15) The method of claim 15, wherein the group of the past interaction measures is further selected based on the past interaction measures of the group being stored in association with the query feature, document feature tuples that each include at least one query feature of the new query. ### Claim 19 (depends on 15) The method of claim 15, wherein the new document is omitted from the access restricted documents used in generating the past interaction measures.