# US 2023/0409640 A1 · Methods and systems for presenting privacy friendly query activity based on environmental signal(s)

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409640 A1
- Document ID: US20230409640A1
- Status: Published application
- Kind: A1
- Application number: 18/239,727
- Filed: 2023-08-29
- Published: 2023-12-21
- Earliest claimed: 2020-11-30
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Matthew Sharifi; Victor Carbune
- Web page: https://patentgrep.com/patent/US20230409640A1

## CPC

- G06F 16/3322: {using system suggestions (G06F16/3325 takes precedence)}
- G06F 16/90335: {Query processing}
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Implementations are directed to receiving a search query from a user, obtaining environmental signal(s) associated with an environment in which the user is located when the search query is received, processing the environmental signal(s) to generate a privacy measure associated with submission of the search query, obtaining additional environmental signal(s) associated with the environment in which the user is located when user input directed to a search interface is received, processing the additional environmental signal(s) to generate an additional privacy measure associated with the user input, selecting, from a superset of historical search queries of the user, a subset of the historical search queries based on at least the privacy measure and the additional privacy measure, and causing the subset of the historical search queries to be presented to the user in response to receiving the user input directed to the search interface.

## Claims

### Claim 1

A method implemented by one or more processors, the method comprising:
receiving, via a client device of a user, user input that includes a search query;
obtaining one or more environmental signals associated with an environment in which the user is located at a time when the search query is received,
wherein the one or more environmental signals associated with the environment in which the user is located at the time when the search query is received includes at least vision data that captures the environment in which the user is located at the time when the search query is received;
processing the one or more environmental signals to generate a privacy measure associated with submission of the search query,
wherein processing the one or more environmental signals to generate the privacy measure associated with submission of the search query comprises processing at least the vision data that captures the environment in which the user is located at the time when the search query is received to generate the privacy measure; and
subsequent to generating the privacy measure associated with the submission of the search query:
obtaining one or more additional environmental signals associated with the environment in which the user is located at a subsequent time,
wherein the subsequent time is subsequent to the time when the search query was received, and
wherein the one or more additional environmental signals associated with the environment in which the user is located at the subsequent time includes at least additional vision data that captures the environment in which the user was located at the time when the search query was received or an additional environment of the user;
processing the one or more additional environmental signals to generate an additional privacy measure,
wherein processing the one or more additional environmental signals to generate the additional privacy measure comprises processing at least the additional vision data that captures the additional environmental noise of the environment when the partial search query is received;
selecting, from a superset of historical search queries of the user, and based on comparing the privacy measure and the additional privacy measure, a subset of the superset of historical search queries; and
causing the subset of the historical search queries to be presented to the user as query suggestions for additional user input to be provided to the client device or the additional client device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more environmental signals associated with the environment of the user further include one or more of: location information that corresponds to a location of the user when the search query is received, or audio data that captures environmental noise of the environment when the search query is received.

### Claim 3 (depends on 2)

The method of claim 2, wherein the one or more environmental signals associated with the search query further include at least the location information that corresponds to the location of the user when the search query is received.

### Claim 4 (depends on 3)

The method of claim 3, wherein processing the one or more environmental signals to generate the privacy measure associated with the submission of the search query further comprises:
processing, using a machine learning model, the location information that corresponds to the location of the user when the search query is received and the vision data that captures the environment in which the user is located at the time when the search query is received to generate output associated with one or more types of the environment,
wherein generating the privacy measure associated with the submission of the search query is based on at least the output associated with one or more of the types of the environment.

### Claim 5 (depends on 4)

The method of claim 4, wherein the type of the environment includes one or more of: a public environment, a semi-public environment, or a private environment.

### Claim 6 (depends on 2)

The method of claim 2, wherein the one or more environmental signals associated with the search query further include at least the audio data that captures the environmental noise of the environment when the search query is received.

### Claim 7 (depends on 6)

The method of claim 6, wherein processing the one or more environmental signals to generate the privacy measure associated with the submission of the search query further comprises:
processing, using a machine learning model, the audio data that captures the environmental noise of the environment when the search query is received and the vision data that captures the environment of the user when the search query is received to generate output associated with one or more types of the environment,
wherein generating the privacy measure associated with the submission of the search query is based on at least the output associated with one or more of the types of the environment.

### Claim 8 (depends on 1)

The method of claim 1, wherein processing the one or more environmental signals to generate the privacy measure associated with the submission of the search query further comprises:
processing, using a machine learning model, the vision data that captures the environment when the search query is received to generate output associated with one or more visual properties of the environment,
wherein generating the privacy measure associated with the submission of the search query is based on at least the one or more visual properties of the environment.

### Claim 9 (depends on 8)

The method of claim 8, wherein the one or more visual properties of the environment include one or more of: an indication of whether one or more additional users are present in the environment, or an indication of one or more objects that are present in the environment.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
determining, based on the comparing, whether the additional privacy measure matches the privacy measure.

### Claim 11 (depends on 10)

The method of claim 10, wherein selecting the subset of the historical search queries is in response to determining that the additional privacy measure does not match the privacy measure.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
causing a selectable element to be presented along with the subset of the historical search queries, wherein the selectable element, when selected, causes one or more additional historical search queries that were not selected for inclusion in the subset to be presented to the user via the client device or the additional client device.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
generating, based on the privacy measure associated with the submission of the search query, a prompt to solicit a user selection associated with whether the search query should be included in the subset; and
causing the prompt to be presented to the user via the client device or the additional client device.

### Claim 14

A method implemented by one or more processors, the method comprising:
receiving, via a client device of a user, user input that includes a search query;
processing a set of environmental signals associated with an environment in which the user is located at a time when the search query is received to generate a privacy measure associated with submission of the search query,
wherein the set of environmental signals associated with the environment in which the user is located at the time when the search query is received includes at least vision data that captures the environment in which the user is located at the time when the search query is received, and
wherein processing the set of environmental signals to generate the privacy measure associated with submission of the search query comprises processing at least the vision data that captures the environment in which the user is located at the time when the search query is received to generate the privacy measure; and
subsequent to generating the privacy measure associated with the submission of the search query:
processing an additional set of additional environmental signals associated with the environment in which the user is located at a subsequent time to generate an additional privacy measure associated with the partial search query,
wherein the subsequent time is subsequent to the time when the search query was received,
wherein the additional set of environmental signals associated with the environment in which the user is located at the subsequent time includes at least additional vision data that captures the environment in which the user was located at the time when the search query was received or an additional environment of the user, and
wherein processing the additional set of environmental signals to generate the additional privacy measure comprises processing at least the additional vision data that captures the additional environmental noise of the environment when the partial search query is received;
causing restricted historical search queries to be presented as query suggestions for additional user input to be provided to the client device or the additional client device,
wherein the restricted historical search queries are restricted based on the privacy measure and the additional privacy measure, and
wherein the restricted historical search queries do not include the search query;
receiving, via the client device or the additional client device, additional user input that includes an additional query,
wherein the additional search query is an additional instance of the search query; and
processing a further additional set of environmental signals associated with the environment in which the user is located at a further subsequent time when the additional search query is received to modify the privacy measure associated with the submission of the search query,
wherein the further subsequent time is subsequent to the time when the search query was received and the subsequent time when the restricted historical search queries were presented, and
wherein the further additional set of environmental signals associated with the environment in which the user is located at the further subsequent time when additional search query is received includes at least further additional vision data that captures the environment in which the user was located at the time when the search query was received or the additional environment of the user.

### Claim 15

A system comprising:
at least one processor; and
at least one memory storing instructions that, when executed, cause the at least one processor to:
receive, via a client device of a user, user input that includes a search query;
obtain one or more environmental signals associated with an environment in which the user is located at a time when the search query is received,
wherein the one or more environmental signals associated with the environment in which the user is located at the time when the search query is received includes at least vision data that captures the environment in which the user is located at the time when the search query is received;
process the one or more environmental signals to generate a privacy measure associated with submission of the search query,
wherein the instructions to process the one or more environmental signals to generate the privacy measure associated with submission of the search query comprise instructions to process at least the vision data that captures the environment in which the user is located at the time when the search query is received to generate the privacy measure; and
subsequent to generating the privacy measure associated with the submission of the search query:
obtain one or more additional environmental signals associated with the environment in which the user is located at a subsequent time,
wherein the subsequent time is subsequent to the time when the search query was received, and
wherein the one or more additional environmental signals associated with the environment in which the user is located at the subsequent time includes at least additional vision data that captures the environment in which the user was located at the time when the search query was received or an additional environment of the user;
process the one or more additional environmental signals to generate an additional privacy measure,
wherein the instructions to process the one or more additional environmental signals to generate the additional privacy measure comprise instructions to process at least the additional vision data that captures the additional environmental noise of the environment when the partial search query is received;
select, from a superset of historical search queries of the user, and based on comparing the privacy measure and the additional privacy measure, a subset of the superset of historical search queries; and
cause the subset of the historical search queries to be presented to the user as query suggestions for additional user input to be provided to the client device or the additional client device.
