# US 2023/0409577 A1 · Aggregating information from different data feed services

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409577 A1
- Document ID: US20230409577A1
- Status: Published application
- Kind: A1
- Application number: 17/842,132
- Filed: 2022-06-16
- Published: 2023-12-21
- Earliest claimed: 2022-06-16
- Assignees: X Development LLC
- Applicants: X Development LLC
- Inventors: David Andre
- Web page: https://patentgrep.com/patent/US20230409577A1

## CPC

- G06F 16/24556: {Aggregation; Duplicate elimination}
- G06F 16/958: Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F 16/248: Presentation of query results
- G06F 40/30: Semantic analysis
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Implementations are described herein for aggregating information responsive to a query from multiple different data feed services using machine learning. In various implementations, NLP may be performed on a natural language input comprising a query for information to generate a data feed-agnostic aggregator embedding (FAAE). A plurality of data feed services may be selected, each having its own data feed service action space that includes actions that are performable to access data via the data feed service. The FAAE may be processed based on domain-specific machine learning models corresponding to the selected data feed services. Each domain-specific machine learning model may translate between a respective data feed service action space and a data feed-agnostic semantic embedding space. Using these models, action(s) may be selected from the data feed service action spaces and performed to aggregate, from the plurality of data feed services, data that is responsive to the query.

## Claims

### Claim 1

A method implemented using one or more processors and comprising:
obtaining a natural language input comprising a query for information;
performing natural language processing (NLP) on the natural language input to generate a data feed-agnostic aggregator embedding;
selecting a plurality of data feed services, wherein each data feed service of the selected plurality of data feed services includes its own data feed service action space, wherein each data feed service action space comprises actions that are performable to access data communicated via the respective data feed service;
processing the feed-agnostic aggregator embedding based on a plurality of domain-specific machine learning models corresponding to the plurality of data feed services, wherein each domain-specific machine learning model is trained to translate between a respective data feed service action space and a data feed-agnostic semantic embedding space that includes the data feed-agnostic aggregator embedding;
based on the processing, selecting and performing one or more actions from each of the data feed service action spaces to aggregate, from the plurality of data feed services, data that is responsive to the query; and
causing the aggregated responsive data to be presented as output.

### Claim 2 (depends on 1)

The method of claim 1, wherein the plurality of data feed services are selected based on an entity identifier contained in the query for information.

### Claim 3 (depends on 1)

The method of claim 1, wherein the query for information comprises a request for social media posts from a particular individual, and the selected plurality of data feed services include two or more social media services that are selected based on membership of the particular individual with the two or more social media services.

### Claim 4 (depends on 3)

The method of claim 3, wherein for a given social media service of the two or more social media services, the one or more actions selected from the data feed service action space of the given social media service include accessing one or more posts by the particular individual from the particular individual's posting history.

### Claim 5 (depends on 3)

The method of claim 3, wherein for a given social media service of the two or more social media services, the one or more actions selected from the data feed service action space of the given social media service include filtering one or more posts by the particular individual from a general data feed on the given social media service provided to a user who issued the natural language input.

### Claim 6 (depends on 1)

The method of claim 1, wherein the plurality of data feed services are selected based on a lookup table controlled by a user who issued the natural language input.

### Claim 7 (depends on 6)

The method of claim 6, wherein the lookup table comprises a contact list of the user.

### Claim 8 (depends on 1)

The method of claim 1, wherein the plurality of data feed services are selected based on a user who issued the natural language input having previously provided permission to an aggregator agent to access the plurality of data feed services.

### Claim 9 (depends on 1)

The method of claim 1, wherein at least one of the data feed services comprises a virtual space that forms part of a larger metaverse comprising multiple virtual spaces.

### Claim 10 (depends on 1)

The method of claim 1, wherein the aggregated responsive data is presented to a user who issued the natural language input as part of a metaverse graphical user interface.

### Claim 11 (depends on 1)

The method of claim 1, wherein the plurality of data feed services are selected based on a browsing history of a user who issued the natural language input.

### Claim 12

A system comprising one or more processors and memory storing instructions that, in response to execution of the instructions, cause the one or more processors to:
obtain a natural language input comprising a query for information;
perform natural language processing (NLP) on the natural language input to generate a data feed-agnostic aggregator embedding;
select a plurality of data feed services, wherein each data feed service of the selected plurality of data feed services includes its own data feed service action space, wherein each data feed service action space comprises actions that are performable to access data communicated via the respective data feed service;
process the feed-agnostic aggregator embedding based on a plurality of domain-specific machine learning models corresponding to the plurality of data feed services, wherein each domain-specific machine learning model is trained to translate between a respective data feed service action space and a data feed-agnostic semantic embedding space that includes the data feed-agnostic aggregator embedding;
select and perform one or more actions from each of the data feed service action spaces to aggregate, from the plurality of data feed services, data that is responsive to the query; and
cause the aggregated responsive data to be presented as output.

### Claim 13 (depends on 12)

The system of claim 12, wherein the plurality of data feed services are selected based on an entity identifier contained in the query for information.

### Claim 14 (depends on 12)

The system of claim 12, wherein the query for information comprises a request for social media posts from a particular individual, and the selected plurality of data feed services include two or more social media services that are selected based on membership of the particular individual with the two or more social media services.

### Claim 15 (depends on 14)

The system of claim 14, wherein for a given social media service of the two or more social media services, the one or more actions selected from the data feed service action space of the given social media service include accessing one or more posts by the particular individual from the particular individual's posting history.

### Claim 16 (depends on 14)

The system of claim 14, wherein for a given social media service of the two or more social media services, the one or more actions selected from the data feed service action space of the given social media service include filtering one or more posts by the particular individual from a general data feed on the given social media service provided to a user who issued the natural language input.

### Claim 17 (depends on 12)

The system of claim 12, wherein the plurality of data feed services are selected based on a lookup table controlled by a user who issued the natural language input.

### Claim 18 (depends on 17)

The system of claim 17, wherein the lookup table comprises a contact list of the user.

### Claim 19 (depends on 12)

The system of claim 12, wherein the plurality of data feed services are selected based on a user who issued the natural language input having previously provided permission to an aggregator agent to access the plurality of data feed services.

### Claim 20

A non-transitory computer-readable medium comprising instructions that, in response to execution of the instructions by a processor, cause the processor to:
obtain a natural language input comprising a query for information;
perform natural language processing (NLP) on the natural language input to generate a data feed-agnostic aggregator embedding;
select a plurality of data feed services, wherein each data feed service of the selected plurality of data feed services includes its own data feed service action space, wherein each data feed service action space comprises actions that are performable to access data communicated via the respective data feed service;
process the feed-agnostic aggregator embedding based on a plurality of domain-specific machine learning models corresponding to the plurality of data feed services, wherein each domain-specific machine learning model is trained to translate between a respective data feed service action space and a data feed-agnostic semantic embedding space that includes the data feed-agnostic aggregator embedding;
select and perform one or more actions from each of the data feed service action spaces to aggregate, from the plurality of data feed services, data that is responsive to the query; and
cause the aggregated responsive data to be presented as output.
