# US 2010/0169318 A1 · Contextual representations from data streams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0169318 A1
- Document ID: US20100169318A1
- Status: Published application
- Kind: A1
- Application number: 12/345,714
- Filed: 2008-12-30
- Published: 2010-07-01
- Earliest claimed: 2008-12-30
- Assignees: Microsoft Corporation
- Inventors: Donald Thompson; Alexander Sasha Stojanovic; Alexander Kolmykov-Zotov
- Web page: https://patentgrep.com/patent/US20100169318A1

## CPC

- G06F 16/957: Browsing optimisation, e.g. caching or content distillation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A user's experience with internet content may be given semantic meaning based upon extracting features of the content and creating kind classifications from the features. Kind classifications may be used to enrich a user's experience with internet content by providing meaningful navigation and discovery of information. As provided herein, a data stream (e.g., HTML, audio, video, unstructured data, etc.) is received, and features (e.g., text, phrases, titles, paragraphs, image data, etc.) may be extracted from the data stream. Kind classifications may be created based upon the extracted features. For example, a shirt image kind classification may be created based upon a button image feature, a collar image feature, and a sleeve image feature. The user's experience may be enriched by a presentation of actions allowing the user to view similar shirts, purchase the shirt, and/or discover other information relating to the shirt, for example.

## Claims

### Claim 1

A system for creating contextual representations of a data stream through semantic interpretation, comprising:
an import component configured to:
receive a data stream;
extract metadata from the data stream;
create a work packet associated with the data stream and the extracted metadata;
an extraction component configured to:
extract at least one feature from the work packet;
a classification component configured to:
create at least one kind classification based upon at least one feature in the work packet, the kind classification comprising:
a confidence level of the classification;
a timestamp; and
the data stream associated with the kind classification; and
a presentation component configured to:
present at least one kind classification.

### Claim 2 (depends on 1)

The system of claim 1, the import component configured to:
remove at least one non-semantic entity within the data stream in the work packet.

### Claim 3 (depends on 1)

The system of claim 1, the classification component configured to:
determine whether at least one duplicate kind classification exists within the work packet; and
upon determining whether at least one duplicate kind classification exists perform at least one of:
remove the at least one duplicate kind classification from the work packet; and
revise the at least one duplicate kind classification to create a revised duplicate kind classification within the work packet.

### Claim 4 (depends on 1)

The system of claim 1, comprising:
a storage component configured to:
store at least one kind classification from the work packet into a persistent storage; and
index at least one kind classification within the persistent storage based upon at least one of:
textual indexing;
spatial indexing; and
temporal indexing.

### Claim 5 (depends on 4)

The system of claim 4, the storage component configured to:
create a schema associated with the at least one kind classification indexed within the persistent storage.

### Claim 6 (depends on 1)

The system of claim 1, comprising:
a ranking component configured to:
create a ranking set comprising an ordered vector of kind classifications based upon at least one user preference.

### Claim 7 (depends on 1)

The system of claim 1, the classification component configured to create at least one kind classification based upon external reference data.

### Claim 8 (depends on 1)

The system of claim 1, the storage component configured to store at least one kind classification within a cloud based computing system.

### Claim 9 (depends on 1)

The system of claim 1, the data stream comprising data associated with at least one of the following:
an e-mail,
text image,
text,
video,
audio,
unstructured data, and
structured data.

### Claim 10

A method for creating contextual representations of a data stream through semantic interpretation, comprising:
receiving a data stream;
extracting metadata from the data stream;
extracting at least one feature from the data stream based upon the extracted metadata;
creating at least one kind classification based upon at least one feature, a kind classification comprising:
a confidence level of the classification;
a timestamp; and
the data stream associated with the kind classification; and
presenting at least one kind classification.

### Claim 11 (depends on 10)

The method of claim 10, the receiving comprising:
removing at least one non-semantic entity with the data stream.

### Claim 12 (depends on 10)

The method of claim 10, the classifying comprising:
determining whether at least one duplicate kind classification exists; and
upon determining whether at least one duplicate kind classification exists, performing at least one of:
remove the at least one duplicate kind classification; and
revise the at least one duplicate kind classification to create a revised duplicate kind classification.

### Claim 13 (depends on 10)

The method of claim 10, comprising:
storing at least one kind classification in a persistent storage.

### Claim 14 (depends on 13)

The method of claim 13, comprising:
indexing at least one kind classification within the persistent storage based upon at least one of:
textual indexing;
spatial indexing; and
temporal indexing.

### Claim 15 (depends on 14)

The method of claim 14, comprising:
creating a schema associated with the at least one kind classification indexed within the persistent storage.

### Claim 16 (depends on 10)

The method of claim 10, comprising:
creating a ranking set comprising an ordered vector of kind classifications based upon at least one user preference.

### Claim 17 (depends on 15)

The method of claim 15, comprising:
presenting the ranking set within at least one of:
a web browser;
a window; and
a carousel.

### Claim 18 (depends on 13)

The method of claim 13, comprising:
storing the persistent storage within a cloud based computing environment.

### Claim 19 (depends on 10)

The method of claim 10, the receiving comprising:
receiving the data stream comprising data associated with at least one of the following:
an e-mail,
text image,
text,
video,
audio,
unstructured data, and
structured data.

### Claim 20

A system for creating contextual representations of a data stream through semantic interpretation, comprising:
an import component configured to:
receive a data stream as a work packet;
remove at least one non-semantic entity within the data stream in the work packet;
create a format table based upon stripped metadata from the data stream; and
create a work packet associated with the data stream and the format table;
an extraction component configured to:
extract at least one feature from the work packet;
a classification component configured to:
create at least one kind classification based upon at least one feature in the work packet, the kind classification comprising:
a confidence level associated with the classification;
a timestamp; and
the data stream associated with the kind classification; and
determine whether at least one duplicate kind classification exists within the work packet; and
upon determining whether at least one duplicate kind classification exists perform at least one of:
remove the at least one duplicate kind classification from the work packet; and
revise the at least one duplicate kind classification to create a revised duplicate kind classification within the work packet;
a presentation component configured to:
present at least one kind classification from the work packet; and
a storage component configured to:
store at least one kind classification from the work packet in a persistent storage;
index at least one kind classification within the persistent storage based upon at least one of:
textual indexing;
spatial indexing; and
temporal indexing; and
create a schema associated with the at least one kind classification indexed within the persistent storage.
