# US 2021/0342354 A1 · Stream browser for data streams

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342354 A1
- Document ID: US20210342354A1
- Status: Published application
- Kind: A1
- Application number: 16/864,905
- Filed: 2020-05-01
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: EMC IP Holding Company LLC
- Applicants: EMC IP Holding Company LLC
- Inventors: Mikhail Danilov; Igor Medvedev
- Web page: https://patentgrep.com/patent/US20210342354A1

## CPC

- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 16/24568: {Data stream processing; Continuous queries}
- G06F 16/1734: {Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs}
- G06F 16/182: Distributed file systems
- G06F 16/2228: {Indexing structures}
- G06F 16/282: {Hierarchical databases, e.g. IMS, LDAP data stores or Lotus Notes}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The described technology is generally directed towards a stream browser that provides a human-readable (e.g., hierarchical) view of event data for a data stream of a data streaming storage service. A stream browser associated with a data stream maintains routing key and event data for the data stream, e.g., in a primary index. The routing keys can correspond to container structures, e.g., folders and subfolders, with the events associated with each routing key corresponding to hierarchical children of the routing key parent container structures (e.g., like files). A secondary index can be used to evict the oldest events from the primary index to limit the number of data stream events returnable by the stream browser to a practical number.

## Claims

### Claim 1

A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, the operations comprising:
maintaining a data structure comprising routing keys for a data stream of events that are stored in the data stream based on the routing keys, in which the data structure comprises the routing keys and respective event data representing one or more respective events associated with respective ones of the routing keys;
receiving a request to return a hierarchical view on stream data of the data stream, the request comprising routing key information;
in response to the request, reading the data structure to obtain a routing key corresponding to the routing key information and event data associated with the routing key; and
returning the hierarchical view of the data stream, comprising representing the routing key as a container structure, wherein the container structure is a hierarchical parent containing the event data associated with the container structure.

### Claim 2 (depends on 1)

The system of claim 1, wherein the receiving the request comprises receiving a list folder content request, wherein the routing key information in the request specifies a first part of the routing key that corresponds to a folder, and wherein the returning the hierarchical view comprises listing respective one or more second parts of the routing key as respective one or more subfolders with respective one or more events as the event data associated with the respective one or more subfolders.

### Claim 3 (depends on 1)

The system of claim 1, wherein the receiving the request comprises receiving a list folder content request, wherein the routing key information in the request specifies null or an empty string, and wherein the returning the hierarchical view comprises listing subfolder content and event content of a root folder.

### Claim 4 (depends on 1)

The system of claim 1, wherein the receiving the request comprises receiving a read event request, wherein the routing key information in the request specifies a full routing key, and wherein the returning the hierarchical view comprises listing one or more events associated with the full routing key as the event data associated with the container structure corresponding to the full routing key.

### Claim 5 (depends on 1)

The system of claim 1, wherein the event data comprises two or more events, wherein the data structure comprises stream position data for each of the two or more events, and wherein the operations further comprise sorting the events by respective stream position data before returning the hierarchical view of the data stream.

### Claim 6 (depends on 1)

The system of claim 1, wherein the data structure is a first data structure, and wherein the operations further comprise maintaining a second data structure that relates respective routing keys to respective event positions in the data stream, wherein the respective event positions for a respective routing key identify a respective first position in the data stream of a least recent event associated with the respective routing key and a respective second position in the data stream of a most recent event associated with the respective routing key.

### Claim 7 (depends on 6)

The system of claim 6, wherein the event data comprises two or more events, and wherein the operations further comprise accessing the second data structure based on the routing key to evict one or more least recent events from the first data structure.

### Claim 8 (depends on 6)

The system of claim 6, wherein the data stream is associated with a stream cut, wherein the data stream is truncated to remove events based on the stream cut, and wherein the operations further comprise, accessing the second data structure based on the stream cut to remove event data from the first data structure that correspond to truncated events, and to modify event position data in the second data structure.

### Claim 9 (depends on 1)

The system of claim 1, wherein the event data exceeds a resource limitation, and wherein the returning the hierarchical view of the data stream comprises providing a sliding window of event data that does not exceed the resource limitation.

### Claim 10 (depends on 1)

The system of claim 1, wherein the maintaining the data structure comprising the routing keys for the data stream comprises maintaining a hierarchical data index.

### Claim 11

A method comprising:
logically associating a stream browser with a data stream, the stream browser maintaining a data structure comprising routing keys for a data stream of events that are stored in the data stream based on the routing keys, in which the data structure maintains respective routing keys and one or more respective events associated with the respective routing keys;
receiving a request at the stream browser to return a hierarchical view on stored data of the data stream, the request comprising routing key information;
in response to the request, accessing the data structure to obtain a routing key corresponding to the routing key information and events associated with the routing key; and
returning a hierarchical view of the data stream, comprising representing the routing key as a folder that is a hierarchical parent containing the events associated with the routing key.

### Claim 12 (depends on 11)

The method of claim 11, wherein the receiving the request comprises receiving a list folder content request, wherein the routing key information in the request specifies a first part of the routing key that corresponds to a folder, and wherein the returning the hierarchical view comprises listing respective one or more second parts of the routing key as respective one or more subfolders with respective one or more events associated with the respective one or more subfolders.

### Claim 13 (depends on 11)

The method of claim 11, wherein the receiving the request comprises receiving a read event request, wherein the routing key information in the request specifies a full routing key, and wherein the returning the hierarchical view comprises listing the full routing key as the folder containing the events.

### Claim 14 (depends on 11)

The method of claim 11, wherein the data structure is a first data structure, and wherein the stream browser further maintains a second data structure that relates the routing key to a first stream position of a least recent event associated with the routing key and a second stream position of a most recent event associated with the routing key.

### Claim 15 (depends on 14)

The method of claim 14, further comprising, evicting events from the first data structure based on the least recent event.

### Claim 16 (depends on 11)

The method of claim 11, further comprising, configuring the hierarchical view of the data stream as an interactive sliding window over a selectable portion of the events associated with the routing key.

### Claim 17

A machine-readable storage medium, comprising executable instructions that, when executed by a processor of a streaming data storage system, facilitate performance of operations, the operations comprising:
maintaining a first data structure comprising routing keys, events and position data for the events of a data stream that stores the events based on the routing keys;
maintaining a second data structure that relates, for respective routing keys, respective first stream position data for a least recent event associated with a respective routing key and respective second stream position data for a most recent event associated with the respective routing key;
receiving a request to return a hierarchical view on stream data of the data stream, the request comprising routing key information;
in response to the request, reading the first data structure based on the routing key information to obtain event data associated with the routing key; and
returning a hierarchical view of the data stream, comprising representing the routing key as a container structure that is a hierarchical parent containing the events.

### Claim 18 (depends on 17)

The machine-readable storage medium of claim 17, wherein the receiving the request comprises receiving a list folder content request, wherein the routing key information in the request specifies a first part of a routing key that corresponds to a folder, and wherein the returning the hierarchical view comprises representing the first part of a routing key as a hierarchical parent folder containing one or more subfolders.

### Claim 19 (depends on 17)

The machine-readable storage medium of claim 17, wherein the receiving the request comprises receiving a read event request, wherein the routing key information in the request specifies a full routing key, and wherein the returning the hierarchical view comprises listing the sorted events associated with the full routing key.

### Claim 20 (depends on 17)

The machine-readable storage medium of claim 17, wherein the operations further comprise accessing the second data structure to remove an event from the first data structure based on the least recent event.
