Sampling-based preview mode for a data intake and query system
AssigneeSplunk Inc.
InventorRam Sriharsha
Life of this patent
Estimating the term…
Loading patent…
AssigneeSplunk Inc.
InventorRam Sriharsha
Estimating the term…
Systems and methods are described for providing a user interface through which a user can program operation of a data processing pipeline by specifying a graph of nodes that transform data and interconnections that designate routing of data between individual nodes within the graph. In response to a user request, a preview mode can be activated that causes the data processing pipeline to retrieve data from at least one source specified by the graph, transform the data according to the nodes of the graph, sample the transformed data, and display the sampling of the transformed data to at least one node without writing the transformed data to at least one destination specified by the graph.
A method, comprising:
A system, comprising:
A non-transitory computer-readable medium comprising instructions executable by a computing system to:
Dependencies are inferred from the claim text.
Drawings are temporarily unavailable. Open the PDF at USPTO
From the US filing history. Foreign family members aren’t listed.
Details of database functions independent of the retrieved data types: indexing; Data structures therefor; Storage structures
Concurrent instruction execution, e.g. pipeline or look ahead: using a plurality of independent parallel functional units
Interprogram communication: buffers; Shared memory; Pipes
Details of searching files based on file metadata: query formulation
About 13 years 4 months of term left · ends 2 Mar 2040 (estimated)
At least one embodiment of the present disclosure pertains to one or more tools for facilitating searching and analyzing large sets of data to locate data of interest.
Information technology (IT) environments can include diverse types of data systems that store large amounts of diverse data types generated by numerous devices. For example, a big data ecosystem may include databases such as MySQL and Oracle databases, cloud computing services such as Amazon web services (AWS), and other data systems that store passively or actively generated data, including machine-generated data (“machine data”). The machine data can include performance data, diagnostic data, or any other data that can be analyzed to diagnose equipment performance problems, monitor user interactions, and to derive other insights.
The large amount and diversity of data systems containing large amounts of structured, semi-structured, and unstructured data relevant to any search query can be massive, and continues to grow rapidly. This technological evolution can give rise to various challenges in relation to managing, understanding and effectively utilizing the data. To reduce the potentially vast amount of data that may be generated, some data systems pre-process data based on anticipated data analysis needs. In particular, specified data items may be extracted from the generated data and stored in a data system to facilitate efficient retrieval and analysis of those data items at a later time. At least some of the remainder of the generated data is typically discarded during pre-processing.
The present disclosure is illustrated by way of example, and not limitation, in the figures of the accompanying drawings, in which like reference numerals indicate similar elements.
FIG. 1 is a block diagram of an example networked computer environment, in accordance with example embodiments.7
FIG. 2 is a block diagram of an example data intake and query system, in accordance with example embodiments.
Embodiments are described herein according to the following outline:
1.0. General Overview
2.0. Operating Environment 2.1. Host Devices 2.2. Client Devices 2.3. Client Device Applications 2.4. Data Intake and Query System Overview