# US 2017/0371707 A1 · Data analysis in storage system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0371707 A1
- Document ID: US20170371707A1
- Status: Published application
- Kind: A1
- Application number: 15/629,659
- Filed: 2017-06-21
- Published: 2017-12-28
- Earliest claimed: 2016-06-22
- Assignees: EMC IP Holding Company LLC
- Applicants: EMC IP Holding Company LLC
- Inventors: Colin Yong Zou; Xiangqing Yang; Man Lv; Wei Lin
- Web page: https://patentgrep.com/patent/US20170371707A1

## CPC

- G06F 9/4843: {by program, e.g. task dispatcher, supervisor, operating system}
- G06F 3/061: {Improving I/O performance}
- G06F 3/065: {Replication mechanisms}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 2009/45562: {Creating, deleting, cloning virtual machine instances}
- G06F 2009/45579: {I/O management, e.g. providing access to device drivers or storage}
- G06F 2009/45583: {Memory management, e.g. access or allocation}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments of the present disclosure provide a method of analyzing data in a storage system, a storage system, and a computer program product. The method includes: in response to detecting a request for a data analytic job, obtaining target data for the data analytic job from a first storage device of the storage system. The method also includes storing the target data into a second storage device of the storage system that is assigned for data analysis, and performing the data analytic job using a data processing device and the second storage device in the storage system.

## Claims

### Claim 1

A method of analyzing data in a storage system, comprising:
in response to detecting a request for a data analytic job, obtaining target data for the data analytic job from a first storage device of the storage system;
storing the target data into a second storage device of the storage system that is assigned for data analysis; and
performing the data analytic job using a data processing device and the second storage device in the storage system.

### Claim 2 (depends on 1)

The method of claim 1, wherein performing the data analytic job comprises:
creating a plurality of virtual machines for the data analysis in the storage system; and
scheduling the data analytic job onto the plurality of virtual machines.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
virtualizing the second storage device into a plurality of virtual storage devices; and
allocating the plurality of virtual storage devices for the plurality of virtual machines.

### Claim 4 (depends on 3)

The method of claim 3, wherein scheduling the data analytic job onto the plurality of virtual machines comprises:
scheduling a first task of the data analytic job onto a first virtual machine of the plurality of virtual machines, the first virtual machine being associated with a virtual storage device of the plurality of virtual storage devices that stores the target data, and the first task directly analyzing the target data; and
scheduling a second task of the data analytic job onto a second virtual machine of the plurality of virtual machines, the second task analyzing an intermediate result produced by the first task.

### Claim 5 (depends on 1)

The method of claim 1, wherein the second storage device includes a cache device of the storage system, the method further comprising:
in response to detecting the request for the data analytic job, transmitting an add command to the cache device to assign the cache device for the data analysis; and
in response to completion of the data analytic job, transmitting a remove command to the cache device to cease assignment of the cache device for the data analysis.

### Claim 6 (depends on 1)

The method of claim 1, wherein the data analytic job includes a first task and a second task, the second task being based on an intermediate result produced by the first task, and the method further comprising:
storing the intermediate result in a cache device of the storage system during the performing of the data analytic job.

### Claim 7 (depends on 1)

The method of claim 1, further comprising detecting the request for the data analytic job based on at least one of the following:
a predetermined trigger period;
detection of completion of the data storage job; and
reception of an indication that the data analytic job is to be performed.

### Claim 8 (depends on 1)

The method of claim 1, wherein obtaining the target data comprises:
determining metadata associated with the target data, the metadata indicating information on storage of the target data; and
reading the target data from the first storage device based on the metadata.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
storing into the first storage device a result of the performing of the data analytic job.

### Claim 10 (depends on 1)

The method of claim 1, wherein the data analytic job includes a MapReduce job.

### Claim 11

A storage system, comprising:
a plurality of storage devices;
a data processing device; and
a controller configured to:
in response to detecting a request for a data analytic job, obtain target data for the data analytic job from a first storage device of the plurality of storage devices,
store the target data into a second storage device of the plurality of storage devices that is assigned for data analysis, and
perform the data analytic job using the data processing device and the second storage device.

### Claim 12 (depends on 11)

The storage system of claim 11, wherein the controller is configured to perform the data analytic job by:
creating a plurality of virtual machines for the data analysis in the storage system; and
scheduling the data analytic job onto the plurality of virtual machines.

### Claim 13 (depends on 12)

The storage system of claim 12, wherein the controller is further configured to:
virtualize the second storage device into a plurality of virtual storage devices; and
allocate the plurality of virtual storage devices for the plurality of virtual machines.

### Claim 14 (depends on 13)

The storage system of claim 13, wherein the controller is configured to schedule the data analytic job onto the plurality of virtual machines by:
scheduling a first task of the data analytic job onto a first virtual machine of the plurality of virtual machines, the first virtual machine being associated with a virtual storage device of the plurality of virtual storage devices that stores the target data, and the first task directly analyzing the target data; and
scheduling a second task of the data analytic job onto a second virtual machine of the plurality of virtual machines, the second task analyzing an intermediate result produced by the first task.

### Claim 15 (depends on 11)

The storage system of claim 11, wherein the second storage device includes a cache device of the storage system, the controller being further configured to:
in response to detecting the request for the data analytic job, transmit an add command to the cache device to assign the cache device for the data analysis; and
in response to completion of the data analytic job, transmit a remove command to the cache device to cease assignment of the cache device for the data analysis.

### Claim 16 (depends on 11)

The storage system of claim 11, wherein the data analytic job includes a first task and a second task, the second task being based on an intermediate result produced by the first task, and the controller being further configured to:
store the intermediate result in a cache device of the storage system during the performing of the data analytic job.

### Claim 17 (depends on 11)

The storage system of claim 11, wherein the controller is further configured to detect the request for the data analytic job based on at least one of the following:
a predetermined trigger period;
detection of completion of the data storage job; and
reception of an indication that the data analytic job is to be performed.

### Claim 18 (depends on 11)

The storage system of claim 11, wherein the controller is configured to obtain the target data by:
determining metadata associated with the target data, the metadata indicating information on storage of the target data; and
reading the target data from the first storage device based on the metadata.

### Claim 19 (depends on 11)

The storage system of claim 11, wherein the controller is further configured to:
store into the first storage device a result of the performing of the data analytic job.

### Claim 20 (depends on 11)

The storage system of claim 11, wherein the data analytic job includes a MapReduce job.

### Claim 21

(canceled)
