# US 2012/0269053 A1 · Co-Scheduling of Network Resource Provisioning and Host-to-Host Bandwidth Reservation on High-Performance Network and Storage Systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0269053 A1
- Document ID: US20120269053A1
- Status: Published application
- Kind: A1
- Application number: 13/273,541
- Filed: 2011-10-14
- Published: 2012-10-25
- Earliest claimed: 2010-10-15
- Assignees: Brookhaven Science Associates, LLC
- Inventors: Dantong Yu; Dimitrios Katramatos; Alexander Sim; Arie Shoshani
- Web page: https://patentgrep.com/patent/US20120269053A1

## CPC

- H04L 12/4641: {Virtual LANs, VLANs, e.g. virtual private networks [VPN] (LAN interconnection over a bridge based backbone H04L12/462; encapsulation techniques H04L12/4633; routing of packets H04L45/00; packet switches H04L49/00; virtual private networks for security H04L63/0272)}
- H04L 47/782: {Hierarchical allocation of resources, e.g. involving a hierarchy of local and centralised entities}
- H04L 47/785: among multiple network domains, e.g. multilateral agreements
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A cross-domain network resource reservation scheduler configured to schedule a path from at least one end-site includes a management plane device configured to monitor and provide information representing at least one of functionality, performance, faults, and fault recovery associated with a network resource; a control plane device configured to at least one of schedule the network resource, provision local area network quality of service, provision local area network bandwidth, and provision wide area network bandwidth; and a service plane device configured to interface with the control plane device to reserve the network resource based on a reservation request and the information from the management plane device. Corresponding methods and computer-readable medium are also disclosed.

## Claims

### Claim 1

A cross-domain network resource reservation scheduler configured to schedule at least one path from at least one end-site, the cross-domain network resource reservation scheduler being associated with the at least one end-site, the cross-domain network resource reservation scheduler comprising:
a management plane device configured to monitor and provide information representing at least one of functionality, performance, faults, and fault recovery associated with a network resource;
a control plane device configured to schedule the network resource by at least one provision local area network quality of service, provision local area network bandwidth, and provision wide area network bandwidth; and
a service plane device configured to interface with the control plane device to reserve the network resource based on a reservation request and the information from the management plane device, the management plane device, control plane device, and service plane device being associated with the at least one end-site.

### Claim 2 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the cross-domain network resource reservation scheduler is configured to schedule at least one end-to-end path interconnecting at least two different end-sites, the cross-domain network resource reservation scheduler being associated with at least one of the at least two different end-sites.

### Claim 3 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the network resource comprises at least one local area network operatively coupled to at least one wide area network, the at least one local area network and the at least one wide area network being interconnected by communication links.

### Claim 4 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the service plane device comprises:
at least one network device controller (NDC) configured to control configuration of network devices associated with a local area network, the local area network being associated with the at least one end-site;
an end-site domain controller (ESDC) configured to control a resource associated with the local area network using the at least one NDC; and
a distributed services module (DSM) configured to interface with the at least one ESDC to configure path segments associated with the local area network, the DSM being configured to interface with an inter-domain controller (IDC) to provide the path from the at least one end-site.

### Claim 5 (depends on 4)

The cross-domain network resource reservation scheduler defined by claim 4, further comprising a hybrid star/daisy-chain configuration scheme in which the DSM is configured to negotiate end-site LAN reservation parameters and to subsequently negotiate WAN reservation parameters using the IDC.

### Claim 6 (depends on 4)

The cross-domain network resource reservation scheduler defined by claim 4, wherein the NDC includes functionality of the network resource, thereby hiding configuration information from the control plane device and management plane device.

### Claim 7 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein dynamic service level agreements (SLAs) are established between network domains along the path from the at least one end-site.

### Claim 8 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the service plane device is configured to consolidate overlapping reservation requests using user-defined virtual local area network identification (VLAN ID), bandwidth utilization levels, and total capacity constraints, the service plane device being configured to assign consolidated reservation requests to a circuit based on duration and capacity associated with the circuit.

### Claim 9 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the service plane device is configured to generate a bandwidth usage graph (BUG) associated with at least one prior reservation request as a step function, the service plane device being configured to subtract the BUG from a maximum bandwidth availability associated with the network resource to obtain a bandwidth availability graph (BAG) associated with the network resource.

### Claim 10 (depends on 9)

The cross-domain network resource reservation scheduler defined by claim 9, wherein the service plane device is configured to intersect a plurality of BAGs to obtain an end-to-end BAG, each of the plurality of BAGs being associated with at least one of a plurality of network resources associated with the path from the at least one end-site, the service plane device being configured to allocate a new reservation request based on the end-to-end BAG.

### Claim 11 (depends on 10)

The cross-domain network resource reservation scheduler defined by claim 10, wherein the service plane device is configured to allocate the new reservation request based on the end-to-end BAG using an algorithm to determine largest rectangles under a histogram, the service plane device being configured to modify bandwidth and duration associated with the new reservation request while maintaining data volume associated with the new reservation request constant, thereby fitting the new reservation request within the largest rectangles associated with the end-to-end BAG and satisfying at least one of earliest start time constraint and latest end time constraint associated with the new reservation request.

### Claim 12 (depends on 4)

The cross-domain network resource reservation scheduler defined by claim 4, wherein the DSM is configured to establish reservation parameters associated with the wide area network using a trial-and-error method with predetermined solutions.

### Claim 13 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the network resource is configured to at least one of send data and receive data.

### Claim 14 (depends on 4)

The cross-domain network resource reservation scheduler defined by claim 4, further comprising a storage resource manager (SRM) associated with a storage resource, the SRM being configured to negotiate storage and transfer parameters, the SRM being configured to negotiate network bandwidth reservation parameters with the DSM.

### Claim 15 (depends on 14)

The cross-domain network resource reservation scheduler defined by claim 14 wherein the SRM represents storage system bandwidth availability as a bandwidth availability graph (BAG), the DSM determining network bandwidth reservation parameters using the BAG and reservation request parameters, the DSM being configured to intersect a plurality of BAGs along the path from the at least one end-site to obtain an end-to-end BAG, each of the plurality of BAGs being associated with at least one of a plurality of network resources along the path from the at least one end-site, the DSM being configured to allocate a new reservation request based on the end-to-end BAG.

### Claim 16 (depends on 14)

The cross-domain network resource reservation scheduler defined by claim 14, wherein the storage resource is configured to at least one of send, receive, and store data.

### Claim 17 (depends on 1)

The cross-domain network resource reservation scheduler defined by claim 1, wherein the scheduler is configured to schedule the at least one end-to-end path from the at least one end-site and provide network quality of service guarantees across multiple autonomous domains having different levels of hertogeneity in at least one of administrative policy, control plane technology, and data plane technology without at least one of prior inter-domain Service Level Agreements and predetermined configuration of network devices associated with the domains.

### Claim 18

A method of scheduling reservations on a path from at least one end-site, the method comprising:
monitoring, by a management plane device, and providing information representing at least one of functionality, performance, faults, and fault recovery associated with a network resource;
scheduling, by a control plane device, the network resource by at least one of provisioning local area network quality of service, provisioning local area network bandwidth, and provisioning wide area network bandwidth; and
interfacing, by a service plane device, with the control plane device to reserve the network resource based on a reservation request and the information from the management plane device, the management plane device, control plane device, and service plane device being associated with the at least one end-site.

### Claim 19 (depends on 18)

The method defined by claim 18, further comprising scheduling at least one end-to-end path interconnecting at least two different end-sites, method being associated with at least one of the at least two different end-sites.

### Claim 20 (depends on 18)

The method defined by claim 18, wherein the network resource comprises at least one local area network operatively coupled to at least one wide area network, the at least one local area network and the at least one wide area network being interconnected by communication links.

### Claim 21 (depends on 18)

The method defined by claim 18 further comprising:
configuring network devices associated with a local area network, by at least one network device controller (NDC), the local area network being associated with the at least one end-site;
controlling, by an end-site domain controller (ESDC) a resource associated with the local area network using the at least one NDC; and
interfacing, by a distributed services module (DSM), with the at least one ESDC to configure path segments associated with the local area network, the DSM being configured to interface with an inter-domain controller (IDC) to provide the path from the at least one end-site.

### Claim 22 (depends on 19)

The method defined by claim 19, further comprising:
negotiating, by the DSM, end-site LAN reservation parameters; and
negotiating, subsequently, WAN reservation parameters using the IDC in a hybrid star/daisy-chain configuration scheme.

### Claim 23 (depends on 21)

The method defined by claim 21, further comprising hiding configuration information from the control plane device and management plane device by the NDC including functionality of the network resource.

### Claim 24 (depends on 18)

The method defined by claim 18, further comprising establishing dynamic service level agreements (SLAs) between network domains along the path from the at least one end-site.

### Claim 25 (depends on 18)

The method defined by claim 18, further comprising:
consolidating, by the service plane device, overlapping reservation requests using user-defined virtual local area network identification (VLAN ID), bandwidth utilization levels, and total capacity constraints; and
assigning, by the service plane device, consolidated reservation requests to a circuit based on duration and capacity associated with the circuit.

### Claim 26 (depends on 18)

The method defined by claim 18, further comprising:
generating, by the service plane device, a bandwidth usage graph (BUG) associated with at least one prior reservation request as a step function; and
subtracting, by the service plane device, the BUG from a maximum bandwidth availability associated with the network resource to obtain a bandwidth availability graph (BAG) associated with the network resource.

### Claim 27 (depends on 26)

The method defined by claim 26, further comprising:
intersecting a plurality of BAGs to obtain an end-to-end BAG, each of the plurality of BAGs being associated with at least one of a plurality of network resources associated with the path from the at least one end-site; and
allocating, by the service plane device, a new reservation request based on the end-to-end BAG.

### Claim 28 (depends on 27)

The method defined by claim 27, further comprising:
allocating, by the service plane device, the new reservation request based on the end-to-end BAG using an algorithm to determine largest rectangles under a histogram; and
modifying, by the service plane device, bandwidth and duration associated with the new reservation request while maintaining data volume associated with the new reservation request constant, thereby fitting the new reservation request within the largest rectangles associated with the end-to-end BAG and satisfying at least one of earliest start time constraint and latest end time constraint associated with the new reservation request.

### Claim 29 (depends on 21)

The method defined by claim 21, further comprising establishing, by the DSM, reservation parameters associated with the wide area network using a trial-and-error method with predetermined solutions.

### Claim 30 (depends on 21)

The method defined by claim 21, further comprising:
negotiating, by a storage resource manager (SRM) associated with a storage resource, storage and transfer parameters; and
negotiating, by the SRM, network bandwidth reservation parameters with the DSM.

### Claim 31 (depends on 30)

The method defined by claim 30, further comprising:
representing, by the SRM, storage system bandwidth availability as a bandwidth availability graph (BAG);
determining, by the DSM, network bandwidth reservation parameters using the BAG and reservation request parameters;
intersecting, by the DSM, a plurality of BAGs along the end-to-end path to obtain an end-to-end BAG, each of the plurality of BAGs being associated with at least one of a plurality of network resources along the path from the at least one end-site; and
allocating, by the DSM, a new reservation request based on the end-to-end BAG.

### Claim 32 (depends on 18)

The method defined by claim 18, further comprising:
scheduling at least one end-to-end path from at least one end-site; and
provide network quality of service guarantees across multiple autonomous domains having different levels of hertogeneity in at least one of administrative policy, control plane technology, and data plane technology without at least one of prior inter-domain Service Level Agreements and predetermined configuration of network devices associated with the domains.

### Claim 33

A computer-readable medium comprising instructions that, when executed by a computing device, schedule reservations on a path from at least one end-site by performing a computer process comprising:
monitoring, by a management plane device, and providing information representing at least one of functionality, performance, faults, and fault recovery associated with a network resource;
scheduling, by a control plane device, the network resource by at least one of provisioning local area network quality of service, provisioning local area network bandwidth, and provisioning wide area network bandwidth; and
interfacing, by a service plane device, with the control plane device to reserve the network resource based on a reservation request and the information from the management plane device, the management plane device, control plane device, and service plane device being associated with the at least one end-site.

### Claim 34 (depends on 33)

The computer-readable medium defined by claim 33, wherein the computer process is configured to schedule at least one end-to-end path interconnecting at least two different end-sites, the computer process being associated with at least one of the at least two different end-sites.

### Claim 35 (depends on 33)

The computer-readable medium defined by claim 33, wherein the computer process further comprises:
configuring network devices associated with a local area network, by at least one network device controller (NDC), the local area network being associated with the at least one end-site;
controlling, by an end-site domain controller (ESDC) a resource associated with the local area network using the at least one NDC; and
interfacing, by a distributed services module (DSM), with the at least one ESDC to configure path segments associated with the local area network, the DSM being configured to interface with an inter-domain controller (IDC) to provide the a path from the at least one end-site.

### Claim 36 (depends on 35)

The computer-readable medium defined by claim 35, wherein the computer process further comprises:
negotiating, by the DSM, end-site LAN reservation parameters; and
negotiating, subsequently, WAN reservation parameters using the IDC in a hybrid star/daisy-chain configuration scheme.

### Claim 37 (depends on 35)

The computer-readable medium defined by claim 35, wherein the computer process further comprises hiding configuration information from the control plane device and management plane device by the NDC including functionality of the network resource.

### Claim 38 (depends on 33)

The computer-readable medium defined by claim 33, wherein the computer process further comprises establishing dynamic service level agreements (SLAs) between network domains along the path from the at least one end-site.

### Claim 39 (depends on 33)

The computer-readable medium defined by claim 33, wherein the computer process further comprises:
consolidating, by the service plane device, overlapping reservation requests using user-defined virtual local area network identification (VLAN ID), bandwidth utilization levels, and total capacity constraints; and
assigning, by the service plane device, consolidated reservation requests to a circuit based on duration and capacity associated with the circuit.

### Claim 40 (depends on 33)

The computer-readable medium defined by claim 33 wherein the computer process further comprises:
generating, by the service plane device, a bandwidth usage graph (BUG) associated with at least one prior reservation request as a step function; and
subtracting, by the service plane device, the BUG from a maximum bandwidth availability associated with the network resource to obtain a bandwidth availability graph (BAG) associated with the network resource.

### Claim 41 (depends on 40)

The computer-readable medium defined by claim 40, wherein the computer process further comprises:
intersecting a plurality of BAGs to obtain an end-to-end BAG, each of the plurality of BAGs being associated with at least one of a plurality of network resources associated with the path from the at least one end-site; and
allocating, by the service plane device, a new reservation request based on the end-to-end BAG.

### Claim 42 (depends on 41)

The computer-readable medium defined by claim 41, wherein the computer process further comprises:
allocating, by the service plane device, the new reservation request based on the end-to-end BAG using an algorithm to determine largest rectangles under a histogram; and
modifying, by the service plane device, bandwidth and duration associated with the new reservation request while maintaining data volume associated with the new reservation request constant, thereby fitting the new reservation request within the largest rectangles associated with the end-to-end BAG and satisfying at least one of earliest start time constraint and latest end time constraint associated with the new reservation request.

### Claim 43 (depends on 35)

The computer-readable medium defined by claim 35, wherein the computer process further comprises establishing, by the DSM, reservation parameters associated with the wide area network using a trial-and-error method with predetermined solutions.

### Claim 44 (depends on 35)

The computer-readable medium defined by claim 35, wherein the computer process further comprises:
negotiating, by a storage resource manager (SRM) associated with a storage resource, storage and transfer parameters; and
negotiating, by the SRM, network bandwidth reservation parameters with the DSM.

### Claim 45 (depends on 44)

The computer-readable medium defined by claim 44, wherein the computer process further comprises:
representing, by the SRM, storage system bandwidth availability as a bandwidth availability graph (BAG);
determining, by the DSM, network bandwidth reservation parameters using the BAG and reservation request parameters;
intersecting, by the DSM, a plurality of BAGs along the path from the at least one end-site to obtain an end-to-end BAG, each of the plurality of BAGs being associated with at least one of a plurality of network resources along the path from the at least one end-site; and
allocating, by the DSM, a new reservation request based on the end-to-end BAG.

### Claim 46 (depends on 33)

The computer-readable medium defined by claim 33, wherein the computer process further comprises:
scheduling at least one end-to-end path from at least one end-site; and
provide network quality of service guarantees across multiple autonomous domains having different levels of hertogeneity in at least one of administrative policy, control plane technology, and data plane technology without at least one of prior inter-domain Service Level Agreements and predetermined configuration of network devices associated with the domains.
