# US 12,118,486 B2 · Mixed-reality assisted dimensionality expansion and manipulation analytics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,486 B2
- Document ID: US12118486B2
- Status: Granted
- Kind: B2
- Application number: 18/510,029
- Filed: 2023-11-15
- Published: 2024-03-14
- Granted: 2024-10-15
- Earliest claimed: 2020-02-05
- Assignees: Blue Yonder Group, Inc.
- Applicants: Blue Yonder Group, Inc.
- Inventors: Brenda Christy; Mayank Tiwari; Tushar Shekhar
- Web page: https://patentgrep.com/patent/US12118486B2

## CPC

- G06Q 10/06315: {Needs-based resource requirements planning or analysis}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system and method are disclosed to generate one or more mixed-reality visualizations and objects to facilitate efficient interaction with large volumes of data. Embodiments include a computer comprising a processor and memory and a mixed-reality display device comprising a display and one or more sensors. Embodiments generate a mixed-reality object comprising a first cuboid, the first cuboid comprising one or more adjustable display dimensions corresponding to one or more key process indicators (KPIs) and one or more cubelets divided along at least one of the one or more adjustable display dimensions. Embodiments display the mixed-reality object on the display, and adjust at least one of the one or more adjustable display dimensions in response to receiving a first input to the one or more sensors. In response to a second input, embodiments transform the one or more cubelets of the first cuboid.

## Claims

### Claim 1

A system, comprising:
a computer, comprising a processor and memory, configured to:
generate a mixed-reality object comprising a visualization of a supply chain network and a first cuboid, the first cuboid comprising one or more adjustable display dimensions corresponding to one or more key process indicators and one or more cubelets divided along at least one of the one or more adjustable display dimensions; and
a mixed-reality display device, comprising a display and one or more sensors, and configured to:
display the mixed-reality object on the display, wherein the mixed-reality object further comprises visual and aural indicators;
navigate the visualization of the supply chain network;
display an alert associated with a detection of an exception or problem condition associated with the one or more key process indicators;
interact with the visualization of the supply chain network to modify the supply chain network; and
in response to the interaction with the visualization of the supply chain network, modify one or more supply chain processes.

### Claim 2 (depends on 1)

The system of claim 1, wherein the mixed-reality display device is further configured to:
display and locate one or more visual elements overlaid on one or more real world scenes based, at least in part, on a calculated visual field of a user.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more sensors of the mixed-reality display device comprise one or more of: a gaze tracking sensor, a hand gesture sensor, and a head orientation sensor.

### Claim 4 (depends on 1)

The system of claim 1, wherein the mixed-reality display device is further configured to:
modify the one or more supply chain processes using one or more of: speech, eye movement, hand gesture and spoken instructions.

### Claim 5 (depends on 1)

The system of claim 1, wherein the mixed-reality display device further comprises a first display to display an image into a user's left eye and a second display to display an image into the user's right eye.

### Claim 6 (depends on 1)

The system of claim 1, wherein the mixed-reality display device is further configured to:
alter an appearance and a placement of one or more visual elements of the visualization of the supply chain network based, at least in part, on movement of one or more objects within a visual feed of a camera.

### Claim 7 (depends on 1)

The system of claim 1, wherein the one or more supply chain processes comprise one or more of:
demand planning, supply and distribution planning, inventory management, allocation planning and order fulfillment.

### Claim 8

A computer-implemented method, comprising:
generating, by a computer comprising a processor and memory, a mixed-reality object comprising a visualization of a supply chain network and a first cuboid, the first cuboid comprising one or more adjustable display dimensions corresponding to one or more key process indicators and one or more cubelets divided along at least one of the one or more adjustable display dimensions;
displaying, by a mixed-reality display device comprising a display and one or more sensors, the mixed-reality object on the display, wherein the mixed-reality object further comprises visual and aural indicators;
navigating, by the mixed-reality display device, the visualization of the supply chain network;
displaying, by the mixed-reality display device, an alert associated with a detection of an exception or problem condition associated with the one or more key process indicators;
interacting, by the mixed-reality display device, with the visualization of the supply chain network to modify the supply chain network; and
in response to the interaction with the visualization of the supply chain network, modifying, by the mixed-reality display device, one or more supply chain processes.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, further comprising:
displaying and locating, by the mixed-reality display device, one or more visual elements overlaid on one or more real world scenes based, at least in part, on a calculated visual field of a user.

### Claim 10 (depends on 8)

The computer-implemented method of claim 8, wherein the one or more sensors of the mixed-reality display device comprise one or more of: a gaze tracking sensor, a hand gesture sensor, and a head orientation sensor.

### Claim 11 (depends on 8)

The computer-implemented method of claim 8, further comprising:
modifying, by the mixed-reality display device, the one or more supply chain processes using one or more of: speech, eye movement, hand gesture and spoken instructions.

### Claim 12 (depends on 8)

The computer-implemented method of claim 8, wherein the mixed-reality display device further comprises a first display to display an image into a user's left eye and a second display to display an image into the user's right eye.

### Claim 13 (depends on 8)

The computer-implemented method of claim 8, further comprising:
altering, by the mixed-reality display device, an appearance and a placement of one or more visual elements of the visualization of the supply chain network based, at least in part, on movement of one or more objects within a visual feed of a camera.

### Claim 14 (depends on 8)

The computer-implemented method of claim 8, wherein the one or more supply chain processes comprise one or more of:
demand planning, supply and distribution planning, inventory management, allocation planning and order fulfillment.

### Claim 15

A non-transitory computer-readable storage medium embodied with software, the software when executed configured to:
generate a mixed-reality object comprising a visualization of a supply chain network and a first cuboid, the first cuboid comprising one or more adjustable display dimensions corresponding to one or more key process indicators (KPIs) and one or more cubelets divided along at least one of the one or more adjustable display dimensions;
display, by a mixed-reality display device comprising a display and one or more sensors, the mixed-reality object on the display, wherein the mixed-reality object further comprises visual and aural indicators;
navigate, by the mixed-reality display device, the visualization of the supply chain network;
display, by the mixed-reality display device, an alert associated with a detection of an exception or problem condition associated with the one or more key process indicators;
interact, by the mixed-reality display device, with the visualization of the supply chain network to modify the supply chain network; and
in response to the interaction with the visualization of the supply chain network, modify one or more supply chain processes.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the software when executed is further configured to:
display and locate, by the mixed-reality display device, one or more visual elements overlaid on one or more real world scenes based, at least in part, on a calculated visual field of a user.

### Claim 17 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the one or more sensors of the mixed-reality display device comprise one or more of: a gaze tracking sensor, a hand gesture sensor, and a head orientation sensor.

### Claim 18 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the software when executed is further configured to:
modify the one or more supply chain processes using one or more of: speech, eye movement, hand gesture and spoken instructions.

### Claim 19 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the mixed-reality display device further comprises a first display to display an image into a user's left eye and a second display to display an image into the user's right eye.

### Claim 20 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the software when executed is further configured to:
alter an appearance and a placement of one or more visual elements of the visualization of the supply chain network based, at least in part, on movement of one or more objects within a visual feed of a camera.
