# US 2022/0253044 A1 · Audio-based industrial automation control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0253044 A1
- Document ID: US20220253044A1
- Status: Published application
- Kind: A1
- Application number: 17/168,805
- Filed: 2021-02-05
- Published: 2022-08-11
- Earliest claimed: 2021-02-05
- Assignees: Rockwell Automation Technologies, Inc.
- Applicants: Rockwell Automation Technologies, Inc.
- Inventors: Natalie A. Tremblay; Kristopher J. Holley; Louisa A. Wood; Thong T. Nguyen; Paul D. Schmirler
- Web page: https://patentgrep.com/patent/US20220253044A1

## CPC

- G05B 19/4185: {characterised by the network communication}
- G05B 19/41855: {by local area network [LAN], network structure}
- G05B 19/4183: {characterised by data acquisition, e.g. workpiece identification}
- G05B 19/4184: {characterised by fault tolerance, reliability of production system}
- G05B 19/41865: {characterised by job scheduling, process planning, material flow}
- G05B 2219/35458: Control command embedded in video, audio stream, signal
- G05B 2219/37337: Noise, acoustic emission, sound
- G05B 2219/37393: acoustic feedback varies as function of positional error
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

A system may include audio devices that output sound waves. The system also includes a control system having a processor. The control system may receive a first plurality of operation parameters associated with a plurality of components in an industrial automation system from one or more sensors. The control system may also determine a plurality of audio tones based on the plurality of operation parameters. Further still, the control system may send one or more control signals to one or more audio devices in response to detecting the plurality of operation parameters, wherein the one or more audio devices are configured to produce the plurality of audio tones in response to receiving of the one or more control signals.

## Claims

### Claim 1

A system, comprising:
one or more audio devices configured to output sound waves; and
a control system comprising a processor, wherein the control system is configured to:
receive a plurality of operation parameters associated with a plurality of components in an industrial automation system from one or more sensors;
determine a plurality of audio tones based on the plurality of operational parameters; and
send one or more control signals to the one or more audio devices in response to detecting the plurality of operation parameters, wherein the one or more audio devices are configured to produce the plurality of audio tones in response to receiving the one or more control signals.

### Claim 2 (depends on 1)

The system of claim 1, wherein the plurality of operation parameters comprises power consumption data, temperature data, electrical data, control signals, or any combination thereof.

### Claim 3 (depends on 1)

The system of claim 1, wherein the control system is configured to:
identify an audio data profile based on the plurality of operation parameters, wherein the audio data profile comprises the plurality of audio tones; and
assign one of the plurality of audio tones to one operation parameter of the plurality of operation parameters.

### Claim 4 (depends on 3)

The system of claim 3, wherein the control system is configured to identify the audio data profile by:
determining a number of operation parameters within the plurality of operation parameters; and
identifying the audio data profile from a plurality of audio data profiles based on the number of operation parameters.

### Claim 5 (depends on 1)

The system of claim 1, wherein the control system is configured to:
receive an additional plurality of operation parameters from the one or more sensors, wherein the additional plurality of operation parameters comprises a fewer number of operation parameters as compared to the plurality of operation parameters; and
send one or more additional control signals to the one or more audio devices in response to detecting the additional plurality of operating parameters, wherein the one or more audio devices are configured to produce an additional plurality of audio tones in response to receiving the one or more additional control signals.

### Claim 6 (depends on 5)

The system of claim 5, wherein the control system is configured to:
determine an error in the additional plurality of operation parameters based on the additional plurality of audio tones; and
adjust one or more operations of at least one of the plurality of components in response to determining the error.

### Claim 7

A method, comprising:
receiving, via a processor, a plurality of audio tones associated with a plurality of operations of one or more components in an industrial system;
detecting, via the processor, a discrepancy between the plurality of audio tones and a melody associated with the plurality of operations of the one or more components in the industrial system;
identifying, via the processor, an operation of the plurality of operations based the discrepancy; and
outputting, via the processor, a control signal to adjust one or more operations of the one or more components based on the operation of the plurality of operations.

### Claim 8 (depends on 7)

The method of claim 7, comprising outputting a notification to a user device indicative of the operation of the plurality of operations.

### Claim 9 (depends on 7)

The method of claim 7, wherein the operation of the plurality of operations corresponds to a software operation performed by one or more software components.

### Claim 10 (depends on 7)

The method of claim 7, wherein the operation of the plurality of operations corresponds to a physical operation performed by one or more hardware components.

### Claim 11 (depends on 7)

The method of claim 7, wherein detecting the discrepancy between the plurality of audio tones and the melody comprises determining that at least one audio tone of the plurality of audio tones is missing based on a plurality of reference audio tones associated with the melody.

### Claim 12 (depends on 11)

The method of claim 11, wherein the at least one audio tone of the plurality of audio tones corresponds to at least one component of the one or more components.

### Claim 13 (depends on 7)

The method of claim 7, wherein detecting the discrepancy between the plurality of audio tones and the melody comprises determining that one or more sound characteristics of an audio tone of the plurality of audio tones does not match one or more reference sound characteristics of a corresponding audio tone in a plurality of reference audio tones associated with the melody.

### Claim 14 (depends on 7)

The method of claim 7, wherein the plurality of audio tones corresponds digital audio.

### Claim 15

A non-transitory computer-readable medium comprising computer-executable instructions that, when executed by at least one processor, are configured to cause the at least one processor to:
receive a plurality of audio tones associated with a plurality of operations of one or more components in an industrial system;
detect a discrepancy between the plurality of audio tones and a melody associated with the plurality of operations of the one or more components in the industrial system;
identify at least one component of the one or more components that corresponds to the discrepancy; and
transmit a notification to a computing device indicative of a possible error in the component.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the audio tone comprises music note.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the notification comprises one or more maintenance instructions associated with the at least one component.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions that are configured to cause the at least one processor to determine that the plurality of audio tones does not match the melody based on a time period between each adjacent audio tone of the plurality of audio tones.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions that are configured to cause the at least one processor to:
receive an indication of a maintenance operation being performed on the industrial system; and
send a control signal to one or more audio devices to modify an output of the plurality of audio tones.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the computer-executable instructions that are configured to cause the at least one processor to adjust an operation of the at least one component based on the possible error.
