# US 2021/0341989 A1 · Signal processing device and related products

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0341989 A1
- Document ID: US20210341989A1
- Status: Published application
- Kind: A1
- Application number: 16/620,540
- Filed: 2018-10-30
- Published: 2021-11-04
- Earliest claimed: 2018-09-28
- Assignees: Shanghai Cambricon Information Technology Co., Ltd.
- Applicants: Shanghai Cambricon Information Technology Co., Ltd
- Inventors: TIANSHI CHEN; SHUAI HU; SHENGYUAN ZHOU; XISHAN ZHANG
- Web page: https://patentgrep.com/patent/US20210341989A1

## CPC

- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 40/30: Semantic analysis
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/048: Activation functions
- G06N 3/06: Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N 3/063: using electronic means
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 2015/223: {Execution procedure of a spoken command}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The present disclosure provides a signal processing device, including a signal collector, an instruction converter, and a processor. Examples of the present disclosure may achieve precise recognition of users' intentions and bring operational conveniences to users.

## Claims

### Claim 1

A signal processing device, comprising:
a signal collector configured to collect a signal input by a user;
an instruction converter configured to convert the signal into a processing instruction and target data according to a target signal instruction conversion model, wherein the target data is processing data of data to be processed; and
a processor configured to process the target data according to the processing instruction and a target processing model.

### Claim 2 (depends on 1)

The signal processing device of claim 1, wherein the instruction converter includes:
a first signal recognizer configured to convert the signal into text information through a signal recognition technology, wherein the signal recognition technology is at least one of followings: a voice recognition technology, a semantic understanding technology, an image recognition technology, and a natural language processing technology,
a signal text converter configured to convert the text information into the processing instruction through the natural language processing technology and the target signal instruction conversion model, and
a first image recognizer configured to divide the data to be processed according to a granularity of a semantic area in the processing instruction and the recognition technology to obtain the target data; or
wherein the instruction converter includes:
a second signal recognizer configured to convert the signal into the processing instruction according to the signal recognition technology and the target signal instruction conversion model, and
a second data recognizer configured to divide the data to be processed according to the granularity of the semantic area of the image to be processed in the processing instruction to obtain the target data.

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The signal processing device of claim 1, further comprising:
a memory configured to store the text information, or the processing instruction, or the target data.

### Claim 5 (depends on 4)

The signal processing device of claim 4, further comprising:
an instruction fetching module configured to obtain M processing instructions form the memory in a preset time window, and
a processing module configured to process the target data according to the M processing instructions and the target processing model.

### Claim 6 (depends on 5)

The signal processing device of claim 5, wherein the processing module is configured to:
delete processing instructions with identical functions from the M processing instructions to obtain N processing instruction, wherein M is an integer greater than one, and N is an integer smaller than M.

### Claim 7 (depends on 1)

The signal processing device of claim 1, wherein the instruction converter is configured to implement adaptive training on the signal instruction conversion model to obtain the target signal instruction conversion model;
wherein the processor is configured to implement adaptive training on the processing model to obtain the target processing model; and
wherein the signal processing device is configured to:
before collecting a signal input by a user, implement adaptive training on the signal instruction conversion model to obtain the target signal instruction conversion model; and
implement adaptive training on the processing model to obtain the target processing model.

### Claim 8 (depends on 7)

The signal processing device of claim 7, wherein the instruction converter is further configured to:
convert the signal into a prediction instruction according to the signal instruction conversion model,
determine a correlation coefficient between the prediction instruction and a corresponding instruction set of the prediction instruction, and
optimize the signal instruction conversion model according to the correlation coefficient between the prediction instruction and the corresponding instruction set of the prediction instruction to obtain the target signal instruction conversion model;
wherein the processor is further configured to:
process the data to be processed according to the processing model to obtain prediction data,
determine a correlation coefficient between the prediction data and corresponding training data of the prediction data, and
optimize the processing model according to the correlation coefficient between the prediction data and the corresponding training data of the prediction data to obtain the target processing model;
wherein the signal processing device is configured to:
convert the voice signal into a prediction instruction according to the signal instruction conversion model,
determine a correlation coefficient between the prediction instruction and a corresponding instruction set of the prediction instruction, and
optimize the signal instruction conversion model according to the correlation coefficient between the prediction instruction and the corresponding instruction set of the prediction instruction to obtain the target signal instruction conversion model; and
wherein the signal processing device is further configured to:
process the data to be processed according to the processing model to obtain prediction data,
determine a correlation coefficient between the prediction data and corresponding training data of the prediction data, and
optimize the processing model according to the correlation coefficient between the prediction data and the corresponding target image to obtain the target processing model.

### Claim 9 (depends on 1)

The signal processing device of claim 1, further comprising:
a trainer configured to convert the signal into a prediction instruction according to the instruction conversion model, determine a correlation coefficient between the prediction instruction and a corresponding instruction set of the prediction instruction, and optimize the signal instruction conversion model according to the correlation coefficient between the prediction instruction and the corresponding instruction set of the prediction instruction to obtain the target signal instruction conversion model;
wherein the trainer is further configured to:
process the data to be processed according to the processing model to obtain prediction data,
determine a correlation coefficient between the prediction data and corresponding training data of the prediction data, and
optimize the processing model according to the correlation coefficient between the prediction data and the corresponding training data of the prediction data to obtain the target processing model.

### Claim 10

(canceled)

### Claim 11

(canceled)

### Claim 12

(canceled)

### Claim 13

(canceled)

### Claim 14

(canceled)

### Claim 15

(canceled)

### Claim 16

(canceled)

### Claim 17 (depends on 1)

The signal processing device of claim 1, wherein the instruction converter further includes:
an interactive module configured to send interactive information to users, receive users' feedback information, and generate a corresponding instruction based on the feedback information.

### Claim at position 18

-23. (canceled)

### Claim 24

A signal processing method, comprising
collecting a signal input by a user;
collecting an input signal;
converting the signal into a processing instruction and target data according to a target signal instruction conversion model, wherein the target data is part of data of data to be processed; and
processing the target data according to the processing instruction and a target processing model.

### Claim 25 (depends on 24)

The signal processing method of claim 24, wherein the converting the signal into a processing instruction and target data according to the target signal instruction conversion model includes:
converting the signal into text information through a signal recognition technology, wherein the signal recognition technology is at least one of the following: a voice recognition technology, a semantic understanding technology, an image recognition technology, and a natural language processing technology,
converting the text information into the processing instruction through the natural language processing technology and the target signal instruction conversion model, and dividing the data to be processed into areas according to a granularity of the semantic area in the processing instruction and the image recognition technology to obtain the target data.

### Claim 26 (depends on 24)

The signal processing method of claim 24, wherein the converting the signal into a processing instruction and target data according to the target signal instruction conversion model includes:
converting the signal into the processing instruction according to the signal recognition technology and the target signal instruction conversion model, and
dividing the data to be processed into areas according to the granularity of the semantic area in the processing instruction in the processing instruction and the image recognition technology to obtain the target data.

### Claim 27 (depends on 24)

The signal processing method of claim 24, further comprising:
storing the text information, or the processing instruction, or the target data.

### Claim 28 (depends on 27)

The signal processing method of claim 27, wherein the processing the target data according to the processing instruction and the target processing model includes:
obtaining M processing instructions in a preset time window, and
processing the target data according to the M processing instructions and the target processing model.

### Claim 29 (depends on 28)

The signal processing method of claim 28, wherein the processing the target data according to the M processing instructions and the target processing model includes:
deleting processing instructions with identical functions from the M processing instructions to obtain N processing instruction, wherein M is an integer greater than one, and N is an integer smaller than M.

### Claim 30 (depends on 24)

The signal processing method of claim 24, further comprising:
implementing adaptive training on the signal instruction conversion model to obtain the target signal instruction conversion model.
