# US 2022/0044043 A1 · Integrated circuit and sensor data processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044043 A1
- Document ID: US20220044043A1
- Status: Published application
- Kind: A1
- Application number: 17/511,383
- Filed: 2021-10-26
- Published: 2022-02-10
- Earliest claimed: 2019-07-31
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co.,Ltd.
- Inventors: Zhengchao Zhu; Yu Liu; Qi Zhang
- Web page: https://patentgrep.com/patent/US20220044043A1

## CPC

- G06F 15/7807: {System on chip, i.e. computer system on a single chip; System in package, i.e. computer system on one or more chips in a single package}
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/063: using electronic means
- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/09: Supervised learning
- G06V 10/82: using neural networks
- G06V 10/94: Hardware or software architectures specially adapted for image or video understanding
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- Y02D 30/70: in wireless communication networks
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

This disclosure discloses an integrated circuit in the artificial intelligence field. This disclosure provides an integrated circuit. The integrated circuit includes a first processor, configured to obtain first sensor data from a first external sensor, and extract first target data from the first sensor data, where the first processor is a real-time response processor; and an accelerator, configured to identify the first target data based on a first neural network model to obtain a first identification result, where the first identification result is used to determine a target operation corresponding to the first identification result. This disclosure provides an integrated circuit and a sensor data processing method, to enable a real-time response processor to identify a complex scenario and process a complex task when responding to an external sensor in real time.

## Claims

### Claim 1

An integrated circuit, comprising:
a first processor, configured to obtain first sensor data from a first external sensor, and extract first target data from the first sensor data, wherein the first processor is a real-time response processor; and
an accelerator, configured to identify the first target data based on a first neural network model to obtain a first identification result, wherein the first identification result is used to determine a target operation corresponding to the first identification result.

### Claim 2 (depends on 1)

The integrated circuit according to claim 1, wherein the integrated circuit further comprises:
a second processor, configured to determine the target operation based on the first identification result.

### Claim 3 (depends on 2)

The integrated circuit according to claim 2, wherein
the first processor is further configured to: after extracting the first target data, indicate the second processor to switch from a sleep state to a working state; and
the second processor is configured to: when being in the working state, determine the target operation based on the first identification result.

### Claim 4 (depends on 2)

The integrated circuit according to claim 2, wherein
the first processor is further configured to determine a third identification result based on the first sensor data; and
the second processor is configured to determine the target operation based on the first identification result and the third identification result.

### Claim 5 (depends on 1)

The integrated circuit according to claim 1, wherein
the first processor is further configured to: obtain second sensor data from a second external sensor, and extract second target data from the second sensor data; and
the accelerator is further configured to identify the second target data based on a second neural network model to obtain a second identification result, wherein the second identification result and the first identification result are used to determine the target operation together.

### Claim 6 (depends on 5)

The integrated circuit according to claim 5, wherein
the accelerator is further configured to identify the first target data and the second target data in a time-sharing manner.

### Claim 7 (depends on 6)

The integrated circuit according to claim 6, wherein the integrated circuit further comprises:
a controller, configured to determine a first priority corresponding to the first target data and a second priority corresponding to the second target data; and
the accelerator is configured to identify, based on the first priority and the second priority, the first target data and the second target data in a time-sharing manner.

### Claim 8 (depends on 6)

The integrated circuit according to claim 6, wherein the integrated circuit further comprises:
a controller, configured to: determine a first priority corresponding to the first target data and a second priority corresponding to the second target data, and control, based on the first priority and the second priority, the first processor to send the first target data and the second target data to the accelerator in a time-sharing manner, so that the accelerator identifies the first target data and the second target data in a time-sharing manner.

### Claim 9 (depends on 2)

The integrated circuit according to claim 2, wherein the integrated circuit further comprises:
a third processor, configured to switch from a sleep state to a working state in response to the target operation.

### Claim 10 (depends on 1)

The integrated circuit according to claim 1, wherein parameters in the first neural network model are updated by using a network.

### Claim 11 (depends on 1)

The integrated circuit according to claim 1, wherein the first external sensor comprises one of a camera, a microphone, a motion sensor, a distance sensor, an ambient optical sensor, a magnetic field sensor, a fingerprint sensor, or a temperature sensor.

### Claim 12 (depends on 1)

An electronic device, comprising the integrated circuit according to claim 1.

### Claim 13 (depends on 12)

The electronic device according to claim 12 further comprising a memory.

### Claim 14

A sensor data processing method, comprising:
obtaining first sensor data from a first external sensor in real time, and extracting first target data from the first sensor data; and
identifying the first target data based on a first neural network model to obtain a first identification result, wherein the first identification result is used to determine a target operation corresponding to the first identification result.

### Claim 15 (depends on 14)

The method according to claim 14, wherein the method further comprises:
determining the target operation based on the first identification result.

### Claim 16 (depends on 14)

The method according to claim 14, wherein the method further comprises:
obtaining second sensor data from a second external sensor in real time, and extracting second target data from the second sensor data; and
identifying the second target data based on a second neural network model to obtain a second identification result, wherein the second identification result and the first identification result are used to determine the target operation together.

### Claim 17 (depends on 16)

The method according to any one of claim 16, wherein the method further comprises:
determine a first priority corresponding to the first target data and a second priority corresponding to the second target data; and
identify, based on the first priority and the second priority, the first target data and the second target data in a time-sharing manner.

### Claim 18 (depends on 14)

The method according to any one of claim 14, wherein the method further comprises:
after extracting the first target data, indicate a second processor to switch from a sleep state to a working state; wherein the second processor is configured to: when being in the working state, determine the target operation based on the first identification result.

### Claim 19 (depends on 14)

The method according to claim 14, wherein parameters in the first neural network model are updated by using a network.

### Claim 20 (depends on 14)

The method according to claim 14, wherein the first external sensor comprises one of a camera, a microphone, a motion sensor, a distance sensor, an ambient optical sensor, a magnetic field sensor, a fingerprint sensor, or a temperature sensor.
