# US 2021/0276192 A1 · Method for providing power-off command to an automatic apparatus within proximity of a human and control apparatus employing the method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0276192 A1
- Document ID: US20210276192A1
- Status: Published application
- Kind: A1
- Application number: 16/807,384
- Filed: 2020-03-03
- Published: 2021-09-09
- Earliest claimed: 2020-03-03
- Assignees: Shenzhen Fugui Precision Ind. Co., Ltd.
- Applicants: Shenzhen Fugui Precision Ind. Co., Ltd.
- Inventors: CHANG-CHING LIAO; SHAO-WEN WANG; SHIH-CHENG WANG
- Web page: https://patentgrep.com/patent/US20210276192A1

## CPC

- B25J 9/1676: {Avoiding collision or forbidden zones}
- G05D 1/0055: {with safety arrangements}
- G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target}
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06V 10/82: using neural networks
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G05B 2219/40202: Human robot coexistence
- G05B 2219/40607: Fixed camera to observe workspace, object, workpiece, global
- G06Q 10/20: Administration of product repair or maintenance
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A method for ensuring safety of humans within operating area or in close proximity to an automatic apparatus is applied in and by a control apparatus. The control apparatus is coupled to one or more cameras arranged around the operating area of the automatic apparatus. The control apparatus uses deep learning techniques to analyze images captured by the cameras to determine whether there is a person in the operating area and powers off the automatic apparatus if any person is deemed present.

## Claims

### Claim 1

A method for providing human-machine cross-over safety applied in a control device, the method comprising:
receiving an image captured by a camera arranged in proximities to an operating area of an automatic apparatus;
analyzing the received image to determine whether the image comprises a person in the operation area; and
transmitting a power-off signal to the automatic apparatus if the image comprises at least one person in the operating area.

### Claim 2 (depends on 1)

The method of claim 1, wherein a method of analyzing the received image to recognize a presence of a person further comprises:
inputting the received image to a trained neural network; and
outputting an analyzing result of the received image using a trained neural network.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
capturing a plurality of images by the camera; and
training the trained neural network by the plurality of images.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
transmitting a power-on control signal to the automatic apparatus if the image does not comprise any person in the operating area.

### Claim 5 (depends on 4)

The method of claim 4 further comprising:
checking an operation status of the automatic apparatus before transmitting the power-on control signal; and if the operation status of the automatic apparatus is power-off, transmitting the power-on control signal after a predetermined time period.

### Claim 6

A control apparatus coupled to a camera and an automatic apparatus, the control apparatus comprising:
a processor; and
a memory for storing at least one computer program, wherein the computer program comprises instructions which are executed by the processor, and performs the following steps:
receiving an image captured by the camera arranged in proximities to an operating area of the automatic apparatus;
analyzing the received image to determine whether the image comprises a person in the operation area; and
transmitting a power-off signal to the automatic apparatus if the image comprises at least one person in the operating area.

### Claim 7 (depends on 6)

The control apparatus of claim 6, wherein the analyzing the received image to determine whether the image comprises a person in the operation area further comprises: inputting the received image to a trained neural network; and outputting an analyzing result on the received image using a trained neural network.

### Claim 8 (depends on 7)

The control apparatus of claim 7, wherein the trained neural network is trained by a plurality of images which are captured by the camera.

### Claim 9 (depends on 6)

The control apparatus of claim 6, wherein the steps further comprise: transmitting a power-on control signal to the automatic apparatus if the image does not comprise any person in the operating area.

### Claim 10 (depends on 9)

The control apparatus of claim 9, wherein the steps further comprise: checking an operation status of the automatic apparatus; and when the operation status is power-off, transmitting the power-on control signal after a predetermined time period.
