# US 2018/0324345 A1 · Method and device for controlling camera and financial equipment terminal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324345 A1
- Document ID: US20180324345A1
- Status: Published application
- Kind: A1
- Application number: 15/774,577
- Filed: 2016-05-10
- Published: 2018-11-08
- Earliest claimed: 2015-12-31
- Assignees: GRG Banking Equipment Co., Ltd.
- Applicants: GRG Banking Equipment Co., Ltd.
- Inventors: Tiancai Liang; Yunyun Nie; Yong Zhang; Daoyu Liu; Wenchuan Gong
- Web page: https://patentgrep.com/patent/US20180324345A1

## CPC

- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/74: by influencing the scene brightness using illuminating means
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for controlling a camera is provided. An image transmitted from a camera is received and detection is performed on the image, where if a target object is not detected, a search instruction for controlling the camera to rotate in a vertical direction is transmitted to the camera until the target object is detected in an image. Then posture parameters of the target object in the image are acquired, where if the posture parameters do not match a preset posture parameter criteria, a fine adjustment instruction for controlling the camera to rotate and move is transmitted to the camera, until the posture parameters of the target object match the preset posture parameter criteria. A device for controlling a camera and a financial device terminal are further provided.

## Claims

### Claim 1

A camera control method, comprising:
detecting whether an image transmitted by a camera contains a target object;
transmitting, if it is detected that the image transmitted by the camera does not contain the target object, one or more search instructions for controlling the camera to perform a first rotation to the camera, until the target object is detected in the image transmitted by the camera in the first rotation;
determining an attitude parameter of the target object in the image; and
transmitting, in a case that the attitude parameter does not meet a preset attitude parameter standard, a fine adjustment instruction for controlling the camera to perform a second rotation to the camera, until the attitude parameter of the target object in the image transmitted by the camera in the second rotation meets the preset attitude parameter standard, wherein the second rotation comprises a movement in a vertical or horizontal direction and a rotation in a vertical or horizontal direction.

### Claim 2 (depends on 1)

The camera control method according to claim 1, wherein a plurality of light filling lamps are arranged in the vicinity of the camera, and the method further comprises:
determining a brightness parameter of the image in which the attitude parameter of the target object meets the preset attitude parameter standard; and
transmitting, in a case that the brightness parameter does not meet a preset brightness parameter standard, one or more light filling instructions to a target light filling lamp among the plurality of light filling lamps, until the brightness parameter of the image transmitted by the camera meets the preset brightness parameter standard.

### Claim 3 (depends on 2)

The camera control method according to claim 2, wherein the target object occupies a plurality of image regions in the image, and the image regions correspond to the plurality of light filling lamps, and wherein determining a target light filling lamp among the plurality of light filling lamps comprises:
determining a region brightness parameter of each of the image regions of the target object; and
determining the light filling lamp corresponding to the image region of which the region brightness parameter is less than the preset brightness parameter as the target light filling lamp.

### Claim 4 (depends on 2)

The camera control method according to claim 2, wherein the light filling instructions transmitted to the target light filling lamp comprise light filling levels, and the light filling levels are sequentially incremented by a fixed increment.

### Claim 5 (depends on 1)

The camera control method according to claim 1, wherein the search instructions transmitted to the camera comprise vertical rotation angles, and the vertical rotation angles are sequentially incremented by a fixed increment.

### Claim 6 (depends on 1)

The camera control method according to claim 1, wherein generating the fine adjustment instruction comprises:
calculating a left-and-right rotation angle α from a left-and-right rotation angle calculation formula α=|α1−α2|, wherein α1 and α2 are respectively acquired from
α
1
=

tan
-
1

(
m
1
-
m
2
1
+
m
1

m
2
)



and


α
2
=

tan
-
1

(
m
1
-
m
3
1
+
m
1

m
3
)

,
m1, m2 and m3 are respectively acquire from
m
1
=
-
x
2
-
x
1
y
2
-
y
1
,
m
2
=
-
y
-
y
1
x
-
x
1

,
and


m
3
=
-
y
-
y
2
x
-
x
2
,
and (x, y), (x1, y1), (x2, y2) and (x3, y3) are coordinates of a first preset position point, a second preset position point, a third preset position point, and a fourth preset position point of the target object in the image, respectively;
calculating an up-and-down pitch angle β from an up-and-down pitch angle calculation formula
β
=
tan
-
1

(
m
1
-
m
4
1
+
m
1

m
4
)
,
wherein m4 is acquired from
m
4
=
-
x
3
-
x
1
y
3
-
y
1

;
generating a fine adjustment instruction to horizontally move leftward by a distance of |DFC tan α| and rotate rightward by the angle of α, in a case of the left-and-right rotation angle α≥N, where N is a preset constant;
generating a fine adjustment instruction to horizontally move rightward by the distance of |DFC tan α| and rotate leftward by the angle of α, in a case of the left-and-right rotation angle α≤−N;
generating a fine adjustment instruction to vertically move upward by a distance of |DFC tan β| and rotate downward by the angle of β, in a case of the up-and-down pitch angle β≥N; and
generating a fine adjustment instruction to vertically move downward by the distance of |DFC tan β| and rotate upward by the angle of β, in a case of the up-and-down pitch angle β≤−N, wherein DFC is acquired from
D
FC
=
k

(
dD
+
nM
)
d
2
+
m
2
;
d is a distance between the first preset position point and the second preset position point in the image; D is an actual distance between the first preset position point and the second preset position point; m is a distance between a center of a connection line of the first preset position point and the second preset position point and a fifth preset position point of the target object in the image; and M is an actual distance between the center of the connection line of the first preset position point and the second preset position point and the fifth preset position point of the target object.

### Claim 7

A camera control device, comprising:
an object detecting module configured to: detect whether an image transmitted by a camera contains a target object, and trigger a search instruction transmitting module if it is detected that the image transmitted by the camera does not contain the target object;
a search instruction transmitting module configured to transmit one or more search instructions for controlling the camera to perform a first rotation to the camera, until the target object is detected in the image transmitted by the camera in the first rotation;
an attitude determining module configured to determine an attitude parameter of the target object in the image; and
a fine adjustment instruction transmitting module configured to transmit, in a case that the attitude parameter does not meet a preset attitude parameter standard, a fine adjustment instruction for controlling the camera to perform a second rotation to the camera, until the attitude parameter of the target object in the image transmitted by the camera in the second rotation meets the preset attitude parameter standard, wherein the second rotation comprises a movement in a vertical or horizontal direction and a rotation in a vertical or horizontal direction.

### Claim 8 (depends on 7)

The camera control device according to claim 7, wherein a plurality of light filling lamps are arranged in the vicinity of the camera, and the device further comprises:
an image brightness determining module configured to determine a brightness parameter of the image in which the attitude parameter of the target object meets the preset attitude parameter standard; and
a light filling instruction transmitting module configured to transmit, in a case that the brightness parameter does not meet a preset brightness parameter standard, one or more light filling instructions to a target light filling lamp among the plurality of light filling lamps, until the brightness parameter of the image transmitted by the camera meets the preset brightness parameter standard.

### Claim 9 (depends on 8)

The camera control device according to claim 8, wherein the target object occupies a plurality of image regions in the image, and the image regions correspond to the plurality of light filling lamps, and wherein for determining a target light filling lamp among the plurality of light filling lamps, the light filling instruction transmitting module is configured to:
determine a region brightness parameter of each of the image regions of the target object; and
determine the light filling lamp corresponding to the image region of which the region brightness parameter is less than the preset brightness parameter as the target light filling lamp.

### Claim 10 (depends on 8)

The camera control device according to claim 8, wherein the light filling instructions transmitted by the light filling instruction transmitting module to the target light filling lamp comprise light filling levels, and the light filling levels are sequentially incremented by a fixed increment.

### Claim 11 (depends on 7)

The camera control device according to claim 7, wherein the search instructions transmitted by the search instruction transmitting module to the camera comprise vertical rotation angles, and the vertical rotation angles are sequentially incremented by a fixed increment.

### Claim 12 (depends on 7)

The camera control device according to claim 7, wherein for generating a fine adjustment instruction, the fine adjustment instruction transmitting module is configured to:
calculate a left-and-right rotation angle α from a left-and-right rotation angle calculation formula α=|α1−α2|, wherein α1 and α2 are respectively acquired from
α
1
=

tan
-
1

(
m
1
-
m
2
1
+
m
1

m
2
)



and


α
2
=

tan
-
1

(
m
1
-
m
3
1
+
m
1

m
3
)

,
m1, m2 and m3 are respectively acquired from
m
1
=
-
x
2
-
x
1
y
2
-
y
1
,
m
2
=
-
y
-
y
1
x
-
x
1

,
and


m
3
=
-
y
-
y
2
x
-
x
2
,
and (x, y), (x1, y1), (x2, y2) and (x3, y3) are coordinates of a first preset position point, a second preset position point, a third preset position point, and a fourth preset position point of the target object in the image, respectively;
calculate an up-and-down pitch angle β from an up-and-down pitch angle calculation formula
β
=
tan
-
1

(
m
1
-
m
4
1
+
m
1

m
4
)
,
wherein m4 is acquired from
m
4
=
-
x
3
-
x
1
y
3
-
y
1

;
generate a fine adjustment instruction to horizontally move leftward by a distance of |DFC tan α| and rotate rightward by the angle of α, in a case of the left-and-right rotation angle α≥N, where N is a preset constant;
generate a fine adjustment instruction to horizontally move rightward by the distance of |DFC tan α| and rotate leftward by the angle of α, in a case of the left-and-right rotation angle α≤−N;
generate a fine adjustment instruction to vertically move upward by a distance of |DFC tan β| and rotate downward by the angle of β, in a case of the up-and-down pitch angle β≥N; and
generate a fine adjustment instruction to vertically move downward by the distance of |DFC tan β| and rotate upward by the angle of β, in a case of the up-and-down pitch angle β≤−N, wherein DFC is acquired from
D
FC
=
k

(
dD
+
nM
)
d
2
+
m
2
;
d is a distance between the first preset position point and the second preset position point in the image; D is an actual distance between the first preset position point and the second preset position point; m is a distance between a center of a connection line of the first preset position point and the second preset position point and a fifth preset position point of the target object in the image; and M is an actual distance between the center of the connection line of the first preset position point and the second preset position point and the fifth preset position point of the target object.

### Claim 13

A financial device terminal, comprising:
a camera, and
a camera control device, wherein the camera control device comprises:
an object detecting module configured to: detect whether an image transmitted by a camera contains a target object, and trigger a search instruction transmitting module if it is detected that the image transmitted by the camera does not contain the target object;
a search instruction transmitting module configured to transmit one or more search instructions for controlling the camera to perform a first rotation to the camera, until the target object is detected in the image transmitted by the camera in the first rotation;
an attitude determining module configured to determine an attitude parameter of the target object in the image; and
a fine adjustment instruction transmitting module configured to transmit, in a case that the attitude parameter does not meet a preset attitude parameter standard, a fine adjustment instruction for controlling the camera to perform a second rotation to the camera, until the attitude parameter of the target object in the image transmitted by the camera in the second rotation meets the preset attitude parameter standard, wherein the second rotation comprises a movement in a vertical or horizontal direction and a rotation in a vertical or horizontal direction.

### Claim 14 (depends on 13)

The financial device terminal according to claim 13, wherein a plurality of light filling lamps are arranged in the vicinity of the camera, and the camera control device further comprises:
an image brightness determining module configured to determine a brightness parameter of the image in which the attitude parameter of the target object meets the preset attitude parameter standard; and
a light filling instruction transmitting module configured to transmit, in a case that the brightness parameter does not meet a preset brightness parameter standard, one or more light filling instructions to a target light filling lamp among the plurality of light filling lamps, until the brightness parameter of the image transmitted by the camera meets the preset brightness parameter standard.

### Claim 15 (depends on 14)

The financial device terminal according to claim 14, wherein the target object occupies a plurality of image regions in the image, and the image regions correspond to the plurality of light filling lamps, and wherein for determining a target light filling lamp among the plurality of light filling lamps, the light filling instruction transmitting module is configured to:
determine a region brightness parameter of each of the image regions of the target object; and
determine the light filling lamp corresponding to the image region of which the region brightness parameter is less than the preset brightness parameter as the target light filling lamp.

### Claim 16 (depends on 14)

The financial device terminal according to claim 14, wherein the light filling instructions transmitted by the light filling instruction transmitting module to the target light filling lamp comprise light filling levels, and the light filling levels are sequentially incremented by a fixed increment.

### Claim 17 (depends on 13)

The financial device terminal according to claim 13, wherein the search instructions transmitted by the search instruction transmitting module to the camera comprise vertical rotation angles, and the vertical rotation angles are sequentially incremented by a fixed increment.

### Claim 18 (depends on 13)

The financial device terminal according to claim 13, wherein for generating a fine adjustment instruction, the fine adjustment instruction transmitting module is configured to:
calculate a left-and-right rotation angle α from a left-and-right rotation angle calculation formula α=|α1−α2|, wherein α1 and α2 are respectively acquired from
α
1
=

tan
-
1

(
m
1
-
m
2
1
+
m
1

m
2
)



and


α
2
=

tan
-
1

(
m
1
-
m
3
1
+
m
1

m
3
)

,
m1, m2 and m3 are respectively acquired from
m
1
=
-
x
2
-
x
1
y
2
-
y
1
,
m
2
=
-
y
-
y
1
x
-
x
1

,
and


m
3
=
-
y
-
y
2
x
-
x
2
,
and (x, y), (x1, y1), (x2, y2) and (x3, y3) are coordinates of a first preset position point, a second preset position point, a third preset position point, and a fourth preset position point of the target object in the image, respectively;
calculate an up-and-down pitch angle β from an up-and-down pitch angle calculation formula
β
=
tan
-
1

(
m
1
-
m
4
1
+
m
1

m
4
)
,
wherein m4 is acquired from
m
4
=
-
x
3
-
x
1
y
3
-
y
1

;
generate a fine adjustment instruction to horizontally move leftward by a distance of |DFC tan α| and rotate rightward by the angle of α, in a case of the left-and-right rotation angle α≥N, where N is a preset constant;
generate a fine adjustment instruction to horizontally move rightward by the distance of |DFC tan α| and rotate leftward by the angle of α, in a case of the left-and-right rotation angle α≤−N;
generate a fine adjustment instruction to vertically move upward by a distance of |DFC tan β| and rotate downward by the angle of β, in a case of the up-and-down pitch angle β≥N; and
generate a fine adjustment instruction to vertically move downward by the distance of |DFC tan β| and rotate upward by the angle of β, in a case of the up-and-down pitch angle β≤−N, wherein DFC is acquired from
D
FC
=
k

(
dD
+
nM
)
d
2
+
m
2
;
d is a distance between the first preset position point and the second preset position point in the image; D is an actual distance between the first preset position point and the second preset position point; m is a distance between a center of a connection line of the first preset position point and the second preset position point and a fifth preset position point of the target object in the image; and M is an actual distance between the center of the connection line of the first preset position point and the second preset position point and the fifth preset position point of the target object.