US 7,688,999 B2Granted

Target detecting system and method

AssigneeElectronics and Telecommunications Research Institute

InventorsKye-Kyung Kim, Soo-Hyun Cho, Hye-Jin Kim, Jae-Yeon Lee

Life of this patent

Estimating the term…

Abstract

A target detecting system and method for detecting a target from an input image is provided. According to the target detecting system and method, when a target is detected from an input image and there are moving areas in the input image, camera movement parameters are obtained, image frames are transformed, and movement candidate areas are extracted from the image frame and the previous input image frame. In addition, image feature information is extracted from the input image, and based on the movement candidate areas and the image feature information a shape of the target is extracted. Therefore, the target can be exactly and rapidly extracted and tracked.

Claims36

Dependent claims

A target detecting method for detecting a target from an input image from a camera, comprising the steps of:

a shape detector configured for obtaining camera movement parameters from a movement area in an input image from the camera, and correcting an image frame using the obtained movement parameters,
extracting movement candidate areas from the input image frame and a previously input image frame,
extracting image feature information from the input image, and
extracting a target shape based on the movement candidate areas and the image feature information;
a tracker is configured for generating blob information from the extracted shape, and
wherein the blob information is an image or an image portion formed by binding adjacent pixels having the same characteristics in the image;
extracting blob information for the extracted shape;
and
checking whether the target is correct by comparing the blob information with that of the shape extracted at the previous frame regardless of background or the camera movement,
wherein the extracting image feature information from the input image further comprises skin color areas are extracted from the input image, skin color being extracted as follows:
If
⁢
[
C
t
b
⁡
(
x
,
y
)
>
α
×
C
t
r
⁡
(
x
,
y
)
⁢
&
⁢
⁢
C
t
b
⁡
(
x
,
y
)
>
β
×
C
t
r
⁡
(
x
,
y
)
⁢
&
⁢
⁢
C
t
g
⁡
(
x
,
y
)
>
γ
×
C
t
r
⁡
(
x
,
y
)
⁢
&
⁢
⁢
C
t
g
⁡
(
x
,
y
)
>
δ
×
C
t
r
⁡
(
x
,
y
)
]
⁢
&
⁢
[
⁢
ɛ
<
⁢
H
[
⁢
x
+
w
×
y
]
<
η
]
⁢
&
⁢
[
⁢
ω
<
⁢
S
[
⁢
x
+
w
×
y
]
<
ζ
]
⁢
⁢
Then
⁢
⁢
f
t
⁡
(
x
+
w
×
y
)
⁢
⁢
is
⁢
⁢
⁢
skincolor
wherein Ctr, Ctg, and Ctb are respectively r, g, and b values of the t-th frame images, H and S are respectively H(ue) and S(aturation) values obtained from Ctr, Ctg, and Ctb, α, β, γ, δ, ε, η, ω, ζ are constants obtained by experiments, and w is a width of the image.

170 more elements

A target detecting system for detecting a target from an input image, comprising:

a camera that obtains a target image to be detected and which transmits the obtained target image to a shape detector;
a shape detector, operatively coupled to said camera, said shape detector extracting a shape from the obtained target image based on movement candidate areas and image feature information extracted through an image difference of temporally-consecutive frames among an image sequence transmitted from the image input unit,
a tracker that extracts blob information for the extracted shape and verifies whether the target is correct by comparing the blob information with the shape extracted at the previous frame regardless of background or the camera movement, and
wherein the blob information is an image or an image portion formed by binding adjacent pixels having the same characteristics in the image,
wherein the shape detector further comprises:
a movement area extractor for extracting the movement candidate area from an image frame and a previous input image frame;
an image feature information extractor for extracting image feature information from the input image;
and
a shape extractor for extracting the shape of the target image based on the movement candidate area and the image feature information, and
wherein the image feature information extractor extracts at least one among skin color, shape, and corner information from the input image, wherein:
the skin color is extracted as follows
If
⁢
[
C
t
b
⁡
(
x
,
y
)
>
α
×
C
t
r
⁡
(
x
,
y
)
⁢
&
⁢
⁢
C
t
b
⁡
(
x
,
y
)
>
β
×
C
t
r
⁡
(
x
,
y
)
⁢
&
⁢
⁢
C
t
g
⁡
(
x
,
y
)
>
γ
×
C
t
r
⁡
(
x
,
y
)
⁢
&
⁢
⁢
C
t
g
⁡
(
x
,
y
)
>
δ
×
C
t
r
⁡
(
x
,
y
)
]
⁢
&
⁢
[
⁢
ɛ
<
⁢
H
[
⁢
x
+
w
×
y
]
<
η
]
⁢
&
⁢
[
⁢
ω
<
⁢
S
[
⁢
x
+
w
×
y
]
<
ζ
]
⁢
⁢
Then
⁢
⁢
f
t
⁡
(
x
+
w
×
y
)
⁢
⁢
is
⁢
⁢
⁢
skincolor
wherein Ctr, Ctg, Ctb are respectively r, g, and b values of the t-th frame images, H and S are H(ue) and S(aturation) values obtained from Ctr, Ctg, and Ctb, α, β, γ, δ, ε, η, ω, ζ are constants obtained by experiment, and w is a width of the image;
the edge value (Et) of the pixel (x,y) is obtained as follows,
E
t
v
=
-
f
t
⁡
(
x
-
1
,
y
-
1
)
+
f
t
⁡
(
x
+
1
,
y
-
1
)
-
2
⨯
f
t
⁡
(
x
-
1
,
y
)
+
2
⨯
f
t
⁡
(
x
+
1
,
y
)
-
f
t
⁡
(
x
-
1
,
y
+
1
)
+
f
t
⁡
(
x
+
1
,
y
+
1
)
E
t
h
=
-
f
t
⁡
(
x
-
1
,
y
-
1
)
-
2
⨯
f
t
⁡
(
x
,
y
-
1
)
-
f
t
⁡
(
x
+
1
,
y
-
1
)
+
f
t
⁡
(
x
-
1
,
y
+
1
)
+
2
⨯
f
t
⁡
(
x
,
y
+
1
)
+
f
t
⁡
(
x
+
1
,
y
+
1
)
E
t
=
(
E
t
v
)
2
+
(
E
t
h
)
2
wherein is the Et is the t-th edge image frame, Etv is the vertical direction edge value of the pixel (x, y), Eth is the horizontal direction edge value of the pixel (x, y), and ft(x,y) is the brightness value of the pixel (x,y);
and the shape feature information is extracted through color clustering of the input image.

354 more elements

Dependencies are inferred from the claim text.

Facts

Application: 11/287,936Filed 28 Nov 2005
Priority: KR 10-2004-01030338 Dec 2004
Published: US 2006/0140481 A129 Jun 2006
Granted: 30 Mar 2010
Term ends: Not estimatedThe source records don’t support an estimate.

Classification6 codes

H04N 23/611
Based on recognised objects: where the recognised objects include parts of the human body
G06T 7/246
Analysis of motion: using feature-based methods, e.g. the tracking of corners or segments
G06V 40/10
Recognition of biometric, human-related or animal-related patterns in image or video data: human or animal bodies, e.g. vehicle occupants or…
H04N
Pictorial communication

Family

US 2006/0140481 A1Pre-grant publication · published 29 Jun 2006
US 7,688,999 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

patentgrep

Loading patent…

Abstract

Facts

Application

11/287,936Filed 28 Nov 2005

Priority

KR 10-2004-01030338 Dec 2004

Published

US 2006/0140481 A129 Jun 2006

Granted

30 Mar 2010

Term ends

Not estimatedThe source records don’t support an estimate.

Classification6 codes

H04N 23/611
Based on recognised objects: where the recognised objects include parts of the human body
G06T 7/246
Analysis of motion: using feature-based methods, e.g. the tracking of corners or segments
G06V 40/10
Recognition of biometric, human-related or animal-related patterns in image or video data: human or animal bodies, e.g. vehicle occupants or…
H04N
Pictorial communication