# US 12,223,503 B2 · Camera control device and method to process captured image using at least one camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,223,503 B2
- Document ID: US12223503B2
- Status: Granted
- Kind: B2
- Application number: 17/414,952
- Filed: 2019-11-06
- Published: 2022-02-24
- Granted: 2025-02-11
- Earliest claimed: 2018-12-17
- Assignees: Hanwha Vision Co., Ltd.
- Applicants: Hanwha Techwin Co., Ltd.
- Inventors: Woong Jeon; Minsuk Sung; Meejee Jeong; Wookeun Kim
- Web page: https://patentgrep.com/patent/US12223503B2

## CPC

- G06Q 20/4014: {Identity check for transactions}
- G06Q 20/20: Point-of-sale [POS] network systems
- G06Q 20/203: {Inventory monitoring}
- G06Q 20/206: {comprising security or operator identification provisions, e.g. password entry}
- G07G 1/0054: {with control of supplementary check-parameters, e.g. weight or number of articles}
- G07G 1/14: Systems including one or more distant stations co-operating with a central processing unit
- H04N 5/77: between a recording apparatus and a television camera
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

According to an embodiment of the present invention, a method for processing an image photographed by using at least one camera comprises the following steps of: receiving a first image photographed to have a first image quality through at least one camera; detecting a human object from the first image; generating an event signal when it is detected that a product object is picked up by the human object after the human object is detected in the first image; and acquiring a second image including the human object by controlling the at least one camera to photograph to have a second image quality higher than the first image quality in response to the event signal.

## Claims

### Claim 1

A method to process a captured image using at least one camera, the method comprising:
receiving a first image captured at a first frame rate by the at least one camera;
detecting a human object from the first image;
generating an event signal when it is detected that a product object is picked up by the human object after the human object is detected from the first image;
acquiring a second image including the human object by controlling the at least one camera to capture the image at a second frame rate higher than the first frame rate in response to the event signal;
receiving payment information from a point-of-sales (POS) device;
providing information related to the detected product object;
converting the second image to a third image of a third frame rate depending on whether the related information matches the payment information, the third frame rate being lower than the second frame rate; and
storing the payment information and the third image in a database.

### Claim 2 (depends on 1)

The method of claim 1, wherein the third frame rate is substantially the same as the first frame rate.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
storing the payment information and the second image in the database when the related information does not match the payment information.

### Claim 4 (depends on 3)

The method of claim 3, wherein the storing of the payment information and the second image in the database further includes storing the first image and at least one of the related information in the database.

### Claim 5 (depends on 1)

The method of claim 1, wherein the providing of the information related to the detected product object includes providing the related information by performing image analysis on the first image.

### Claim 6 (depends on 1)

The method of claim 1, wherein the providing of the information related to the detected product object includes receiving the related information from an external event detection device.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
generating first metadata including information on the gender and age of the human object by performing face recognition on the human object;
generating second metadata including information on a product that the human object is interested in by performing at least one of an eye tracking and a head direction tracking on the human object; and
relating the first and second metadata to the second image signal and storing the same in the database.

### Claim 8

The computer device communicating with at least one camera through a network, the computer device comprising:
a communicator; and
a processor configured to communicate with the at least one camera through the communicator,
wherein the processor is configured to allow:
a first image captured at a first frame rate to be received by the at least one camera;
a human object to be detected from the first image;
an event signal to be generated when it is detected that a product object is picked up by the human object after the human object is detected from the first image; and
a second image including the human object to be acquired by controlling the at least one camera to capture the image at a second frame rate higher than the first frame rate in response to the event signal;
payment information to be received from an external point-of-sales (POS) device through the communicator;
information related to the detected product object to be generated;
the second image to be converted to a third image of a third frame rate depending on whether the related information matches the payment information, the third frame rate being lower than the second frame rate; and
the payment information and the third image to be stored in a database.

### Claim 9 (depends on 8)

The computer device of claim 8, wherein the processor is configured to allow:
the payment information and the third image to be stored in the database when the related information matches the payment information; and
the payment information and the second image to be stored in the database when the related information does not match the payment information.

### Claim 10 (depends on 9)

The computer device of claim 9, wherein the processor is configured to allow the first image and at least one of the related information to be further stored in the database.

### Claim 11 (depends on 8)

The computer device of claim 8, wherein the processor is configured to allow the related information to be generated by performing image analysis on the first image signal.