# US 2024/0185603 A1 · Electronic device and method for controlling the electronic device thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0185603 A1
- Document ID: US20240185603A1
- Status: Published application
- Kind: A1
- Application number: 18/379,969
- Filed: 2023-10-13
- Published: 2024-06-06
- Earliest claimed: 2022-12-02
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Namuk KIM; Cheuihee HAHM; Jayoon KOO; Wookhyung KIM; IIhyun CHO
- Web page: https://patentgrep.com/patent/US20240185603A1

## CPC

- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06N 3/08: Learning methods
- G06V 10/225: {based on a marking or identifier characterising the area}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Provided are an electronic device and a control method thereof. The electronic device includes at least one memory storing at least one instruction; and at least one processor connected to the at least one memory and configured to execute the at least one instruction to: input information about a first frame among a plurality of frames to a first object detection network and obtain first information about an object included in the first frame, store the first information in the at least one memory, and input the first information and information about a second frame among the plurality of frames to a second object detection network and obtain second information about an object included in the second frame, wherein the second frame is a next frame following the first frame.

## Claims

### Claim 1

An electronic device comprising:
at least one memory storing at least one instruction; and
at least one processor connected to the at least one memory and configured to execute the at least one instruction to:
input information about a first frame among a plurality of frames to a first object detection network and obtain first information about an object included in the first frame,
store the first information in the at least one memory, and
input the first information and information about a second frame among the plurality of frames to a second object detection network and obtain second information about an object included in the second frame,
wherein the second frame is a next frame following the first frame.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the first information comprises information about a bounding box comprising information about a size of the object included in the first frame.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the first object detection network is trained to obtain information about an object by using a plurality of anchor boxes, and
wherein the second object detection network is trained to obtain information about an object by using a bounding box of an object included in a previous frame as an anchor box.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the at least one processor further is configured to execute the at least one instruction to:
obtain the first information using an anchor box located in a first grid among a plurality of grids, and
obtain the second information using a bounding box, as an anchor box, of the object included in the first frame located in the first grid.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to execute the at least one instruction to:
obtain the first information using an anchor box located in a first grid among a plurality of grids, and
obtain the second information using a bounding box, as an anchor box, located in a second grid among the plurality of grids around the first grid based on information about a motion of the object included in the second frame.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured to execute the at least one instruction to:
obtain the first information using an anchor box located in a first grid among a plurality of grids, and
obtain the second information using a bounding box, as an anchor box, located in the first grid and a plurality of third grids from among the plurality of grids located at an upper, lower, left, or right portions of the first grid.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein each of the plurality of frames is classified into a plurality of frame sections,
wherein each of the plurality of frame sections comprises one intra frame and at least two inter frames, and
wherein the first frame is the intra frame, and the second frame is an inter frame of the at least two inter frames.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the plurality of frame sections are classified based on a video frame included in video codec information.

### Claim 9

A method of controlling an electronic device, the method comprising:
inputting information about a first frame among a plurality of frames to a first object detection network and obtaining first information about an object included in the first frame;
storing the first information in the at least one memory; and
inputting the first information and information about a second frame among the plurality of frames to a second object detection network and obtaining second information about an object included in the second frame,
wherein the second frame is a next frame following the first frame.

### Claim 10 (depends on 9)

The method of claim 9, wherein the first information comprises information about a bounding box comprising information about a size of the object included in the first frame.

### Claim 11 (depends on 10)

The method of claim 10, wherein the first object detection network is trained to obtain information about an object by using a plurality of anchor boxes, and
wherein the second object detection network is trained to obtain information about an object by using a bounding box of an object included in a previous frame as an anchor box.

### Claim 12 (depends on 9)

The method of claim 9, wherein the obtaining the first information comprises obtaining the first information using an anchor box located in a first grid among a plurality of grids, and
wherein the obtaining the second information comprises obtaining the second information using the bounding box, as an anchor box, of the object included in the first frame located in the first grid.

### Claim 13 (depends on 9)

The method of claim 9, wherein the obtaining the first information comprises obtaining the first information using an anchor box located in a first grid among a plurality of grids, and
wherein the obtaining the second information comprises obtaining the second information using a bounding box, as an anchor box, located in a second grid among the plurality of grids around the first grid based on information about a motion of the object included in the second frame.

### Claim 14 (depends on 9)

The method of claim 9, wherein the obtaining the first information comprises obtaining the first information using an anchor box located in a first grid among a plurality of grids, and
wherein the obtaining the second information comprises obtaining the second information using a bounding box, as an anchor box, located in the first grid and a plurality of third grids from among the plurality of grids located at an upper, lower, left, or right portions of the first grid.

### Claim 15 (depends on 9)

The method of claim 9, wherein each of the plurality of frames is classified into a plurality of frame sections,
wherein each of the plurality of frame sections comprises one intra frame and at least two inter frames, and
wherein the first frame is the intra frame, and the second frame is an inter frame of the at least two inter frames.
