# US 2026/0073707 A1 · Electronic device, method and non-transitory computer readable storage medium identifying direction of movement of external object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073707 A1
- Document ID: US20260073707A1
- Status: Published application
- Kind: A1
- Application number: 19/317,394
- Filed: 2025-09-03
- Published: 2026-03-12
- Earliest claimed: 2024-09-11
- Assignees: Thinkware Corporation
- Applicants: Thinkware Corporation
- Inventors: Yosep Park; Haejun Jung; Dongwon Shin
- Web page: https://patentgrep.com/patent/US20260073707A1

## CPC

- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/50: Depth or shape recovery
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/82: using neural networks
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30256: Lane; Road marking
- G06V 2201/08: Detecting or categorising vehicles
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An electronic device includes an image sensor, a CPU, an NPU, and memory including one or more storage media storing instructions. The instructions, when executed by the CPU, cause the electronic device to obtain, via the image sensor, an image, execute an object detection model configured to detect an external object from the image, by controlling the NPU, obtain, from the NPU, coordinate values indicating a portion of the image associated with the external object, perform a plurality of calculations defining a direction identification model configured to identify a direction of movement of the external object based on the coordinate values, by controlling processing circuitry of the CPU, and based on a direction of movement of the external object indicated by a result of the plurality of calculations, output a notification with respect to the direction of movement.

## Claims

### Claim 1

An electronic device comprising:
an image sensor;
a central processing unit (CPU);
a neural processing unit (NPU); and
memory comprising one or more storage media storing instructions that, when executed by the CPU, cause the electronic device to:
obtain, via the image sensor, an image,
execute an object detection model configured to detect an external object from the image, by controlling the NPU,
obtain, from the NPU, coordinate values indicating a portion of the image associated with the external object,
perform a plurality of calculations defining a direction identification model configured to identify a direction of movement of the external object based on the coordinate values, by controlling processing circuitry of the CPU, and
based on a direction of movement of the external object indicated by a result of the plurality of calculations, output a notification with respect to the direction of movement.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the CPU, cause the electronic device to:
based on obtaining other coordinate values indicating another portion of the image in conjunction with the coordinate values indicating the portion of the image by executing the object detection model, obtain a first size of the portion and a second size of the another portion, and
based on obtaining the second size greater than the first size:
refrain from performing the plurality of calculations based on the coordinate values,
perform the plurality of calculations defining the direction identification model based on the other coordinate values, and
based on a direction of movement of another external object corresponding to the another portion indicated by a result of the plurality of calculations performed based on the other coordinate values, output a notification with respect to a direction of movement of the another external object.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the instructions, when executed by the CPU, cause the electronic device to:
obtain, from the NPU, first data with respect to a type of the external object and second data with respect to a type of the another external object, and
further based on the first data and the second data:
refrain from performing the plurality of calculations based on the coordinate values,
perform the plurality of calculations defining the direction identification model based on the other coordinate values, and
based on a direction of movement of the another external object corresponding to the another portion indicated by a result of the plurality of calculations performed based on the other coordinate values, output a notification with respect to a direction of movement of the another external object.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the CPU, cause the electronic device to:
execute an image segmentation model configured to recognize, from the image, a lane on which a car equipped with the electronic device is positioned, by controlling the NPU,
identify, from the NPU, an area within the image corresponding to a lane on which the car is positioned,
based on identifying, from the object detection model executed by the NPU, portions respectively corresponding to a plurality of external objects from the image, compare the portions and the area, and
perform the plurality of calculations defining the direction identification model using coordinate values of a portion overlapping the area from among the portions, by controlling the processing circuitry of the CPU.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the CPU, cause the electronic device to:
execute an image segmentation model configured to recognize, from the image, a road on which a car equipped with the electronic device is positioned, by controlling the NPU,
identify, from the NPU, an area within the image, corresponding to a road on which the car is positioned, divided by a central line,
based on identifying, from the object detection model executed by the NPU, portions respectively corresponding to a plurality of external objects from the image, compare the portions and the area,
refrain from performing the plurality of calculations defining the direction identification model using coordinate values of a portion that does not overlap the area from among the portions, by controlling the processing circuitry of the CPU, and
perform the plurality of calculations defining the direction identification model using coordinate values of a portion overlapping the area from among the portions, by controlling the processing circuitry of the CPU.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the CPU, cause the electronic device to:
based on a result of the plurality of calculations, obtain duration in which the plurality of calculations is performed by the processing circuitry of the CPU,
based on another image obtained from the image sensor after obtaining the image, execute the object detection model using the another image, by controlling the NPU, and
based on identifying, from the NPU, portions of the another image respectively associated with a plurality of external objects, determine the number of the portions of the another image such that a plurality of calculations of the direction identification model associated with the another image is performed within the duration.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the instructions, when executed by the CPU, cause the electronic device to:
in accordance with determining that the number of the portions identified from the another image is greater than the determined number, select portions to be used for performing the plurality of calculations defining the direction identification model based on sizes of each of the portions, from among the portions identified from the another image.

### Claim 8 (depends on 1)

The electronic device of claim 1, further comprising:
a speaker,
wherein the instructions, when executed by the CPU, cause the electronic device to:
based on the direction of movement of the external object indicated by the result of the plurality of calculations, determine a probability of collision between the external object and a car equipped with the electronic device, and
based on the probability of collision, output an audio notification via the speaker.

### Claim 9 (depends on 1)

The electronic device of claim 1, further comprising:
a light emitting diode (LED),
wherein the instructions, when executed by the CPU, cause the electronic device to:
based on the direction of movement of the external object indicated by the result of the plurality of calculations, determine a probability of collision between the external object and a car equipped with the electronic device, and
based on the probability of collision, emit light via the LED.

### Claim 10 (depends on 1)

The electronic device of claim 1, further comprising:
a display,
wherein the instructions, when executed by the CPU, cause the electronic device to:
based on the direction of movement of the external object indicated by the result of the plurality of calculations, determine a probability of collision between the external object and a car equipped with the electronic device, and
based on the probability of collision, display a screen including a warning content via the display.

### Claim 11

An electronic device comprising:
an image sensor;
a central processing unit (CPU);
a neural processing unit (NPU); and
memory comprising one or more storage media storing instructions that, when executed by the CPU, cause the electronic device to:
obtain, via the image sensor, an image,
execute an object detection model configured to detect an external object from the image, by controlling the NPU,
obtain, from the NPU, coordinate values indicating a portion of the image associated with the external object,
perform a plurality of calculations defining a direction identification model configured to identify a direction of movement of the external object based on the coordinate values, by controlling processing circuitry of the CPU, and
based on the coordinate values and a direction of movement of the external object indicated by a result of the plurality of calculations, output a notification with respect to a distance between a car equipped with the electronic device and the external object.

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein the instructions, when executed by the CPU, cause the electronic device to:
obtain, from the NPU, data with respect to a type of the external object, and
further based on the data, output the notification with respect to the distance between the car equipped with the electronic device and the external object.

### Claim 13 (depends on 11)

The electronic device of claim 11, further comprising:
a speaker,
wherein the instructions, when executed by the CPU, cause the electronic device to:
based on the distance and the direction of movement of the external object indicated by the result of the plurality of calculations, determine a probability of collision between the external object and the car equipped with the electronic device, and
based on the probability of collision, output an audio notification via the speaker.

### Claim 14 (depends on 11)

The electronic device of claim 11, further comprising:
a light emitting diode (LED),
wherein the instructions, when executed by the CPU, cause the electronic device to:
based on the distance and the direction of movement of the external object indicated by the result of the plurality of calculations, determine a probability of collision between the external object and the car equipped with the electronic device, and
based on the probability of collision, emit light via the LED.

### Claim 15 (depends on 11)

The electronic device of claim 11, further comprising:
a display,
wherein the instructions, when executed by the CPU, cause the electronic device to:
based on the distance and the direction of movement of the external object indicated by the result of the plurality of calculations, determine a probability of collision between the external object and the car equipped with the electronic device, and
based on the probability of collision, display a screen including a warning content via the display.

### Claim 16

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by an electronic device with an image sensor, a CPU, and an NPU, cause the electronic device to:
obtain, via the image sensor, an image,
execute an object detection model configured to detect an external object from the image, by controlling the NPU,
obtain, from the NPU, coordinate values indicating a portion of the image associated with the external object,
perform a plurality of calculations defining a direction identification model configured to identify a direction of movement of the external object based on the coordinate values, by controlling processing circuitry of the CPU, and
based on a direction of movement of the external object indicated by a result of the plurality of calculations, output a notification with respect to the direction of movement.

### Claim 17 (depends on 16)

The non-transitory computer readable storage medium of claim 16,
wherein the one or more programs includes instructions that, when executed by the electronic device, cause the electronic device to:
based on obtaining other coordinate values indicating another portion of the image in conjunction with the coordinate values indicating the portion of the image by executing the object detection model, obtain a first size of the portion and a second size of the another portion, and
based on obtaining the second size greater than the first size:
refrain from performing the plurality of calculations based on the coordinate values,
perform the plurality of calculations defining the direction identification model based on the other coordinate values, and
based on a direction of movement of another external object corresponding to the another portion indicated by a result of the plurality of calculations performed based on the other coordinate values, output a notification with respect to a direction of movement of the another external object.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium of claim 17,
wherein the one or more programs includes instructions that, when executed by the electronic device, cause the electronic device to:
obtain, from the NPU, first data with respect to a type of the external object and second data with respect to a type of the another external object, and
further based on the first data and the second data:
refrain from performing the plurality of calculations based on the coordinate values,
perform the plurality of calculations defining the direction identification model based on the other coordinate values, and
based on a direction of movement of the another external object corresponding to the another portion indicated by a result of the plurality of calculations performed based on the other coordinate values, output a notification with respect to a direction of movement of the another external object.

### Claim 19 (depends on 16)

The non-transitory computer readable storage medium of claim 16,
wherein the one or more programs includes instructions that, when executed by the electronic device, cause the electronic device to:
execute an image segmentation model configured to recognize, from the image, a lane on which a car equipped with the electronic device is positioned, by controlling the NPU,
identify, from the NPU, an area within the image corresponding to a lane on which the car is positioned,
based on identifying, from the object detection model executed by the NPU, portions respectively corresponding to a plurality of external objects from the image, compare the portions and the area, and
perform the plurality of calculations defining the direction identification model using coordinate values of a portion overlapping the area from among the portions, by controlling the processing circuitry of the CPU.

### Claim 20 (depends on 16)

The non-transitory computer readable storage medium of claim 16,
wherein the one or more programs includes instructions that, when executed by the electronic device, cause the electronic device to:
execute an image segmentation model configured to recognize, from the image, a road on which a car equipped with the electronic device is positioned, by controlling the NPU,
identify, from the NPU, an area within the image, corresponding to a road on which the car is positioned, divided by a central line,
based on identifying, from the object detection model executed by the NPU, portions respectively corresponding to a plurality of external objects from the image, compare the portions and the area,
refrain from performing the plurality of calculations defining the direction identification model using coordinate values of a portion that does not overlap the area from among the portions, by controlling the processing circuitry of the CPU, and
perform the plurality of calculations defining the direction identification model using coordinate values of a portion overlapping the area from among the portions, by controlling the processing circuitry of the CPU.
