# US 2024/0098347 A1 · Electronic device comprising image sensor and dynamic vision sensor, and operating method therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0098347 A1
- Document ID: US20240098347A1
- Status: Published application
- Kind: A1
- Application number: 18/519,683
- Filed: 2023-11-27
- Published: 2024-03-21
- Earliest claimed: 2021-05-25
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jongwoon JANG; Jinhyun KIM; Sungoh KIM
- Web page: https://patentgrep.com/patent/US20240098347A1

## CPC

- H04N 23/61: based on recognised objects
- H04N 1/2133: {Recording or reproducing at a specific moment, e.g. time interval or time-lapse}
- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 5/915: for field- or frame-skip recording or reproducing
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 25/47: Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device includes an image sensor; a dynamic vision sensor (DVS); and at least one processor electrically connected to the image sensor and the DVS. The at least one processor shoots video by using the image sensor, determines the moving speed of a subject by using the DVS during the video shooting, determines the frame rate of the image sensor on the basis of the moving speed, controls that the image sensor outputs, on the basis of the frame rate, a plurality of image frames including the subject, and acquires a hyperlapse video on the basis of the plurality of image frames.

## Claims

### Claim 1

An electronic device comprising:
an image sensor;
a dynamic vision sensor (DVS); and
at least one processor electrically connected with the image sensor and the DVS,
wherein memory stores instructions that, when executed by the at least one processor, cause the electronic device to:
shoot a video by using the image sensor,
determine a moving speed of a subject by using the DVS while shooting the video,
determine a frame rate of the image sensor based on the moving speed,
control the image sensor to output a plurality of image frames including the subject, based on the frame rate of the image sensor, and
acquire a hyperlapse video based on the plurality of image frames.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, further cause the electronic device to determine the frame rate of the image sensor as a minimum frame rate of the image sensor in response to it being determined that the moving speed is less than a designated value.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the instructions, when executed by the at least one processor, further cause the electronic device to:
acquire a change in the moving speed in response to it being determined that the moving speed is greater than or equal to the designated value, and
determine the frame rate of the image sensor based on the change in the moving speed.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, further cause the electronic device to determine a playback speed of the hyperlapse video based on the moving speed, and to determine the frame rate of the image sensor based on the playback speed of the hyperlapse video.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the instructions, when executed by the at least one processor, further cause the electronic device to determine the frame rate of the image sensor based on a frame rate of the hyperlapse video along with the playback speed of the hyperlapse video.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the frame rate of the hyperlapse video is 30 frame per second (fps).

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, further cause the electronic device to:
determine the frame rate of the image sensor as a first frame rate in response to the moving speed being a first speed, and
determine the frame rate of the image sensor as a second frame rate which is higher than the first frame rate in response to the moving speed being a second speed which is faster than the first speed.

### Claim 8 (depends on 1)

The electronic device of claim 1, further comprising the memory is electrically connected with the at least one processor,
wherein the instructions, when executed by the at least one processor, further cause the electronic device to store the hyperlapse video in the memory.

### Claim 9

An operating method of an electronic device, the method comprising:
shooting a video by using an image sensor included in the electronic device;
determining a moving speed of a subject by using a dynamic vision sensor (DVS) included in the electronic device while shooting the video;
determining a frame rate of the image sensor based on the moving speed;
controlling the image sensor to output a plurality of image frames including the subject, based on the frame rate of the image sensor; and
acquiring a hyperlapse video based on the plurality of image frames.

### Claim 10 (depends on 9)

The method of claim 9, wherein determining the frame rate of the image sensor based on the moving speed comprises determining the frame rate of the image sensor as a minimum frame rate of the image sensor in response to it being determined that the moving speed is less than a designated value.

### Claim 11 (depends on 10)

The method of claim 10, wherein determining the frame rate of the image sensor based on the moving speed comprises:
acquiring a change in the moving speed in response to it being determined that the moving speed is greater than or equal to the designated value; and
determining the frame rate of the image sensor based on the change in the moving speed.

### Claim 12 (depends on 9)

The method of claim 9, wherein determining the frame rate of the image sensor based on the moving speed comprises:
determining a playback speed of the hyperlapse video based on the moving speed; and
determining the frame rate of the image sensor based on the playback speed of the hyperlapse video.

### Claim 13 (depends on 12)

The method of claim 12, wherein determining the frame rate of the image sensor based on the moving speed comprises determining the frame rate of the image sensor based on a frame rate of the hyperlapse video along with the playback speed of the hyperlapse video.

### Claim 14 (depends on 9)

The method of claim 9, wherein determining the frame rate of the image sensor based on the moving speed comprises:
determining the frame rate of the image sensor as a first frame rate in response to the moving speed being a first speed; and
determining the frame rate of the image sensor as a second frame rate which is higher than the first frame rate in response to the moving speed being a second speed which is faster than the first speed.

### Claim 15 (depends on 9)

The method of claim 9, further comprising storing the hyperlapse video in a memory included in the electronic device.

### Claim 16

An electronic device comprising:
an image sensor;
a dynamic vision sensor (DVS);
at least one processor electrically connected with the image sensor and the DVS; and
memory storing instructions that, when executed by the at least one processor, cause the electronic device to:
shoot a video by using the image sensor,
determine a moving speed of a subject by using the DVS while shooting the video,
determine a playback speed of a hyperlapse video based on the moving speed,
determine a frame rate of the image sensor based on the playback speed and a frame rate of the hyperlapse video,
control the image sensor to output a plurality of image frames including the subject, based on the frame rate of the image sensor, and
acquire the hyperlapse video based on the plurality of image frames.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the instructions, when executed by the at least one processor, further cause the electronic device to acquire the hyperlapse video based on the plurality of image frames without a sampling process.

### Claim 18 (depends on 16)

The electronic device of claim 16, wherein the instructions, when executed by the at least one processor, further cause the electronic device to determine the frame rate of the image sensor based on a ratio between the playback speed and the frame rate of the hyperlapse video.

### Claim 19 (depends on 16)

The electronic device of claim 16, wherein the instructions, when executed by the at least one processor, further cause the electronic device to:
determine the frame rate of the image sensor as a first frame rate in response to it being determined that the moving speed is a first speed at a first time point,
determine that the moving speed is a second speed at a second time point which follows the first time point, and
acquire a difference value between the second speed and the first speed in response to it being determined that the second speed is greater than or equal to a designated value.

### Claim 20 (depends on 19)

The electronic device of claim 19, wherein the instructions, when executed by the at least one processor, further cause the electronic device to determine the frame rate of the image sensor as the first frame rate in response to the difference value satisfying a designated condition.
