# US 12,003,881 B2 · Electronic device and control method of electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,003,881 B2
- Document ID: US12003881B2
- Status: Granted
- Kind: B2
- Application number: 17/993,280
- Filed: 2022-11-23
- Published: 2023-03-16
- Granted: 2024-06-04
- Earliest claimed: 2020-06-10
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Dongnam Byun; Jongmyeong Ban; Hyechan Bae; Seongwoo Oh; Jaeyeop Lee; Haedong Yeo; Jinyoung Hwang
- Web page: https://patentgrep.com/patent/US12003881B2

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- H04N 5/265: Mixing
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06T 5/60: using machine learning, e.g. neural networks
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/036: Insert-editing
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- H04N 5/77: between a recording apparatus and a television camera
- H04N 5/91: Television signal processing therefor
- H04N 23/61: based on recognised objects
- H04N 23/617: Upgrading or updating of programs or applications for camera control
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30168: Image quality inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

An electronic device and a control method thereof are provided. The control method of an electronic device includes the steps of when a user command for initiating video recording is received, transmitting, to an external device connected to the electronic device, a first signal including a request for initiating video recording, acquiring a first image according to the user command, acquiring a first score for composition of the first image by using a trained neural network model, when a second signal including a second score for composition of a second image acquired by the external device is received according to the first signal, identifying, from the second image, at least one merging section to be merged into the first image, on the basis of the first score and the second score, transmitting, to the external device, a third signal including a request for image data corresponding to the at least one merging section, and when a fourth signal including the image data is received according to the third signal, acquiring a third image by merging an image corresponding to the at least one merging section into the first image on the basis of the image data.

## Claims

### Claim 1

An electronic device, comprising:
a camera;
a communication unit including a circuit;
memory storing one or more computer programs; and
one or more processors communicatively coupled to the camera. the communication unit, and the memory,
wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to:
when a user command for initiating video recording is received, control the communication unit to transmit a first signal including a request for initiating video recording to an external device connected to the electronic device,
acquire a first image through the camera according to the user command,
acquire a first score for a composition of the first image using a trained neural network model,
when a second signal including a second score for a composition of a second image acquired by the external device is received from the external device through the communication unit according to the first signal, identify at least one merging section to be merged into the first image from the second image on a basis of the first score and the second score,
control the communication unit to transmit a third signal including a request for image data corresponding to the at least one merging section to the external device, and
when a fourth signal including the image data is received from the external device through the communication unit according to the third signal, acquire a third image by merging an image corresponding to the at least one merging section into the first image on a basis of the image data.

### Claim 2 (depends on 1)

The electronic device of claim 1,
wherein the first score is an average value of scores for at least some of a plurality of frames included in a main section of the first image,
wherein the main section of the first image is at least one of a plurality of sections of the first image in which an average value of scores for at least some frames included in each of the plurality of sections is equal to or greater than a preset threshold value,
wherein the second score is an average value of scores for at least some of a plurality of frames included in a main section of the second image, and
wherein the main section of the second image is at least one of a plurality of sections of the second image in which an average value of scores for at least some frames included in each of the plurality of sections is equal to or greater than the preset threshold value.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to:
acquire first time information on a start time point and an end time point of each of main sections of the first image,
on a basis of the first time information and second time information on a start time point and an end time point of each of main sections of the second image included in the second signal, identify a section overlapping a main section of the first image among the main sections of the second image, and
identify, as the at least one merging section, a section overlapping a main section of the first image and having a higher score than the main section of the first image among the main sections of the second image, and a section that does not overlap the main sections of the first image among the main sections of the second image.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to:
while a plurality of frames of the first image are acquired, input at least some of the plurality of frames of the first image to the neural network model at a preset frame interval; and
acquire scores for the at least some of the plurality of frames of the first image.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the request for initiating video recording includes time code information for synchronizing system times of the electronic device and the external device with each other.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the second score is received from the external device through the communication unit as a fifth signal including a request for terminating the initiated video recording is transmitted to the external device through the communication unit.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the second score is acquired using a neural network model included in the external device.

### Claim 8

A control method performed by an electronic device, the control method comprising:
when a user command for initiating video recording is received, transmitting a first signal including a request for initiating video recording to an external device connected to the electronic device;
acquiring a first image according to the user command;
acquiring a first score for a composition of the first image using a trained neural network model;
when a second signal including a second score for a composition of a second image acquired by the external device is received according to the first signal, identifying at least one merging section to be merged into the first image from the second image on a basis of the first score and the second score;
transmitting a third signal including a request for image data corresponding to the at least one merging section to the external device; and
when a fourth signal including the image data is received according to the third signal, acquiring a third image by merging an image corresponding to the at least one merging section into the first image on a basis of the image data.

### Claim 9 (depends on 8)

The control method of claim 8,
wherein the first score is an average value of scores for at least some of a plurality of frames included in a main section of the first image,
wherein the main section of the first image is at least one of a plurality of sections of the first image in which an average value of scores for at least some frames included in each of the plurality of sections is equal to or greater than a preset threshold value,
wherein the second score is an average value of scores for at least some of a plurality of frames included in a main section of the second image, and
wherein the main section of the second image is at least one of a plurality of sections of the second image in which an average value of scores for at least some frames included in each of the plurality of sections is equal to or greater than the preset threshold value.

### Claim 10 (depends on 8)

The control method of claim 8, wherein the identifying of the at least one merging section includes:
acquiring first time information on a start time point and an end time point of each of main sections of the first image;
on a basis of the first time information and second time information on a start time point and an end time point of each of main sections of the second image included in the second signal, identifying a section overlapping a main section of the first image among the main sections of the second image; and
identifying, as the at least one merging section, a section overlapping a main section of the first image and having a higher score than the main section of the first image among the main sections of the second image, and a section that does not overlap the main sections of the first image among the main sections of the second image.

### Claim 11 (depends on 8)

The control method of claim 8, wherein the acquiring of the first score includes:
while a plurality of frames of the first image are acquired, inputting at least some of the plurality of frames of the first image to the neural network model at a preset frame interval; and
acquiring scores for the at least some of the plurality of frames of the first image.

### Claim 12 (depends on 8)

The control method of claim 8, wherein the request for initiating video recording includes time code information for synchronizing system times of the electronic device and the external device with each other.

### Claim 13 (depends on 8)

The control method of claim 8, wherein the second score is received from the external device as a fifth signal including a request for terminating the initiated video recording is transmitted.

### Claim 14 (depends on 8)

The control method of claim 8, wherein the second score is acquired using a neural network model included in the external device.

### Claim 15

One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform operations, the operations comprising:
when a user command for initiating video recording is received, transmitting a first signal including a request for initiating video recording to an external device connected to the electronic device;
acquiring a first image according to the user command;
acquiring a first score for a composition of the first image using a trained neural network model;
when a second signal including a second score for a composition of a second image acquired by the external device is received according to the first signal, identifying at least one merging section to be merged into the first image from the second image on a basis of the first score and the second score;
transmitting a third signal including a request for image data corresponding to the at least one merging section to the external device; and
when a fourth signal including the image data is received according to the third signal, acquiring a third image by merging an image corresponding to the at least one merging section into the first image on a basis of the image data.