# US 10,313,628 B2 · Apparatus and method for processing a plurality of video data captured by a plurality of devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,628 B2
- Document ID: US10313628B2
- Status: Granted
- Kind: B2
- Application number: 15/333,838
- Filed: 2016-10-25
- Published: 2018-04-05
- Granted: 2019-06-04
- Earliest claimed: 2016-10-04
- Assignees: 39Degrees C Inc.
- Applicants: 39degrees C Inc.
- Inventors: Seung Won Woo; Hyun Goo Park
- Web page: https://patentgrep.com/patent/US10313628B2

## CPC

- H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter}
- G06T 1/0021: {Image watermarking}
- H04N 5/268: Signal distribution or switching
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/2187: Live feed
- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- H04N 21/440263: {by altering the spatial resolution, e.g. for displaying on a connected PDA}
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 23/63: by using electronic viewfinders
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 7/01: Conversion of standards {, e.g. involving analogue television standards or digital television standards processed at pixel level}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Provided are an image processing apparatus and method. The image processing apparatus includes a main device configured to capture a moving picture including first audio data and first video data of an object at a location, and a subdevice connected to the main device through wireless communication and including first to Nth devices configured to convert first video data of the object captured at least one location different from the location into second video data.

## Claims

### Claim 1

An image processing apparatus, comprising:
a main device configured to capture a moving picture including first audio data and first main video data of an object at a location; and
a plurality of subdevices connected to the main device through wireless communication, and including first to Nth subdevices configured to convert first sub-video data of the object, which is captured at at least one location different from the location of the main device, into second sub-video data,
wherein the main device comprises a processor configured to:
convert the first main video data into second main video data;
display the second main video data converted from the first main video data on a first display region;
display one or more of the second sub-video data, without being encoded and decoded, received from the plurality of subdevices on a second display region different from the first display region, wherein the second display region is divided into at least one subregion;
switch the second sub-video data, displayed on a subregion selected according to a request to select one subregion, to be displayed on the first display region;
encode the second main video data displayed on the first display region and encode the first audio data; and
transmit the encoded second main video data displayed on the first display region and the encoded first audio data to outside,
wherein the second main video data is displayed on the first display region at a first frame rate and the one or more of the second sub-video data is displayed on the second display region at a second frame rate different from the first frame rate,
wherein, when switching, a control signal is transmitted to one of the plurality of subdevices corresponding to the second sub-video data displayed on the subregion selected according to the request to select the one subregion, and
wherein the control signal instructs the one of the plurality of subdevices to transmit the second sub-video data at the first frame rate to be displayed on the first display region.

### Claim 2 (depends on 1)

The image processing apparatus of claim 1 wherein the processor of the main device is further configured to insert a received watermark into the second main video data displayed on the first display region.

### Claim 3 (depends on 1)

The image processing apparatus of claim 1, wherein the processor of the main device is further configured to:
detect the first to Nth subdevices in a range of the wireless communication; and
transmit a connection request signal requesting connection to the main device to the detected first to Nth subdevices, and set starting of a connection between the main device and the first to Nth subdevices transmitting a connection permission signal when receiving the connection permission signal from the first to Nth subdevices.

### Claim 4 (depends on 3)

The image processing apparatus of claim 3, wherein, when the setting of the starting of the connection is completed, the processor generates a same shooting start signal and transmits the same shooting start signal to the main device and the first to Nth subdevices transmitting the connection permission signal.

### Claim 5

A method of operating an image processing apparatus, performed by a main device, the image processing apparatus including the main device configured to capture a moving picture including first audio data and first main video data of an object at a location and a plurality of subdevices connected to the main device through wireless communication and including first to Nth devices configured to convert first main video data of the object captured at at least one location different from the location of the main device into second sub-video data, the method comprising:
converting the first main video data into second main video data;
displaying the second main video data on a first display region, and displaying one or more of the second sub-video data, without being encoded and decoded, received from the plurality of subdevices on a second display region different from the first display region, wherein the second display region is divided into at least one subregion;
switching the second sub-video data, displayed on a subregion selected according to a request to select one subregion, to be displayed on the first display region;
encoding the second main video data displayed on the first display region and encoding the first audio data; and
transmitting the encoded second main video data displayed on the first display region and the encoded first audio data to outside,
wherein the second main video data is displayed on the first display region at a first frame rate and the one or more of second sub-video data is displayed on the second display region at a second frame rate different from the first frame rate,
wherein the switching further comprises transmitting a control signal to one of the plurality of subdevices corresponding to the second sub-video data displayed on the subregion selected according to the request to select the one subregion, and
wherein the control signal instructs the one of the plurality of subdevices to transmit the second sub-video data at the first frame rate to be displayed on the first display region.

### Claim 6 (depends on 5)

The method of claim 5, further comprising inserting a received watermark into the second main video data displayed on the first display region.

### Claim 7 (depends on 5)

The method of claim 5, further comprising:
detecting the first to Nth subdevices in a radius of the wireless communication;
transmitting a connection request signal requesting connection to the main device to the detected first to Nth subdevices;
receiving a connection permission signal from the first to Nth subdevices; and
setting starting connection to the first to Nth subdevices transmitting the connection permission signal.

### Claim 8 (depends on 7)

The method of claim 7, further comprising, when the setting of the starting of the connection is completed, generating a same shooting start signal and transmitting the same shooting start signal to the main device and the first to Nth subdevices transmitting the connection permission signal.

### Claim 9 (depends on 5)

A computer program stored in a non-transitory computer-readable recording medium and configured to perform the method of claim 5 by using a computer.

### Claim 10 (depends on 6)

A computer program stored in a non-transitory computer-readable recording medium and configured to perform the method of claim 6 by using a computer.

### Claim 11 (depends on 7)

A computer program stored in a non-transitory computer-readable recording medium and configured to perform the method of claim 7 by using a computer.

### Claim 12 (depends on 8)

A computer program stored in a non-transitory computer-readable recording medium and configured to perform the method of claim 8 by using a computer.