# US 11,910,103 B2 · Electronic system and image aggregation method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,910,103 B2 - Document ID: US11910103B2 - Status: Granted - Kind: B2 - Application number: 17/386,070 - Filed: 2021-07-27 - Published: 2022-02-03 - Granted: 2024-02-20 - Earliest claimed: 2020-07-28 - Assignees: eYs3D Microelectronics, Co. - Applicants: eYs3D Microelectronics, Co. - Inventors: Hong-Yeh Hsieh; Ming-Hua Lin - Web page: https://patentgrep.com/patent/US11910103B2 ## CPC - H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation} - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - H04N 1/2141: {in a multi-frame buffer} - H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects} - H04N 23/662: {by using camera arrangements where one camera controls another camera to affect the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image} - H04N 23/6845: {by combination of a plurality of images sequentially taken} - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - H04N 5/06: Generation of synchronising signals - H04N 5/77: between a recording apparatus and a television camera - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract The application provides an electronic system and an image aggregation method thereof. The electronic system includes a plurality of image pickup devices and an image aggregation device coupled to the image pickup devices. The image aggregation device controls trigger of the image pickup devices. When the image pickup devices are triggered, the image pickup devices pickup a plurality of images and send to the image aggregation device. The image aggregation device flexibly selects the images pickup by the image pickup devices to flexibly aggregate into an aggregated image. ## Claims ### Claim 1 An electronic system, comprising: a plurality of image pickup devices; and an image aggregation device coupled to the image pickup devices for controlling triggering of the image pickup devices, wherein when the image pickup devices are triggered, the image pickup devices pick up and send a plurality of images to the image aggregation device, the image aggregation device flexibly selects required images from the pickup images of the image pickup devices and flexibly rearranges the selected images as an aggregated image by dynamically adjusting relative positions of the selected images, wherein the image aggregation device decodes the pickup images of the image pickup devices to generate a sync signal and a video streaming, and rearranges the video streaming as the aggregated image based on the sync signal. ### Claim 2 (depends on 1) The electronic system according to claim 1, wherein, the image aggregation device flexibly and repeatedly uses the pickup images of the image pickup devices according to a size of an internal buffer. ### Claim 3 (depends on 1) The electronic system according to claim 1, wherein, the image aggregation device comprises: a trigger control unit coupled to the image pickup devices for controlling triggering of the image pickup devices; an interface circuit coupled to the image pickup devices and the trigger control unit, wherein when the image pickup devices are triggered, the pickup images of the image pickup devices are sent to the interface circuit, the interface circuit decodes the pickup images of the image pickup devices to generate the sync signal and the video streaming and further sends the sync signal to the trigger control unit; a write circuit coupled to the interface circuit for receiving the video streaming obtained by the interface circuit through decoding; a storage unit coupled to the write circuit for storing the video streaming written by the write circuit; and a retiming circuit coupled to the storage unit for flexibly rearranging the video streaming read from the storage unit as the aggregated image. ### Claim 4 (depends on 3) The electronic system according to claim 3, wherein, the interface circuit adjusts a frame size of the images. ### Claim 5 (depends on 3) The electronic system according to claim 3, wherein, the write circuit writes the video streaming to the storage unit according to a raster scan sequence. ### Claim 6 (depends on 3) The electronic system according to claim 3, wherein, the storage unit comprises a plurality of line buffers or a frame buffer; wherein, when the storage unit comprises the line buffers, a size of the storage unit is relevant to a number of the image pickup devices, an image width of the pickup image and the image pixel bit number of the pickup image. ### Claim 7 (depends on 3) The electronic system according to claim 3, wherein, the retiming circuit comprises a plurality of retiming units each comprising a storage control unit, a read unit and a frame control unit, wherein, when an image data of the storage unit is ready, the storage control unit notifies the read unit to read the storage unit according to a scheduling queue parameter set by the user; the scheduling queue parameter flexibly selects images from the pickup images of the image pickup devices for image aggregation, and flexibly designates an image aggregation sequence. ### Claim 8 (depends on 7) The electronic system according to claim 7, wherein, in response to notification of the storage control unit, the read unit reads the video streaming from the storage unit and sends the video streaming to the storage control unit; and the storage control unit sends the video streaming to the frame control unit; and the frame control unit flexibly rearranges the video streaming received from the storage control unit to generate the aggregated image. ### Claim 9 (depends on 3) The electronic system according to claim 3, wherein, the trigger control unit generates a plurality of trigger signals to the image pickup devices for controlling the image pickup of the image pickup devices and an image output timing, wherein the trigger signals of the image pickup devices are mutually independent. ### Claim 10 (depends on 3) The electronic system according to claim 3, wherein, the trigger control unit selects one of the image pickup devices as a reference image pickup device, and triggering of each of other non-reference image pickup devices of the image pickup devices is delayed in comparison to triggering of the reference image pickup device. ### Claim 11 (depends on 10) The electronic system according to claim 10, wherein, the trigger control unit comprises a multiplexer, a timing calculation unit and a delay control unit, the delay control unit comprises a plurality of delay control units; the multiplexer is coupled to the interface circuit for sending the sync signal of the reference image pickup device to the timing calculation unit; the timing calculation unit performs timing calculation; and the delay control units count individual delay time of each of the image pickup devices to trigger the image pickup devices according to a delay time parameter. ### Claim 12 An image aggregation method, comprising: controlling triggering of a plurality of image pickup devices; when the image pickup devices are triggered, picking up a plurality of images by the image pickup devices; and flexibly selecting required images from the pickup images of the image pickup devices and flexibly rearranging the selected images as an aggregated image by dynamically adjusting relative positions of the selected images, wherein the image aggregation device decodes the pickup images of the image pickup devices to generate a sync signal and a video streaming, and rearranges the video streaming as the aggregated image based on the sync signal. ### Claim 13 (depends on 12) The image aggregation method according to claim 12, further comprising: flexibly and repeatedly using the pickup images of the image pickup devices according to a size of an internal buffer. ### Claim 14 (depends on 12) The image aggregation method according to claim 12, wherein, the pickup images of the image pickup devices are decoded to generate the sync signal and the video streaming; storing the video streaming to a storage unit; and rearranging the video streaming read from the storage unit as an aggregated image. ### Claim 15 (depends on 14) The image aggregation method according to claim 14, further comprising: adjusting a frame size of the images. ### Claim 16 (depends on 14) The image aggregation method according to claim 14, wherein, the video streaming is written to the storage unit according to a raster scan sequence. ### Claim 17 (depends on 14) The image aggregation method according to claim 14, wherein, the storage unit comprises a plurality of line buffers or a frame buffer; wherein, when the storage unit comprises the line buffers, a size of the storage unit is relevant to a number of the image pickup devices, an image width of the pickup image and the image pixel bit number of the pickup image. ### Claim 18 (depends on 14) The image aggregation method according to claim 14, wherein, when an image data of the storage unit is ready, the storage unit is read according to a scheduling queue parameter set by the user; the scheduling queue parameter flexibly selects images from the pickup images of the image pickup devices for image aggregation, and flexibly designates an image aggregation sequence. ### Claim 19 (depends on 14) The image aggregation method according to claim 14, wherein, a plurality of trigger signals are generated to the image pickup devices for controlling the image pickup of the image pickup devices and an image output timing, wherein the trigger signals of the image pickup devices are mutually independent. ### Claim 20 (depends on 14) The image aggregation method according to claim 14, wherein, one of the image pickup devices is selected as a reference image pickup device, and triggering of each of other non-reference image pickup devices of the image pickup devices is delayed in comparison to triggering of the reference image pickup device. ### Claim 21 (depends on 20) The image aggregation method according to claim 20, wherein, timing calculation is performed according to the sync signal of the reference image pickup device; and individual delay time of each of the image pickup devices is counted to trigger the image pickup devices according to a delay time parameter. ### Claim 22 An electronic system, comprising: a plurality of image pickup devices; and an image aggregation device coupled to the image pickup devices for controlling triggering of the image pickup devices, wherein when the image pickup devices are triggered, the image pickup devices pick up and send a plurality of images to the image aggregation device, the image aggregation device flexibly selects images from the pickup images of the image pickup devices and flexibly rearranges the selected images as one or more than one aggregated image by dynamically adjusting relative positions of the selected images, wherein the image aggregation device decodes the pickup images of the image pickup devices to generate a sync signal and a video streaming, and rearranges the video streaming as the aggregated image based on the sync signal.