# US 11,445,121 B2 · Movable photographing system and photography composition control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,445,121 B2
- Document ID: US11445121B2
- Status: Granted
- Kind: B2
- Application number: 17/137,190
- Filed: 2020-12-29
- Published: 2022-06-30
- Granted: 2022-09-13
- Earliest claimed: 2020-12-29
- Assignees: Industrial Technology Research Institute
- Applicants: Industrial Technology Research Institute
- Inventors: Guo-Ruei Chen; Tzu-Yang Lin; Hui-Ping Kuo
- Web page: https://patentgrep.com/patent/US11445121B2

## CPC

- G06T 7/74: {involving reference images or patches}
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/248: {involving reference images or patches}
- G06V 10/24: Aligning, centring, orientation detection or correction of the image
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06V 40/161: {Detection; Localisation; Normalisation}
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/60: Control of cameras or camera modules
- H04N 23/61: based on recognised objects
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06T 2207/20164: Salient point detection; Corner detection
- G06T 2207/30168: Image quality inspection
- G06T 2207/30196: Human being; Person
- G06V 2201/033: of skeletal patterns
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A movable photographing system is provided. The movable photographing system includes a carrier, an image capturing device, a storage device and a processing device. The image capturing device is carried by the carrier and configured to generate a first image. The storage device stores a plurality of image data. The processing device obtains the feature information of a target object in the first image, and according to the feature information, compares the first image with the plurality of image data to select a reference image from the plurality of image data. In addition, the processing device generates motion information using the first image and the reference image and the carrier moves according to the motion information to adjust the shot position of the image capturing device to generate a second image.

## Claims

### Claim 1

A movable photographing system, comprising:
a carrier;
an image capturing device, carried by the carrier and configured to generate a first image;
a storage device, storing a plurality of image data; and
a processing device, obtaining feature information of a target object in the first image, and according to the feature information, comparing the first image with the plurality of image data to select a reference image from the plurality of image data,
wherein the processing device generates motion information based on the first image and the reference image and the carrier moves according to the motion information to adjust a shot position of the image capturing device to generate a second image,
wherein the processing device calculates similarities between a plurality of skeletons of the target object with the plurality of image data according to the feature information to compare the first image with the plurality of image data and selects the image data corresponding to the highest degree of similarity to be the reference image.

### Claim 2 (depends on 1)

The movable photographing system of claim 1, wherein the feature information may comprise human-body feature information, salient-object feature information or environment feature information.

### Claim 3 (depends on 2)

The movable photographing system of claim 2, wherein the processing device obtains the human-body feature information according to a pedestrian detection algorithm, a facial detection algorithm and a human skeleton detection algorithm.

### Claim 4 (depends on 2)

The movable photographing system of claim 2, wherein the processing device obtains the salient-object feature information according to a salient-object detection algorithm.

### Claim 5 (depends on 2)

The movable photographing system of claim 2, wherein the processing device obtains the environment feature information according to an environment detection algorithm.

### Claim 6 (depends on 1)

The movable photographing system of claim 1, wherein the plurality of skeletons have different weights.

### Claim 7 (depends on 1)

The movable photographing system of claim 1, wherein the processing device calculates areas of the region of interest (ROI) of the first image and the ROI of the reference image, and according to the areas of the ROI of the first image and the ROI of the reference image, generates the motion information.

### Claim 8 (depends on 1)

The movable photographing system of claim 1, wherein the processing device adjusts a size of the second image according to the first image and the reference image.

### Claim 9

A photography composition control method, applied to a movable photographing system, comprising:
generating, by an image capturing device of the movable photographing system, a first image, wherein the image capturing device is carried by a carrier;
obtaining, by a processing device of the movable photographing system, feature information of a target object in the first image;
calculating, by the processing device, similarities between a plurality of skeletons of the target object with a plurality of image data stored in a storage device of the movable photographing system according to the feature information to compare the first image with the plurality of image data;
selecting the image data corresponding to the highest degree of similarity to be the reference image;
generating, by the processing device, moving information according to the first image and the reference image; and
moving the carrier according to the moving information to adjust the a shot position of the image capturing device to generate a second image.

### Claim 10 (depends on 9)

The photography composition control method of claim 9, wherein the feature information may comprise human-body feature information, salient-object feature information or environment feature information.

### Claim 11 (depends on 10)

The photography composition control method of claim 10, wherein the processing device obtains the human-body feature information according to a pedestrian detection algorithm, a facial detection algorithm and a human skeleton detection algorithm.

### Claim 12 (depends on 10)

The photography composition control method of claim 10, wherein the processing device obtains the salient-object feature information according to a salient-object detection algorithm.

### Claim 13 (depends on 10)

The photography composition control method of claim 10, wherein the processing device obtains the environment feature information according to an environment detection algorithm.

### Claim 14 (depends on 9)

The photography composition control method of claim 9, wherein the plurality of skeletons have different weights.

### Claim 15 (depends on 9)

The photography composition control method of claim 9, further comprising:
calculating, by the processing device, areas of the region of interest (ROI) of the first image and the ROI of the reference image; and
generating the motion information according to the areas of the ROI of the first image and the ROI of the reference image.

### Claim 16 (depends on 9)

The photography composition control method of claim 9, further comprising:
adjusting, by the processing device, a size of the second image according to the first image and the reference image.