# US 2026/0094281 A1 · Image capturing device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094281 A1
- Document ID: US20260094281A1
- Status: Published application
- Kind: A1
- Application number: 19/098,024
- Filed: 2025-04-02
- Published: 2026-04-02
- Earliest claimed: 2024-10-01
- Assignees: Magic Control Technology Corporation
- Applicants: Magic Control Technology Corporation
- Inventors: Pei-Chung LIU
- Web page: https://patentgrep.com/patent/US20260094281A1

## CPC

- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 7/90: Determination of colour characteristics
- G06V 10/82: using neural networks
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- H04N 23/61: based on recognised objects
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image capturing method comprising: obtaining a plurality of video images; analyzing whether there is a palm in the video images and identifying a palm gesture; when the palm gesture is a tracking gesture, entering a tracking identification mode, so as to use an interaction manner between a user and an object to determine that the object is a tracking object, and calculating relevant information of the tracking object; tracking the tracking object using a tracking operation, so as to generate a plurality of tracking images; and according to a first video display mode, using the tracking images and the video images to generate a plurality of live images.

## Claims

### Claim 1

An image capturing device for tracking objects in a live stream, the image capturing device comprising:
an image capturing unit for acquiring a plurality of video images;
an image processing unit for analyzing and processing the video images to generate a plurality of live images based on the video images;
a connection port unit for connecting to an external device; and
an output and input control unit for receiving the live images from the image processing unit and transmitting the live images to the external device through the connection port unit,
wherein, the analysis and processing of the video images by the image processing unit include:
analyzing whether there is a palm in the video images and identifying a palm gesture;
when the palm gesture is a tracking gesture, entering a tracking identification mode, so as to use an interaction manner between a user and an object to determine that the object is a tracking object, and calculating relevant information of the tracking object;
tracking the tracking object using a tracking operation, so as to generate a plurality of tracking images; and
according to a first video display mode, using the tracking images and the video images to generate the live images.

### Claim 2 (depends on 1)

The image capturing device of claim 1,
wherein, the image processing unit includes a video processor, a neural network processor, a memory, and a storage unit,
wherein, the video processor and the neural network processor use programs stored in the storage unit to perform processing, and the memory is used to store the video images and the live images,
wherein, the processing is based on the result of the artificial intelligence operations of the neural network processor, and
wherein, the artificial intelligence operations include edge detection, image segmentation, vocal direction detection and feature extraction.

### Claim 3 (depends on 2)

The image capturing device of claim 2,
wherein, the first video display mode includes picture-in-picture, side-by-side picture, picture cropping, picture overlapping, and picture zooming in and out,
wherein, the first video display mode uses the tracking images and the video images to generate the live images based on the results of the artificial intelligence operations of the neural network processor, and
wherein, the artificial intelligence operations in the first video display mode includes edge detection, image segmentation, vocal direction detection and feature extraction.

### Claim 4 (depends on 2)

The image capturing device of claim 2,
wherein, the analysis and processing of the video images by the image processing unit further include:
analyzing whether there is a palm in the video image and identifying whether the palm gesture is an end tracking gesture;
when the palm gesture is the end tracking gesture, stopping the tracking of the tracking object; and
according to a second video display mode, using the video images to generate the live images.

### Claim 5 (depends on 4)

The image capturing device of claim 4,
wherein, the second video display mode includes picture-in-picture, side-by-side picture, picture cropping, picture overlapping, picture zoom-in and zoom-out, and original picture,
wherein, the second video display mode uses the video images to generate the live images based on the results of the artificial intelligence operations of the neural network processor, and
wherein, the artificial intelligence operations in the second video display mode include edge detection, image segmentation, vocal direction detection and feature extraction.

### Claim 6 (depends on 1)

The image capturing device of claim 1,
wherein, the tracking gesture includes at least one of a first tracking gesture and a second tracking gesture, and
wherein, the analysis and processing of the video images by the image processing unit further include:
when the palm gesture is the first tracking gesture, entering a first tracking identification mode, using a first interaction manner between the user and the object, determining the object as the tracking object, and calculating relevant information of the tracking object; and/or
when the palm gesture is the second tracking gesture, entering a second tracking identification mode, using a second interaction manner between the user and the object, determining the object as the tracking object, and calculating relevant information of the tracking object.

### Claim 7 (depends on 6)

The image capturing device of claim 6, wherein the first tracking identification mode is used for objects that can be easily moved, and the second tracking identification mode is used for objects that cannot be easily moved or a tracking area.

### Claim 8 (depends on 7)

The image capturing device of claim 7, wherein the first interaction manner is the user holding the tracking object and shaking the tracking object.

### Claim 9 (depends on 8)

The image capturing device of claim 8, wherein when the user shakes the tracking object, a first frame of the video images is used as a reference image, and relevant information of the tracking object is calculated by using a (1+N)th frame as a comparison image.

### Claim 10 (depends on 7)

The image capturing device of claim 7, wherein the second interaction manner is the user hand-tracing the position of the tracking area using a specific gesture.

### Claim 11 (depends on 10)

The image capturing device of claim 10, wherein when a color of the tracking object in the tracking area is significantly different from a color of the surrounding environment, the tracking object is determined and the relevant information of the tracking object is calculated, and when there is no obvious color difference between the tracking object in the tracking area and the surrounding environment, the entire tracking area is used as the tracking object and the relevant information of the tracking object is calculated.

### Claim 12

An image capturing method for tracking objects in a live stream, the image capturing method comprising:
obtaining a plurality of video images;
analyzing whether there is a palm in the video images and identifying a palm gesture;
when the palm gesture is a tracking gesture, entering a tracking identification mode, so as to use an interaction manner between a user and an object to determine that the object is a tracking object, and calculating relevant information of the tracking object;
tracking the tracking object using a tracking operation, so as to generate a plurality of tracking images; and
according to a first video display mode, using the tracking images and the video images to generate a plurality of live images.

### Claim 13 (depends on 12)

The image capturing method of claim 12,
wherein, the tracking gesture includes at least one of a first tracking gesture and a second tracking gesture, and
wherein, the image capturing method further comprises:
when the palm gesture is the first tracking gesture, entering a first tracking identification mode, using a first interaction manner between the user and the object, determining the object as the tracking object, and calculating relevant information of the tracking object; and/or
when the palm gesture is the second tracking gesture, entering a second tracking identification mode, using a second interaction manner between the user and the object, determining the object as the tracking object, and calculating relevant information of the tracking object.
