# US 2026/0087811 A1 · Video summary system capable of detecting specific object through text

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087811 A1
- Document ID: US20260087811A1
- Status: Published application
- Kind: A1
- Application number: 18/288,934
- Filed: 2023-10-04
- Published: 2026-03-26
- Earliest claimed: 2023-07-28
- Assignees: ZIOVISION Co., Ltd.
- Applicants: Ziovision Co., Ltd.
- Inventors: Yoon KIM; Hyunsoo CHOI; Dohyeon KIM; Jongwoo HAN; Pooreum LEE; Heecheol KIM
- Web page: https://patentgrep.com/patent/US20260087811A1

## CPC

- G06V 20/47: {Detecting features for summarising video content}
- G06F 40/58: Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
- G06N 3/0475: Generative networks
- G06N 3/08: Learning methods
- G06V 10/46: Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features (colour feature extraction G06V10/56)
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/82: using neural networks
- G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44)
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/62: Text, e.g. of license plates, overlay texts or captions on TV images
- G06V 30/182: by coding the contour of the pattern
- H04N 21/488: Data services, e.g. news ticker {(systems specially adapted for using meteorological information in broadcast systems H04H60/71)}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The video summary system according to an embodiment of the present disclosure identifies objects by transforming text descriptions into text embedding vectors via a text encoder and images into image embedding vectors using an image encoder. By assessing the similarity between these vectors, users can input a description of an object or its actions to detect the said object. This approach mitigates the challenge of monitoring when the object count in the summarized video surpasses that of the original.

## Claims

### Claim 1

A video summary system, comprising:
an object extraction module configured to detect an object in an original video and generate object information including a position and size in a frame of the object and an object ID;
a compression module configured to generate a summary video by compressing the original video so that at least some of objects at different times in the original video are positioned at the same time; and
an image detection module configured to detect an object corresponding to input text when a user inputs the text,
wherein the image detection module detects an object that needs to be found by converting the text describing an image into a text embedding unit vector through a text encoder, converting the image into an image embedding unit vector through an image encoder, and calculating a similarity between the text embedding unit vector and image embedding unit vector.

### Claim 2 (depends on 1)

The video summary system of claim 1, wherein
the image detection module is an artificial intelligence model trained with training data in which a caption is written on the image.

### Claim 3 (depends on 2)

The video summary system of claim 2, wherein
an English caption of the training data may be translated into a Korean caption using a large natural language generation model and added to the training data.

### Claim 4 (depends on 2)

The video summary system of claim 2, wherein
as a caption of the training data, a Korean caption or English caption with various expressions having the same or similar meaning is generated using a large-scale natural language generation model (NLP) and added to the training data.

### Claim 5 (depends on 2)

The video summary system of claim 2, wherein
a pseudo-labeled image having an inappropriate caption is added to the training data.

### Claim 6 (depends on 1)

The video summary system of claim 1, wherein
when the image detection module detects an object that needs to be found, an object positioned at the same time as the object detected in the original video is exposed together on the summary video.
