# US 10,455,256 B2 · System and method for providing image-based video service

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,256 B2
- Document ID: US10455256B2
- Status: Granted
- Kind: B2
- Application number: 15/057,008
- Filed: 2016-02-29
- Published: 2016-09-01
- Granted: 2019-10-22
- Earliest claimed: 2012-05-03
- Assignees: Enswers Co., Ltd.
- Applicants: Enswers Co., Ltd.
- Inventors: Kil-youn Kim; Jaehyung Lee; Hoon-young Cho
- Web page: https://patentgrep.com/patent/US10455256B2

## CPC

- H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- G06Q 20/123: {Shopping for digital content}
- G06Q 50/10: Services
- H04N 21/2183: Cache memory {(caches in web servers or browsers G06F16/9574; intermediate storage and caching in data networks H04L67/568)}
- H04N 21/254: Management at additional data server, e.g. shopping server, rights management server {(arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53)}
- H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite
- H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)}
- H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)}
- H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme}
- H04N 21/8153: {comprising still images, e.g. texture, background image}
- H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID]
- H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

The present invention provides a system for providing image-based video service, including a cache system configured to store video information that matches image-related data; a fingerprint extraction unit configured to extract the fingerprint of an image corresponding to input image-related data; and a matching unit configured to determine video information that matches the fingerprint of the image extracted by the fingerprint extraction unit; wherein the system for providing image-based video service determines video information, matching image-related data received from a client terminal, via the cache system or the matching unit, and transmits video result information corresponding to the determined video information to the client terminal, and a method using the same.

## Claims

### Claim 1

A server, comprising:
a cache system, comprising a cache table that stores first video information, the first video information including an expiration time for the first video information;
wherein the server is configured for:
receiving image-related data comprising a network location for retrieving an image and an expiration time for the image, the expiration time indicating a duration that the image is valid at the network location;
determining whether the first video information stored in the cache table matches the received image-related data based on the network location and the expiration time by at least determining whether the stored expiration time for the first video information matches the received expiration time for the image; and
after determining that the first video information does not match the image-related data:
extracting a fingerprint of the image corresponding to the received image-related data, wherein the extracting comprises: (i) segmenting the acquired image data into one or more pieces of segmented image data, and (ii) extracting a fingerprint for at least one piece of the one or more pieces of segmented image data,
determining second video information that matches the extracted fingerprint of the image, and
transmitting the second video information.

### Claim 2 (depends on 1)

The server of claim 1, wherein the server is further configured for:
after determining that the first video information does match the image-related data, transmitting the first video information.

### Claim 3 (depends on 1)

The server of claim 1, wherein determining whether the first video information stored in the cache table matches the received image-related data further comprises determining the first video information using the cache table based on the received network location.

### Claim 4 (depends on 1)

The server of claim 1, wherein the first video information comprises a video identifier (ID) identifying a video, and a frame ID identifying a frame of the video.

### Claim 5 (depends on 1)

The server of claim 1, wherein extracting the fingerprint of an image corresponding to the received image-related data comprises:
acquiring image data corresponding to the image-related data, and
extracting an extracted fingerprint for the acquired image data.

### Claim 6 (depends on 5)

The server of claim 5, wherein determining second video information that matches the extracted fingerprint of the image comprises:
determining the second video information that matches the extracted fingerprint by at least matching the extracted fingerprint with one or more fingerprints stored in a fingerprint database.

### Claim 7 (depends on 5)

The server of claim 5, wherein the server is further configured for:
transmitting the second video information to the cache system, and
storing the second video information in the cache table using the cache system, wherein the second video information comprises a video ID and a frame ID matching the extracted fingerprint.

### Claim 8 (depends on 1)

The server of claim 1, wherein the server is further configured for:
identifying one or more pieces of the second video information; and
determining that the acquired image data matches the second video information by at least matching at least one piece of the one or more pieces of segmented image data with at least one piece of the one or more pieces of the second video information.

### Claim 9 (depends on 8)

The server of claim 8, wherein identifying the one or more pieces of the second video information comprises identifying video information corresponding to most frequent video and frame IDs of video and frame IDs included in the one or more pieces of the second video information.

### Claim 10 (depends on 8)

The server of claim 8, wherein the server is further configured for storing the one or more pieces of the second video information in the cache table.

### Claim 11 (depends on 1)

The server of claim 1, wherein the cache table is updated at regular intervals based on a hash value of image data.

### Claim 12 (depends on 1)

The server of claim 1, wherein the second video information comprises a network location for retrieving video data associated with the second video information.

### Claim 13

A method, comprising:
receiving image-related data at a server, wherein the image-related data comprises a network location for retrieving an image and an expiration time for the image, the expiration time indicating a duration that the image is valid at the network location, wherein first video information is stored in a cache table of the server, and wherein the first video information includes an expiration time for the first video information;
determining, using the server, whether the first video information matches the received image-related data based on the network location and the expiration time by at determining whether the stored expiration time for the first video information matches the received expiration time for the image; and
after determining that the first video information does not match the image-related data, the server:
extracting a fingerprint of the image corresponding to the received image-related data, wherein the extracting comprises: (i) segmenting the acquired image data into one or more pieces of segmented image data, and (ii) extracting a fingerprint for at least one piece of the one or more pieces of segmented image data,
determining second video information that matches the extracted fingerprint of the image, and
transmitting the second video information.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
after determining that the first video information does match the image-related data, the server transmitting the first video information.

### Claim 15 (depends on 13)

The method of claim 13,
wherein determining whether the first video information stored in the cache table matches the received image-related data further comprises determining the first video information using the cache table based on the received network location.

### Claim 16 (depends on 13)

The method of claim 13, wherein the first video information comprises a video identifier (ID) identifying a video, and a frame ID identifying a frame of the video.

### Claim 17 (depends on 13)

The method of claim 13, wherein extracting the fingerprint of an image corresponding to the received image-related data comprises:
acquiring image data corresponding to the image-related data, and
extracting an extracted fingerprint for the acquired image data.

### Claim 18 (depends on 13)

The method of claim 13, wherein the cache table is updated at regular intervals based on a hash value of image data.

### Claim 19 (depends on 13)

The method of claim 13, wherein the second video information comprises a network location for retrieving video data associated with the second video information.
