# US 12,015,807 B2 · System and method for providing image-based video service > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,015,807 B2 - Document ID: US12015807B2 - Status: Granted - Kind: B2 - Application number: 17/348,276 - Filed: 2021-06-15 - Published: 2021-10-07 - Granted: 2024-06-18 - Earliest claimed: 2012-05-03 - Assignees: Enswers Co., Ltd. - Applicants: Enswers Co., Ltd. - Inventors: Kil-youn Kim; Jaehyung Lee; Hoon-young Cho - Web page: https://patentgrep.com/patent/US12015807B2 ## CPC - H04N 21/23418: {involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - G06Q 20/123: {Shopping for digital content} - G06Q 50/10: Services - H04N 21/2183: Cache memory {(caches in web servers or browsers G06F16/9574; intermediate storage and caching in data networks H04L67/568)} - H04N 21/254: Management at additional data server, e.g. shopping server, rights management server {(arrangements for maintenance or administration in data networks H04L41/00; network services using third party service providers H04L67/53)} - H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite - H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)} - H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)} - H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme} - H04N 21/8153: {comprising still images, e.g. texture, background image} - H04N 21/8352: involving content or source identification data, e.g. Unique Material Identifier [UMID] - H04N 21/8358: involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract The present invention provides a system for providing image-based video service, including a cache system configured to store video information that matches image-related data; a fingerprint extraction unit configured to extract the fingerprint of an image corresponding to input image-related data; and a matching unit configured to determine video information that matches the fingerprint of the image extracted by the fingerprint extraction unit; wherein the system for providing image-based video service determines video information, matching image-related data received from a client terminal, via the cache system or the matching unit, and transmits video result information corresponding to the determined video information to the client terminal, and a method using the same. ## Claims ### Claim 1 A server comprising: at least one processor; and a memory that stores instruction code executable by the at least one processor for causing the server to perform operations comprising: receiving, from a client terminal, image-related data about an image that includes a first network address that specifies a location where the image is stored on a network, wherein the image-related data is acquired by the client terminal from an electronic document including the image, and the electronic document is received from an image server through the network; responsive to determining that video information has been previously associated with the first network address, communicating the video information previously associated with the first network address to a client device; and responsive to determining that video information is not associated with the first network address: retrieving the image from a particular server associated with first network address; extracting a fingerprint from the image to become a fingerprint of the image; determining video information including both a frame identifier (ID) of a frame matching the image based on the fingerprint of the image and a video ID of a video including the frame matching the image; and communicating the video result information corresponding to the determined video information to the client device, wherein the video result information includes the determined video information and address information about an address where video data is present in a video service server with respect to the determined video information. ### Claim 2 (depends on 1) The server of claim 1, wherein if video information is determined to not be associated with the first network address, the operations further comprise: adding, to a database, a record that associates the first network address with the video information determined to be associated with the fingerprint. ### Claim 3 (depends on 1) The server of claim 1, wherein the video information comprises a video identifier (ID) that specifies a video, and a frame ID that specifies a frame of the video that is associated with the image. ### Claim 4 (depends on 3) The server of claim 3, wherein the video information further comprises a second network address that facilitates retrieving video data associated with the video information. ### Claim 5 (depends on 1) The server of claim 1, wherein the image-related data further specifies expiration time information indicative of a duration during which the image-related data is valid. ### Claim 6 (depends on 1) The server of claim 1, wherein determining the video information associated with the fingerprint further comprises: searching a fingerprint database for a fingerprint record that associates the fingerprint with the video information. ### Claim 7 (depends on 1) The server of claim 1, wherein extracting the fingerprint from the image further comprises: segmenting the image into a plurality of sub-images; and extracting a plurality of fingerprints from the plurality of sub-images. ### Claim 8 (depends on 7) The server of claim 7, wherein the determined video information is associated with one of the plurality of fingerprints. ### Claim 9 (depends on 7) The server of claim 7, wherein extracting the fingerprint from the image further comprises: ranking each fingerprint of the plurality of fingerprints, wherein the determined video information is associated with a particular fingerprint of the plurality of fingerprints having a highest rank. ### Claim 10 (depends on 1) The server of claim 1, wherein determining that video information has been previously associated with the first network address comprises: searching a database for a record that matches the first network address, wherein the record associates the first network address of the image with a hash of the image. ### Claim 11 (depends on 10) The server of claim 10, wherein the operations further comprise: determining whether a particular hash of a particular record matches an image associated with a corresponding network location of the particular record; and if the image associated with the corresponding network location of the particular record does not match the particular hash, updating the database. ### Claim 12 A method comprising: receiving, from a client terminal, image-related data about an image that includes a first network address that specifies a location where the image is stored on a network, wherein the image-related data is acquired by the client terminal from an electronic document including the image, and the electronic document is received from an image server through the network; responsive to determining that video information has been previously associated with the first network address, communicating the video information previously associated with the first network address to a client device; and responsive to determining that video information is not associated with the first network address: retrieving the image from a particular server associated with the first network address; extracting a fingerprint from the image to become a fingerprint of the image; determining video information including both a frame identifier (ID) of a frame matching the image based on the fingerprint of the image and a video ID of a video including the frame matching the image; and communicating video result information corresponding to the determined video information to the client device, wherein the video result information includes the determined video information, and address information about an address where video data is present in a video service server with respect to the determined video information. ### Claim 13 (depends on 12) The method claim 12, wherein if video information is determined to not be associated with the first network address, the method further comprises: adding, to a database, a record that associates the first network address with the video information determined to be associated with the fingerprint. ### Claim 14 (depends on 12) The method claim 12, wherein the video information comprises a video identifier (ID) that specifies a video, and a frame ID that specifies a frame of the video that is associated with the image. ### Claim 15 (depends on 14) The method claim 14, wherein the video information further comprises a second network address that facilitates retrieving video data associated with the video information. ### Claim 16 (depends on 12) The method claim 12, wherein the image-related data further specifies expiration time information indicative of a duration during which the image-related data is valid. ### Claim 17 (depends on 12) The method claim 12, wherein determining the video information associated with the fingerprint further comprises: searching a fingerprint database for a fingerprint record that associates the fingerprint with the video information. ### Claim 18 (depends on 12) The method claim 12, wherein extracting the fingerprint from the image further comprises: segmenting the image into a plurality of sub-images; and extracting a plurality of fingerprints from the plurality of sub-images. ### Claim 19 (depends on 18) The method claim 18, wherein the determined video information is associated with one of the plurality of fingerprints. ### Claim 20 A non-transitory computer-readable medium having stored thereon instruction code that when executed by at least one processor of a server causes the server to perform operations comprising: receiving, from a client terminal, image-related data about an image that includes a first network address that specifies a location where the image is stored on a network, wherein the image-related data is acquired by the client terminal from an electronic document including the image, and the electronic document is received from an image server through the network; responsive to determining that video information has been previously associated with the first network address, communicating the video information previously associated with the first network address to a client device; and responsive to determining that video information is not associated with the first network address: retrieving the image from a particular server associated with the first network address; extracting a fingerprint from the image to become a fingerprint of the image; determining video information including both a frame identifier (ID) of a frame matching the image based on the fingerprint of the image and a video ID of a video including the frame matching the image; and communicating video result information corresponding to the determined video information to the client device, wherein the video result information includes the determined video information, and address information about an address where video data is present in a video service server with respect to the determined video information.