Mobile search-ready smart display technology utilizing optimized content fingerprint coding and delivery

A non-transitory computer-readable medium having computer program for, when being executed by a hardware processor, performing a content retrieval method, the method comprising:

• extracting, by the hardware processor, a plurality of video fingerprints from an ongoing content displayed on the screen, the ongoing content having video frames corresponding to the video fingerprints;
• determining, by the hardware processor, one or more representative video fingerprints of the video frames from the plurality of video fingerprints;
• generating, by the hardware processor, one or more encoded representative video fingerprints through encoding the one or more representative video fingerprints into a pixel translucency change;
• delivering, by the hardware processor, the one or more encoded representative video fingerprints via a screen-camera communication;
• and
• performing, by the hardware processor, the encoding of the one or more representative video fingerprints and the delivering of the one or more encoded representative video fingerprints by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time.

A method for a mobile device having a camera, comprising:

• receiving, by a hardware processor, one or more encoded representative video fingerprints of a video frame delivered via a screen-camera communication via a screen-camera communication;
• decoding, by the hardware processor, the one or more encoded representative video fingerprints to uncoded video fingerprints;
• searching, by the hardware processor, for a matching video having video frames corresponding to the uncoded video fingerprints in a content database;
• and
• returning, by the hardware processor, searching results to a user;
• wherein:
• the one or more encoded representative video fingerprints of the video frame are generated by encoding one or more representative video fingerprints of the video frame into a pixel translucency change,
• the one or more representative video fingerprints are selected from a plurality of video fingerprints extracted from an ongoing content displayed on a screen of a smart display,
• the encoding of the representative fingerprints and the delivering of the encoded representative video fingerprints are performed by solving a polynomial time dynamic problem to find a value indicating a video retrieval accuracy between an error resilience and a transmission time.