# US 12,008,062 B2 · Systems and methods for screenshot linking > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,062 B2 - Document ID: US12008062B2 - Status: Granted - Kind: B2 - Application number: 18/503,794 - Filed: 2023-11-07 - Published: 2024-03-14 - Granted: 2024-06-11 - Earliest claimed: 2015-07-15 - Assignees: rewardStyle, Inc. - Applicants: rewardStyle, Inc. - Inventors: Jason Ellis Pearlman; Elias Jason Mablekos; Andrew Cummins - Web page: https://patentgrep.com/patent/US12008062B2 ## CPC - G06F 16/9566: {URL specific, e.g. using aliases, detecting broken or misspelled links} - G06F 16/51: Indexing; Data structures therefor; Storage structures - G06F 16/583: using metadata automatically derived from the content - G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information} - G06F 16/9554: {by using bar codes} - G06T 1/0007: {Image acquisition} - G06V 10/40: Extraction of image or video features - G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]} - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A system for analyzing screenshots can include a computing device including a processor coupled to a memory and a display screen configured to display content. The system can include an application stored on the memory and executable by the processor. The application can include a screenshot receiver configured to access, from storage to which a screenshot of the content displayed on the display screen captured using a screenshot function of the computing device is stored, the screenshot including an image and a predetermined marker. The application can include a marker detector configured to detect the predetermined marker included in the screenshot. The application can include a link identifier configured to identify, using the predetermined marker, a link to a resource mapped to the image included in the screenshot, the resource accessible by the computing device via the link. ## Claims ### Claim 1 A method for providing product recommendations to a user, the method comprising: receiving, from an application executing on a client computing device of the user, an image displayed on the client computing device; identifying a product included in the image; determining, using at least one machine learning model, a product recommendation based on a plurality of images and the identified product, wherein the product recommendation corresponds to an image from the plurality of images that includes a matching product to the identified product; providing the product recommendation to the application for display on the client computing device, the product recommendation including the image from the plurality of images that includes the matching product; and adapting the at least one machine learning model based on feedback associated with the product recommendation that is received based on interactions of the user with the product recommendation displayed on the client computing device. ### Claim 2 (depends on 1) The method of claim 1, wherein the user has an account associated with the application, and the plurality of images include at least one of: images associated with the user; images associated with one or more other users having accounts associated with the application; or images retrieved from websites. ### Claim 3 (depends on 2) The method of claim 2, wherein when the plurality of images include at least the images associated with user and the images associated with the one or more other users, and a plurality of product recommendations are determined using the at least one machine learning model, the plurality of product recommendations including a first subset corresponding to one or more of the images associated with the user, and a second subset corresponding to one or more of the images associated with the one or more other users. ### Claim 4 (depends on 3) The method of claim 3, wherein providing the product recommendation to the application for display on the client computing device comprises: causing to be displayed, on the client computing device, a plurality of graphical user interfaces (GUIs), wherein a first GUI of the plurality of GUIs includes the first subset of the plurality of product recommendations, and a second GUI of the plurality of GUIs includes the second subset of the plurality of product recommendations. ### Claim 5 (depends on 1) The method of claim 1, wherein the plurality of images are associated with a plurality of links. ### Claim 6 (depends on 5) The method of claim 5, further comprising: identifying a link, from the plurality of links, associated with the image from the plurality of images that includes the matching product; and providing the link to the application for association with the product recommendation. ### Claim 7 (depends on 6) The method of claim 6, wherein the link is directed to an interface via which the matching product associated with the product recommendation can be purchased. ### Claim 8 (depends on 1) The method of claim 1, further comprising: generating a link; and providing the link to the application for association with the product recommendation. ### Claim 9 (depends on 1) The method of claim 1, wherein the matching product is a product identical to the identified product in the image or is a product similar to the identified product in the image. ### Claim 10 (depends on 1) The method of claim 1, wherein the image is taken using a camera associated with the client computing device. ### Claim 11 (depends on 1) The method of claim 1, wherein the image is included in a gallery of images on the client computing device, and the application is configured to access the gallery. ### Claim 12 A system for providing product recommendations to a user, the system comprising: at least one processor; and at least one storage device storing instructions which, when executed by the at least one processor, cause the at least one processor to perform operations comprising: receiving, from an application executing on a client computing device of the user, an image displayed on the client computing device; identifying a product included in the image; determining, using at least one machine learning model, a product recommendation based on a plurality of images and the identified product, wherein the product recommendation corresponds to an image from the plurality of images that includes a matching product to the identified product; providing the product recommendation to the application for display on the client computing device, the product recommendation including the image from the plurality of images that includes the matching product; and adapting the at least one machine learning model based on feedback associated with the product recommendation that is received based on interactions of the user with the product recommendation displayed on the client computing device. ### Claim 13 (depends on 12) The system of claim 12, wherein the user has an account associated with the application, and the plurality of images include at least one of: images associated with the user; images associated with one or more other users having accounts associated with the application; or images retrieved from websites. ### Claim 14 (depends on 13) The system of claim 13, wherein when the plurality of images include at least the images associated with user and the images associated with the one or more other users, and a plurality of product recommendations are determined using the at least one machine learning model, the plurality of product recommendations including a first subset corresponding to one or more of the images associated with the user, and a second subset corresponding to one or more of the images associated with the one or more other users. ### Claim 15 (depends on 14) The system of claim 14, wherein providing the product recommendation to the application for display on the client computing device comprises: causing to be displayed, on the client computing device, a plurality of graphical user interfaces (GUIs), wherein a first GUI of the plurality of GUIs includes the first subset of the plurality of product recommendations, and a second GUI of the plurality of GUIs includes the second subset of the plurality of product recommendations. ### Claim 16 (depends on 12) The system of claim 12, wherein the plurality of images are associated with a plurality of links. ### Claim 17 (depends on 16) The system of claim 16, the operations further comprising: identifying a link, from the plurality of links, associated with the image from the plurality of images that includes the matching product; and providing the link to the application for association with the product recommendation. ### Claim 18 (depends on 12) The system of claim 12, further comprising: generating a link; and providing the link to the application for association with the product recommendation. ### Claim 19 (depends on 12) The system of claim 12, wherein the matching product is a product identical to the identified product in the image or is a product similar to the identified product in the image. ### Claim 20 A non-transitory computer-readable medium storing computer-executable instructions which, when executed by at least one processor, cause the at least one processor to perform operations comprising: receiving, from an application executing on a client computing device of a user, an image displayed on the client computing device; identifying a product included in the image; determining, using at least one machine learning model, a product recommendation based on a plurality of images and the identified product, wherein the product recommendation corresponds to an image from the plurality of images that includes a matching product to the identified product; providing the product recommendation to the application for display on the client computing device, the product recommendation including the image from the plurality of images that includes the matching product; and adapting the at least one machine learning model based on feedback associated with the product recommendation that is received based on interactions of the user with the product recommendation displayed on the client computing device.