# US 2021/0243313 A1 · System and method for ordering a print product including a digital image utilizing augmented reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243313 A1 - Document ID: US20210243313A1 - Status: Published application - Kind: A1 - Application number: 17/239,883 - Filed: 2021-04-26 - Published: 2021-08-05 - Earliest claimed: 2018-08-14 - Assignees: FUJIFILM North America Corporation - Applicants: FUJIFILM North America Corporation - Inventors: James Dolce; Jonathan Nick - Web page: https://patentgrep.com/patent/US20210243313A1 ## CPC - H04N 1/00145: {from a remote location} - G06F 16/74: Browsing; Visualisation therefor (end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic programme guides, H04N21/472) - G06Q 30/0631: {Recommending goods or services} - G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)} - H04N 1/00129: {with a display device, e.g. CRT or LCD monitor (with a television apparatus H04N1/00283; arrangements for control of display devices G09G)} - H04N 1/00164: {at a remote location} - H04N 1/00336: {with an apparatus performing pattern recognition, e.g. of a face or a geographic feature (image or video recognition or understanding of scenes G06V20/00)} - H04N 1/00159: {for sharing images without access restriction, e.g. publishing images} - H04N 1/00167: {Processing or editing (H04N1/00196 - H04N1/00201 take precedence)} - H04N 1/0019: {on souvenir-type products or the like, e.g. T-shirts or mugs} - H04N 1/00411: {the display also being used for user input, e.g. touch screen} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract A method for ordering a print product comprises displaying a video that includes an exhibited physical product; comparing a feature or attribute associated with the exhibited product with a feature or attribute associated with the available product; displaying a digital overlay in the video and in association with the displayed exhibited product if the displayed exhibited product corresponds to the digital representation of the available product; allowing for the selection of the digital overlay and then a digital image; establishing a print order including an identification of the displayed exhibited product associated with the selected digital overlay and the selected digital image; and allowing for the fulfillment of the print order to produce a print product using a printing device, wherein the print product includes the selected digital image disposed on a selected physical product representative of the displayed exhibited product associated with the selected digital overlay. ## Claims ### Claim 1 A computing system for providing a customized print product, the system comprising: a first memory for storing computer-executable instructions; a camera configured for capturing a video; a display configured for displaying the video; and a processor configured for executing the computer-executable instructions to perform the following steps: a) utilizing the camera to display a video that includes an exhibited physical product; b) comparing one or more feature or attribute associated with the exhibited physical product being displayed in the video with one or more feature or attribute associated with a digital representation of an available product stored in a server memory, wherein the server is in communication with the processor over a network; c) upon determining that the displayed exhibited physical product corresponds to the digital representation of the available product, displaying a digital overlay in the video and in association with the displayed exhibited physical product; d) allowing for the selection of the digital overlay being displayed in the video on the display; and e) in response to the selection of the digital overlay, allowing for the selection of a digital image to customize the displayed exhibited physical product, wherein the selected digital image is not representative of the displayed exhibited physical product, and wherein the selected digital image is configured to be disposed on a selected physical product representative of the displayed exhibited physical product associated with the selected digital overlay to provide the customized print product. ### Claim 2 (depends on 1) A system in accordance with claim 1, wherein the one or more feature of the digital representation of the available product includes a stock digital image, wherein the one or more feature of the exhibited physical product is a stock image, wherein step c) includes scanning the displayed exhibited physical product to identify the stock image disposed thereon, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the stock image matches the stock digital image. ### Claim 3 (depends on 1) A system in accordance with claim 1, wherein one or more attribute includes at least one dimension of the available product, wherein step c) includes scanning the displayed exhibited physical product to identify the at least one dimension of the displayed exhibited physical product, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the at least one dimension of the displayed exhibited physical product matches the at least one dimension of the available product. ### Claim 4 (depends on 1) A system in accordance with claim 1, wherein the one or more attribute includes at least one shape of the available product, wherein step c) includes scanning the displayed exhibited physical product to identify the at least one shape of the displayed exhibited physical product, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the at least one shape of the displayed exhibited physical product matches the at least one shape of the available product. ### Claim 5 (depends on 1) A system in accordance with claim 1, wherein the camera, the display, and the processor are included in a mobile computing device. ### Claim 6 (depends on 5) A system in accordance with claim 5, wherein data representing the digital overlay is stored in the server memory. ### Claim 7 (depends on 5) A system in accordance with claim 5, wherein the digital image is stored in the first memory. ### Claim 8 (depends on 7) A system in accordance with claim 7, wherein the first memory is included in the mobile computing device. ### Claim 9 (depends on 5) A system in accordance with claim 5, wherein the digital image is stored in a remote social media server, wherein the remote social media server is in communication with the mobile computing device over the network. ### Claim 10 (depends on 1) A system in accordance with claim 1, wherein the step of displaying the digital overlay in association with the displayed exhibited physical product includes superimposing the digital overlay on top of the displayed exhibited physical product. ### Claim 11 (depends on 10) A system in accordance with claim 10, wherein the digital overlay is displayed in the same perspective as the exhibited physical product is displayed in the video. ### Claim 12 (depends on 1) A system in accordance with claim 1, wherein the display includes a touch screen, and wherein the selection of the digital overlay is performed using the touch screen. ### Claim 13 (depends on 1) A system in accordance with claim 1, wherein the video is a real-time video. ### Claim 14 (depends on 1) A system in accordance with claim 1, further comprising, subsequent to step e), the additional step of displaying a digital representation of the customized print product on the display, wherein the digital representation of the customized print product includes: the selected digital image; and a digital representation of the displayed exhibited physical product associated with the selected digital overlay. ### Claim 15 (depends on 14) A system in accordance with claim 14, wherein the digital representation of the customized print product is displayed in the video superimposed on the exhibited physical product displayed on the video. ### Claim 16 (depends on 1) A system in accordance with claim 1, wherein the selected physical product includes an image print, calendar, mug, photo book, poster, blanket, phone case, pillow, clothing, or jewelry. ### Claim 17 (depends on 1) A system in accordance with claim 1, wherein the digital overlay includes a description of the displayed exhibited physical product. ### Claim 18 (depends on 1) A system in accordance with claim 1, wherein a plurality of digital images are stored in the first memory, and wherein the digital image is selected from the plurality of digital images. ### Claim 19 (depends on 5) A system in accordance with claim 5, wherein a plurality of digital images are stored in a remote social media server, wherein the remote social media server is in communication with the mobile computing device over the network, and wherein the digital image is selected from the plurality of digital images. ### Claim 20 A computer-implemented method programmed for execution in a computing environment for providing a custom print product, the method comprising: a) storing a digital representation of an available product in a memory; b) displaying a video that includes an exhibited physical product; c) comparing one or more feature or attribute associated with the exhibited physical product being displayed in the video with one or more feature or attribute associated with the digital representation of the available product; d) upon determining that the displayed exhibited physical product corresponds to the digital representation of the available product, displaying a digital overlay in the video and in association with the displayed exhibited physical product; e) allowing for the selection of the digital overlay being displayed in the video; f) in response to the selection of the digital overlay, allowing for the selection of a digital image, wherein the selected digital image is not representative of the displayed exhibited physical product, and wherein the selected digital image is configured to be disposed on a selected physical product representative of the displayed exhibited physical product associated with the selected digital overlay to provide the customized print product. ### Claim 21 (depends on 20) A computer-implemented method in accordance with claim 20, wherein the one or more feature of the digital representation of the available product includes a stock digital image, wherein the one or more feature of the exhibited physical product is a stock image, wherein step c) includes scanning the displayed exhibited physical product to identify the stock image disposed thereon, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the stock image matches the stock digital image. ### Claim 22 (depends on 20) A computer-implemented method in accordance with claim 20, wherein the one or more attribute includes at least one dimension of the available product, wherein step c) includes scanning the displayed exhibited physical product to identify at least one dimension of the displayed exhibited physical product, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the at least one dimension of the displayed exhibited physical product matches the at least one dimension of the available product. ### Claim 23 (depends on 20) A computer-implemented method in accordance with claim 20, wherein the one or more attribute includes at least one shape of the available product, wherein the step c) includes scanning the displayed exhibited physical product to identify the at least one shape of the displayed exhibited physical product, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the at least one shape of the displayed exhibited physical product matches the at least one shape of the available product. ### Claim 24 (depends on 20) A computer-implemented method in accordance with claim 20, wherein the step of displaying the digital overlay in association with the displayed exhibited physical product includes superimposing the digital overlay on top of the displayed exhibited physical product. ### Claim 25 (depends on 24) A computer-implemented method in accordance with claim 24, wherein the digital overlay is displayed in the same perspective as the exhibited physical product is displayed in the video. ### Claim 26 (depends on 20) A computer-implemented method in accordance with claim 20, further comprising, subsequent to step f), the additional step of displaying a digital representation of the customized print product, wherein the digital representation of the customized print product includes: the selected digital image; and a digital representation of the displayed exhibited physical product associated with the selected digital overlay. ### Claim 27 (depends on 26) A computer-implemented method in accordance with claim 26, wherein the digital representation of the customized print product is displayed in the video superimposed on the exhibited physical product displayed on the video. ### Claim 28 (depends on 20) A computer-implemented method in accordance with claim 20, wherein a plurality of digital images are stored in the memory, and wherein the digital image is selected from the plurality of digital images. ### Claim 29 A non-transitory computer readable medium having thereon computer executable instructions for execution in a computing environment for providing a customized print product, the method comprising: a) storing a digital representation of an available product in a memory; b) displaying a video that includes an exhibited physical product; c) comparing one or more feature or attribute associated with the exhibited physical product being displayed in the video with one or more feature or attribute associated with the digital representation of the available product; d) upon determining that the displayed exhibited physical product corresponds to the digital representation of the available product, displaying a digital overlay in the video and in association with the displayed exhibited physical product; e) allowing for the selection of the digital overlay being displayed in the video; f) in response to the selection of the digital overlay, allowing for the selection of a digital image, wherein the selected digital image is not representative of the displayed exhibited physical product, and wherein the selected digital image is configured to be disposed on a selected physical product representative of the displayed exhibited physical product associated with the selected digital overlay to provide the customized print product. ### Claim 30 (depends on 29) A non-transitory computer readable medium in accordance with claim 29, wherein the one or more feature of the digital representation of the available product includes a stock digital image, wherein the one or more feature of the exhibited physical product is a stock image, wherein step c) includes scanning the displayed exhibited physical product to identify the stock image disposed thereon, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the stock image matches the stock digital image. ### Claim 31 (depends on 29) A non-transitory computer readable medium in accordance with claim 29, wherein the one or more attribute includes at least one dimension of the available product, wherein step c) includes scanning the displayed exhibited physical product to identify at least one dimension of the displayed exhibited physical product, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the at least one dimension of the displayed exhibited physical product matches the at least one dimension of the available product. ### Claim 32 (depends on 29) A non-transitory computer readable medium in accordance with claim 29, wherein the one or more attribute includes at least one shape of the available product, wherein the step c) includes scanning the displayed exhibited physical product to identify the at least one shape of the displayed exhibited physical product, and wherein the displayed exhibited physical product corresponds to the digital representation of the available product when the at least one shape of the displayed exhibited physical product matches the at least one shape of the available product. ### Claim 33 (depends on 29) A non-transitory computer readable medium in accordance with claim 29, wherein the step of displaying the digital overlay in association with the displayed exhibited physical product includes superimposing the digital overlay on top of the displayed exhibited physical product. ### Claim 34 (depends on 33) A non-transitory computer readable medium in accordance with claim 33, wherein the digital overlay is displayed in the same perspective as the exhibited physical product is displayed in the video. ### Claim 35 (depends on 29) A non-transitory computer readable medium in accordance with claim 29, further comprising, subsequent to step f), the additional step of displaying a digital representation of the customized print product, wherein the digital representation of the customized print product includes: the selected digital image; and a digital representation of the displayed exhibited physical product associated with the selected digital overlay. ### Claim 36 (depends on 35) A non-transitory computer readable medium in accordance with claim 35, wherein the digital representation of the customized print product is displayed in the video superimposed on the exhibited physical product displayed on the video. ### Claim 37 (depends on 29) A non-transitory computer readable medium in accordance with claim 29, wherein a plurality of digital images are stored in the memory, and wherein the digital image is selected from the plurality of digital images.