# US 2021/0240909 A1 · Systems and methods for product visualization using a single-page application > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0240909 A1 - Document ID: US20210240909A1 - Status: Published application - Kind: A1 - Application number: 17/248,586 - Filed: 2021-01-29 - Published: 2021-08-05 - Earliest claimed: 2020-01-30 - Assignees: Leap Tools Inc. - Applicants: Leap Tools Inc. - Inventors: Stefan-Alexandru GHIAUS; Vlad Cristian SUSANU - Web page: https://patentgrep.com/patent/US20210240909A1 ## CPC - G06Q 30/0643: {graphically representing goods, e.g. 3D product representation} - G06F 9/44: Arrangements for executing specific programs - G06F 9/451: Execution arrangements for user interfaces - G06F 16/9538: Presentation of query results - G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents} - G06F 18/2431: Multiple classes - G06F 40/103: Formatting, i.e. changing of presentation of documents (automatic justification G06F40/189; automatic line break hyphenation G06F40/191) - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 20/00: Machine learning - G06Q 30/0625: {by formulating product or service queries, e.g. using keywords or predefined options} - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/77: Retouching; Inpainting; Scratch removal - G06T 15/04: Texture mapping - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06V 10/764: using classification, e.g. of video objects - G06V 10/82: using neural networks - G06V 20/20: in augmented reality scenes - G06N 3/045: Combinations of networks - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/20084: Artificial neural networks [ANN] - G06T 2219/2004: Aligning objects, relative positioning of parts - G06T 2219/2016: Rotation, translation, scaling - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Systems and methods are disclosed for visualizing products in a single-page application. Consistent with disclosed embodiments, an application system can receive from a client system, during rendering of a webpage received by the client system from a host system, a request for a script associated with the host system. The script can be executable by the client system to perform operations including modifying the webpage to include a visualization application in response to a selection of a visualization control in the webpage by a user of the client system. Consistent with disclosed embodiments, the application system can receive, from the visualization application, a request to display a product in a first image. A location can be identified in the first image using a machine learning model. Instructions can be provided to the visualization application for displaying the product at the location. ## Claims ### Claim 1 A method for visualizing products in a single-page application, comprising: receiving, by an application system from a client system during rendering of a webpage received by the client system from a host system, a first request for a script associated with the host system, the script executable by the client system to perform operations comprising: modifying the webpage to include a visualization application in response to a selection of a visualization control in the webpage by a user of the client system; receiving, by the application system from the visualization application, a second request to display an augmented reality image; and providing, by the application system to the client system, instructions to cause the display, by the client system and using a native tool of the client system, of the augmented reality image in image data of an environment, the augmented reality image depicting a product at a location in the environment. ### Claim 2 (depends on 1) The method of claim 1, wherein: the product is randomly selected by the application system based on product availability information. ### Claim 3 (depends on 1) The method of claim 1, wherein: the product comprises a predetermined product. ### Claim 4 (depends on 1) The method of claim 1, wherein: the visualization control is associated with the product. ### Claim 5 (depends on 1) The method of claim 1, further comprising: identify, based on the first request, a context of the webpage; and generating the script based on the context provided in the first request. ### Claim 6 (depends on 1) The method of claim 1, wherein the script is generated from a template associated with a context provided in the first request. ### Claim 7 (depends on 1) The system of claim 1, further comprising: forwarding, by the visualization application to an analytics system, a notification in response to detection of an event. ### Claim 8 (depends on 1) The method of claim 1, wherein the image data of the environment comprises a live stream of images acquired by the client system. ### Claim 9 (depends on 1) The method of claim 1, wherein the location is fixed with respect to the environment. ### Claim 10 A method for visualizing products in a single-page application, comprising: receiving, by an application system from a client system during rendering of a webpage received by the client system from a host system, a request for a script associated with the host system, the script executable by the client system to perform operations comprising: modifying the webpage to include a visualization application in response to a selection of a visualization control in the webpage by a user of the client system; receiving, by the application system from the visualization application, a display request; identifying a location in a first image associated with the display request; providing, to the client system for display in the visualization application, an indication of the location; receiving a selection of the indication; and providing, based on the selection, instructions to the visualization application for displaying an image of a product associated with the location in the location. ### Claim 11 (depends on 10) The method of claim 10, wherein: the operations further comprise identifying a product type corresponding to the location; and the instructions are provided based in part on the product type corresponding to the location. ### Claim 12 (depends on 10) The method of claim 10, wherein identifying the location in the first image comprises: performing semantic segmentation of the first image to identify features in the first image; and identifying the location from at least one of the identified features. ### Claim 13 (depends on 10) The method of claim 10, wherein identifying the location in the first image associated with the display request comprises: using a machine learning model to identify the location in the first image. ### Claim 14 (depends on 10) The method of claim 10, wherein identifying the location in the first image associated with the display request comprises: providing the first image to a convolutional neural network selected based on at least one of a type of the product, the webpage, or the host system. ### Claim 15 (depends on 10) The method of claim 10, wherein identifying the location in the first image associated with the display request comprises: classifying pixels in the first image as corresponding to a surface depicted in the first image; and identifying the location based on the classified pixels in the first image. ### Claim 16 (depends on 15) The method of claim 15, wherein the surface is landscaping, house exterior, roof, door, garage door, window, or side paneling. ### Claim 17 (depends on 10) The method of claim 10, further comprising: obtaining, by the application system from local storage associated with a browser of the client system, session information for the user; and obtaining, by the application system, the first image using the session information. ### Claim 18 (depends on 10) The method of claim 10, wherein: the method further comprises: detecting a device parameter of the client system; and generating a modified first image based on the detected device parameter; and the instructions comprise instructions for displaying the image of the product at the location in the modified first image. ### Claim 19 (depends on 10) The method of claim 10, further comprising: providing a set of potential products to a vendor system including the product; and receiving a selection of subset from the vendor system for display on the webpage by the visualization application. ### Claim 20 (depends on 10) The method of claim 10, wherein: the host system comprises an interactive kiosk machine including a QR code scanner; and the operations further comprise: scanning an QR code using the QR code scanner; and uploading, based on the scanned QR code, the first image. ### Claim 21 (depends on 10) The method of claim 10, further comprising: forwarding, by the visualization application to an analytics system, a notification in response to detection of an event.