# US 10,121,189 B2 · Computer implemented methods and systems for generating virtual body models for garment fit visualisation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,189 B2 - Document ID: US10121189B2 - Status: Granted - Kind: B2 - Application number: 15/054,818 - Filed: 2016-02-26 - Published: 2016-06-23 - Granted: 2018-11-06 - Earliest claimed: 2011-02-17 - Assignees: Metail Limited - Applicants: Metail Limited - Inventors: Tom Adeyoola; Nick Brown; Nikki Trott; Edward Herbert; Duncan Robertson; Jim Downing; Nick Day; Robert Boland; Tom Boucher; Joe Townsend; Edward Clay; Tom Warren; Anoop Unadkat; Yu Chen - Web page: https://patentgrep.com/patent/US10121189B2 ## CPC - G06Q 30/0643: {graphically representing goods, e.g. 3D product representation} - G06F 3/005: {Input arrangements through a video camera} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 16/248: Presentation of query results - G06F 16/54: Browsing; Visualisation therefor - G06F 16/5854: {using shape and object relationship} - G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information} - G06F 16/9535: Search customisation based on user profiles and personalisation - G06F 18/22: Matching criteria, e.g. proximity measures - G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders - G06Q 10/40: Business processes related to social networking or social networking services - G06Q 10/42: Determination of affinities or common interests between users - G06Q 30/0605: {Pooling transaction partners, e.g. group buying or group selling} - G06Q 30/0625: {by formulating product or service queries, e.g. using keywords or predefined options} - G06Q 30/0629: {by pre-processing results, e.g. ranking or ordering results} - G06Q 30/0631: {Recommending goods or services} - G06T 7/11: Region-based segmentation - G06T 7/194: involving foreground-background segmentation - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 13/20: Three-dimensional [3D] animation - G06T 13/40: of characters, e.g. humans, animals or virtual beings - G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites - G06T 15/205: {Image-based rendering} - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00) - H04N 13/207: using a single two-dimensional [2D] image sensor - H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps - H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems - G06T 2200/04: involving 3D image data - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10012: Stereo images - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/20212: Image combination - G06T 2207/30196: Human being; Person - G06T 2210/16: Cloth - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods for generating and sharing a virtual body model of a person, created with a small number of measurements and a single photograph, combined with one or more images of garments. The virtual body model represents a realistic representation of the users body and is used for visualizing photo-realistic fit visualizations of garments, hairstyles, make-up, and/or other accessories. The virtual garments are created from layers based on photographs of real garment from multiple angles. Furthermore the virtual body model is used in multiple embodiments of manual and automatic garment, make-up, and, hairstyle recommendations, such as, from channels, friends, and fashion entities. The virtual body model is sharable for, as example, visualization and comments on looks. Furthermore it is also used for enabling users to buy garments that fit other users, suitable for gifts or similar. The implementation can also be used in peer-to-peer online sales where garments can be bought with the knowledge that the seller has a similar body shape and size as the user. ## Claims ### Claim 1 A computer implemented method of generating search results using a web search engine associated with a social network including an account of a user, and generating a photo-realistic image of a selected garment combined onto a 3D virtual body model, the method comprising the steps of: (a) receiving user measurement data entered by the user; (b) generating the 3D virtual body model of the user based on the received user measurement data entered by the user; (c) the web search engine using the 3D virtual body model, or data that defines some or all of the 3D virtual body model, in its search process, algorithm or algorithms so that a search for garments or other goods or services returns search results that are relevant to a potential purchaser with the user's 3D virtual body model, in which the web search engine is associated with the social network, the social network including a plurality of user accounts including the account of the user, and in which the social network includes the user's 3D virtual body model; (d) the web search engine receiving an indication of the selected garment on a website from the user, and (e) a computer implemented system analysing the image of the selected garment from the web site and then searching and identifying the selected garment in a database of previously analysed garments and then combining one or more virtual images of the selected garment from the database onto the 3D virtual body model of the user and then displaying to the user the combined selected garment and 3D virtual body model, as the photo-realistic image of the selected garment combined onto the 3D virtual body model. ### Claim 2 (depends on 1) The method of claim 1, in which a search for shopping for garments returns search results that are relevant to a potential purchaser with that user's 3D virtual body model. ### Claim 3 (depends on 2) The method of claim 2, in which the user is presented with alternative garments that match a garment in an identified image and the user can select which garment is to be presented on the user's associated body model. ### Claim 4 (depends on 2) The method of claim 2, in which the user can also get a recommendation that one of the garments they are trying out has complementary garments. ### Claim 5 (depends on 2) The method of claim 2, in which a combined garment and 3D virtual body model is shown within a web browser. ### Claim 6 (depends on 2) The method of claim 2, in which a virtual fitting room is connectable to the search engine as well as to different types of platforms such as social networking sites and different retailers. ### Claim 7 (depends on 6) The method of claim 6, in which there is provided a feature where the user can take an image of an outfit worn by a person and that image, or the corresponding outfit, is matched to garments the virtual fitting room has in its database. ### Claim 8 (depends on 7) The method of claim 7, in which the search provides an absolute match of the garments and suggest the same ones as seen in the image. ### Claim 9 (depends on 2) The method of claim 2, in which there is provided an index matching system such that a user could search for items from people with an 80% body match index, or from people with a 95% body match index. ### Claim 10 (depends on 2) The method of claim 2, in which a virtual fitting room can provide sizing information data to a search engine, either as the sizing information for a specific retailer or brand or for instance the measurements of the user's body model. ### Claim 11 (depends on 2) The method of claim 2, in which a virtual fitting room allows the user to search and filter the garments presented using different filter parameters. ### Claim 12 (depends on 2) The method of claim 2, the method further comprising a method for generating an image of a user in a garment, in which a system can access a virtual body model of the user and a database of garment images and a history or record of previous garments purchased or viewed by the user, and the system automatically, without user intervention, selects a garment which the system determines is a suitable garment given the history or record of previous garments purchased or viewed by the user and then combines an image of that garment onto the virtual body model and automatically without user intervention provides to the user an image of the garment, combined with the virtual body model, to enable that person to visualise what the garment will look like when worn by them. ### Claim 13 (depends on 2) The method of claim 2, in which a system has access to a database of images of many different garments and selects which garment to choose by applying criteria based on a purchasing history of the user. ### Claim 14 (depends on 2) The method of claim 2, in which a virtual wardrobe or garment storage environment is provided which stores images of all garments purchased by the user after they have been shown when combined with the user's virtual body model; including in the virtual wardrobe or garment storage environment images of other garments, purchased or selected by the user without having been combined with the user's virtual body model. ### Claim 15 (depends on 2) The method of claim 2, in which a virtual fitting room allows the user to search and filter the garments presented using different filter parameters, and in which the user can filter the garments based on a specific style, a product category or a fashion trend. ### Claim 16 (depends on 1) The method of claim 1, in which the search engine optimises searches from a user for any of the following good or services or events using the 3D virtual body model of that user: garments, footwear, food, restaurants, holidays, flights, insurance, sports events, medicines, physical therapy, books, entertainment. ### Claim 17 (depends on 1) The method of claim 1, so that search results are optimised to be relevant to a user with that particular 3D virtual body model when searching. ### Claim 18 (depends on 1) The method of claim 1, in which the user, when viewing a website showing a garment on a touch screen device, indicates that the garment is to be visualised on his or her 3D virtual body model by touching the image of the garment shown on the touch screen display. ### Claim 19 (depends on 1) The method of claim 1, in which the computer implemented system searches and identifies that garment in a database of previously analysed garments by using an image matching system that can assess the similarity between two images of objects. ### Claim 20 (depends on 1) The method of claim 1, in which the computer implemented system searches and identifies that garment in a database of previously analysed garments by using garment identification metadata exposed by the website. ### Claim 21 (depends on 1) The method of claim 1, in which a web browser extension enables the user, when browsing the web site, to initiate the tasks required to be performed by the computer implemented system. ### Claim 22 (depends on 1) The method of claim 1, in which 3D virtual body model sizing information is usable in the search engine's search algorithms. ### Claim 23 A computer system, the computer system including a web search engine and a social network, the computer system adapted or operable to generate search results using the web search engine which is associated with the social network, the social network including a plurality of user accounts including an account of a user, in which the computer system is configured to: (a) receive user measurement data entered by the user; (b) generate a 3D virtual body model of the user based on the received user measurement data entered by the user; (c) use the web search engine to use the 3D virtual body model, or data that defines some or all of the 3D virtual body model, in its search process, algorithm or algorithms so that a search for garments or other goods or services returns search results that are relevant to a potential purchaser with the user's 3D virtual body model, and wherein the social network includes the user's 3D virtual body model; (d) use the web search engine to receive an indication of a selected garment on a web site from the user, and (e) analyse the image of the selected garment from the website and then search and identify the selected garment in a database of previously analysed garments and then combine one or more virtual images of the selected garment from the database onto the 3D virtual body model of the user and then display to the user the combined selected garment and 3D virtual body model, as a photo-realistic image of the selected garment combined onto the 3D virtual body model.