# US 10,310,616 B2 · Modification of three-dimensional garments using gestures > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,310,616 B2 - Document ID: US10310616B2 - Status: Granted - Kind: B2 - Application number: 14/675,241 - Filed: 2015-03-31 - Published: 2016-10-06 - Granted: 2019-06-04 - Earliest claimed: 2015-03-31 - Assignees: eBay Inc. - Applicants: eBay Inc. - Inventors: Kyle Smith Rose; Pooja Sapra; Vivienne Melody Blue; Chuck Barnum; Giridhar Singam; Chris Miller; Rachel Maxine Minenno; James Stephen Perrine - Web page: https://patentgrep.com/patent/US10310616B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) - G06Q 30/0621: {by configuring or customising goods or services} - G06Q 30/0643: {graphically representing goods, e.g. 3D product representation} - G06T 13/40: of characters, e.g. humans, animals or virtual beings - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06F 2113/12: Cloth - G06T 2210/16: Cloth - G06T 2219/2016: Rotation, translation, scaling - G06T 2219/2021: Shape modification - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Techniques for modifying a garment based on gestures are presented herein. An access module can access a first set of sensor data from a first sensor, and a second set of sensor data from a second sensor. A garment simulation module can generate a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data. A display module can cause a presentation, on a display of a device, of the 3D garment model draped on the avatar. Additionally, the garment simulation module can determine a modification gesture associated with the 3D garment model draped on the avatar based on the first set of sensor data and the second set of sensor data. Furthermore, the garment simulation module can modify the 3D garment model based on the determined modification gesture. ## Claims ### Claim 1 A method comprising: accessing a first set of sensor data from a first sensor; accessing a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor; generating a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data; causing a presentation, on a display of a device, of the 3D garment model draped on the avatar; detecting a section-specific garment-fit modification gesture in relation to a section of the 3D garment model draped on the avatar based on the first set of sensor data and the second set of sensor data, including: identifying a difference between initial and final sensor data of the first set of sensor data with respect to the section of the 3D garment model, the initial sensor data received at a first time and the final sensor data received at a second time; and determining the section specific garment-fit modification gesture based on the identified difference; and modifying the 3D garment model by tailoring the section of the 3D garment model as draped on the avatar according to the detected section-specific garment-fit modification gesture, the tailoring including at least one alteration effective to modify the section of the 3D garment model to produce a custom size from a manufacturer-predefined size. ### Claim 2 (depends on 1) The method of claim 1, wherein generating the 3D garment model draped on the avatar includes: generating the avatar based on the first set of sensor data and the second set of sensor data; and draping the 3D garment model of the garment available for sale on the generated avatar. ### Claim 3 (depends on 2) The method of claim 2, further comprising: accessing the 3D garment model from a garment model database included as part of an electronic marketplace, the 3D garment model having a material property; and calculating a simulated force acting on the 3D garment model based on the material property, the 3D garment model being draped on the avatar based on the calculated simulated force. ### Claim 4 (depends on 2) The method of claim 2, further comprising determining a size for the garment available for sale based on the generated avatar. ### Claim 5 (depends on 1) The method of claim 1, further comprising updating the presentation, on the display of the device, of the modified 3D garment model draped on the avatar. ### Claim 6 (depends on 5) The method of claim 5, further comprising: determining a confirmation gesture for the modified 3D garment model based on the first set of sensor data and the second set of sensor data; and transmitting a request to modify the garment available for sale based on the determined confirmation gesture. ### Claim 7 (depends on 1) The method of claim 1, wherein the first sensor includes a depth sensor, a red-green-blue (RGB) camera, and a microphone. ### Claim 8 (depends on 1) The method of claim 1, further comprising: accessing a third set of sensor data from a third sensor, wherein the first sensor, the second sensor, and the third sensor are positioned in a triangle configuration; wherein generating the 3D garment model draped on the avatar is further based on the third set of sensor data; and wherein detecting the section-specific garment-fit modification gesture is further based on the third set of sensor data. ### Claim 9 (depends on 1) The method of claim 1, wherein the first set of sensor data includes a two-dimensional (2D) range image, the 2D range image having pixel values corresponding to distance information for depicted objects in relation to the first sensor. ### Claim 10 (depends on 1) The method of claim 1, wherein generating the 3D garment model draped on the avatar is performed by a graphics processing unit. ### Claim 11 (depends on 1) The method of claim 1, wherein accessing the first set of sensor data from the first sensor is performed by a wireless transceiver. ### Claim 12 (depends on 1) The method of claim 1, wherein the section-specific garment-fit modification gesture includes at least one of a hand pulling gesture, a hand stretching gesture, a hand pinching gesture, a pinching and pulling gesture, and a pinching and tucking gesture. ### Claim 13 (depends on 12) The method of claim 12, wherein the at least one alteration includes at least one of elongating the section of the 3D garment model based on the hand pulling gesture, elongating the section of the 3D garment model based on the hand stretching gesture, shortening the section of the 3D garment model based on the hand stretching gesture, converting the 3D garment model to a smaller size that is not predefined by a manufacturer based on the pinching and pulling gesture, or converting the 3D garment model to a larger size that is not predefined by the manufacturer based on the pinching and tucking gesture. ### Claim 14 (depends on 1) The method of claim 1, further comprising: determining at least one garment fit for the avatar based on the first set of sensor data and the second set of sensor data; determining that manufacturer-predefined sizes of the garment available for sale do not fit the avatar based on the determined at least one garment fit; and responsive to determining that the manufacturer-predefined sizes do not fit the avatar, performing at least one of: communicating custom sizing information indicative of the at least one garment fit to the manufacturer; and modifying the 3D garment model by tailoring the 3D garment model from the manufacturer-predefined size to the custom size based on the at least one garment fit. ### Claim 15 A system comprising: an access module configured to: access a first set of sensor data from a first sensor; and access a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor; at least one processor of a garment simulation module configured to generate a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data; a display module configured to cause a presentation, on a display of a device, of the 3D garment model draped on the avatar; and the garment simulation module further configured to: identify, with respect to a section of the 3D garment model draped on the avatar, a difference between initial sensor data and final sensor data of the first set of sensor data, the initial sensor data received at a first time and the final sensor data received at a second time; determine a section-specific garment-fit modification gesture in relation to the section based on the identified difference; and modify the 3D garment model by tailoring the section of the 3D garment model as draped on the avatar according to the determined section-specific garment-fit modification gesture, the tailoring including at least one alteration in relation to the section effective to modify the 3D garment model from a manufacturer-predefined size to a custom size. ### Claim 16 (depends on 15) The system of claim 15, wherein the display module is further configured to update the presentation, on the display of the device, of the modified 3D garment model draped on the avatar. ### Claim 17 (depends on 15) The system of claim 15, wherein the garment simulation module is further configured to: determine a confirmation gesture for the modified 3D garment model based on the first set of sensor data and the second set of sensor data; and transmit a request to modify the garment available for sale based on the determined confirmation gesture. ### Claim 18 (depends on 15) The system of claim 15, wherein the section-specific garment-fit modification gesture includes at least one of a hand pulling gesture, a hand stretching gesture, a hand pinching gesture, a pinching and pulling gesture, and a pinching and tucking gesture. ### Claim 19 (depends on 18) The system of claim 18, wherein the at least one alteration includes at least one of elongating the section of the 3D garment model based on the hand pulling gesture, elongating the section of the 3D garment model based on the hand stretching gesture, shortening the section of the 3D garment model based on the hand stretching gesture, converting the 3D garment model to a smaller size that is not predefined by a manufacturer based on the pinching and pulling gesture, or converting the 3D garment model to a larger size that is not predefined by the manufacturer based on the pinching and tucking gesture. ### Claim 20 A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising: accessing a first set of sensor data from a first sensor; accessing a second set of sensor data from a second sensor, the second sensor having a different location than the first sensor; generating a three-dimensional (3D) garment model of a garment available for sale draped on an avatar based on the first set of sensor data and the second set of sensor data; determining at least one garment fit for the avatar based on the first set of sensor data and the second set of sensor data; determining that manufacturer-predefined sizes of the garment available for sale do not fit the avatar based on the determined at least one garment fit; and responsive to determining that the manufacturer-predefined sizes do not fit the avatar, performing at least one of: communicating custom sizing information indicative of the at least one garment fit to the manufacturer; and modifying the 3D garment model by tailoring the 3D garment model from a manufacturer-predefined size to a custom size based on the at least one garment fit; and causing a presentation, on a display of a device, of the 3D garment model having the custom size draped on the avatar.