# US 10,872,426 B2 · Guide-assisted capture of material data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,872,426 B2 - Document ID: US10872426B2 - Status: Granted - Kind: B2 - Application number: 16/447,943 - Filed: 2019-06-20 - Published: 2019-12-26 - Granted: 2020-12-22 - Earliest claimed: 2018-06-20 - Assignees: Centric Software, Inc. - Applicants: Centric Software, Inc. - Inventors: Humberto Roa; Rammohan Akula; Fabrice Canonge; Nicholas Fjellberg Swerdlowe; Rohit Ghatol; Grif Von Holst - Web page: https://patentgrep.com/patent/US10872426B2 ## CPC - G06T 7/73: using feature-based methods - G06F 16/583: using metadata automatically derived from the content - G06T 3/00: Geometric image transformations in the plane of the image - G06T 3/4084: in the transform domain, e.g. fast Fourier transform [FFT] domain scaling - G06T 3/608: by skew deformation, e.g. two-pass or three-pass rotation - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/70: Denoising; Smoothing - G06T 5/80: Geometric correction - G06T 7/13: Edge detection - G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration - G06T 7/529: from texture - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 15/04: Texture mapping - H04N 1/00172: {directly from a still digital camera or from a storage medium mounted in a still digital camera (H04N1/0018 takes precedence)} - H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)} - H04N 1/3872: {Repositioning or masking} - G06F 2218/00: Aspects of pattern recognition specially adapted for signal processing - G06T 2207/20132: Image cropping - G06T 2207/20192: Edge enhancement; Edge preservation - G06T 2207/30124: Fabrics; Textile; Paper - G06T 2207/30204: Marker - G06T 2210/16: Cloth - H04N 2201/325: Modified version of the image, e.g. part of the image, image reduced in size or resolution, thumbnail or screennail - H04N 2201/3252: Image capture parameters, e.g. resolution, illumination conditions, orientation of the image capture device (H04N2201/3256 and subgroups take precedence) - H04N 2201/3256: colour related metadata, e.g. colour, ICC profiles - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A material data collection system allows capturing of material data. For example, the material data collection system may include digital image data for materials. The material data collection system may ensure that captured digital image data is properly aligned, so that material data may be easily recalled for later use, while maintaining the proper alignment for the captured digital image. The material data collection system may include using a capture guide, to provide cues on how to orient a mobile device used with the material data collection system. ## Claims ### Claim 1 A method comprising: capturing an initial material sample image using an application executing on a mobile device, wherein the initial material sample image includes at least the following visible areas: a sample material area, and a capture guide area including a capture guide and a first alignment indicator included on the capture guide; determining a first location of the initial material sample image where the first alignment indicator has been captured in the initial material sample image; storing a first matched alignment indicator pair, wherein the first matched alignment indicator pair associates the first alignment indicator with a first position; transforming the initial material sample image, based on the first matched alignment indicator pair, to render an alignment corrected material sample image; identifying, from the alignment corrected material sample image, a sample material swatch area, wherein the sample material swatch area includes at least one instance of a pattern found in the initial material sample image; and storing on the mobile device the sample material swatch area and the initial material sample image. ### Claim 2 (depends on 1) The method of claim 1 wherein transforming the initial material sample image comprises determining, based on the first matched alignment indicator pair and without user input, a bounded area where the sample material area is shown in the initial material sample image. ### Claim 3 (depends on 2) The method of claim 2 wherein the bounded area corresponds to the sample material swatch area. ### Claim 4 (depends on 1) The method of claim 1 wherein transforming the initial material sample image comprises correcting, based on the first matched alignment indicator pair, a skew of the initial material sample image. ### Claim 5 (depends on 1) The method of claim 1 wherein determining the first location where the first alignment indicator has been captured is identified using optical recognition of the first alignment indicator. ### Claim 6 (depends on 1) The method of claim 1 wherein determining the first location where the first alignment indicator has been captured is performed without user input. ### Claim 7 (depends on 1) The method of claim 1 comprising: before transforming the initial material sample image, displaying on the mobile device the initial material sample image overlaid with a first application provided alignment indicator at the first position; while displaying the initial material sample image, receiving a first adjustment of the first application provided alignment indicator from the first position to a second position to associate the first application provided alignment indicator with the first alignment indicator; and updating the first matched alignment indicator pair to associate the first alignment indicator with the first application provided alignment indicator at the second position and not the first position. ### Claim 8 (depends on 1) The method of claim 1 comprising: before capturing the initial material sample image, taking an orientation of a sample material and capture guide by the mobile device; and before capturing the initial material sample image, providing visual feedback indicating whether at a given time the mobile device is in a similar orientation of the sample material and capture guide. ### Claim 9 (depends on 8) The method of claim 8 wherein taking an orientation comprises using a three-axis accelerometer of the mobile device. ### Claim 10 (depends on 1) The method of claim 1 comprising associating with the sample material swatch area metadata comprising an International Standards Organization (ISO) sensitivity when the initial material sample image was captured. ### Claim 11 (depends on 1) The method of claim 1 comprising: rendering a three-dimensional model on a geometric form, wherein the rendered three-dimensional model comprises at least a portion of a surface of the three-dimensional model including the sample material swatch area. ### Claim 12 (depends on 11) The method of claim 11 wherein the geometric form comprises at least a portion of a human body. ### Claim 13 (depends on 11) The method of claim 11 comprising creating the surface of the three-dimensional model based on repeating at least two or more copies of the sample material swatch area. ### Claim 14 (depends on 1) The method of claim 1 wherein the capture guide area entirely encloses at least a portion of the sample material area in the initial material sample image. ### Claim 15 (depends on 1) The method of claim 1 comprising reducing an edge artifact of the sample material swatch area. ### Claim 16 (depends on 1) The method of claim 1 comprising: before capturing the initial material sample image, taking an orientation of a sample material and capture guide by the mobile device; before capturing the initial material sample image and after a user input to capture the initial material sample image, accessing an accelerometer of the mobile device to determine whether at a given time the mobile device is in a similar orientation of the sample material and capture guide; at a first time when the mobile device is not in a similar orientation of the sample material and capture guide, determining to not capture the initial material sample image; and at a second time when the mobile device is in a similar orientation of the sample material and capture guide, capturing the initial material sample image, without user input to capture the initial material sample image at the second time. ### Claim 17 (depends on 1) The method of claim 1 comprising: detecting a computer-readable indication shown on the capture guide area of the initial material sample image; and determining a first direction for a sample material shown in the sample material area using the computer-readable indication. ### Claim 18 (depends on 1) The method of claim 1 comprising: comparing, based on two different white point markers that are visible in the initial material sample image, a chromaticity differential for the two different white point markers; determining, based on the chromaticity differential, a chromaticity gradient to compensate for the chromaticity differential; and applying the chromaticity gradient over the initial material sample image by adjusting chromaticity values. ### Claim 19 (depends on 1) The method of claim 1 comprising: comparing, based on two different color markers of a single color that are visible in the initial material sample image, a color differential for the two different color markers; determining, based on the color differential, a color gradient to compensate for the color differential; and applying the color gradient over the initial material sample image by adjusting color values. ### Claim 20 (depends on 1) The method of claim 1 comprising: comparing, based on two different white point markers that are visible in the initial material sample image, a chromaticity differential for the two different white point markers; determining, based on the chromaticity differential, a chromaticity gradient to compensate for the chromaticity differential; applying the chromaticity gradient over the initial material sample image by adjusting chromaticity values; comparing, based on two different color markers of a single color that are visible in the initial material sample image, a color differential for the two different color markers; determining, based on the color differential, a color gradient to compensate for the color differential; and applying the color gradient over the initial material sample image by adjusting color values. ### Claim 21 (depends on 20) The method of claim 20 wherein applying the chromaticity gradient is before applying the color gradient. ### Claim 22 (depends on 1) The method of claim 1 comprising: converting the sample material swatch area into a grayscale layer; receiving selection of a base color; applying a base color layer to at least a portion of the grayscale layer, wherein the applied base color matches the intensity of an original color of the sample material swatch area. ### Claim 23 (depends on 1) The method of claim 1 comprising: receiving selection of a first area from the sample material swatch area or the initial material sample image and a selected color space; translating, from a color at the first area, to a matching color identifier in the selected color space; and storing as metadata with the sample material swatch area or the initial material sample image the matching color identifier.