# US 11,113,826 B2 · Assisted material data collection > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,113,826 B2 - Document ID: US11113826B2 - Status: Granted - Kind: B2 - Application number: 16/447,949 - Filed: 2019-06-20 - Published: 2019-12-26 - Granted: 2021-09-07 - Earliest claimed: 2018-06-20 - Assignees: Centric Software, Inc. - Applicants: Centric Software, Inc. - Inventors: Humberto Roa; Rammohan Akula; Fabrice Canonge; Nicholas Fjellberg Swerdlowe; Rohit Ghatol; Grif Von Holst - Web page: https://patentgrep.com/patent/US11113826B2 ## CPC - G06T 7/73: using feature-based methods - G06F 16/583: using metadata automatically derived from the content - G06T 3/00: Geometric image transformations in the plane of the image - G06T 3/4084: in the transform domain, e.g. fast Fourier transform [FFT] domain scaling - G06T 3/608: by skew deformation, e.g. two-pass or three-pass rotation - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/70: Denoising; Smoothing - G06T 5/80: Geometric correction - G06T 7/13: Edge detection - G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration - G06T 7/529: from texture - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 15/04: Texture mapping - H04N 1/00172: {directly from a still digital camera or from a storage medium mounted in a still digital camera (H04N1/0018 takes precedence)} - H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)} - H04N 1/3872: {Repositioning or masking} - G06F 2218/00: Aspects of pattern recognition specially adapted for signal processing - G06T 2207/20132: Image cropping - G06T 2207/20192: Edge enhancement; Edge preservation - G06T 2207/30124: Fabrics; Textile; Paper - G06T 2207/30204: Marker - G06T 2210/16: Cloth - H04N 2201/325: Modified version of the image, e.g. part of the image, image reduced in size or resolution, thumbnail or screennail - H04N 2201/3252: Image capture parameters, e.g. resolution, illumination conditions, orientation of the image capture device (H04N2201/3256 and subgroups take precedence) - H04N 2201/3256: colour related metadata, e.g. colour, ICC profiles - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A material data collection system allows capturing of material data. For example, the material data collection system may include digital image data for materials. The material data collection system may ensure that captured digital image data is properly aligned, so that material data may be easily recalled for later use, while maintaining the proper alignment for the captured digital image. The material data collection system may include using a capture guide, to provide cues on how to orient a mobile device used with the material data collection system. ## Claims ### Claim 1 A method comprising: capturing an initial material sample image using an application executing on a mobile device, wherein the initial material sample image includes at least the following visible areas: a sample material area, and a capture guide area including a capture guide and a set of alignment indicators included on the capture guide of at least three alignment indicators; identifying positions for the set of alignment indicators from the captured initial material sample image; overlaying the positions for the set of alignment indicators with a set of application provided alignment indicators that indicate where in the captured initial material sample image the set of alignment indicators are found; in response to identifying the positions for the set of alignment indicators, transforming the initial material sample image, based upon a bounded polygon formed using the set of application provided alignment indicators, to render an alignment corrected material sample image; identifying, from the alignment corrected material sample image, a sample material swatch area, wherein the sample material swatch area includes at least one instance of a pattern found in the initial material sample image; and storing on the mobile device the sample material swatch area and the initial material sample image. ### Claim 2 (depends on 1) The method of claim 1 wherein the set of alignment indicators includes four alignment indicators and the bounded polygon comprises an irregular polygon. ### Claim 3 (depends on 2) The method of claim 2 wherein the set of alignment indicators included on the capture guide forms a regular polygon. ### Claim 4 (depends on 1) The method of claim 1 wherein the transforming the initial material sample image comprises compensating, based on the first match alignment indicator pair, for at least a lens aberration introduced by a lens of the mobile device when capturing the initial material sample image. ### Claim 5 A method comprising: providing a capture guide placed on top of a sample material, wherein the capture guide includes a cut out portion that allows at least a portion of the sample material to appear while the capture guide is on top of the sample material; capturing a digital image of the sample material and the capture guide on top of the sample material; transforming, based on the capture guide captured in the digital image, the portion of the sample material appearing in the cut out portion, wherein the transforming comprises at least one of performing a color calibration of the digital image based on a color marker of the capture guide, a straightening of the digital image based on a straight line defined by the cut out portion of the capture guide, a dimensions correction of dimensions of the cut out portion as shown in the digital image, or a deskewing of the digital image based on a polygon formed by corners of the cut out portion; and determining a material swatch for the sample material, wherein the material swatch comprises only the portion of the sample material visible in the cut-out portion. ### Claim 6 (depends on 5) The method of claim 5 comprising: before capturing the digital image, positioning using fasteners of the capture guide to hold the sample material in place; and while capturing the digital image, fastening the sample material in place. ### Claim 7 (depends on 5) The method of claim 5 wherein the color calibration comprises: comparing, based on two different markers on the capture guide that is of the same color, a color differential for the two different markers as captured in the digital image; determining, based on the color differential, a gradient to compensate for the color differential of the digital image; and applying the gradient over the captured digital image by adjusting color values of the captured digital image. ### Claim 8 (depends on 7) The method of claim 7 wherein the gradient comprises adjusting the color values according to the color differential within a preselected color space. ### Claim 9 A method comprising: receiving a digital image of a real-world material sample; analyzing the digital image to determine at least two marker areas found on a capture guide included with the digital image; correcting, based on the at least two marker areas, at least one of an alignment, color, or chromaticity of the digital image; and creating, after correcting the digital image, a cropped version of the digital image comprising: removing the capture guide from the cropped version of the digital image, identifying at least one pattern of the real-world material sample, and including the at least one pattern of the real-world material sample in the cropped version of the digital image. ### Claim 10 (depends on 9) The method of claim 9 wherein the including the at least one pattern comprises receiving user input to determine the at least one pattern. ### Claim 11 (depends on 9) The method of claim 9 wherein the including the at least one pattern comprises before receiving the user input, providing a tiled image of an initial cropped version of the digital image. ### Claim 12 (depends on 9) The method of claim 9 wherein the correcting the digital image comprises correcting at least two of an alignment, color, or chromaticity of the digital image. ### Claim 13 (depends on 9) The method of claim 9 wherein the at least two marker areas are found near opposite areas on an opening of the capture guide. ### Claim 14 (depends on 9) The method of claim 9 wherein the at least two marker areas comprise at least three different colors and each of the at least two marker areas comprise the same colors. ### Claim 15 (depends on 14) The method of claim 14 wherein the correcting the digital image is based on a comparison of values for the at least three colors in the digital image and values for the at least three colors received before the digital image was captured. ### Claim 16 (depends on 15) The method of claim 15 wherein the at least three colors received before the digital image was captured comprises colors used during creation of the capture guide. ### Claim 17 (depends on 1) The method of claim 1 wherein the capture guide area includes the set of alignment indicators shown on the capture guide. ### Claim 18 (depends on 1) The method of claim 1 wherein the capture guide is shown in the initial material sample image as surrounding the sample material swatch area. ### Claim 19 (depends on 1) The method of claim 1 wherein the at least three alignment indicators are included on a single piece material. ### Claim 20 (depends on 19) The method of claim 19 wherein the single piece of material comprises at least one of acrylic, plastic, paper, or cardboard. ### Claim 21 (depends on 1) The method of claim 1 wherein the at least three alignment indicators comprise a first alignment indicator of a first color and a second alignment indicator of a second color that is different than the first color.