# US 11,310,414 B2 · Automated guide for image capturing for 3D model creation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,414 B2 - Document ID: US11310414B2 - Status: Granted - Kind: B2 - Application number: 17/010,625 - Filed: 2020-09-02 - Published: 2020-12-24 - Granted: 2022-04-19 - Earliest claimed: 2017-01-11 - Assignees: Hover Inc. - Applicants: Hover Inc. - Inventors: Manish Upendran; William Castillo; Derek Halliday - Web page: https://patentgrep.com/patent/US11310414B2 ## CPC - G06T 7/50: Depth or shape recovery - H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image} - G06T 7/0002: {Inspection of images, e.g. flaw detection} - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet - H04N 23/71: Circuitry for evaluating the brightness variation - G06T 2200/08: involving all processing steps from image acquisition to 3D model generation - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2200/28: involving image processing hardware - G06T 2207/30168: Image quality inspection - G06T 2207/30184: Infrastructure - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image capture system provides automated prompts for aiding a user in capturing images for use in 3D model creation. While a user is preparing to capture an image, the system provides visual indications that indicate whether a quality-based condition is satisfied. Based on the visual indications, a user can determine whether an image, if captured, would likely be suitable for use in creating a 3D model. Determining if the quality-based condition is satisfied may include monitoring output generated by one or more sensors and comparing the output against a threshold value. Additionally, the system may analyze the visual content or metadata associated with an image to determine if the quality-based condition is satisfied and request user input to further identify certain image features that were identified by the system. ## Claims ### Claim 1 A method for capturing images used to create 3D models, comprising: displaying, on a device, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated; determining, by one or more processors, whether a quality-based condition is satisfied; wherein determining whether the quality-based condition is satisfied comprises generating a bounding box around an entirety of the target object; and determining, by one or more processors, whether an entirety of the bounding box is within an image frame comprising the visual content; at least while the quality-based condition is not satisfied, displaying, on the device, a visual indication associated with the quality-based condition concurrent with displaying the visual content; capturing the visual content displayed on the device, as an image, in response to activation of the capture control. ### Claim 2 (depends on 1) The method of claim 1, further comprising: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication. ### Claim 3 (depends on 1) The method of claim 1, further comprising: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication. ### Claim 4 (depends on 1) The method of claim 1, wherein: the target object is a building; and determining, by one or more processors, whether the visual content comprises one or more of: a corner of the building, a top of the building, or a bottom of the building. ### Claim 5 One or more non-transitory computer-readable media storing one or more sequences of instructions that, when executed by one or more processors, cause: displaying, on a device, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated; determining, by one or more processors, whether a quality-based condition is satisfied; wherein determining whether the quality-based condition is satisfied comprises generating a bounding box around an entirety of the target object; and determining, by one or more processors, whether an entirety of the bounding box is within an image frame comprising the visual content; at least while the quality-based condition is not satisfied, displaying, on the device, a visual indication associated with the quality-based condition concurrent with displaying the visual content; capturing the visual content displayed on the device, as an image, in response to activation of the capture control. ### Claim 6 (depends on 5) The one or more non-transitory computer-readable media of claim 5, wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication. ### Claim 7 (depends on 5) The one or more non-transitory computer-readable media of claim 5, wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication. ### Claim 8 (depends on 5) The one or more non-transitory computer-readable media of claim 5, wherein: the target object is a building; and determining, by one or more processors, whether the visual content comprises one or more of: a corner of the building, a top of the building, or a bottom of the building. ### Claim 9 A method for capturing images used to create 3D models, comprising: displaying, on a device display, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated; determining, by one or more processors, whether a quality-based condition is satisfied; wherein determining whether the quality-based condition is satisfied comprises: generating a bounding box for the target object; and determining whether the bounding box satisfies a condition of being disposed entirely inside an image frame comprising the visual content; at least while the quality-based condition is not satisfied, displaying, on the device display, a visual indication associated with the quality-based condition concurrent with displaying the visual content; and capturing the visual content displayed on the device, as an image, in response to activation of the capture control. ### Claim 10 (depends on 9) The method of claim 9, wherein determining whether the bounding box satisfies a condition of being disposed entirely inside the image frame further comprises determining whether the bounding box satisfies a condition of being disposed entirely inside the visual content. ### Claim 11 (depends on 9) The method of claim 9, further comprising: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication. ### Claim 12 (depends on 9) The method of claim 9, further comprising: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication. ### Claim 13 (depends on 9) The method of claim 9, wherein: the target object is a building; and determining, by one or more processors, whether the visual content comprises one or more of: corners of the building, a top of the building, or a bottom of the building. ### Claim 14 One or more non-transitory computer-readable media storing one or more sequences of instructions that, when executed by one or more processors, cause: displaying, on a device display, visual content comprising a target object that would be captured as an image if a capture control for the device were to be activated; determining, by one or more processors, whether a quality-based condition is satisfied; wherein determining whether the quality-based condition is satisfied comprises: generating a bounding box for an entirety of the target object; and determining, by one or more processors, whether the bounding box satisfies a condition of being disposed entirely inside an image frame comprising the visual content; at least while the quality-based condition is not satisfied, displaying, on the device display, a visual indication associated with the quality-based condition concurrent with displaying the visual content; and capturing the visual content displayed on the device, as an image, in response to activation of the capture control. ### Claim 15 (depends on 14) The one or more non-transitory computer-readable media of claim 14, wherein determining whether the bounding box satisfies a condition of being disposed entirely inside the image frame further comprises determining whether the generated bounding box satisfies a condition of being disposed entirely inside the visual content. ### Claim 16 (depends on 14) The one or more non-transitory computer-readable media of claim 14, wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, ceasing to display the visual indication. ### Claim 17 (depends on 14) The one or more non-transitory computer-readable media of claim 14, wherein the one or more sequences of instructions further comprise instructions that, when executed by one or more processors, cause: detecting that the quality-based condition is satisfied; and in response to detecting that the quality-based condition is satisfied, changing an appearance of the visual indication. ### Claim 18 (depends on 14) The one or more non-transitory computer-readable media of claim 14, wherein: the target object is a building; and determining, by one or more processors, whether the visual content comprises one or more of: a corner of the building, a top of the building, or a bottom of the building.