# US 2021/0241524 A1 · Mobile device 3-dimensional modeling > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0241524 A1 - Document ID: US20210241524A1 - Status: Published application - Kind: A1 - Application number: 16/779,480 - Filed: 2020-01-31 - Published: 2021-08-05 - Earliest claimed: 2020-01-31 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Thomas Dawson - Web page: https://patentgrep.com/patent/US20210241524A1 ## CPC - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2219/024: Multi-user, collaborative environment - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Implementations generally relate to 3D modeling. In some implementations, a method includes displaying a live video of a scene on a device with a user interface overlay on top of the scene, wherein the user interface overlay includes one or more objects and includes one or more selectable controls. The method further includes receiving a selection of one or more new virtual points on a target object, wherein the target object is one object of the one or more objects in an image. The method further includes generating 3D polygonal data, wherein the 3D polygonal data is saved as a 3-dimensional (3D) model. ## Claims ### Claim 1 A system comprising: one or more processors; and logic encoded in one or more non-transitory computer-readable storage media for execution by the one or more processors and when executed operable to cause the one or more processors to perform operations comprising: displaying a live video of a scene on a device with a user interface overlay on top of the scene, wherein the user interface overlay includes one or more objects and includes one or more selectable controls; enabling a user to enter one or more new virtual points by tapping on a target object on a display screen; receiving a selection of the one or more new virtual points on the target object, wherein the target object is one object of the one or more objects in an image; and generating 3D polygonal data, wherein the 3D polygonal data is saved as a 3-dimensional (3D) model. ### Claim 2 (depends on 1) The system of claim 1, wherein the logic when executed is further operable to cause the one or more processors to perform operations comprising adding the selection of the one or more new virtual points to the 3D model, wherein the one or more new virtual points represent physical points on a target object. ### Claim 3 (depends on 1) The system of claim 1, wherein the target object represents a physical target object in a physical environment, wherein the physical target object is represented as a live video image on the device with a data overlay, and wherein each new virtual point shown in the data overlay of the one or more new virtual points approximates a physical point on the physical target object. ### Claim 4 (depends on 1) The system of claim 1, wherein the one or more new virtual points are grouped as at least three new virtual points to form a polygon, and wherein the logic when executed is further operable to cause the one or more processors to perform operations comprising generating the 3D polygonal data based on the at least three new virtual points. ### Claim 5 (depends on 1) The system of claim 1, wherein the logic when executed is further operable to cause the one or more processors to perform operations comprising: combining the one or more new virtual points with existing virtual points; and generating the 3D polygonal data based on a combination of the one or more new virtual points and the existing virtual points. ### Claim 6 (depends on 1) The system of claim 1, wherein the logic when executed is further operable to cause the one or more processors to perform operations comprising: receiving a plurality of new virtual points from a plurality of client devices of a plurality of users; and generating the 3D polygonal data based on a combination of the plurality of new virtual points and existing virtual points. ### Claim 7 (depends on 1) The system of claim 1, wherein the logic when executed is further operable to cause the one or more processors to perform operations comprising: generating a polygon model based on the one or more new virtual points; and generating the 3D polygonal data in a specific 3D model format based on the polygon model. ### Claim 8 A non-transitory computer-readable storage medium with program instructions stored thereon, the program instructions when executed by one or more processors are operable to cause the one or more processors to perform operations comprising: displaying a live video of a scene on a device with a user interface overlay on top of the scene, wherein the user interface overlay includes one or more objects and includes one or more selectable controls; enabling a user to enter one or more new virtual points by tapping on a target object on a display screen; receiving a selection of the one or more new virtual points on the target object, wherein the target object is one object of the one or more objects in an image; and generating 3D polygonal data, wherein the 3D polygonal data is saved as a 3-dimensional (3D) model. ### Claim 9 (depends on 8) The computer-readable storage medium of claim 8, wherein the instructions when executed are further operable to cause the one or more processors to perform operations comprising adding the selection of the one or more new virtual points to the 3D model, wherein the one or more new virtual points represent physical points on a target object. ### Claim 10 (depends on 8) The computer-readable storage medium of claim 8, wherein the target object represents a physical target object in a physical environment, wherein the physical target object is represented as a live video image on the device with a data overlay, and wherein each new virtual point shown in the data overlay of the one or more new virtual points approximates a physical point on the physical target object. ### Claim 11 (depends on 8) The computer-readable storage medium of claim 8, wherein the one or more new virtual points grouped as at least three virtual points to form a polygon, and wherein the instructions when executed are further operable to cause the one or more processors to perform operations comprising generating the 3D polygonal data based on the at least three new virtual points. ### Claim 12 (depends on 8) The computer-readable storage medium of claim 8, wherein the instructions when executed are further operable to cause the one or more processors to perform operations comprising: combining the one or more new virtual points with existing virtual points; and generating the 3D polygonal data based on a combination of the one or more new virtual points and the existing virtual points. ### Claim 13 (depends on 8) The computer-readable storage medium of claim 8, wherein the instructions when executed are further operable to cause the one or more processors to perform operations comprising receiving a plurality of new virtual points from a plurality of client devices of a plurality of users; and generating the 3D polygonal data based on a combination of the plurality of new virtual points and existing virtual points. ### Claim 14 (depends on 8) The computer-readable storage medium of claim 8, wherein the instructions when executed are further operable to cause the one or more processors to perform operations comprising: generating a polygon model based on the one or more new virtual points; and generating the 3D polygonal data in a specific 3D model format based on the polygon model. ### Claim 15 A computer-implemented method for 3D modeling using a client device, the method comprising: displaying a live video of a scene on a device with a user interface overlay on top of the scene, wherein the user interface overlay includes one or more objects and includes one or more selectable controls; enabling a user to enter one or more new virtual points by tapping on a target object on a display screen; receiving a selection of the one or more new virtual points on the target object, wherein the target object is one object of the one or more objects in an image; and generating 3D polygonal data, wherein the 3D polygonal data is saved as a 3-dimensional (3D) model. ### Claim 16 (depends on 15) The method of claim 15, further comprising adding the selection of the one or more new virtual points to the 3D model, wherein the one or more new virtual points represent physical points on a target object. ### Claim 17 (depends on 15) The method of claim 15, wherein the target object represents a physical target object in a physical environment, wherein the physical target object is represented as a live video image on the device with a data overlay, and wherein each new virtual point shown in the data overlay of the one or more new virtual points approximates a physical point on the physical target object. ### Claim 18 (depends on 15) The method of claim 15, wherein the one or more new virtual points grouped as at least three virtual points to form a polygon, and wherein the method further comprises generating the 3D polygonal data based on the at least three new virtual points. ### Claim 19 (depends on 15) The method of claim 15, further comprising: combining the one or more new virtual points with existing virtual points; and generating the 3D polygonal data based on a combination of the one or more new virtual points and the existing virtual points. ### Claim 20 (depends on 15) The method of claim 15, further comprising: receiving a plurality of new virtual points from a plurality of client devices of a plurality of users; and generating the 3D polygonal data based on a combination of the plurality of new virtual points and existing virtual points.