# US 12,118,686 B2 · Virtualization, visualization and autonomous design and development of objects > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,686 B2 - Document ID: US12118686B2 - Status: Granted - Kind: B2 - Application number: 18/464,203 - Filed: 2023-09-09 - Published: 2023-12-28 - Granted: 2024-10-15 - Earliest claimed: 2016-03-08 - Assignees: Az, LLC - Applicants: Sana Rezgui - Inventors: Sana Rezgui - Web page: https://patentgrep.com/patent/US12118686B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) - G06F 30/347: Physical level, e.g. placement or routing - G06F 30/39: Circuit design at the physical level (physical level design for reconfigurable circuits G06F30/347) - G06F 40/103: Formatting, i.e. changing of presentation of documents (automatic justification G06F40/189; automatic line break hyphenation G06F40/191) - G06F 40/137: Hierarchical processing, e.g. outlines - G06F 2111/18: using virtual or augmented reality - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An integrated platform is provided that enables the various steps of development operations from design to sales, the virtualization, the visualization and the interpretation of a device so it may be fully created (designed), viewed, manipulated, packaged, simulated, tested, published and marketed right from within the platform. The resulting virtual device (VD) may be a multi-layered, -dimensional, -angular, -disciplinary, -documentarian, -service, manipulated and used in multiple ways. The provided VD may include visual representations of the VD via a traditional display device in a non-immersive environment and/or within an immersive environment via new virtual-reality (VR) devices. For instance, a user may create, manipulate, in real-time, layered multi-dimensional views of a VD in a virtual-reality, augmented-reality (AR), augmented virtual-reality (AVR), and/or mixed-reality (MR) environments. ## Claims ### Claim 1 One or more non-transitory computer-readable storage media having instructions stored thereon, which, when executed by one or more processors of a computing device cause the computing device to perform actions comprising: receiving one or more documents, wherein at least one of the received documents includes descriptive information indicating one or more physical layouts of one or more objects; accessing a library associated with at least one of the objects, documentation in the library being updated with new information regarding the one or more objects when the new information is received; generating one or more virtual objects based at least in part on at least one of the physical layouts of the at least one of the objects and the library associated with the at least one of the objects, the one or more virtual objects including one or more representations of the at least one of the objects; generating one or more visualizations of at least one of the virtual objects; and providing and positioning at least one of the visualizations of the at least one of the virtual objects within one or more environments, wherein the one or more environments including at least one of: one or more non-immersive environments and one or more immersive environments, and wherein at least one of the immersive environments including at least one of a virtual-reality (VR) environment, an augmented VR environment, an augmented-reality (AR) environment, and a mixed-reality (MR) environment. ### Claim 2 (depends on 1) The one or more computer-readable storage media of claim 1, wherein the actions further comprise: making at least one of the received documents, at least one of the virtual objects, at least one of the visualizations of at least one of the virtual objects, and least one of the environments accessible to others through one or more communication channels including at least one of: one or more clouds, the web, one or more applications, and one or more networked computing devices. ### Claim 3 (depends on 2) The one or more computer-readable storage media of claim 2, wherein the actions further comprise: receiving through at least one of the communication channels, one or more entries associated with at least one of the received documents, at least one of the objects, at least one of the virtual objects, at least one of the visualizations of at least one of the virtual objects and at least one of the environments; and updating at least one of the at least one of the received documents, the at least one of the objects, the at least one of the virtual objects, the at least one of the visualizations of the at least one of the virtual objects and the at least one of the environments based in part on at least one of the entries. ### Claim 4 (depends on 1) The one or more computer-readable storage media of claim 1, wherein the actions further comprise: receiving one or more animations of at least one of the objects; animating at least one of the virtual objects based in part on at least one of the animations; generating at least one of the visualizations of the at least one of the virtual objects; and providing the at least one of the visualizations of the at least one of the virtual objects within at least one of the environments. ### Claim 5 (depends on 4) The one or more computer-readable storage media of claim 4, wherein the actions further comprise: generating one or more animation models of at least one of the objects based at least in part on at least one of the received documents; and generating at least one of the animations of the at least one of the objects based at least in part on at least one of the animation models of the at least one of the objects. ### Claim 6 (depends on 4) The one or more computer-readable storage media of claim 4, wherein the actions further comprise: coordinating at least one of: at least one of the animations of at least one of the objects with at least another one of the animations of the at least one of the objects and at least one of the animations of at least one of the objects with at least one of the animations of at least another one of the objects; animating at least one of the virtual objects based in part on at least one of the coordinated animations; generating at least one of the visualizations of the at least one of the virtual objects; and providing the at least one of the visualizations of the at least one of the virtual objects within at least one of the environments. ### Claim 7 (depends on 1) The one or more computer-readable storage media of claim 1, wherein the actions further comprise: combining at least two or more of the virtual objects; generating at least one of the visualizations of the at least two or more virtual objects; and providing the at least one of the visualizations of the at least two or more virtual objects within at least one of the environments. ### Claim 8 A method comprising: receiving one or more documents, wherein at least one of the received documents includes descriptive information indicating one or more physical layouts of one or more objects; accessing a library associated with at least one of the objects, documentation in the library being updated with new information regarding the one or more objects when the new information is received; generating one or more virtual objects based at least in part on at least one of the physical layouts of the at least one of the objects and the library associated with the at least one of the objects, the one or more virtual objects including one or more representations of the at least one of the objects; generating one or more visualizations of at least one of the virtual objects; and providing and positioning at least one of the visualizations of the at least one of the virtual objects within one or more environments, wherein the one or more environments including at least one of: one or more non-immersive environments and one or more immersive environments, and wherein at least one of the immersive environments including at least one of a virtual-reality (VR) environment, an augmented VR environment, an augmented-reality (AR) environment, and a mixed-reality (MR) environment. ### Claim 9 (depends on 8) The method of claim 8, further comprising: making at least one of the received documents, at least one of the virtual objects, at least one of the visualizations of at least one of the virtual objects, and least one of the environments accessible to others through one or more communication channels including at least one of: one or more clouds, the web, one or more applications, and one or more networked computing devices. ### Claim 10 (depends on 9) The method of claim 9, further comprising: receiving through at least one of the communication channels, one or more entries associated with at least one of the received documents, at least one of the objects, at least one of the virtual objects, at least one of the visualizations of at least one of the virtual objects and at least one of the environments; and updating at least one of the at least one of the received documents, the at least one of the objects, the at least one of the virtual objects, the at least one of the visualizations of the at least one of the virtual objects and the at least one of the environments based in part on at least one of the entries. ### Claim 11 (depends on 8) The method of claim 8, further comprising: receiving one or more animations of at least one of the objects; animating at least one of the virtual objects based in part on at least one of the animations; generating at least one of the visualizations of the at least one of the virtual objects; and providing the at least one of the visualizations of the at least one of the virtual objects within at least one of the environments. ### Claim 12 (depends on 11) The method of claim 11, further comprising: generating one or more animation models of at least one of the objects based at least in part on at least one of the received documents; and generating at least one of the animations of the at least one of the objects based at least in part on at least one of the animation models of the at least one of the objects. ### Claim 13 (depends on 11) The method of claim 11, further comprising: coordinating at least one of: at least one of the animations of at least one of the objects with at least another one of the animations of the at least one of the objects and at least one of the animations of at least one of the objects with at least one of the animations of at least another one of the objects; animating at least one of the virtual objects based in part on at least one of the coordinated animations; generating at least one of the visualizations of the at least one of the virtual objects; and providing the at least one of the visualizations of the at least one of the virtual objects within at least one of the environments. ### Claim 14 (depends on 8) The method of claim 8, further comprising: combining at least two or more of the virtual objects; generating at least one of the visualizations of the at least two or more virtual objects; and providing the at least one of the visualizations of the at least two or more virtual objects within at least one of the environments. ### Claim 15 A computing system for generating a documentary of a source document comprising: a processor; and a computer-readable storage medium, coupled with the processor, having instructions stored thereon, which, when executed by the processor, execute actions comprising: receiving one or more documents, wherein at least one of the received documents includes descriptive information indicating one or more physical layouts of one or more objects; accessing a library associated with at least one of the objects, documentation in the library being updated with new information regarding the one or more objects when the new information is received; generating one or more virtual objects based at least in part on at least one of the physical layouts of the at least one of the objects and the library associated with the at least one of the objects, the one or more virtual objects including one or more representations of the at least one of the objects; generating one or more visualizations of at least one of the virtual objects; and providing and positioning at least one of the visualizations of the at least one of the virtual objects within one or more environments, wherein the one or more environments including at least one of: one or more non-immersive environments and one or more immersive environments, and wherein at least one of the immersive environments including at least one of a virtual-reality (VR) environment, an augmented VR environment, an augmented-reality (AR) environment, and a mixed-reality (MR) environment. ### Claim 16 (depends on 15) The computing system of claim 15, wherein the actions further comprise: making at least one of the received documents, at least one of the virtual objects, at least one of the visualizations of at least one of the virtual objects, and least one of the environments accessible to others through one or more communication channels including at least one of: one or more clouds, the web, one or more applications, and one or more networked computing devices. ### Claim 17 (depends on 16) The computing system of claim 16, wherein the actions further comprise: receiving through at least one of the communication channels, one or more entries associated with at least one of the received documents, at least one of the objects, at least one of the virtual objects, at least one of the visualizations of at least one of the virtual objects and at least one of the environments; and updating at least one of the at least one of the received documents, the at least one of the objects, the at least one of the virtual objects, the at least one of the visualizations of the at least one of the virtual objects and the at least one of the environments based in part on at least one of the entries. ### Claim 18 (depends on 15) The computing system of claim 15, wherein the actions further comprise: receiving one or more animations of at least one of the objects; animating at least one of the virtual objects based in part on at least one of the animations; generating at least one of the visualizations of the at least one of the virtual objects; and providing the at least one of the visualizations of the at least one of the virtual objects within at least one of the environments. ### Claim 19 (depends on 15) The computing system of claim 15, wherein the object is one of a semiconductor device, an organism, a human body, and a machine. ### Claim 20 (depends on 15) The computing system of claim 15, wherein the descriptive information includes one or more of image, text, drawing, speech, video, metadata of at least one of the object, the virtual object, the visualization of the virtual object and the environment.