# US 2019/0318542 A1 · System and method for creating virtual and augmented reality environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318542 A1
- Document ID: US20190318542A1
- Status: Published application
- Kind: A1
- Application number: 16/384,910
- Filed: 2019-04-15
- Published: 2019-10-17
- Earliest claimed: 2018-04-13
- Assignees: Scapic Innovations Private Limited
- Applicants: SCAPiC INNOVATiONS PRIVATE LIMITED
- Inventors: VARAHUR KANNAN SAI KRISHNA; AJAY PONNA VENKATESHA
- Web page: https://patentgrep.com/patent/US20190318542A1

## CPC

- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06T 17/10: Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/20: in augmented reality scenes
- G06V 20/64: Three-dimensional [3D] objects
- G06T 2210/61: Scene description
- G06T 2219/2008: Assembling, disassembling
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The embodiments herein provide a system and method for generating data for a three-dimensional (3D) environment using existing information from a virtual or augmented reality scene is disclosed. The method includes reading data from a data store. The data comprising component identifying data and component position data for at least one of said 3D components. Further, the component data is analyzed for at least one identified component from a data store, the component data including at least 3D geometry data for the component. Thereafter, at least one component of the 3D geometry data is transformed using component position data to provide 3D virtual environment data for a specific 3D virtual environment. The 3D virtual environment data defines a substantially contiguous 3D surface enclosing the 3D virtual environment. The system includes a scene recognizer, parser, asset mapper, machine learning driven design algorithm, and asset store reorganizer.

## Claims

### Claim 1

A system for generating virtual environment and providing contents/suggestions in a Virtual and Augmented reality scene, the system comprising:
a scene recognizer module configured for receiving a scene as an input from a user, and wherein the user is enabled to upload one or more new scenes or select one or more existing scenes from a predefined list of scenes available in an asset store, and wherein the scene recognizer is configured for analysing the one or more scenes to identify scene intents and scene entity;
a parser module coupled to the scene recognizer, wherein the parser module is configured for converting the scene intents and scene entities into a format compatible with an editor of the asset store;
an asset mapping module coupled to the parser module, wherein the asset mapping module comprises a plurality of pre-trained data sets and one or more machine learning algorithms, and wherein the asset mapping module is configured for additively generating a new scene from the intents and entities using pre-trained data sets and one or more machine learning algorithms; and
a display module coupled to the asset mapper, and wherein the display module is configured for displaying the generated scene to the user for selection, and wherein upon selection by the user, the scene is previewed with appropriate toggles to select, unselect and revert selections for generating the scene with desired effects.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the scene intent comprises holistic image recognition of the scene and wherein the scene entity comprises one or more individually recognized elements in the scene and wherein the elements in the scene are recognized by identifying 3D component geometry data and position data.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the 3D component geometry data of the recognized element is transformed using position data to provide 3D virtual environment data for a specific 3D virtual environment.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the asset store comprises a catalog of 3D component geometry data with one or more visual appearances, and wherein the one or more visual appearances are provided by a plurality of textures.

### Claim 5 (depends on 1)

The system according to claim 1, wherein the 3D component geometry data comprises data for at least two sets of 3D components preferably with the same basic connectivity and general shape but with one or more visual appearances.

### Claim 6 (depends on 1)

The system according to claim 1, wherein each component is theme based, and wherein each 3D component's visual appearance is varied based on the surrounding look and feel.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the 3D virtual environment data defines a substantially contiguous 3D surface enclosing the 3D virtual environment.

### Claim 8 (depends on 1)

The system according to claim 1, wherein the new scene generated by the system further comprises one or more unique characteristics, and wherein the one or more unique characteristics comprise scene effects, 2D scene element, 3D scene element and scene descriptor text.

### Claim 9 (depends on 1)

The system according to claim 1, further comprises contextual recommendations module configured for providing continuous contextual recommendations based on user actions and preferences, and wherein the contextual recommendations consider selection choices made by user as a weighted average to reorganize the content with reference to intent and entities in the asset store.

### Claim 10

A computer implemented method comprising instructions stored on a computer readable non transitory storage medium and executed on hardware processor in a computing system for generating virtual environment and for providing suggestions in a Virtual and Augmented reality scene through one or more applications, the method comprising the steps of:
receiving a scene as an input from a user, and wherein the user is enabled to upload one or more new scenes or select one or more existing scenes from a predefined list of scenes available in an asset store;
analysing the one or more scenes to identify scene intents and scene entity, the scene intent comprises holistic image recognition of the scene and the scene entity comprises one or more individually recognized elements in the scene and wherein the recognizing elements in the scene further comprises identifying 3D component geometry data and position data;
transforming at least one component of the 3D component geometry data using position data to provide 3D virtual environment data for a specific 3D virtual environment; and
combining the transformed data to provide 3D virtual environment data for said 3D virtual environment.

### Claim 11 (depends on 10)

The method according to claim 10, wherein each component comprises one or more interface portions for interfacing to other components.

### Claim 12 (depends on 10)

The method according to claim 10, further comprises the step of enabling component geometry to close the interface when the interface is not used in order to connect to another component using the interface portion, and wherein the interface portion is associated with a plug comprising plug data.

### Claim 13 (depends on 10)

The method according to claim 10, further comprises the step of mapping the scenes into a pre-trained dataset using an asset mapper, and wherein the asset mapper is configured for additively generating a new scene from the intents and entities, and wherein the new scene comprises one or more unique characteristics, and wherein the one or more characteristics comprise scene effects, 2D scene element, 3D scene element, and scene descriptor text.

### Claim 14 (depends on 10)

The method according to claim 10, further comprises the step of displaying the generated scene to the user for selection.

### Claim 15 (depends on 10)

The method according to claim 10, further comprises the step of previewing the selected scene to the user with appropriate toggles to select, unselect and revert selections for generating the scene with desired effects.
