# US 2010/0164953 A1 · Systems and methods for transporting physical objects from real physical life into virtual worlds

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0164953 A1
- Document ID: US20100164953A1
- Status: Published application
- Kind: A1
- Application number: 12/317,737
- Filed: 2008-12-29
- Published: 2010-07-01
- Earliest claimed: 2008-12-29
- Assignees: Intel Corporation
- Inventors: Rita H. Wouhaybi; Mic Bowman; Robert Knauerhase
- Web page: https://patentgrep.com/patent/US20100164953A1

## CPC

- G06F 3/002: {Specific input/output arrangements not covered by G06F3/01 - G06F3/16 (other optical apparatus G02B27/00)}
- A63F 13/20: Input arrangements for video game devices
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for transporting physical objects from real physical life into virtual worlds. Briefly stated, the method includes receiving characteristic and structure data from an object constructed in the real world. The characteristic and structure data is obtained from the object using a plurality of sensors placed in the vicinity of the object to sense the characteristics and structure of the object. The characteristic and structure data of the object is used to produce code necessary to create an equivalent representation of the object in a virtual world.

## Claims

### Claim 1

A method for transporting physical objects into a virtual world comprising:
sensing characteristics and structure data of a physical object; and
transmitting the characteristics and structure data to a computing device, wherein the characteristic and structure data is automatically translated into code that when instantiated in a virtual world results in a virtual world object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the physical object comprises an object constructed by a user having a construction kit comprising a plurality of modular components that when connected together result in a physical object, wherein each of the modular components resemble real life components of objects that are annotated for ease of recognition.

### Claim 3 (depends on 2)

The method of claim 2, wherein each of the plurality of modular components comprises a predefined modular component having a unique identification and the annotations comprise texture, patterns, color, and corner markings with visual or infra-red paint.

### Claim 4 (depends on 1)

The method of claim 1, wherein sensing characteristics and structure data of a physical object comprises sensing the characteristics and structure data of the physical object using a plurality of intelligent sensors, the intelligent sensors being placed in the vicinity of the physical object in order to sense the characteristics and structure data of the object.

### Claim 5 (depends on 4)

The method of claim 4, wherein each of the plurality of intelligent sensors comprises a sensing component, a data synthesis component, a memory component, a transmission component, and a communication bus to enable communication between the sensing component, the data synthesis component, the memory component, and the transmission component.

### Claim 6 (depends on 4)

The method of claim 4, wherein the sensing component comprises a visual sensor, a temperature sensor, a motion sensor, a sound-based sensor, a laser sensor, an infra-red sensor, a combination thereof, or any other sensing component having the ability to sense the characteristics and structure of the physical object.

### Claim 7 (depends on 4)

The method of claim 4, wherein the data synthesis component comprises a tiny processing component for receiving the characteristics and structure data from the sensing component and queuing the characteristics and structure data for transmission to another sensing component or a software module on a computing device, wherein the tiny processor further comprising enough compute power to perform sophisticated processes.

### Claim 8 (depends on 4)

The method of claim 4, wherein the transmission component comprises a wireless communication component.

### Claim 9 (depends on 4)

The method of claim 4, wherein one of the plurality of intelligent sensors comprises a base station sensor for communicating with the remaining plurality of intelligent sensors, the base station sensor receiving all data from the remaining plurality of intelligent sensors and transmitting the data as input to a software module on the computing device.

### Claim 10 (depends on 9)

The method of claim 9, wherein the base station sensor performs data synthesis before transmitting the data as input to the software module.

### Claim 11 (depends on 1)

The method of claim 1, wherein the code comprises code based upon the virtual world in which the object is to be placed.

### Claim 12 (depends on 1)

The method of claim 1, wherein automatically translated into code comprises a mapping process wherein each modular component from the physical object is mapped to a corresponding component in a pre-defined library of a virtual world to obtain the code for the virtual world object.

### Claim 13 (depends on 1)

The method of claim 1, wherein if images of the real world object are taken, automatically translated into code comprises a mapping process wherein the images are mapped to images on pre-defined objects of a selected virtual world to obtain the code for the virtual world object.

### Claim 14 (depends on 9)

The method of claim 9, wherein if the physical object is recognized by the base station sensor, automatically translated into code comprises a mapping process wherein the physical object is mapped to a corresponding object or primitive of a selected virtual world.

### Claim 15

A method for transporting physical objects into a virtual world comprising:
enabling modular components having self-organizing embedded sensors that are assembled by a user to form a physical object to exchange information about their respective characteristics, structures, locations, and areas in which they inter-connect in order to perform sense-making to detect composite shapes;
mapping the composite shapes to corresponding composite shapes in the virtual world to obtain code for the object;
instantiating the code for the object within the virtual world to generate a virtual object; and
presenting the virtual object to the user, wherein if the interpretation of the virtual object is unsatisfactory, enabling the user to click on the virtual object to browse a pre-defined library and select a virtual object representative of the physical object.

### Claim 16 (depends on 15)

The method of claim 15, further comprising associating the data presented by the self-organizing embedded sensors with the selected virtual object from the pre-defined library as a learning mechanism such that if a user builds the same physical object again, the data presented by the self-organizing embedded sensors will result in the selected virtual object being instantiated.

### Claim 17 (depends on 15)

The method of claim 15, wherein the characteristics of the sensors comprises shape, color, texture, and size.

### Claim 18

A method for creating virtual objects comprising:
conveying one or more pictures of a physical object as input to a software module on a computing device; and
using graphical and visualization techniques coupled with image and object recognition techniques to map the physical object into an equivalent or similar object in the virtual world.

### Claim 19 (depends on 18)

The method of claim 18, wherein the one or more pictures of the physical object are taken using a camera, wherein the one or more pictures are conveyed via a wireless or wired connection to the computing device.

### Claim 20 (depends on 18)

The method of claim 18, wherein the one or more pictures of the physical object are obtained from one of a book, magazine, or some other printed publication, wherein the one or more pictures are conveyed to the computing device by scanning the one or more pictures into the computing device.

### Claim 21

An article comprising: a storage medium having a plurality of machine accessible instructions, wherein when the instructions are executed by a processor, the instructions provide for sensing characteristics and structure data of a physical object; and
transmitting the characteristics and structure data to a computing device, wherein the characteristic and structure data is automatically translated into code that when instantiated in a virtual world results in a virtual world object.

### Claim 22 (depends on 21)

The article of claim 21, wherein the physical object comprises an object constructed by a user having a construction kit comprising a plurality of modular components that when connected together result in a physical object, wherein each of the modular components resemble real life components of objects that are annotated for ease of recognition.

### Claim 23 (depends on 21)

The article of claim 21, wherein each of the plurality of modular components comprises a predefined modular component having a unique identification and the annotations comprise texture, patterns, color, and corner markings with visual or infra-red paint.

### Claim 24 (depends on 21)

The article of claim 21, wherein sensing characteristics and structure data of a physical object comprises instructions for sensing the characteristics and structure data of the physical object using a plurality of intelligent sensors, the intelligent sensors being placed in the vicinity of the physical object in order to sense the characteristics and structure data of the object.

### Claim 25 (depends on 23)

The article of claim 23, wherein each of the plurality of intelligent sensors comprises a sensing component, a data synthesis component, a memory component, a transmission component, and a communication bus to enable communication between the sensing component, the data synthesis component, the memory component, and the transmission component.

### Claim 26 (depends on 23)

The article of claim 23, wherein one of the plurality of intelligent sensors comprises at least one base station sensor for communicating with the remaining plurality of intelligent sensors, the article further comprising instructions for the base station sensor receiving all data from the remaining plurality of intelligent sensors and transmitting the data as input to a software module on the computing device.

### Claim 27 (depends on 25)

The article of claim 25, wherein the base station sensor performs data synthesis before transmitting the data as input to the software module.

### Claim 28 (depends on 21)

The article of claim 21, wherein automatically translated into code comprises instructions for a mapping process wherein each modular component from the physical object is mapped to a corresponding component in a pre-defined library of a virtual world to obtain the code for the virtual world object.

### Claim 29 (depends on 21)

The article of claim 21, wherein if images of the real world object are taken, automatically translated into code comprises instructions for a mapping process wherein the images are mapped to images on pre-defined objects of a selected virtual world to obtain the code for the virtual world object.

### Claim 30 (depends on 21)

The article of claim 21, wherein if the physical object is recognized by the base station sensor, automatically translated into code comprises instructions for a mapping process wherein the physical object is mapped to a corresponding object or primitive of a selected virtual world.
