# US 2016/0259409 A1 · Device for object manipulating with multi-input sources

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259409 A1
- Document ID: US20160259409A1
- Status: Published application
- Kind: A1
- Application number: 13/147,069
- Filed: 2010-01-29
- Published: 2016-09-08
- Earliest claimed: 2009-01-29
- Assignees: Samsung Electronics Co., Ltd.
- Inventors: Hyun Jeong Lee; Seung Ju Han; Joon Ah Park; Wook Chang; Jeong Hwan Ahn
- Web page: https://patentgrep.com/patent/US20160259409A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- A63F 13/21: characterised by their sensors, purposes or types
- A63F 13/285: Generating tactile feedback signals via the game input device, e.g. force feedback
- A63F 13/56: Computing the motion of game characters with respect to other game characters, game objects or elements of the game scene, e.g. for simulating the behaviour of a group of virtual soldiers or for path finding
- A63F 13/58: by computing conditions of game characters, e.g. stamina, strength, motivation or energy level
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 17/10: Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
- A63F 2300/1037: being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
- A63F 2300/5553: user representation in the game field, e.g. avatar
- A63F 2300/65: for computing the condition of a game character
- A63F 2300/6607: for animating game characters, e.g. skeleton kinematics
- A63F 2300/6623: for animating a group of characters
- A63F 2300/8082: Virtual reality
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An object manipulation apparatus and method model an object for manipulation of a virtual object, suggest object operation schema, define a physical and mental condition of an avatar, and set motion data of the avatar.

## Claims

### Claim 1

An object manipulation device comprising:
an object modeling unit configured by a processor to set a structure of a virtual object; and
an object operating unit configured by the processor to select the virtual object and control an object operation of the selected virtual object,
wherein a model of the virtual object comprises general information, an object identifier, and object attributes,
wherein the object identifier comprises an object identification, an object state, and modifiable attributes,
wherein the object state comprises available status, selected status, and unavailable status
wherein the modifiable attributes comprise available status and unavailable status, and
wherein the object operating unit is responsive to one of the statuses of the object state and one of the statuses of the modifiable attributes.

### Claim 2 (depends on 1)

The object manipulation device of claim 1, wherein the virtual object comprises at least one of general information on the virtual object, an object identifier for identification of the virtual object in a virtual world, and object attributes comprising at least one attribute of the virtual object.

### Claim 3 (depends on 2)

The object manipulation device of claim 2, wherein the object identifier comprises at least one of an object ID allocated to the virtual object, an object state for recognition of a state of the virtual object, and modifiable attributes for determining modifiability of attributes of the virtual object.

### Claim 4 (depends on 2)

The object manipulation device of claim 2, wherein the object attributes comprises at least one of spatial attributes, physical attributes, temporal attributes, and combinational attributes.

### Claim 5 (depends on 4)

The object manipulation device of claim 4, wherein the spatial attributes comprise at least one of a shape, a location, and a size of the virtual object, the physical attributes comprise at least one of a tactile sensation, a pressure, a vibration, and a temperature of the virtual object, and the temporal attributes comprise at least one of a duration and a motion of the virtual object.

### Claim 6 (depends on 1)

The object manipulation device of claim 1, wherein the object operating unit controls at least one performance of selection of the virtual object, collection of object attributes of the virtual object, modification of the object attributes of the virtual object, and removal and storing of the object attributes of the virtual object.

### Claim at position 7

7-11. (canceled)

### Claim 12 (depends on 1)

The object manipulation device of claim 1, further comprising:
a computer comprising the processor,
wherein the object attributes comprise spatial attributes, physical attributes, temporal attributes, and combinations,
wherein the spatial attributes comprise shape, location, and size,
wherein the physical attributes comprise tactile, pressure or force, vibration, and temperature, and
wherein the temporal attributes comprise duration and motion.

### Claim 13 (depends on 12)

The object manipulation device of claim 12, wherein the virtual object comprises at least one of general information on the virtual object, an object identifier for identification of the virtual object in a virtual world, and object attributes comprising at least one attribute of the virtual object.

### Claim 14 (depends on 13)

The object manipulation device of claim 13, wherein the object identifier comprises at least one of an object ID allocated to the virtual object, an object state for recognition of a state of the virtual object, and modifiable attributes for determining modifiability of attributes of the virtual object.

### Claim 15 (depends on 13)

The object manipulation device of claim 13, wherein the object attributes comprises at least one of spatial attributes, physical attributes, temporal attributes, and combinational attributes.

### Claim 16

An object manipulation method comprising:
setting, by an object modeling unit of a computer, a structure of a virtual object; and
selecting, by an object operating unit of the computer, the virtual object and control an object operation of the selected virtual object,
wherein a model of the virtual object comprises general information, an object identifier, and object attributes,
wherein the object identifier comprises an object identification, an object state, and modifiable attributes,
wherein the object state comprises available status, selected status, and unavailable status,
wherein the modifiable attributes comprise available status and unavailable status, and
wherein the object operating unit is responsive to one of the statuses of the object state and one of the statuses of the modifiable attributes.

### Claim 17 (depends on 16)

The object manipulation method of claim 16, wherein the virtual object comprises at least one of general information on the virtual object, an object identifier for identification of the virtual object in a virtual world, and object attributes comprising at least one attribute of the virtual object.

### Claim 18 (depends on 17)

The object manipulation method of claim 17, wherein the object identifier comprises at least one of an object ID allocated to the virtual object, an object state for recognition of a state of the virtual object, and modifiable attributes for determining modifiability of attributes of the virtual object.

### Claim 19 (depends on 17)

The object manipulation method of claim 17, wherein the object attributes comprises at least one of spatial attributes, physical attributes, temporal attributes, and combinational attributes.

### Claim 20 (depends on 16)

A non-transitory computer-readable recording medium controlling a computer to execute the method of claim 16.

### Claim 21

An object manipulation device comprising:
a processor configured to
import an object identifier from a virtual world engine based on an predefined object model, wherein the predefined object model defines that the object identifier comprises an object state and an modifiable attributes, wherein the object state comprises available status, selected status, and unavailable status, and wherein the modifiable attributes comprise available status and unavailable status;
import an object information from the virtual world engine based on the predefined object model, wherein the predefined object model further defines that the object information comprises spatial attributes, physical attributes, and temporal attributes;
manipulate the object information by modifying, removing, restoring, or combining at least one of the spatial attributes, the physical attributes, and the temporal attributes; and
export the manipulated object information to the virtual world engine.

### Claim 22 (depends on 21)

The object manipulation device of claim 21, wherein the processor is further configured to:
receive a first sensor input command from a sensor, wherein the first sensor input command corresponds to a selecting operation;
import the object identifier, based on the first sensor input command;
check the object state from the imported object identifier to determine whether the object state has an available status, a selected status, or an unavailable status;
responsive to the object state having an available status, set the object state to indicate a selected status;
import the object information;
receive a second sensor input command from the sensor, wherein the second sensor input command corresponds to manipulating operation;
check the modifiable attributes from the imported object identifier to determine whether the modifiable attributes has an available status or an unavailable status; and
responsive to the modifiable attributes having an available status, manipulate the object information based on the second sensor input command, and export the manipulated object information.

### Claim 23 (depends on 22)

The object manipulation device of claim 22, wherein:
the spatial attributes comprise shape, location, and size;
the physical attributes comprise tactile, pressure or force, vibration, and temperature; and
the temporal attributes comprise duration, and motion.

### Claim 24 (depends on 22)

The object manipulation device of claim 22, wherein, if the object state indicates an unavailable status, the processor is further configured not to perform the selecting operation; and if the modifiable attributes indicate an unavailable status, the processor is further configured not to perform the manipulating operation.