# US 2019/0377482 A1 · Electronic device and system for generating object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377482 A1
- Document ID: US20190377482A1
- Status: Published application
- Kind: A1
- Application number: 16/437,892
- Filed: 2019-06-11
- Published: 2019-12-12
- Earliest claimed: 2018-06-12
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sangmin SHIN; Donghoon KANG; Jikwang KANG; Zion KWON; Jeonghoon KIM; Hojin JEON; Yeunwook LIM
- Web page: https://patentgrep.com/patent/US20190377482A1

## CPC

- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04162: {for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware}
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04W 4/026: {using orientation information, e.g. compass}
- G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
- G06T 3/60: Rotation of whole images or parts thereof
- G06T 15/10: Geometric effects
- H04W 4/33: for indoor environments, e.g. buildings
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Electronic device and system. Electronic device includes a housing, a touch screen display disposed within housing and exposed through at least a portion of housing, a camera, a wireless communication circuit disposed within housing, a position sensor, a motion sensor, a processor disposed within housing and operatively connected to display, camera, wireless communication circuit, position sensor, and motion sensor, and a memory disposed within housing and operatively connected to processor, wherein the memory is configured to store instructions causing, upon execution, the processor to capture an image by using the camera, receive the captured image from the camera, receive position data associated with the captured image from the position sensor, receive orientation data associated with the captured image from the motion sensor, receive a user input for adding an object to the captured image through the display, and transmit the object, the captured image, the position data, and the orientation data to an external server through the wireless communication circuit.

## Claims

### Claim 1

An electronic device, comprising:
a housing;
a touch screen display disposed within the housing and exposed through at least a portion of the housing;
a camera;
a wireless communication circuit disposed within the housing;
a position sensor;
a motion sensor;
a processor disposed within the housing and operatively connected to the display, the camera, the wireless communication circuit, the position sensor, and the motion sensor; and
a memory disposed within the housing and operatively connected to the processor,
wherein the memory is configured to store instructions causing, upon execution, the processor to:
capture an image by using the camera,
receive the captured image from the camera,
receive position data associated with the captured image from the position sensor,
receive orientation data associated with the captured image from the motion sensor,
receive a user input for adding an object to the captured image through the display, and
transmit the object, the captured image, the position data, and the orientation data to an external server through the wireless communication circuit.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the instructions further cause, upon execution, the processor to receive the user input using a stylus pen.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the object includes at least one of text, a symbol, a geometric form, and an image.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the instructions further cause, upon execution, the processor to:
receive a first user input of constructing a geometric form on the captured image, and
receive a second user input of writing text at least partially overlapped with the geometric form on the captured image.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the instructions further cause, upon execution, the processor to:
change a direction of the text in accordance with the geometric form, and
transmit information about the changed direction to the server.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the instructions further cause, upon execution, the processor to:
receive a third user input of moving the text in the captured image, and
display the moved text on the display without displaying the geometric form.

### Claim 7 (depends on 5)

The electronic device of claim 5, wherein the instructions further cause, upon execution, the processor to:
identify three-dimensional (3D)-related information corresponding to the geometric form, and
change the direction of the text, based on the identified 3D-related information.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the 3D-related information includes data on at least one of coordinates, angle, slope, width, length, height, and area, which corresponds to the geometric form.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein the instructions further cause, upon execution, the processor to:
receive a multi-touch input, and
rotate the object at least in part, based on the received multi-touch input.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the multi-touch input includes a first touch input for determining a rotation axis of the object, and a second touch input for determining a rotation direction of the object.

### Claim 11 (depends on 2)

The electronic device of claim 2, wherein the instructions further cause, upon execution, the processor to:
receive tilt information of the stylus pen from the stylus pen, and
rotate the object at least in part, based on the received tilt information.

### Claim 12 (depends on 1)

The electronic device of claim 1, further comprising:
a pressure sensor,
wherein the instructions further cause, upon execution, the processor to:
receive pressure information associated with the user input from the pressure sensor, and
generate the object, based on the received pressure information.

### Claim 13 (depends on 1)

The electronic device of claim 1, wherein the instructions further cause, upon execution, the processor to:
generate the object in accordance with the received user input, and
store the generated object in the memory.

### Claim 14

A system, comprising:
a network interface;
a processor operatively connected to the network interface; and
a memory operatively connected to the processor,
wherein the memory is configured to store instructions causing, upon execution, the processor to:
receive first data from a first external electronic device including a display and a camera via the network interface, wherein the first data includes an image, position data associated with the image, orientation data associated with the image, and an object generated in response to a user input to be overlapped with the image,
process the first data such that a direction of the object is applied on the image, based on, at least in part, the position data, the orientation data, or the user input received from the first external electronic device, and
transmit the processed first data to another external electronic device via the network interface.

### Claim 15 (depends on 14)

The system of claim 14, wherein the instructions further cause, upon execution, the processor to:
receive an image, position data associated with the image, and orientation data associated with the image from a second external electronic device including a display and a camera via the network interface, and
transmit the object to the second external electronic device via the network interface such that the object is displayed on the display of the second external electronic device, wherein the orientation data is applied to the displayed object.

### Claim 16 (depends on 14)

The system of claim 14, wherein the instructions further cause, upon execution, the processor to:
receive a first user input of constructing a geometric form on the image and a second user input of writing text at least partially overlapped with the geometric form, and
transmit the text to the another external electronic device, wherein a direction of the text is changed in accordance with the geometric form.

### Claim 17 (depends on 16)

The system of claim 16, wherein the instructions further cause, upon execution, the processor to:
receive a third user input of moving the text, and
transmit the moved text to the another external electronic device without displaying the geometric form.

### Claim 18 (depends on 16)

The system of claim 16, wherein the instructions further cause, upon execution, the processor to:
identify three-dimensional (3D)-related information corresponding to the geometric form, and
transmit the direction-changed text to the another external electronic device, based on the identified 3D-related information.

### Claim 19 (depends on 14)

The system of claim 14, wherein the instructions further cause, upon execution, the processor to:
receive a multi-touch input, and
rotate the object at least in part, based on the received multi-touch input.

### Claim 20 (depends on 14)

The system of claim 14, further comprising:
a stylus pen,
wherein the instructions further cause, upon execution, the processor to:
receive tilt information of the stylus pen from the stylus pen, and
rotate the object at least in part, based on the received tilt information.
