# US 2014/0192247 A1 · Method for controlling camera operation based on haptic function and terminal supporting the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192247 A1
- Document ID: US20140192247A1
- Status: Published application
- Kind: A1
- Application number: 14/149,433
- Filed: 2014-01-07
- Published: 2014-07-10
- Earliest claimed: 2013-01-07
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Cheolho CHEONG; Dongjin Koh
- Web page: https://patentgrep.com/patent/US20140192247A1

## CPC

- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G03B 37/02: with scanning movement of lens or cameras
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)

## Abstract

A method for providing camera operations using a haptic function, and an electronic device implementing the same are provided. The method of operating the electric device includes receiving, by an electronic device including a camera, an input to activate the camera; receiving a request to output guidance information for assisting with photographing with the camera; determining haptic feedback corresponding to the guidance information; and outputting the determined haptic feedback.

## Claims

### Claim 1

A method for operating an electric device, the method comprising:
receiving, by an electronic device including a camera, an input to activate the camera;
receiving a request to output guidance information for assisting with photographing with the camera;
determining haptic feedback corresponding to the guidance information; and
outputting the determined haptic feedback.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the haptic feedback comprises:
calculating a virtual image area to be photographed in sequence based on a previously photographed image;
calculating correlation information between a current preview area and the virtual image area; and
determining the haptic feedback according to the correlation information.

### Claim 3 (depends on 2)

The method of claim 2, wherein determining the haptic feedback comprises determining the haptic feedback such that the haptic feedback guides a user to move the camera so that the current preview area becomes identical to the virtual image area.

### Claim 4 (depends on 2)

The method of claim 2, wherein the correlation information includes at least one of a distance between an image of the current preview area and the virtual image, angle difference, directional nature, overlapping nature, overlapping ratio of boundary line, overlapping ratio of area, overlapping area of volume, overlapped area, or length of overlapped boundary line.

### Claim 5 (depends on 2)

The method of claim 2, wherein determining the haptic feedback determines a type or amplitude of haptic feedback according to the size of the correlation information.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining the haptic feedback comprises adjusting at least one of a strength, amplitude, intensity, frequency, duration, time, period, pattern, number of vibrations, temperature, air pressure, or electrostatics of the haptic feedback.

### Claim 7 (depends on 1)

The method of claim 1, further comprising collecting context information including at least one of a terminal grip or contact location, camera location, camera state, angle, azimuth, rotation, service state, camera movement, object movement, GPS, geomagnetism, gyro compass, acceleration, angular velocity, horizontality, contact detection, expansion ratio, focusing information, motion recognition, or distance to object.

### Claim 8 (depends on 1)

The method of claim 1, wherein determining the haptic feedback comprises adjusting at least one of a predefined strength, pattern, frequency, or drive order of a plurality of haptic devices.

### Claim 9 (depends on 7)

The method of claim 7, wherein determining the haptic feedback comprises providing the haptic feedback including at least one of a terminal contact location obtained in the collection of context information, or an adjacent location within a predetermined distance from the terminal contact location.

### Claim 10 (depends on 1)

The method of claim 1, wherein the guidance information includes information for facilitating with at least one of a panorama image photography mode, an action shot image photography mode, a face recognition mode, an image-based barcode recognition mode, or a card recognition mode.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
selecting the panorama image photography mode or the action shot image photography mode;
deactivating components related to the haptic feedback after activating the camera; and,
activating the components related to the haptic feedback if a first image is photographed.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
selecting the panorama image photography mode;
identifying whether motion information of a specific object is included in a preview image; and,
outputting a haptic feedback warning while temporarily stopping storing and synthesizing an image if the motion information is included.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
selecting the action shot image photography mode;
identifying whether motion information of specific object is included in a preview image; and
calculating an estimated motion of object and outputting a haptic feedback based on the calculation if the motion information is included.

### Claim 14

An electronic device, comprising:
a camera configured to obtain an image;
a processor configured to determine haptic feedback corresponding to guidance information for assisting with photographing with the camera, if an output of the guidance information is requested; and
a haptic device module configured to output the determined haptic feedback.

### Claim 15 (depends on 14)

The electronic device of claim 14, wherein the processor is further configured to:
calculate a virtual image area to be photographed in sequence based on a previously photographed image;
calculate correlation information between a current preview area and the virtual image area; and
determine the haptic feedback according to the correlation information.

### Claim 16 (depends on 15)

The electronic device of claim 15, wherein the processor determines the haptic feedback by instructing so that the current preview area becomes identical to the virtual image area.

### Claim 17 (depends on 15)

The electronic device of claim 15, wherein the correlation information includes at least one of a distance between an image of the current preview area and the virtual image, angle difference, directional nature, overlapping nature, overlapping ratio of boundary line, overlapping ratio of area, overlapping area of volume, overlapped area, or length of overlapped boundary line.

### Claim 18 (depends on 15)

The electronic device of claim 15, wherein the processor determines a type and amplitude of haptic feedback differently according to a size of the correlation information.

### Claim 19 (depends on 14)

The electronic device of claim 14, further comprising a context information collecting module configured to collect information including at least one of a terminal grip or contact location, camera location, camera state, angle, azimuth, rotation, service state, camera movement, object movement, GPS, geomagnetism, gyro compass, acceleration, angular velocity, horizontality, contact detection, expansion ratio, focusing information, motion recognition, or distance to object.

### Claim 20 (depends on 19)

The electronic device of claim 19, wherein the processor determines the haptic feedback by adjusting at least one of a predefined strength, pattern, frequency, or drive order of a plurality of haptic devices.

### Claim 21 (depends on 19)

The electronic device of claim 19, wherein the processor controls to provide the haptic feedback including at least one of a terminal contact location obtained in the collecting context information, or an adjacent location within a predetermined distance from the terminal contact location.

### Claim 22 (depends on 14)

The electronic device of claim 14, further comprising an input unit configured to generate an input signal or a display unit having an input function to select at least one of a panorama image photography mode, action shot image photography mode, face recognition mode, image-based barcode recognition mode, or card recognition mode.

### Claim 23 (depends on 22)

The electronic device of claim 22, wherein the processor deactivates components related to the haptic feedback after activating the camera, and activates the components related to the haptic feedback after a first image is photographed, if the panorama image photography mode or action shot image photography mode is selected.

### Claim 24 (depends on 22)

The electronic device of claim 22, wherein the processor temporarily stops storing and synthesizing an image, and outputs a haptic feedback warning, if motion information of a specific object is identified to be included in a preview image when the panorama image photography mode is selected.

### Claim 25 (depends on 22)

The electronic device of claim 22, wherein the processor calculates an estimated motion of an object and controls to output haptic feedback warning based on the calculation, if motion information of a specific object is identified to be included in a preview image when the action shot image photographing mode is selected.

### Claim 26 (depends on 14)

The electronic device of claim 14, wherein the haptic device module comprises at least one of a motor, vibrator, mechanical, electromechanical, electromagnetic, piezoelectric, acoustic generator, heat generator, cooler, pneumatic, or microfluidic haptic device.

### Claim 27 (depends on 26)

The electronic device of claim 26, wherein the processor controls to output the determined haptic feedback by applying at least one of a strength of haptic, frequency, duration time, period, pattern, number of vibration, temperature, air pressure, or electrostatics of the haptic devices.

### Claim 28

A method of operating an electronic device, the method comprising:
receiving, by an electronic device including a camera and one or more haptic devices, an input to activate the camera;
determining, by the electronic device, one or more of a desired position, orientation, or movement of the electronic device for an operation of the camera; and
activating, by the electronic device, at least one of the one or more haptic devices, based on the determined one or more of the desired position, orientation, or movement.

### Claim 29 (depends on 28)

The method of claim 28, wherein the electronic device further comprises a sensor configured to determine at least one of a position or an orientation of the electronic device, and wherein determining the one or more of the desired position, orientation, or movement comprises using at least one of the sensor or an image provided by the camera.

### Claim 30 (depends on 28)

The method of claim 28, wherein activating the at least one of the one or more haptic devices comprises selecting the at least one of the one or more the haptic devices, which corresponds to the one or more of the desired position, orientation, or movement.

### Claim 31

An electronic device comprising:
a camera configured to obtain an image;
a processor configured to receive an input to activate the camera, and to determine one or more of a desired position, orientation, or movement of the electronic device for an operation of the camera; and
one or more haptic devices,
wherein the processor is further configured to activate at least one of the one or more haptic devices, based on the determined one or more of the desired position, orientation, or movement.

### Claim 32 (depends on 31)

The electronic device of claim 31, further comprising a sensor configured to determine at least one of a position or orientation of the electronic device,
wherein the processor is further configured to determine the one or more of the desired position, orientation, or movement using at least one of the sensor or an image provided by the camera.

### Claim 33 (depends on 31)

The electronic device of claim 31, wherein the processor is further configured to select the at least one of the one or more the haptic devices corresponding to the one or more of the desired position, orientation, or movement.

### Claim 34 (depends on 31)

The electronic device of claim 31, wherein the processor is further configured to determine an object movement using one or more images provided by the camera, to determine one or more of a position or a movement direction of the object, and to determine the one or more of the desired position, orientation, or movement of the electronic device using the one or more of the position or the movement direction of the object.
