# US 2019/0172456 A1 · Method for sharing photograph based on voice recognition, apparatus and system for the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172456 A1
- Document ID: US20190172456A1
- Status: Published application
- Kind: A1
- Application number: 16/191,342
- Filed: 2018-11-14
- Published: 2019-06-06
- Earliest claimed: 2017-12-05
- Assignees: Live Pictures Co.,Ltd.
- Applicants: Live Pictures Co.,Ltd.
- Inventors: SEOK-HEE LEE
- Web page: https://patentgrep.com/patent/US20190172456A1

## CPC

- H04L 9/50: {using hash chains, e.g. blockchains or hash trees}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 11/60: Creating or editing images; Combining images with text
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- H04L 9/3239: {involving non-keyed hash functions, e.g. modification detection codes [MDCs], MD5, SHA or RIPEMD}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Provided is a method for sharing a photograph based on voice recognition in an aspect. The method may include obtaining an image for a photograph taken using a camera; obtaining voice data associated with the obtained image; generating a text by recognizing the obtained voice data; associating and storing the obtained image, the obtained voice data and the generated text; and outputting the store image together with at least one of the stored voice data and the stored text.

## Claims

### Claim 1

A method for sharing a photograph based on voice recognition, the method comprising:
obtaining an image for a photograph taken using a camera;
obtaining voice data associated with the obtained image;
generating a text by recognizing the obtained voice data;
associating and storing the obtained image, the obtained voice data and the generated text; and
outputting the store image together with at least one of the stored voice data and the stored text.

### Claim 2 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, further comprising storing the obtained image, the obtained voice data and the generated text in a server,
wherein the data stored in the server is searched based on at least one of the voice data and the text.

### Claim 3 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein associating and storing the obtained image, the obtained voice data and the generated text comprises:
inserting the text into the image,
wherein the text is inserted to a first layer which is identical to a layer that the image inserted in or inserted into a second layer which is different from the layer that the image is inserted in.

### Claim 4 (depends on 3)

The method for sharing a photograph based on voice recognition of claim 3, wherein the insertion of the text into the first layer comprises:
inserting the text into an arbitrary area on the image;
identifying a first area in which the text is inserted; and
generating the image in which the text is inserted as an image file, wherein the image file is associated with identification information on the first area.

### Claim 5 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein the stored voice data is stored by being packaged with the image and the text.

### Claim 6 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein the stored voice data is stored in a separate storage, and wherein the image and the text are packaged with link information on the storage of the voice data.

### Claim 7 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein the associated voice data includes at least one of voice data associated with a photographer placed outside of a first space in relation to taking the photograph and voice data associated with a subject placed in the first space.

### Claim 8 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein associating and storing the obtained image, the obtained voice data and the generated text comprises:
analyzing voice of the obtained voice data, wherein the voice data includes a first voice data having a first voice characteristic and a second voice data having a second voice characteristic, and separating into the first voice data and the second voice data.

### Claim 9 (depends on 8)

The method for sharing a photograph based on voice recognition of claim 8, the generating a text by recognizing the obtained voice data comprising:
generating a first text by recognizing the separated first voice data; and
generating a second text by recognizing the separated second voice data, wherein the first text and the second text are associated with the first voice data and the second voice data, respectively.

### Claim 10 (depends on 9)

The method for sharing a photograph based on voice recognition of claim 9, wherein associating and storing the obtained image, the obtained voice data and the generated text comprises:
recognizing each of a first subject and a second subject included in the image by applying object recognition algorithm for the image;
associating the first subject included in the image with the first text; and
associating the second subject included in the image with the second text.

### Claim 11 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein associating and storing the obtained image, the obtained voice data and the generated text comprises:
identifying the voice data by comparing voice characteristic information associated with the obtained voice data with voice characteristic information previously stored in a voice database.

### Claim 12 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein a position of the text is determined by at least one of:
a first mode in which the text is automatically disposed in at least one position of a previously designated position and a position according to an image analysis result, among the area of the image; and
a second mode in which the text is disposed according to a user input.

### Claim 13 (depends on 12)

The method for sharing a photograph based on voice recognition of claim 12, further comprising:
analyzing a meaning of the text,
wherein the text is automatically disposed in an area corresponding to meaning analysis result when operating in the first mode.

### Claim 14 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, when the stored image is registered in Social Network Service (SNS), wherein the stored image is registered by generating hash tag automatically based on at least one of the image, the voice data, the text and metadata associated with the image.

### Claim 15 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, in outputting the text, based on an output order among a plurality of letters that construct the text, an output order among a plurality of strokes included in each of the plurality of letters and information on drawing from an output start point to an output end point of each of the plurality of strokes,
the text is outputted with a dictation format from a first letter to a last letter of the text.

### Claim 16 (depends on 1)

The method for sharing a photograph based on voice recognition of claim 1, wherein associating and storing the obtained image, the obtained voice data and the generated text comprises:
storing the information associated with the obtained image, the obtained voice data and the generated text in block-chain.

### Claim 17

An apparatus for sharing a photograph based on voice recognition, the apparatus comprising:
an information acquisition unit for obtaining an image for a photograph taken using a camera, and obtaining voice data associated with the obtained image;
a text transform unit for generating a text by recognizing the obtained voice data;
a data storage unit for associating and storing the obtained image, the obtained voice data and the generated text; and
a data output unit for outputting the store image together with at least one of the stored voice data and the stored text.

### Claim 18

A system for sharing a photograph based on voice recognition, the system comprising:
a user terminal for obtaining an image associated with a photograph and voice data associated with the image, generating a text by recognizing the obtained voice data, associating and storing the image, the voice data and the text, and requesting to record the stored image, the voice data and the text in block-chain format;
a plurality of block-chain possession servers for recording the image, the voice data and the text generated in the user terminal in the block-chain format; and
a blockchain-based data management server for processing a block-chain management role including at least one of addition, move and deletion for block-chain information recorded in the block-chain data possession servers based on an approval of the block-chain data possession servers.

### Claim 19 (depends on 18)

The system for sharing a photograph based on voice recognition of claim 18, wherein the blockchain-based data management server records at least one of download information and payment information in relation to the image, the voice data and the text, which are exchanged between a first user terminal and a second user terminal, in the block-chain data possession servers.

### Claim 20 (depends on 18)

The system for sharing a photograph based on voice recognition of claim 18, when there is a request of recording the block-chain of the image, the voice data and the text, wherein the user terminal generates a public key and a private key through an authentication information issuance server and transmits it to the blockchain-based data management server,
after checking whether the public key and the private key received from the user terminal is registered, the blockchain-based data management server generates the transaction for recording information by processing the image, the voice data and the text requested by the user terminal into hash value, and forwards the generated transaction to the block-chain data possession servers to be approved.
