# US 2010/0303288 A1 · Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0303288 A1
- Document ID: US20100303288A1
- Status: Published application
- Kind: A1
- Application number: 12/857,358
- Filed: 2010-08-16
- Published: 2010-12-02
- Earliest claimed: 2002-09-30
- Assignees: Myport Technologies, Inc.
- Inventors: MICHAEL F. MALONE
- Web page: https://patentgrep.com/patent/US20100303288A1

## CPC

- H04L 9/14: using a plurality of keys or algorithms
- G06F 16/48: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/50: of still image data
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information}
- G06F 16/68: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 16/687: using geographical or spatial information, e.g. location
- H04L 9/3263: {involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements (network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823)}
- H04L 9/3271: {using challenge-response}
- H04L 9/3297: {involving time stamps, e.g. generation of time stamps}
- H04N 5/44: Receiver circuitry {for the reception of television signals according to analogue transmission standards} (H04N5/14 takes precedence)
- H04N 5/76: Television signal recording
- H04N 21/25816: {involving client authentication (restricting access to computer systems by authenticating users using a predetermined code G06F21/33; cryptographic authentication protocols H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06)}
- H04N 21/25875: {involving end-user authentication (restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06)}
- H04N 21/26603: {for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques}
- H04N 21/26613: {for generating or managing keys in general (key distribution for secret or secure communication involving central third party, e.g. key distribution center [KDC] or trusted third party [TTP] H04L9/083; network support of key management H04L63/06; key management for network security in communication control or processing H04W12/04)}
- H04N 21/2747: Remote storage of video programmes received via the downstream path, e.g. from the server
- H04N 21/4108: {characterised by an identification number or address, e.g. local network address (protecting specific internal or external computer components using identification number G06F21/73; network arrangements, protocols or services for addressing or naming H04L61/00)}
- H04N 21/6582: {Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number (arrangements where receivers interact with the broadcast H04H20/38)}
- H04N 21/835: Generation of protective data, e.g. certificates {(protecting software against unauthorised usage in a vending or licensing environment G06F21/10)}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04L 2209/60: Digital content management, e.g. content distribution
- H04L 2209/80: Wireless
- H04N 5/77: between a recording apparatus and a television camera
- H04N 5/9201: {involving the multiplexing of an additional signal and the video signal}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

This invention relates to an apparatus for capturing data a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set. A second capture device is provided interfacing with a secondary data source to capture data therefrom for storage into a secondary data set. An associating device is then operable to associate the converted data set with the primary data set. A data converter converts the data stored in the second data set to a different and inverted form as a converted data set.

## Claims

### Claim 1

An apparatus for capturing data:
a first capture device interfacing with a primary data source to capture data therefrom for storage into a primary data set;
a second capture device interfacing with a secondary data source to capture data therefrom for storage into a secondary data set;
an associating device for associating the converted data set with the primary data set; and
a data converter for converting the data stored in the second data set to a different and inverted form as a converted data set.

### Claim 2 (depends on 1)

The apparatus of claim 1 wherein the first capture device is a camera capable of capturing data into a primary data set composed of an image.

### Claim 3 (depends on 1)

The apparatus of claim 1 wherein the second capture device is a microphone capable of capturing data into a secondary data set composed of audio.

### Claim 4 (depends on 1)

The apparatus of claim 1 wherein the second capture device is a keypad capable of capturing data representing a keypad output and the data converter is operable to convert the keypad output to a text form.

### Claim 5 (depends on 1)

The apparatus of claim 1 wherein the data converter converts the secondary data set to a data form that is a function of a process that identifies features in the primary data set.

### Claim 6 (depends on 5)

The process of claim 5 wherein the feature identification process is confirmed by a user instruction with a user input device.

### Claim 7 (depends on 1)

The apparatus of claim 1 wherein the second capture device is a location-determining device capable of capturing location information.

### Claim 8 (depends on 1)

The apparatus of claim 1 wherein the second capture device is an identification device capable of providing identification information.

### Claim 9 (depends on 1)

The apparatus of claim 1 wherein the associating device outputs to a composite data set.

### Claim 10 (depends on 9)

The apparatus of claim 9 wherein the composite data set is an e-mail message.

### Claim 11 (depends on 9)

The apparatus of claim 9 wherein the composite data set is an image with embedded tags.

### Claim 12 (depends on 9)

The apparatus of claim 9 wherein the composite data set is a compressed archive.

### Claim 13 (depends on 1)

The apparatus of claim 1 in which the form of the converted data set is plain text format.

### Claim 14 (depends on 1)

The apparatus of claim 1 in which the form of the converted secondary data set is XML format.

### Claim 15 (depends on 1)

The apparatus of claim 1 in which the primary and secondary data sets are stored in a storage medium.

### Claim 16 (depends on 3)

The apparatus of claim 3 in which the data converter converts the secondary data set to text by an algorithmic process to identify speech elements in the recorded audio.

### Claim 17 (depends on 16)

The apparatus of claim 16 in which the text converted from speech is further converted to searchable tags.
