# US 2001/0033661 A1 · Digital imaging system for evidentiary use

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0033661 A1
- Document ID: US20010033661A1
- Status: Published application
- Kind: A1
- Application number: 09/778,967
- Filed: 2001-02-07
- Published: 2001-10-25
- Earliest claimed: 2000-02-07
- Assignees: Mikos, Ltd.
- Inventors: Francine J. Prokoski
- Web page: https://patentgrep.com/patent/US20010033661A1

## CPC

- H04L 9/3297: {involving time stamps, e.g. generation of time stamps}
- H04L 2209/603: Digital right managament [DRM]
- H04L 2209/805: Lightweight hardware, e.g. radio-frequency identification [RFID] or sensor
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The Evidentiary Imaging System (EIS) provides secure storage or transmission of a digital image into which is encoded the date, time, and location at which the image was taken, along with the camera ID and frame number. The encoding is dispersed throughout the image so that the image cannot be modified without distorting the encoding. The image may be encrypted for additional security. Annotation can be superimposed on the encoded or encoded and encrypted image to classify or identify the image to human or automated scanning systems. The annotation can also be used to key the decoding and decryption tasks. The EIS produces imagery which may be authenticated as to originality, time and location of imaging. The imagery may be stored, duplicated, and transmitted while retaining its authenticity. However, any modifications to the image, including any local changes, are readily detected because the encoding will not decode correctly. The EIS is designed to provide imagery which may be used for evidentiary proof of authenticity, ownership, originality, date and time, and location of imaged events. Certain users of EIS systems, such as police forensics labs, may have a central depository for the decoding and decryption keys used with their cameras. Other users may rely upon authentication services provided by the EIS manufacturer or an independent expert in the EIS technique. While many different schemes for encoding and encryption may be used, FlashCorrelation® provides a computationally simple and rapid method for encoding each item of information; allowing for separate or total encoding and readout of encoding layers representing: date, time, location, camera ID, and frame number. As covered in the issued FlashCorrelation® U.S. Pat. Nos. 5,583,950 and 5,982,932, readout and authentication can be done by one party authorized to have the decoding and decryption schemes, or readout and authentication may require two or more parties.

## Claims

### Claim 1

System for authenticating digital information, comprising:
a) an image acquisition device for producing an original array of two-dimensional digital information;
b) means for obtaining current date and time information from satellite or radio broadcasts;
c) means for obtaining current location information from satellite or radio broadcasts;
d) means for identifying a Sensor ID for the image acquisition device;
e) an encoder for converting date/time, location, and Sensor ID into two-dimensional format called the Encoded Data Array;
f) an embedder for combining the Encoded Data Array and the Original Array into a new Composite Array
g) an encrypter for transforming the Composite Array into another two-dimensional array called the Encrypted Composite Array;
h) a Transmission Process to transfer the Encrypted Composite Array to the intended recipient;
i) a decrypter to restore the Composite Array
j) a decoder with fault indicator when date/time, location, and source cannot be decoded;
k) an Encoding Extractor for removing the Encoded Data Array from the Decrypted Composite Array;
l) means for restoring the Original Array at pixel locations used for the Encoding; and
m) means for determining changes between the Restored Original Array and the Original Array.

### Claim 2 (depends on 1)

System as in claim 1 in which the Original Array size is increased by a factor and subpixels are used in steps f through m.

### Claim 3 (depends on 1, 2)

System as in claims 1 and 2 in which the encryption of step g and decryption of step i is repeated more than one time.

### Claim 4 (depends on 1, 2)

System as in claims 1 and 2 in which the encryption process involves scrambling the pixels or subpixels.

### Claim 5 (depends on 1, 2)

System as in claims 1 and 2 in which steps b and c utilize the GPS (Global Positioning Satellite) system.

### Claim 6

System as in claims land 2 in which the Decoder utilizes FlashCorrelation<<to select pixel locations of the Encoded Data Array and test for authenticity.

### Claim 7 (depends on 1, 2)

System as in claims 1 and 2 in which the Sensor ID in step d includes a biometric identifier of the User of the image acquisition device.

### Claim 8 (depends on 1, 2)

System as in claims 1 and 2 in which the Sensor ID in step d includes the serial number and odometer setting of the image acquisition device of step a.

### Claim 9 (depends on 1, 2)

System as in claims 1 and 2 in which the change detector of step m evaluates subsections of the Restored Original Array and the Original Array to localize areas of difference.

### Claim 10 (depends on 6)

System as in claim 6 in which FlashCorrelation<<is used to verify that the encoded data is the same as data which is expected to be encoded into a particular Original Array.

### Claim 11 (depends on 6)

System as in claim 6 in which FlashCorrelation is used to identify the encoded data by exhaustive comparison against each possible value for each of date/time, location, and source.

### Claim 12 (depends on 1, 2)

System as in claims 1 and 2 in which date/time, location, and source are annotated onto the Encrypted Composite Array.

### Claim 13 (depends on 1, 2)

System as in claims 1 and 2 in which the encoded data provides the key to the encryption and decryption algorithms.

### Claim 14 (depends on 1, 2)

System of claims 1 and 2 in which the operation of the EIS is triggered by the change of status of another device.

### Claim 15 (depends on 14)

System of claim 14 in which the triggering device is a face recognition system.

### Claim 16 (depends on 14)

System of claim 14 in which the triggering device is a speed sensor.

### Claim 17 (depends on 14)

System of claim 14 in which the triggering device is an alarm condition sensor.

### Claim 18

System of claims land 2 in which the Encoding is performed by overlaying a pattern of pixels of a particular color or grey scale value.

### Claim 19 (depends on 1, 2)

System of claims 1 and 2 in which the Encoding is performed by steganography.

### Claim 20 (depends on 1, 2)

System of claims 1 and 2 in which no encryption or scrambling is performed.

### Claim 21

A method for authenticating digital images, comprising the steps of:
capturing a digital image;
recording authentication information at the time and place of said capturing, said authentication information being unique to said digital image and including at least one piece of information from a source independent of said capturing;
encoding said authentication information into a data array mapable to said digital image;
mapping said data array to said digital image, thereby creating a composite array;
optionally encrypting said composite array;
optionally annotating said composite array;
comparing said data array, optionally encrypted and annotated, to a target composite array, wherein said comparing determines whether said authentication information is embedded in said target composite array, thereby proving that said target composite array is an authentic copy of said composite array.

### Claim 22 (depends on 21)

The method of claim 21, wherein said at least one piece of information from a source independent of said capturing is GMT time information.

### Claim 23 (depends on 21)

The method of claim 21, wherein said at least one piece of information from a source independent of said capturing is GPS location information.

### Claim 24 (depends on 21)

The method of claim 21, wherein said at least one piece of information from a source independent of said capturing is GMT time information and GPS location information.

### Claim 25 (depends on 21)

The method of claim 21, wherein said comparing step is flashcorrelation of said data array with said target composite array.

### Claim 26 (depends on 25)

The method of claim 25, wherein said digital image is a sequence of digital images, there being a unique set of authenticating information for each digital image in said sequence and a corresponding unique data array, there being a unique composite array corresponding to each digital image in said sequence, wherein said composite array is a sequence of composite arrays and said target composite array is a sequence of target composite arrays, and wherein said flashcorrelation determines whether said sequence of target composite arrays is an authentic copy of said sequence of composite arrays.

### Claim 27 (depends on 26)

The method of claim 26, wherein said sequence of digital images is a video image and said flashcorrelation is done in real time.

### Claim 28

A system for authenticating digital images, comprising:
means for capturing a digital image;
means for recording authentication information at the time and place of said capturing, said authentication information being unique to said digital image and including at least one piece of information from a source independent of said capturing;
means for encoding said authentication information into a data array mapable to said digital image;
means for mapping said data array to said digital image, thereby creating a composite array;
means for optionally encrypting said composite array;
means for optionally annotating said composite array;
means for comparing said data array, optionally encrypted and annotated, to a target composite array, wherein said comparing determines whether said authentication information is embedded in said target composite array, thereby proving that said target composite array is an authentic copy of said composite array.

### Claim 29 (depends on 28)

The system of claim 28, wherein said at least one piece of information from a source independent of said capturing is GMT time information.

### Claim 30 (depends on 28)

The system of claim 28, wherein said at least one piece of information from a source independent of said capturing is GPS location information.

### Claim 31 (depends on 28)

The system of claim 28, wherein said at least one piece of information from a source independent of said capturing is GMT time information and GPS location information.

### Claim 32 (depends on 28)

The system of claim 28, wherein said comparing step is flashcorrelation of said data array with said target composite array.

### Claim 33 (depends on 32)

The system of claim 32, wherein said digital image is a sequence of digital images, there being a unique set of authenticating information for each digital image in said sequence and a corresponding unique data array, there being a unique composite array corresponding to each digital image in said sequence, wherein said composite array is a sequence of composite arrays and said target composite array is a sequence of target composite arrays, and wherein said flashcorrelation determines whether said sequence of target composite arrays is an authentic copy of said sequence of composite arrays.

### Claim 34 (depends on 33)

The system of claim 33, wherein said sequence of digital images is a video image and said flashcorrelation is done in real time.
