# US 2009/0276464 A1 · Image processing system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0276464 A1
- Document ID: US20090276464A1
- Status: Published application
- Kind: A1
- Application number: 12/500,801
- Filed: 2009-07-10
- Published: 2009-11-05
- Earliest claimed: 2004-02-26
- Assignees: ATI Technologies ULC
- Inventors: Peter Bandas
- Web page: https://patentgrep.com/patent/US20090276464A1

## CPC

- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G06F 16/5838: {using colour}
- Y10S 707/99945: Object-oriented database structure processing
- Y10S 707/99948: Application of database or data structure, e.g. distributed, multimedia, or image
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

An image processing system and method receives one or more digital images in the form of image data, including selected object data of a digital image, and determines, by an electronic recognition process, if a recognition match is available between the selected object data of the digital image and image object library data associated with image descriptor library data. An automated library user interface presents selectable matched object descriptor data associated with the image descriptor library data when a recognition match occurs between the selected object data of the digital image and the image descriptor library data. In response, the automated library user interface provides user feedback data to confirm that the image descriptor library data corresponds with the selected object data of the digital image, or entered descriptor data if no match or an incorrect match occurs, to create library descriptor associated image data.

## Claims

### Claim 1

An image processing method carried out by an image processing system, comprising:
determining, by an electronic recognition process, if a recognition match occurs between selected object data of a digital image and image object library data, wherein the image object library data are associated with image descriptor library data;
presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data;
receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image; and
in response to the feedback data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 2 (depends on 1)

The method of claim 1 including:
receiving entered descriptor data to associate with the digital image; and
creating the descriptor associated image library data in response to receiving the entered descriptor data when at least one of: (a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicates that the image descriptor library data do not correspond with the selected object data of the digital image.

### Claim 3 (depends on 1)

The method of claim 1 wherein the selected object data of the digital image represent a plurality of objects in the digital image, the method further including:
determining, by the electronic recognition process, if a recognition match occurs between each of the plurality of objects in the digital image and the image object library data;
presenting the plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the corresponding plurality of objects in the digital image and the image object library data;
receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data associated with the plurality of selectable matched object descriptor data match the corresponding plurality of objects in the digital image; and
in response to the feedback data, associating the image descriptor library data with the digital image for each of the corresponding plurality of objects to create corresponding descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 4 (depends on 1)

The method of claim 1 wherein the descriptor associated image library data include subdescriptor data associated with the selected object data of the digital image.

### Claim 5 (depends on 1)

The method of claim 1 wherein the descriptor associated image library data are selected from at least one of: person attribute data, place attribute data, thing attribute data and event attribute data.

### Claim 6 (depends on 5)

The method of claim 5 wherein the person attribute data are associated with at least one of: name attribute data, facial expression attribute data and activity attribute data; wherein the place attribute data are selected from at least one of: landscape attribute data, weather attribute data, season attribute data and lighting attribute data; wherein the thing attribute data are selected from at least one of: animal attribute data and building attribute data; and wherein the event attribute data are selected from party attribute data, family event attribute data and vacation attribute data.

### Claim 7 (depends on 1)

The method of claim 1 including generating the selected object data of the digital image in response to selecting at least one of: the digital image, and a portion of the digital image, by at least one of: a user and an electronic object recognizer.

### Claim 8

An image processing method carried out by an image processing system, comprising:
receiving image data representing a digital image;
generating selected object data of the digital image in response to receiving the image data;
determining, by an electronic recognition process, if a recognition match occurs between the selected object data of the digital image and image object library data, wherein the image object library data are associated with image descriptor library data;
presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data;
receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image; and
in response to the feedback data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 9 (depends on 8)

The method of claim 8 wherein the image data represent a plurality of digital images such that each of the plurality of digital images is associated with corresponding descriptor associated image library data, including:
storing the descriptor associated image library data associated with each of the corresponding plurality of digital images; and
creating at least one of: a table of contents, an index and a photo album including the descriptor associated image library data associated with each of the corresponding plurality of digital images.

### Claim 10 (depends on 8)

The method of claim 8 including:
receiving entered descriptor data to associate with the digital image; and
creating the descriptor associated image library data in response to receiving the entered descriptor data when at least one of: (a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicates that the image descriptor library data do not correspond with the selected object data of the digital image.

### Claim 11 (depends on 8)

The method of claim 8 wherein the selected object data of the digital image represent a plurality of objects in the digital image, the method further including:
determining, by the electronic recognition process, if a recognition match occurs between each of the plurality of objects in the digital image and the image object library data;
presenting the plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the corresponding plurality of objects in the digital image and the image object library data;
receiving feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data associated with the plurality of selectable matched object descriptor data match the corresponding plurality of objects in the digital image; and
in response to the feedback data, associating the image descriptor library data with the digital image for each of the corresponding plurality of objects to create corresponding descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 12 (depends on 8)

The method of claim 8 including generating the selected object data of the digital image based on selecting at least one of: the digital image, and a portion of the digital image, by at least one of: a user and an electronic object recognizer.

### Claim 13

An image processing system comprising:
memory containing image object library data and image descriptor library data associated with the image object library data; and
an object recognizer, operatively coupled to the memory, and operative to receive selected object data of a digital image, the image object library data and the image descriptor library data and, in response, to determine, by an electronic recognition process, if a recognition match occurs between the selected object data of the digital image and the image object library data, and to present a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data, such that the object recognizer is operative to receive feedback data in response to the presented selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image, wherein the image descriptor library data is, in response to the feedback data, associated with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 14 (depends on 13)

The image processing system of claim 13 wherein the memory is operative to receive entered descriptor data to associate with the digital image and to create the descriptor associated image library data when at least one of: (a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicates that the image descriptor library data do not correspond with the selected object data of the digital image.

### Claim 15 (depends on 13)

The image processing system of claim 13, including a user interface, operatively coupled to the object recognizer, and operative to receive the plurality of selectable matched object descriptor data and, in response, to display the plurality of selectable matched object descriptor data.

### Claim 16 (depends on 13)

The image processing system of claim 13, including an object detector, operatively coupled to the memory and to the object recognizer, and operative to receive image data representing the digital image and, in response, to provide the selected object data of the digital image to the object recognizer.

### Claim 17 (depends on 13)

The image processing system of claim 13 wherein the selected object data of the digital image are generated in response to selecting at least one of: the digital image, and a portion of the digital image, by at least one of: a user and the object recognizer.

### Claim 18

An image processing system comprising:
memory containing image object library data and image descriptor library data associated with the image object library data;
a library access circuit, operatively coupled to the memory, and operative to produce the image object library data and the image descriptor library data;
an object recognizer, operatively coupled to the library access circuit, and operative to receive selected object data of a digital image, the image object library data and the image descriptor library data and, in response, to determine, by an electronic recognition process, if a recognition match occurs between the selected object data of the digital image and the image object library data, and to produce a plurality of selectable matched object descriptor data associated with the image object library data when a recognition match is determined between the selected object data of the digital image and the image object library data; and
a user interface, operatively coupled to the object recognizer, and operative to present the plurality of selectable matched object descriptor data and, in response, to provide feedback data to the object recognizer to confirm that the image descriptor library data corresponds with the selected object data of the digital image;
wherein the image descriptor library data are, in response to the feedback data, associated with the selected object data of the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 19 (depends on 18)

The image processing system of claim 18 wherein the library access circuit receives entered descriptor data to associate with the digital image and, in response, creates the descriptor associated image library data, when at least one of: (a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicate that the image descriptor library data do not correspond with the selected object data of the digital image.

### Claim 20 (depends on 18)

The image processing system of claim 18 including an object detector, operatively coupled to the library access circuit and to the object recognizer, and operative to receive image data representing the digital image and, in response, to provide the selected object data of the digital image to the object recognizer.

### Claim 21

Memory containing instructions executable by one or more processing devices that cause the one or more processing devices to:
determine, by an electronic recognition process, if a recognition match occurs between selected object data of a digital image and image object library data, wherein the image object library data are associated with image descriptor library data;
present a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data;
receive feedback data in response to presenting the plurality of selectable matched object descriptor data to confirm that the image descriptor library data corresponds with the selected object data of the digital image; and
in response to the feedback data, associate the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 22 (depends on 21)

The memory of claim 21 containing executable instructions that cause the one or more processing devices to:
receive entered descriptor data to associate with the digital image and in response create the descriptor associated image library data when at least one of: (a) no recognition match is determined between the selected object data of the digital image and the image object library data, and (b) the feedback data indicate that the image descriptor library data do not correspond with the selected object data of the digital image.

### Claim 23

An image processing method carried out by an image processing system, comprising:
determining, by an electronic recognition process, if a recognition match occurs between selected object data of a digital image and image object library data, wherein the image object library data are associated with image descriptor library data;
presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the selected object data of the digital image and the image object library data; and
in response to selected object descriptor data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 24

An image processing method carried out by an image processing system, comprising:
determining, by an electronic recognition process, if a recognition match occurs between a digital image and image object library data, wherein the image object library data are associated with user generated image descriptor library data;
presenting a plurality of selectable matched object descriptor data associated with the image descriptor library data when a recognition match is determined between the digital image and the image object library data; and
in response to the feedback data, associating the image descriptor library data with the digital image to create descriptor associated image library data and adding the created descriptor associated image library data as stored new object library data.

### Claim 25 (depends on 1)

The method of claim 1 wherein the plurality of selectable matched object descriptor data represent a plurality of textual description, each of which can be selected to correspond with the digital image.
