# US 2002/0055947 A1 · System and method for deploying a graphical program on an image acquisition device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2002/0055947 A1
- Document ID: US20020055947A1
- Status: Published application
- Kind: A1
- Application number: 09/949,783
- Filed: 2001-09-10
- Published: 2002-05-09
- Earliest claimed: 1997-08-18
- Assignees: National Instruments Corporation
- Inventors: Kevin L. Schultz; Jeffrey L. Kodosky; Hugo Andrade; Brian Keith Odom; Cary Paul Butler
- Web page: https://patentgrep.com/patent/US20020055947A1

## CPC

- G06F 8/60: Software deployment
- G06F 8/34: Graphical or visual programming
- G06F 11/2294: {by remote test}
- G06F 11/2733: {Test interface between tester and unit under test}
- G06F 30/30: Circuit design
- G06F 30/34: for reconfigurable circuits, e.g. field programmable gate arrays [FPGA] or programmable logic devices [PLD]
- G06F 30/343: Logical level
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer-implemented system and method for deploying a graphical program onto an image acquisition (IMAQ) device. The method may operate to configure an image acquisition (IMAQ) device to perform image processing or machine vision functions, wherein the device includes a programmable hardware element and/or a processor and memory. The method comprises first creating a graphical program which implements the image processing or machine vision function. A portion of the graphical program may be converted into a hardware implementation on a programmable hardware element, and a portion may optionally be compiled into machine code for execution by a CPU. The programmable hardware element is thus configured utilizing a hardware description and implements a hardware implementation of at least a portion of the graphical program. The CPU-executable code may be executed by a computer coupled to the IMAQ device, or by a processor/memory on the IMAQ device.

## Claims

### Claim 1

A computer-implemented method for configuring an image acquisition device to perform an image processing function, the method comprising:
creating a graphical program on a computer system, wherein the graphical program implements the image processing function, and wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program;
deploying the graphical program on the image acquisition device, wherein the image acquisition device is coupled to or comprised in the computer system;
the image acquisition device acquiring an image of an object; and
the image acquisition device executing to perform the image processing function on the image.

### Claim 2 (depends on 1)

The method of claim 1, wherein the image acquisition device includes a processor and a memory;
wherein said deploying the graphical program on the image acquisition device comprises transferring the graphical program to the memory on the image acquisition device; and
wherein the image acquisition device executing to perform the image processing function on the image comprises the processor in the image acquisition device executing the graphical program from the memory.

### Claim 3 (depends on 1)

The method of claim 1, wherein the image acquisition device includes a processor and a memory;
wherein said deploying the graphical program on the image acquisition device comprises:
generating an executable program based on the graphical program, wherein the executable program implements functionality of the graphical program; and
transferring the executable program to the memory on the image acquisition device; and
wherein the image acquisition device executing to perform the image processing function on the image comprises the processor in the image acquisition device executing the executable program from the memory.

### Claim 4 (depends on 1)

The method of claim 1, wherein the image acquisition device includes a programmable hardware element;
wherein said deploying the graphical program on the image acquisition device comprises:
generating a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; and
configuring the programmable hardware element in the image acquisition device utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the graphical program; and
wherein the image acquisition device executing to perform the image processing function on the image comprises the programmable hardware element in the image acquisition device executing to perform the image processing function on the image.

### Claim 5 (depends on 1)

The method of claim 1, wherein the image acquisition device includes a processor and a memory and a programmable hardware element;
wherein said deploying the graphical program on the image acquisition device comprises:
transferring a first portion of the graphical program to the memory on the image acquisition device;
generating a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configuring the programmable hardware element in the image acquisition device utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program; and
wherein the image acquisition device executing to perform the image processing function on the image comprises the processor in the image acquisition device executing the first portion of the graphical program from the memory and the programmable hardware element executing the second portion of the graphical program.

### Claim 6 (depends on 5)

The method of claim 5,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 7 (depends on 5)

The method of claim 5,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 8 (depends on 1)

The method of claim 1, wherein the image acquisition device includes a processor and a memory and a programmable hardware element;
wherein said deploying the graphical program on the image acquisition device comprises:
generating an executable program based on a first portion of the graphical program, wherein the executable program implements functionality of the first portion of the graphical program; and
transferring the executable program to the memory on the image acquisition device;
generating a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; and
configuring the programmable hardware element in the image acquisition device utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program; and
wherein the image acquisition device executing to perform the image processing function on the image comprises the processor in the image acquisition device executing the executable program from the memory and the programmable hardware element executing the second portion of the graphical program.

### Claim 9 (depends on 8)

The method of claim 8,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 10 (depends on 8)

The method of claim 8,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 11 (depends on 1)

The method of claim 1,
wherein the image acquisition device includes a first processor, a second processor, and at least one memory; and
wherein the image acquisition device executing to perform the image processing function on the image comprises the first processor in the image acquisition device executing a first portion of the graphical program from the at least one memory and the second processor in the image acquisition device executing a second portion of the graphical program from the at least one memory.

### Claim 12 (depends on 11)

The method of claim 11,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 13 (depends on 11)

The method of claim 11,
wherein the first portion of the graphical program comprises a first portion of the image processing function, and wherein the second portion of the graphical program comprises a second portion of the image processing function.

### Claim 14 (depends on 1)

The method of claim 1, further comprising:
the image acquisition device receiving an image present signal;
wherein the image acquisition device acquires the image of the object in response to receiving the image present signal.

### Claim 15 (depends on 1)

The method of claim 1, further comprising:
the image acquisition device performing a control operation after said executing to perform the image processing function on the image.

### Claim 16 (depends on 1)

The method of claim 1, further comprising:
the image acquisition device generating a pass/fail indication after said executing to perform the image processing function on the image.

### Claim 17 (depends on 1)

The method of claim 1,
wherein the image acquisition device is coupled to a camera; and
wherein the image acquisition device acquiring an image of an object comprises the camera acquiring the image of the object and the image acquisition device receiving and storing the image.

### Claim 18 (depends on 1)

The method of claim 1,
wherein said executing further comprises:
the image acquisition device determining characteristics of the image after performing the image processing function; and
the image acquisition device performing an operation based on the determined characteristics of the image.

### Claim 19 (depends on 1)

The method of claim 1,
wherein the image acquisition device comprises a smart camera.

### Claim 20 (depends on 1)

The method of claim 1,
wherein the image acquisition device comprises an image acquisition board coupled to or comprised in a computer system.

### Claim 21 (depends on 1)

The method of claim 1,
wherein the graphical program includes a user interface portion;
the method further comprising:
presenting the user interface portion on a display during the image acquisition device executing to perform the image processing function on the image.

### Claim 22 (depends on 21)

The method of claim 21,
wherein the user interface portion operates as a front panel for the image acquisition device.

### Claim 23 (depends on 21)

The method of claim 21, further comprising:
receiving user input to the user interface portion on the display to control the image acquisition device during the programmable hardware element in the image acquisition device executing to perform the image processing function on the image.

### Claim 24 (depends on 21)

The method of claim 21, further comprising:
compiling the user interface portion into executable code for execution by a processor and storing the executable code in a memory; and
the processor executing the executable code from the memory to present the user interface portion on the display.

### Claim 25 (depends on 24)

The method of claim 24,
wherein the image acquisition device includes the processor and the memory; and
wherein the processor in the image acquisition device executes the executable code from the memory to present the user interface portion on the display during the image acquisition device executing to perform the image processing function on the image.

### Claim 26 (depends on 24)

The method of claim 24,
wherein the computer system includes the processor and the memory; and
wherein the computer system executes the executable code from the memory to present the user interface portion on the display during the image acquisition device executing to perform the image processing function on the image.

### Claim 27 (depends on 1)

The method of claim 1, wherein said creating the graphical program includes:
arranging on a display of the computer system a plurality of nodes comprising the graphical program and interconnecting the plurality of nodes;
creating and storing data structures which represent the graphical program in response to said arranging and said interconnecting.

### Claim 28 (depends on 1)

The method of claim 1, wherein the graphical program comprises a data flow diagram.

### Claim 29 (depends on 1)

The method of claim 1, wherein the graphical program comprises one or more of data flow, control flow and execution flow constructs.

### Claim 30 (depends on 1)

The method of claim 1,
wherein said creating the graphical program is performed on the computer system;
wherein the image acquisition device is coupled to the computer system over a network; and
wherein said deploying the graphical program comprises the computer system deploying the graphical program over the network to the image acquisition device.

### Claim 31

An image processing system, comprising:
a computer system comprising a processor, memory and a display;
wherein the memory stores a graphical program, wherein the graphical program implements an image processing function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program; and
wherein the memory also stores a software program which is executable to deploy the graphical program on the image acquisition device;
an image acquisition device coupled to the computer system, wherein the image acquisition device includes:
an input for acquiring an image; and
at least one functional unit that is configurable based on the graphical program for performing the image processing function on the image.

### Claim 32 (depends on 31)

The image processing system of claim 31,
wherein the at least one functional unit comprises a second processor and a second memory;
wherein the software program is executable by the processor in the computer system to transfer the graphical program to the second memory on the image acquisition device; and
wherein the second processor in the image acquisition device is operable to execute the graphical program from the second memory.

### Claim 33 (depends on 31)

The image processing system of claim 31,
wherein the at least one functional unit comprises a second processor and a second memory;
wherein the software program is executable by the processor in the computer system to 1) generate an executable program based on the graphical program, wherein the executable program implements functionality of the graphical program, and 2) transfer the executable program to the second memory on the image acquisition device; and
wherein the second processor in the image acquisition device is operable to execute the executable program from the second memory.

### Claim 34 (depends on 31)

The image processing system of claim 31,
wherein the at least one functional unit comprises a programmable hardware element; and
wherein the software program is executable by the processor in the computer system to generate a hardware description based on the graphical program and configure the programmable hardware element based on the hardware description, wherein after being configured the programmable hardware element implements a hardware implementation of the graphical program, wherein the programmable hardware element in the image acquisition device is executable to perform an image processing function on an acquired image.

### Claim 35 (depends on 31)

The image processing system of claim 31,
wherein the at least one functional unit comprises a second processor, a second memory, and a programmable hardware element;
wherein the software program is executable by the processor in the computer system to:
transfer a first portion of the graphical program to the second memory on the image acquisition device;
generate a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configure the programmable hardware element in the image acquisition device utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program;
wherein the second processor in the image acquisition device is operable to execute the first portion of the graphical program from the second memory; and
wherein the programmable hardware element in the image acquisition device is operable to implement the second portion of the graphical program.

### Claim 36 (depends on 35)

The image processing system of claim 35,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 37 (depends on 35)

The image processing system of claim 35,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 38 (depends on 31)

The image processing system of claim 31,
wherein the at least one functional unit comprises a second processor, a second memory, and a programmable hardware element;
wherein the software program is executable by the processor in the computer system to:
generate an executable program based on a first portion of the graphical program, wherein the executable program implements functionality of the first portion of the graphical program;
transfer the executable program to the second memory on the image acquisition device;
generate a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configure the programmable hardware element in the image acquisition device utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program;
wherein the second processor in the image acquisition device is operable to execute the executable program from the second memory to implement the first portion of the graphical program; and
wherein the programmable hardware element in the image acquisition device is operable to implement the second portion of the graphical program.

### Claim 39 (depends on 38)

The image processing system of claim 38,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 40 (depends on 38)

The image processing system of claim 38,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 41 (depends on 31)

The image processing system of claim 31,
wherein the at least one functional unit comprises a second processor, a third processor, and at least one memory; and
wherein the second processor in the image acquisition device is operable to execute a first portion of the graphical program from the at least one memory and the third processor in the image acquisition device is operable to execute a second portion of the graphical program from the at least one memory.

### Claim 42 (depends on 41)

The image processing system of claim 41,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 43 (depends on 41)

The image processing system of claim 41,
wherein the first portion of the graphical program comprises a first portion of the image processing function, and wherein the second portion of the graphical program comprises a second portion of the image processing function.

### Claim 44 (depends on 31)

The image processing system of claim 31,
wherein the image acquisition device is operable to receive an image present signal; and
wherein the image acquisition device is operable to acquire the image of the object in response to receiving the image present signal.

### Claim 45 (depends on 31)

The image processing system of claim 31, further comprising:
wherein the image acquisition device is operable to perform a control operation after executing to perform the image processing function on the image.

### Claim 46 (depends on 31)

The image processing system of claim 31, further comprising:
wherein the image acquisition device is operable to generate a pass/fail indication after executing to perform the image processing function on the image.

### Claim 47 (depends on 31)

The image processing system of claim 31,
wherein the image acquisition device is coupled to a camera; and
wherein the image acquisition device is operable to receive and store an image acquired from the camera.

### Claim 48 (depends on 31)

The image processing system of claim 31,
wherein the image acquisition device is operable to determine characteristics of the image after performing the image processing function; and
wherein the image acquisition device is operable to perform an operation based on the determined characteristics of the image.

### Claim 49 (depends on 31)

The image processing system of claim 31,
wherein the image acquisition device comprises a smart camera.

### Claim 50 (depends on 31)

The image processing system of claim 31,
wherein the image acquisition device comprises an image acquisition board coupled to or comprised in a computer system.

### Claim 51 (depends on 31)

The image processing system of claim 31,
wherein the graphical program includes a user interface portion; and
wherein the computer system is operable to present the user interface portion on a display when the at least one functional unit in the image acquisition device executes to perform the image processing function on the image.

### Claim 52 (depends on 51)

The image processing system of claim 51,
wherein the user interface portion operates as a front panel for the image acquisition device.

### Claim 53 (depends on 51)

The image processing system of claim 51,
wherein the computer system further comprises a user input device for receiving user input to the user interface portion on the display; and
wherein the user input is operable to control the image acquisition device when the at least one functional unit in the image acquisition device executes to perform the image processing function on the image.

### Claim 54 (depends on 51)

The image processing system of claim 51,
wherein the user interface portion is operable to be compiled into executable code for execution by the processor and stored in the memory; and
wherein the processor is operable to execute the executable code from the memory to present the user interface portion on the display.

### Claim 55 (depends on 31)

The image processing system of claim 31,
wherein the memory of the computer system stores a graphical program development program for creating the graphical program;
wherein the graphical program development program is executable to:
arrange on the screen a plurality of nodes comprising the graphical program and interconnect the plurality of nodes in response to user input; and
create and store data structures which represent the graphical program in response to said user input.

### Claim 56 (depends on 31)

The image processing system of claim 31, wherein the graphical program comprises one or more of data flow, control flow and execution flow constructs.

### Claim 57 (depends on 31)

The image processing system of claim 31,
wherein the image acquisition device is coupled to the computer system over a network; and
wherein the computer system is operable to deploy the graphical program over the network to the image acquisition device.

### Claim 58

An image acquisition device, comprising:
an input for receiving an image of an object;
a memory coupled to the input for storing data corresponding to the image of the object, wherein the memory also stores a graphical program, wherein the graphical program implements an image processing function; and
a processor coupled to the memory, wherein the processor is operable to execute the graphical program to perform the image processing function on an acquired image.

### Claim 59 (depends on 58)

The image acquisition device of claim 58,
wherein the memory further stores a graphical program execution engine; and
wherein the processor is operable to execute the graphical program execution engine in executing the graphical program.

### Claim 60 (depends on 58)

The image acquisition device of claim 58,
wherein the memory further stores a real time operating system; and
wherein the processor is operable to execute the real time operating system in executing the graphical program.

### Claim 61 (depends on 58)

The image acquisition device of claim 58,
wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 62 (depends on 58)

The image acquisition device of claim 58,
wherein the graphical program is created by assembling a plurality of interconnected nodes which visually indicate functionality of the graphical program in response to user input.

### Claim 63 (depends on 58)

The image acquisition device of claim 58, wherein the image acquisition device further comprises:
analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog image to produce a digital image.

### Claim 64 (depends on 58)

The image acquisition device of claim 58,
wherein the image acquisition device further includes timer/counter logic; and
wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the image acquisition device executes to perform the image processing function on the image.

### Claim 65

An image acquisition device, comprising:
an input for receiving an image of an object;
a memory coupled to the input for storing data corresponding to the image of the object, wherein the memory also stores a software program, wherein the software program implements an image processing function, wherein the software program is created based on a graphical program; and
a processor coupled to the memory, wherein the processor is operable to execute the software program to perform the image processing function on an acquired image.

### Claim 66 (depends on 65)

The image acquisition device of claim 65,
wherein the memory further stores a real time operating system; and
wherein the processor is operable to execute the real time operating system in executing the graphical program.

### Claim 67 (depends on 65)

The image acquisition device of claim 65,
wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 68 (depends on 65)

The image acquisition device of claim 65,
wherein the graphical program is created by assembling a plurality of interconnected nodes which visually indicate functionality of the graphical program in response to user input.

### Claim 69 (depends on 65)

The image acquisition device of claim 65, wherein the image acquisition device further comprises:
analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog image to produce a digital image.

### Claim 70 (depends on 65)

The image acquisition device of claim 65,
wherein the image acquisition device further includes timer/counter logic; and
wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the image acquisition device executes to perform the image processing function on the image.

### Claim 71

An image acquisition device, comprising:
an input for receiving an image of an object;
a memory coupled to the input for storing data corresponding to the image of the object; and
a programmable hardware element coupled to the memory that is configured to implement an image processing function, wherein the programmable hardware element in the image acquisition device is configured utilizing a hardware description generated from a graphical program, wherein the programmable hardware element implements a hardware implementation of the graphical program, wherein the programmable hardware element in the image acquisition device is operable to perform an image processing function on the image.

### Claim 72 (depends on 71)

The image acquisition device of claim 71,
wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 73 (depends on 71)

The image acquisition device of claim 71,
wherein the graphical program is created by assembling a plurality of interconnected nodes which visually indicate functionality of the graphical program in response to user input.

### Claim 74 (depends on 71)

The image acquisition device of claim 71, wherein the image acquisition device further comprises:
analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog image to produce a digital image.

### Claim 75 (depends on 71)

The image acquisition device of claim 71,
wherein the image acquisition device further includes timer/counter logic; and
wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the image acquisition device executes to perform the image processing function on the image.

### Claim 76 (depends on 71)

The image acquisition device of claim 71, wherein the programmable hardware element comprises a field programmable gate array (FPGA).

### Claim 77 (depends on 71)

The image acquisition device of claim 71, wherein the image acquisition device further includes a non-volatile memory coupled to the programmable hardware element;
wherein the non-volatile memory is operable to store the hardware description; and
wherein the non-volatile memory is operable to transfer the hardware description to the programmable hardware element to configure the programmable hardware element.

### Claim 78

A method for configuring an image acquisition device to perform an image processing function, the method comprising:
coupling the image acquisition device to a computer system, wherein the image acquisition device comprises at least one functional unit, wherein the computer system stores a graphical program, wherein the graphical program implements the image processing function; and
deploying the graphical program onto the functional unit in the image acquisition device to configure the functional unit;
wherein after said deploying the functional unit is operable to implement the graphical program.

### Claim 79 (depends on 78)

The method of claim 78, further comprising:
disconnecting the image acquisition device from the computer system after said deploying.

### Claim 80 (depends on 78)

The method of claim 78, further comprising:
creating the graphical program prior to said deploying, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 81 (depends on 78)

The method of claim 78,
wherein the functional unit is a processor and memory;
wherein said deploying the graphical program onto the functional unit comprises transferring the graphical program to the memory of the functional unit; and
wherein the processor in the image acquisition device is operable to execute the graphical program from the memory.

### Claim 82 (depends on 78)

The method of claim 78,
wherein the functional unit is a processor and memory;
wherein said deploying the graphical program onto the functional unit comprises:
generating an executable program based on the graphical program, wherein the executable program implements functionality of the graphical program; and
transferring the executable program to the memory on the image acquisition device; and
wherein the processor in the image acquisition device is operable to execute the executable program from the memory.

### Claim 83 (depends on 78)

The method of claim 78,
wherein the functional unit is a programmable hardware element;
wherein said deploying the graphical program onto the functional unit comprises:
downloading a hardware configuration onto the programmable hardware element in the image acquisition device to configure the programmable hardware element, wherein the hardware configuration corresponds to a hardware implementation of the graphical program;
wherein after said downloading the programmable hardware element implements a hardware implementation of the graphical program.

### Claim 84

A computer-implemented method for configuring a smart camera to perform an image processing function, the method comprising:
creating a graphical program on a computer system, wherein the graphical program implements the image processing function, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program;
deploying the graphical program on the smart camera, wherein the smart camera is coupled to the computer system;
the smart camera acquiring an image of an object; and
the smart camera executing to perform the image processing function on the image.

### Claim 85 (depends on 84)

The method of claim 84, wherein the smart camera includes a processor and a memory;
wherein said deploying the graphical program on the smart camera comprises transferring the graphical program to the memory on the smart camera; and
wherein the smart camera executing to perform the image processing function on the image comprises the processor in the smart camera executing the graphical program from the memory.

### Claim 86 (depends on 84)

The method of claim 84, wherein the smart camera includes a processor and a memory;
wherein said deploying the graphical program on the smart camera comprises:
generating an executable program based on the graphical program, wherein the executable program implements functionality of the graphical program; and
transferring the executable program to the memory on the smart camera; and
wherein the smart camera executing to perform the image processing function on the image comprises the processor in the smart camera executing the executable program from the memory.

### Claim 87 (depends on 84)

The method of claim 84, wherein the smart camera includes a programmable hardware element;
wherein said deploying the graphical program on the smart camera comprises:
generating a hardware description based on the graphical program, wherein the hardware description describes a hardware implementation of the graphical program; and
configuring the programmable hardware element in the smart camera utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the graphical program; and
wherein the smart camera executing to perform the image processing function on the image comprises the programmable hardware element in the smart camera executing to perform the image processing function on the image.

### Claim 88 (depends on 84)

The method of claim 84, wherein the smart camera includes a processor and a memory and a programmable hardware element;
wherein said deploying the graphical program on the smart camera comprises:
transferring a first portion of the graphical program to the memory on the smart camera;
generating a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configuring the programmable hardware element in the smart camera utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program; and
wherein the smart camera executing to perform the image processing function on the image comprises the processor in the smart camera executing the first portion of the graphical program from the memory and the programmable hardware element executing the second portion of the graphical program.

### Claim 89 (depends on 88)

The method of claim 88,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 90 (depends on 88)

The method of claim 88,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 91 (depends on 84)

The method of claim 84, wherein the smart camera includes a processor and a memory and a programmable hardware element;
wherein said deploying the graphical program on the smart camera comprises:
generating an executable program based on a first portion of the graphical program, wherein the executable program implements functionality of the first portion of the graphical program; and
transferring the executable program to the memory on the smart camera;
generating a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configuring the programmable hardware element in the smart camera utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program; and
wherein the smart camera executing to perform the image processing function on the image comprises the processor in the smart camera executing the executable program from the memory and the programmable hardware element executing the second portion of the graphical program.

### Claim 92 (depends on 91)

The method of claim 91,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 93 (depends on 91)

The method of claim 91,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 94 (depends on 84)

The method of claim 84,
wherein the smart camera includes a first processor, a second processor, and at least one memory; and
wherein the smart camera executing to perform the image processing function on the image comprises the first processor in the smart camera executing a first portion of the graphical program from the at least one memory and the second processor in the smart camera executing a second portion of the graphical program from the at least one memory.

### Claim 95 (depends on 94)

The method of claim 94,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 96 (depends on 94)

The method of claim 94,
wherein the first portion of the graphical program comprises a first portion of the image processing function, and wherein the second portion of the graphical program comprises a second portion of the image processing function.

### Claim 97 (depends on 84)

The method of claim 84, further comprising:
the smart camera receiving an image present signal;
wherein the smart camera acquires the image of the object in response to receiving the image present signal.

### Claim 98 (depends on 84)

The method of claim 84, further comprising:
the smart camera performing a control operation after said executing to perform the image processing function on the image.

### Claim 99 (depends on 84)

The method of claim 84, further comprising:
the smart camera generating a pass/fail indication after said executing to perform the image processing function on the image.

### Claim 100 (depends on 84)

The method of claim 84,
wherein the smart camera acquiring an image of an object comprises the smart camera acquiring the image of the object and storing the image in a memory.

### Claim 101 (depends on 84)

The method of claim 84,
wherein said executing further comprises:
the smart camera determining characteristics of the image after performing the image processing function; and
the smart camera performing an operation based on the determined characteristics of the image.

### Claim 102 (depends on 84)

The method of claim 84,
wherein the graphical program includes a user interface portion;
the method further comprising:
presenting the user interface portion on a display during the smart camera executing to perform the image processing function on the image.

### Claim 103 (depends on 102)

The method of claim 102,
wherein the user interface portion operates as a front panel for the smart camera.

### Claim 104 (depends on 102)

The method of claim 102, further comprising:
receiving user input to the user interface portion on the display to control the smart camera during the programmable hardware element in the smart camera executing to perform the image processing function on the image.

### Claim 105 (depends on 102)

The method of claim 102, further comprising:
compiling the user interface portion into executable code for execution by a processor and storing the executable code in a memory; and
the processor executing the executable code from the memory to present the user interface portion on the display.

### Claim 106 (depends on 105)

The method of claim 105,
wherein the smart camera includes the processor and the memory; and
wherein the processor in the smart camera executes the executable code from the memory to present the user interface portion on the display during the smart camera executing to perform the image processing function on the image.

### Claim 107 (depends on 105)

The method of claim 105,
wherein the computer system includes the processor and the memory; and
wherein the computer system executes the executable code from the memory to present the user interface portion on the display during the smart camera executing to perform the image processing function on the image.

### Claim 108 (depends on 84)

The method of claim 84, wherein said creating the graphical program includes:
arranging on a display of the computer system a plurality of nodes comprising the graphical program and interconnecting the plurality of nodes; and
creating and storing data structures which represent the graphical program in response to said arranging and said interconnecting.

### Claim 109 (depends on 84)

The method of claim 84, wherein the graphical program comprises a data flow diagram.

### Claim 110 (depends on 84)

The method of claim 84, wherein the graphical program comprises one or more of data flow, control flow and execution flow constructs.

### Claim 111 (depends on 84)

The method of claim 84,
wherein said creating the graphical program is performed on the computer system;
wherein the smart camera is coupled to the computer system over a network; and
wherein said deploying the graphical program comprises the computer system deploying the graphical program over the network to the smart camera.

### Claim 112

A image processing system, comprising:
a computer system comprising a processor, memory and a display;
wherein the memory stores a graphical program, wherein the graphical program implements an image processing function, and wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program; and
wherein the memory also stores a software program which is executable to deploy the graphical program on the smart camera; and
a smart camera coupled to the computer system, wherein the smart camera includes:
a camera for acquiring an image; and
at least one functional unit coupled to the camera that is configurable based on the graphical program for performing the image processing function on the image.

### Claim 113 (depends on 112)

The image processing system of claim 112,
wherein the at least one functional unit comprises a second processor and a second memory;
wherein the software program is executable by the processor in the computer system to transfer the graphical program to the second memory on the smart camera; and
wherein the second processor in the smart camera is operable to execute the graphical program from the second memory.

### Claim 114 (depends on 112)

The image processing system of claim 112,
wherein the at least one functional unit comprises a second processor and a second memory;
wherein the software program is executable by the processor in the computer system to 1) generate an executable program based on the graphical program, wherein the executable program implements functionality of the graphical program, and 2) transfer the graphical program to the second memory on the smart camera; and
wherein the second processor in the smart camera is operable to execute the executable program from the second memory.

### Claim 115 (depends on 112)

The image processing system of claim 112,
wherein the at least one functional unit comprises a programmable hardware element; and
wherein the software program is executable by the processor in the computer system to generate a hardware description based on the graphical program and configure the programmable hardware element based on the hardware description, wherein after being configured the programmable hardware element implements a hardware implementation of the graphical program, and wherein the programmable hardware element in the smart camera is executable to perform an image processing function on an acquired image.

### Claim 116 (depends on 112)

The image processing system of claim 112,
wherein the at least one functional unit comprises a second processor, a second memory, and a programmable hardware element;
wherein the software program is executable by the processor in the computer system to:
transfer a first portion of the graphical program to the second memory on the smart camera;
generate a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configure the programmable hardware element in the smart camera utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program;
wherein the second processor in the smart camera is operable to execute the first portion of the graphical program from the second memory; and
wherein the programmable hardware element in the smart camera is operable to implement the second portion of the graphical program.

### Claim 117 (depends on 116)

The image processing system of claim 116,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 118 (depends on 116)

The image processing system of claim 116,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 119 (depends on 112)

The image processing system of claim 112,
wherein the at least one functional unit comprises a second processor, a second memory, and a programmable hardware element;
wherein the software program is executable by the processor in the computer system to:
generate an executable program based on a first portion of the graphical program, wherein the executable program implements functionality of the first portion of the graphical program;
transfer the executable program to the second memory on the smart camera;
generate a hardware description based on a second portion of the graphical program, wherein the hardware description describes a hardware implementation of the second portion of the graphical program; and
configure the programmable hardware element in the smart camera utilizing the hardware description, wherein after said configuring the programmable hardware element implements a hardware implementation of the second portion of the graphical program;
wherein the second processor in the smart camera is operable to execute the executable program from the second memory; and
wherein the programmable hardware element in the smart camera is operable to implement the second portion of the graphical program.

### Claim 120 (depends on 119)

The image processing system of claim 119,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 121 (depends on 119)

The image processing system of claim 119,
wherein the first portion of the graphical program comprises a control portion, and wherein the second portion of the graphical program comprises an image processing portion.

### Claim 122 (depends on 112)

The image processing system of claim 112,
wherein the at least one functional unit comprises a second processor, a third processor, and at least one memory; and
wherein the second processor in the smart camera is operable to execute a first portion of the graphical program from the at least one memory and the third processor in the smart camera is operable to execute a second portion of the graphical program from the at least one memory.

### Claim 123 (depends on 122)

The image processing system of claim 122,
wherein the first portion of the graphical program comprises an image processing portion, and wherein the second portion of the graphical program comprises a control portion.

### Claim 124 (depends on 122)

The image processing system of claim 122,
wherein the first portion of the graphical program comprises a first portion of the image processing function, and wherein the second portion of the graphical program comprises a second portion of the image processing function.

### Claim 125 (depends on 112)

The image processing system of claim 112,
wherein the smart camera is operable to receive an image present signal; and
wherein the smart camera is operable to acquire the image of the object in response to receiving the image present signal.

### Claim 126 (depends on 112)

The image processing system of claim 112,
wherein the smart camera is operable to perform a control operation after executing to perform the image processing function on the image.

### Claim 127 (depends on 112)

The image processing system of claim 112,
wherein the smart camera is operable to generate a pass/fail indication after executing to perform the image processing function on the image.

### Claim 128 (depends on 112)

The image processing system of claim 112,
wherein the smart camera includes a memory for storing an acquired image.

### Claim 129 (depends on 112)

The image processing system of claim 112,
wherein the smart camera is operable to determine characteristics of the image after performing the image processing function; and
wherein the smart camera is operable to perform an operation based on the determined characteristics of the image.

### Claim 130 (depends on 112)

The image processing system of claim 112,
wherein the graphical program includes a user interface portion; and
wherein the computer system is operable to present the user interface portion on a display when the at least one functional unit in the smart camera executes to perform the image processing function on the image.

### Claim 131 (depends on 130)

The image processing system of claim 130,
wherein the user interface portion operates as a front panel for the smart camera.

### Claim 132 (depends on 130)

The image processing system of claim 130,
wherein the computer system further comprises a user input device for receiving user input to the user interface portion on the display; and
wherein the user input is operable to control the smart camera when the at least one functional unit in the smart camera executes to perform the image processing function on the image.

### Claim 133 (depends on 130)

The image processing system of claim 130,
wherein the user interface portion is operable to be compiled into executable code for execution by the processor and stored in the memory; and
wherein the processor is operable to execute the executable code from the memory to present the user interface portion on the display.

### Claim 134 (depends on 112)

The image processing system of claim 112,
wherein the memory of the computer system stores a graphical program development program for creating the graphical program; and
wherein the graphical program development program is executable to:
arrange on the screen a plurality of nodes comprising the graphical program and interconnect the plurality of nodes in response to user input; and
create and store data structures which represent the graphical program in response to said user input.

### Claim 135 (depends on 112)

The image processing system of claim 112, wherein the graphical program comprises one or more of data flow, control flow and execution flow constructs.

### Claim 136 (depends on 112)

The image processing system of claim 112,
wherein the smart camera is coupled to the computer system over a network; and
wherein the computer system is operable to deploy the graphical program over the network to the smart camera.

### Claim 137

A smart camera, comprising:
a camera for acquiring an image of an object;
a memory coupled to the camera for storing data corresponding to the image of the object, wherein the memory also stores a graphical program, wherein the graphical program implements an image processing function; and
a processor coupled to the memory, wherein the processor is operable to execute the graphical program to perform the image processing function on an acquired image.

### Claim 138 (depends on 137)

The smart camera of claim 137,
wherein the memory further stores a graphical program execution engine; and
wherein the processor is operable to execute the graphical program execution engine in executing the graphical program.

### Claim 139 (depends on 137)

The smart camera of claim 137,
wherein the memory further stores a real time operating system; and
wherein the processor is operable to execute the real time operating system in executing the graphical program.

### Claim 140 (depends on 137)

The smart camera of claim 137,
wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 141 (depends on 137)

The smart camera of claim 137,
wherein the graphical program is created by assembling a plurality of interconnected nodes which visually indicate functionality of the graphical program in response to user input.

### Claim 142 (depends on 137)

The smart camera of claim 137, wherein the smart camera further comprises:
analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog image to produce a digital image.

### Claim 143 (depends on 137)

The smart camera of claim 137,
wherein the smart camera further includes timer/counter logic; and
wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the smart camera executes to perform the image processing function on the image.

### Claim 144

A smart camera, comprising:
a camera for acquiring an image of an object;
a memory coupled to the camera for storing data corresponding to the image of the object, wherein the memory also stores a software program, wherein the software program implements an image processing function, and wherein the software program is created based on a graphical program; and
a processor coupled to the memory, wherein the processor is operable to execute the software program to perform the image processing function on an acquired image.

### Claim 145 (depends on 144)

The smart camera of claim 144,
wherein the memory further stores a real time operating system; and
wherein the processor is operable to execute the real time operating system in executing the graphical program.

### Claim 146 (depends on 144)

The smart camera of claim 144,
wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 147 (depends on 144)

The smart camera of claim 144,
wherein the graphical program is created by assembling a plurality of interconnected nodes which visually indicate functionality of the graphical program in response to user input.

### Claim 148 (depends on 144)

The smart camera of claim 144, wherein the smart camera further comprises:
analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog image to produce a digital image.

### Claim 149 (depends on 144)

The smart camera of claim 144,
wherein the smart camera further includes timer/counter logic; and
wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the smart camera executes to perform the image processing function on the image.

### Claim 150

A smart camera, comprising:
a camera for receiving an image of an object;
a memory coupled to the camera for storing data corresponding to the image of the object; and
a programmable hardware element coupled to the memory that is configured to implement an image processing function, wherein the programmable hardware element in the smart camera is configured utilizing a hardware description generated from a graphical program, wherein the programmable hardware element implements a hardware implementation of the graphical program, and wherein the programmable hardware element in the smart camera is operable to perform an image processing function on the image.

### Claim 151 (depends on 150)

The smart camera of claim 150,
wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 152 (depends on 150)

The smart camera of claim 150,
wherein the graphical program is created by assembling a plurality of interconnected nodes which visually indicate functionality of the graphical program in response to user input.

### Claim 153 (depends on 150)

The smart camera of claim 150, wherein the smart camera further comprises:
analog to digital conversion logic coupled to the input and to the programmable hardware element for performing analog to digital conversion logic on an acquired analog image to produce a digital image.

### Claim 154 (depends on 150)

The smart camera of claim 150,
wherein the smart camera further includes timer/counter logic; and
wherein the timer/counter logic performs one of timing/counting operations while the programmable hardware element in the smart camera executes to perform the image processing function on the image.

### Claim 155 (depends on 150)

The smart camera of claim 150, wherein the programmable hardware element comprises a field programmable gate array (FPGA).

### Claim 156 (depends on 150)

The smart camera of claim 150,
wherein the smart camera further includes a non-volatile memory coupled to the programmable hardware element;
wherein the non-volatile memory is operable to store the hardware description; and
wherein the non-volatile memory is operable to transfer the hardware description to the programmable hardware element to configure the programmable hardware element.

### Claim 157

A method for configuring a smart camera to perform an image processing function, the method comprising:
coupling the smart camera to a computer system, wherein the smart camera comprises at least one functional unit, wherein the computer system stores a graphical program, wherein the graphical program implements the image processing function; and
deploying the graphical program onto the functional unit in the smart camera to configure the functional unit;
wherein after said deploying the functional unit is operable to implement the graphical program.

### Claim 158 (depends on 157)

The method of claim 157, further comprising:
disconnecting the smart camera from the computer system after said deploying.

### Claim 159 (depends on 157)

The method of claim 157, further comprising:
creating the graphical program prior to said deploying, wherein the graphical program comprises a plurality of interconnected nodes which visually indicate functionality of the graphical program.

### Claim 160 (depends on 157)

The method of claim 157,
wherein the functional unit is a processor and memory;
wherein said deploying the graphical program onto the functional unit comprises transferring the graphical program to the memory of the functional unit; and
wherein the processor in the smart camera is operable to execute the graphical program from the memory.

### Claim 161 (depends on 157)

The method of claim 157,
wherein the functional unit is a processor and memory;
wherein said deploying the graphical program onto the functional unit comprises:
generating an executable program based on the graphical program, wherein the executable program implements functionality of the graphical program; and
transferring the executable program to the memory on the smart camera; and
wherein the processor in the smart camera is operable to execute the executable program from the memory.

### Claim 162 (depends on 157)

The method of claim 157,
wherein the functional unit is a programmable hardware element;
wherein said deploying the graphical program onto the functional unit comprises:
downloading a hardware configuration onto the programmable hardware element in the smart camera to configure the programmable hardware element, wherein the hardware configuration corresponds to a hardware implementation of the graphical program; and
wherein after said downloading the programmable hardware element implements a hardware implementation of the graphical program.
