# US 2004/0083451 A1 · Method for developing embedded code for system simulations and for use in a HMI

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0083451 A1
- Document ID: US20040083451A1
- Status: Published application
- Kind: A1
- Application number: 10/279,547
- Filed: 2002-10-24
- Published: 2004-04-29
- Earliest claimed: 2002-10-24
- Assignees: Visteon Global Technologies, Inc.
- Inventors: Peter S. Abowd; Dimitri Khijniak
- Web page: https://patentgrep.com/patent/US20040083451A1

## CPC

- G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30)
- G06F 2111/18: using virtual or augmented reality
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present invention concerns a method and apparatus for integrating a CAD model of a product and an HMI simulation model of a product into a format suitable to be run in a virtual reality program. The method and apparatus according to the present invention includes the steps of providing a CAD model and a simulation model of the product. The simulation model includes an HMI simulation portion and an electronics/mechanical simulation portion. The CAD model and the HMI simulation portion of the simulation model are then integrated into a virtual reality representation of the product and modeled in the virtual reality program.

## Claims

### Claim 1

A method for integrating a CAD model of a product and an HMI simulation model of a product into a format suitable to be run in a virtual reality program, said method comprising the steps of:
a) providing a CAD model of the product;
b) providing a simulation model of the product, said simulation model including a HMI simulation portion and an electronics/mechanical simulation portion;
c) integrating the CAD model and the HMI simulation portion of the simulation model into a virtual reality representation of the product; and
d) modeling the integrated CAD model and simulation model in the virtual reality program.

### Claim 2 (depends on 1)

The method according to claim 1 wherein step c) is performed by characterizing said HMI simulation portion as a surface texture of the product in the virtual reality program.

### Claim 3

A method for developing embedded object code for a controllable electronic product having a programmable user interface and a processor operable to execute the embedded code, said method comprising the steps of:
a) providing a CAD model of the product;
b) providing a simulation model of the product, said simulation model including a HMI simulation portion and an electronics/mechanical simulation portion;
c) integrating said CAD model and said HMI simulation portion of said simulation model into a virtual reality representation of the product; and
d) modeling said integrated CAD model and simulation model in a virtual reality program;
e) modifying said HMI simulation portion of said simulation model in response to performance of said integrated CAD model and simulation model in the virtual reality program;
f) outputting object code modeled by said modified system, said object code including said HMI simulation portion and said electronics/mechanical simulation portion; and
g) embedding said object code in the product processor.

### Claim 4 (depends on 3)

The method according to claim 3 including, prior to step a), creating a two dimensional image of a visual display of the user interface and creating a CAD model of said two dimensional image.

### Claim 5 (depends on 4)

The method according to claim 4 wherein said CAD model is a three dimensional CAD model.

### Claim 6 (depends on 4)

The method according to claim 4 wherein said two dimensional image is created by a photo quality graphic rendering tool.

### Claim 7 (depends on 3)

The method according to claim 3 wherein steps e) and f) are performed by a simulation program.

### Claim 8 (depends on 3)

The method according to claim 3 wherein step c) is performed by characterizing said HMI simulation portion as a surface texture of the product in the virtual reality program.

### Claim 9 (depends on 3)

The method according to claim 3 including performing steps a) through c) at least twice to provide a plurality of HMI simulation portions, and performing step d) utilizing the plurality of HMI simulation portions.

### Claim 10 (depends on 9)

The method according to claim 9 wherein the virtual reality program performs step d) remotely from each of the plurality of HMI simulation portions.

### Claim 11

An apparatus for developing embedded object code or a human machine interface, said apparatus comprising:
CAD means for providing a CAD model of the product;
first modeling means for providing a simulation model of the product, said simulation model including a HMI simulation portion and an electronics/mechanical simulation portion;
integrating means for integrating said CAD model and said HMI simulation portion of said simulation model into a virtual reality representation of the product utilizing a means for integrating the models; and
second modeling means for modeling said integrated CAD model and simulation model in a virtual reality program;
modification means for modifying said HMI simulation portion of said simulation model in response to performance of said integrated CAD model and simulation model in the virtual reality program;
output means for outputting object code modeled by said modified system, said object code including said HMI simulation portion and said electronics/mechanical simulation portion; and
embedding means for embedding said object code in the product processor.

### Claim 12 (depends on 11)

The apparatus according to claim 11 wherein said CAD means incorporates a two dimensional image of a visual display of the user interface.

### Claim 13 (depends on 11)

The apparatus according to claim 11 wherein said CAD model is a three dimensional CAD model.

### Claim 14 (depends on 11)

The apparatus according to claim 11 wherein said two dimensional image is created by photo quality graphic rendering tool.

### Claim 15 (depends on 11)

The apparatus according to claim 11 wherein said integrating means characterizes said HMI simulation portion as a surface texture of the product in the virtual reality program.

### Claim 16 (depends on 11)

The apparatus according to claim 11 including a plurality of CAD means and first modeling means for providing a simulation model for a plurality of products, and wherein said second modeling means utilizes the plurality of products when modeling said integrated CAD model and simulation model in a virtual reality program.

### Claim 17 (depends on 16)

The apparatus according to claim 16 wherein the virtual reality program models the plurality or products remotely from each of the plurality of products.
