# US 2022/0036758 A1 · System and method for providing vehicle function guidance and virtual test-driving experience based on augmented reality content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036758 A1
- Document ID: US20220036758A1
- Status: Published application
- Kind: A1
- Application number: 16/944,984
- Filed: 2020-07-31
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: Inventis Co., Ltd.
- Applicants: Inventis Co.,Ltd
- Inventors: HOON TACK OH
- Web page: https://patentgrep.com/patent/US20220036758A1

## CPC

- G09B 9/05: the view from a vehicle being simulated (G09B9/052, G09B9/058 take precedence)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G09B 19/167: {Control of land vehicles}
- H04R 2499/13: Acoustic transducers and sound field adaptation in vehicles
- H04S 7/302: {Electronic adaptation of stereophonic sound system to listener position or orientation (H04S7/301 takes precedence)}
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- H04S: STEREOPHONIC SYSTEMS

## Abstract

A system for providing vehicle function guidance and test-driving experience based on augmented reality content according to an embodiment includes: an augmented reality terminal for executing a vehicle description application realizing a vehicle function guidance or test-driving experience providing service on the basis of augmented reality content; a window display device provided on at least two windows including the front side of a vehicle and displaying the augmented reality content; a vehicle speaker for outputting audio according to the augmented reality content; a virtual driving device for providing haptic including predetermined vibration or tilting in the vehicle; and a test-driving experience service providing server for controlling the window display device, the vehicle speaker or the virtual driving device in connection with the vehicle description application.

## Claims

### Claim 1

A system for providing vehicle function guidance and test-driving experience based on augmented reality content, the system comprising:
an augmented reality terminal for executing a vehicle description application realizing a vehicle function guidance or test-driving experience providing service on the basis of augmented reality content;
a window display device provided on at least two windows including the front side of a vehicle and displaying the augmented reality content;
a vehicle speaker for outputting audio according to the augmented reality content;
a virtual driving device for providing haptic including predetermined vibration or tilting in the vehicle; and
a test-driving experience service providing server for controlling the window display device, the vehicle speaker or the virtual driving device in connection with the vehicle description application.

### Claim 2 (depends on 1)

The system of claim 1, further comprising an active suspension system for providing a predetermined vibrating or tilting effect delivered to the vehicle.

### Claim 3 (depends on 2)

The system of claim 2, wherein the test-driving experience service providing server controls at least one of the virtual driving device and the active suspension system such that the vibrating or tilting effect corresponding to the augmented reality content is delivered to the vehicle.

### Claim 4 (depends on 3)

The system of claim 3, wherein, when entry of the augmented reality terminal into the vehicle is detected, the test-driving experience service providing server provides a test-driving experience mode in which functions of the vehicle are experienced using the augmented reality content on the basis of the vehicle description application of the detected augmented reality terminal.

### Claim 5 (depends on 4)

The system of claim 4, wherein the test-driving experience mode includes a vehicle function virtual experience mode in which guidance of functions of the vehicle is provided on the basis of the augmented reality content and a vehicle test-driving virtual experience mode in which a user enters the vehicle and experiences virtual driving.

### Claim 6 (depends on 5)

The system of claim 5, wherein the test-driving experience service providing server executes the vehicle function virtual experience mode to provide guide information about a first vehicle function matching an object sensed by an image sensor of the augmented reality terminal.

### Claim 7 (depends on 6)

The system of claim 6, wherein the test-driving experience service providing server controls the augmented reality terminal to provide the guide information about the first vehicle function through a virtual avatar based on augmented reality.

### Claim 8 (depends on 5)

The system of claim 5, wherein the test-driving experience service providing server executes the vehicle test-driving virtual experience mode to provide a virtual driving environment setting interface by which at least one of a virtual driving parameter and a scenario for setting an environment of the virtual driving on the basis of the vehicle description application is set.

### Claim 9 (depends on 8)

The system of claim 8, wherein the test-driving experience service providing server provides a test-driving virtual experience scenario image which is an augmented reality image providing the virtual driving experience environment on the basis of at least one of the set virtual driving parameter and scenario.

### Claim 10 (depends on 9)

The system of claim 9, wherein, when the test-driving virtual experience scenario image is output, the test-driving experience service providing server includes event content related to a second vehicle function in the test-driving virtual experience scenario image and outputs the test-driving virtual experience scenario image.

### Claim 11 (depends on 10)

The system of claim 10, wherein the test-driving experience service providing server provides the test-driving virtual experience scenario image on the basis of at least one of a user input for performing an operation with respect to driving of the vehicle and an input for operation according to automatic activation of the second vehicle function upon output of the event content.

### Claim 12

A method for providing vehicle function guidance and test-driving experience based on augmented reality content in a test-driving experience service providing server, the method comprising:
detecting entry of an augmented reality terminal into a vehicle;
executing a vehicle description application on the basis of the detected augmented reality terminal;
providing a test-driving experience mode in which functions of the vehicle are experienced using the augmented reality content on the basis of the executed vehicle description application;
executing the determined test-driving experience mode;
outputting the augmented reality content on the basis of the executed test-driving experience mode; and
providing a predetermined vibrating or tilting effect according to the output augmented reality content to the vehicle.

### Claim 13 (depends on 12)

The method of claim 12, wherein the executing of the determined test-driving experience mode comprises:
executing a vehicle function virtual experience mode in which guidance of functions of the vehicle is provided on the basis of the augmented reality content; or
executing a vehicle test-driving virtual experience mode in which a user enters the vehicle and experience virtual driving.

### Claim 14 (depends on 12)

The method of claim 12, wherein the outputting of the augmented reality content comprises providing the augmented reality content on the basis of at least one of a user input for performing an operation with respect to driving of the vehicle and an input for operation according to automatic activation of a function of the vehicle.
