# US 2023/0069742 A1 · Gazed based generation and presentation of representations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069742 A1
- Document ID: US20230069742A1
- Status: Published application
- Kind: A1
- Application number: 17/459,143
- Filed: 2021-08-27
- Published: 2023-03-02
- Earliest claimed: 2021-08-27
- Assignees: Toyota Motor Engineering & Manufacturing North America, Inc.
- Applicants: Toyota Motor Engineering & Manufacturing North America, Inc.
- Inventors: John C. Rafferty
- Web page: https://patentgrep.com/patent/US20230069742A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- B60R 1/23: with a predetermined field of view
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- B60R 2011/004: {outside the vehicle}
- B60R 2300/80: characterised by the intended use of the viewing arrangement
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

A method for granting access to vehicle functionalities is provided. The method includes receiving a signal from a device that is external to the vehicle, the signal including identification data of an object associated with the device, comparing the identification data with user identifications stored in the memory of the vehicle, and granting, to the object, access to a first set of functionalities of the vehicle in response to determining that the identification data matches a first user identification of the user identifications stored in the memory of the vehicle.

## Claims

### Claim 1

A method implemented by a computing device of a vehicle, the method comprising:
detecting, using a sensor operating in conjunction with the computing device of the vehicle, a gaze of a user relative to one or more input devices positioned in an interior of the vehicle; and
presenting a representation of the one or more input devices on a surface of the vehicle that is adjacent to the user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the representation includes interactive icons.

### Claim 3 (depends on 2)

The method of claim 2, wherein each of the interactive icons corresponds to a respective one of the one or more input devices positioned in the interior of the vehicle.

### Claim 4 (depends on 1)

The method of claim 1, wherein the user is positioned in a rear passenger seat of the vehicle.

### Claim 5 (depends on 1)

The method of claim 1, wherein the one or more input devices are positioned on an additional surface of the vehicle, the additional surface is adjacent to a front seat of the vehicle.

### Claim 6 (depends on 4)

The method of claim 4, wherein the surface of the vehicle that is adjacent to the user is located on a rear-passenger window adjacent to the rear passenger seat in which the user is positioned.

### Claim 7 (depends on 1)

The method of claim 1, wherein the sensor is a camera.

### Claim 8 (depends on 1)

The method of claim 1, further comprising detecting, using an additional sensor operating in conjunction with the computing device, an input from the user relative to the representation, the additional sensor is a touch sensor.

### Claim 9 (depends on 8)

The method of claim 8, further comprising controlling, by the computing device, an operation associated with the vehicle responsive to the detecting of the input relative to the representation.

### Claim 10 (depends on 8)

The method of claim 8, wherein the detecting of the input from the user relative to the representation corresponds to the user selecting an icon of a plurality of interactive icons included in the representation.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
transmitting, by the computing device, instructions associated with the representation of the one or more input devices to an additional device that is external to the vehicle; and
presenting, based on the instructions, the representation on a display of the additional device that is external to the vehicle.

### Claim 12 (depends on 11)

The method of claim 11, further comprising receiving, by the computing device, data associated with an additional input of the user associated with the representation that is output on the display of the additional device that is external to the vehicle.

### Claim 13 (depends on 12)

The method of claim 12, further comprising controlling, by the computing device, an additional operation associated with the vehicle responsive to receiving the data associated with the additional input.

### Claim 14

A vehicle comprising:
a sensor and; and
a computing device that is communicatively coupled to the sensor and the computing device is configured to:
detecting, using the sensor operating in conjunction with the computing device of the vehicle, a gaze of a user relative to one or more input devices positioned in an interior of the vehicle; and
presenting a representation of the one or more input devices on a surface of the vehicle that is adjacent to the user.

### Claim 15 (depends on 14)

The vehicle of claim 14, wherein the representation includes interactive icons.

### Claim 16 (depends on 15)

The vehicle of claim 15, wherein each of the interactive icons corresponds to a respective one of the one or more input devices positioned in the interior of the vehicle.

### Claim 17 (depends on 14)

The vehicle of claim 14, wherein the surface of the vehicle that is adjacent to the user is located on a rear-passenger window adjacent to a rear passenger seat in which the user is positioned.

### Claim 18

A vehicle comprising:
a sensor and an image capture device positioned on an exterior portion of the vehicle;
a computing device communicatively coupled to each of the sensor and the image capture device, the computing device is configured to:
detect, using the sensor, a gaze of a user relative to a location that is external to the vehicle;
capture, using the image capture device, a real-time video stream of the location that is external to the vehicle;
generate, responsive to the gaze of the user, a representation of the location that is external to the vehicle from the real-time video stream; and
present, on a surface of the vehicle that is adjacent to the user, the representation of the location that is included in the real-time video stream.

### Claim 19 (depends on 18)

The vehicle of claim 18, wherein the computing device that is configured to present the representation of the location includes presenting an enlarged digital image of the location that is external to the vehicle.

### Claim 20 (depends on 19)

The vehicle of claim 19, wherein the computing device that is configured to present the representation of the location includes presenting an enlarged version of the real-time video stream of the location that is external to the vehicle.
