# US 2024/0200956 A1 · Navigation through real-time street view

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0200956 A1
- Document ID: US20240200956A1
- Status: Published application
- Kind: A1
- Application number: 18/065,823
- Filed: 2022-12-14
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Chun-Sheng Chung; Yu-Ning Hsu; Zen-Jerr Hong; Tien Yu Chu
- Web page: https://patentgrep.com/patent/US20240200956A1

## CPC

- G01C 21/3461: {Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types or segments such as motorways, toll roads or ferries}
- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- G01C 21/3617: {using user history, behaviour, conditions or preferences, e.g. predicted or inferred from previous use or current movement}
- G01C 21/3629: {Guidance using speech or audio output, e.g. text-to-speech (text to speech systems per se G10L13/00)}
- G01C 21/3638: {including 3D objects and buildings (three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05)}
- G01C 21/3644: {Landmark guidance, e.g. using POIs or conspicuous other objects}
- G01C 21/3647: {Guidance involving output of stored or live camera images or video streams}
- G01C 21/3691: {Retrieval, searching and output of information related to real-time traffic, weather, or environmental conditions (arrangements for giving variable traffic instructions G08G1/09)}
- G06V 20/20: in augmented reality scenes
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

According to one embodiment, a method, computer system, and computer program product for real-time navigation is provided. The embodiment may include capturing one or more visual input streams. The embodiment may also include collecting data, including location data and a collected visual input stream from the one or more visual input streams. The embodiment may further include identifying items from the collected visual input stream. The embodiment may also include determining an optimal route based on the collected data. The embodiment may further include providing the optimal route to a user based on a context of the identified items.

## Claims

### Claim 1

A processor-implemented method, the method comprising:
capturing one or more visual input streams;
collecting data, including location data and a collected visual input stream from the one or more visual input streams;
identifying items from the collected visual input stream;
determining an optimal route based on the collected data; and
providing the optimal route to a user based on a context of the identified items.

### Claim 2 (depends on 1)

The method of claim 1, wherein identifying items is performed using visual recognition techniques.

### Claim 3 (depends on 1)

The method of claim 1, wherein the identified items include a building or landmark.

### Claim 4 (depends on 1)

The method of claim 1, wherein the optimal route is selected by a comparison to similar routes from the collected data.

### Claim 5 (depends on 1)

The method of claim 1, wherein providing the optimal route includes providing an augmented reality overlay over a street-level visual input stream from the one or more visual input streams.

### Claim 6 (depends on 1)

The method of claim 1, wherein providing the optimal route includes a natural language explanation of the context of the identified items.

### Claim 7 (depends on 1)

The method of claim 1, wherein the captured location data includes geolocation data obtained using a global navigation system and a geofence.

### Claim 8

A computer system, the computer system comprising:
one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising:
capturing one or more visual input streams;
collecting data, including location data and a collected visual input stream from the one or more visual input streams;
identifying items from the collected visual input stream;
determining an optimal route based on the collected data; and
providing the optimal route to a user based on a context of the identified items.

### Claim 9 (depends on 8)

The computer system of claim 8, wherein identifying items is performed using visual recognition techniques.

### Claim 10 (depends on 8)

The computer system of claim 8, wherein the identified items include a building or landmark.

### Claim 11 (depends on 8)

The computer system of claim 8, wherein the optimal route is selected by a comparison to similar routes from the collected data.

### Claim 12 (depends on 8)

The computer system of claim 8, wherein providing the optimal route includes providing an augmented reality overlay over a street-level visual input stream from the one or more visual input streams.

### Claim 13 (depends on 8)

The computer system of claim 8, wherein providing the optimal route includes a natural language explanation of the context of the identified items.

### Claim 14 (depends on 8)

The computer system of claim 8, wherein the captured location data includes geolocation data obtained using a global navigation system and a geofence.

### Claim 15

A computer program product, the computer program product comprising:
one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more tangible storage medium, the program instructions executable by a processor capable of performing a method, the method comprising:
capturing one or more visual input streams;
collecting data, including location data and a collected visual input stream from the one or more visual input streams;
identifying items from the collected visual input stream;
determining an optimal route based on the collected data; and
providing the optimal route to a user based on a context of the identified items.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein identifying items is performed using visual recognition techniques.

### Claim 17 (depends on 15)

The computer program product of claim 15, wherein the identified items include a building or landmark.

### Claim 18 (depends on 15)

The computer program product of claim 15, wherein the optimal route is selected by a comparison to similar routes from the collected data.

### Claim 19 (depends on 15)

The computer program product of claim 15, wherein providing the optimal route includes providing an augmented reality overlay over a street-level visual input stream from the one or more visual input streams.

### Claim 20 (depends on 15)

The computer program product of claim 15, wherein providing the optimal route includes a natural language explanation of the context of the identified items.
