Augmented reality maps
AssigneeApple Inc.
InventorJaron Waldman
Life of this patent
Estimating the term…
Abstract
A user points a handheld communication device to capture and display a real-time video stream. The handheld communication device detects geographic position, camera direction, and tilt of the image capture device. The user sends a search request to a server for nearby points of interest. The handheld communication device receives search results based on the search request, geographic position, camera direction, and tilt of the handheld communication device. The handheld communication device visually augments the captured video stream with data related to each point of interest. The user then selects a point of interest to visit. The handheld communication device visually augments the captured video stream with a directional map to a selected point of interest in response to the user input.
Claims25
A method implemented on a handheld communication device having a processor, an image capture device, and a display, the method comprising:
- presenting a captured image on the display, the image being captured by the image capture device;
- detecting a geographic position of the handheld communication device and a camera direction of the image capture device;
- determining a field of view based on the geographic position and the camera direction;
- processing map data describing streets, buildings, and points of interest near the geographic position of the handheld communication device;
- receiving a search input for one or more points of interest within the field of view of the captured image displayed on the display of the handheld communication device;
- identifying one or more points of interest in accordance with the received search input for the one or more points of interest that are:
- within the field of view of the captured image;
- within a certain distance of the geographic position;
- and
- obstructed by an in-screen object;
- and
- visually augmenting the captured image with an indication of each of the one or more identified points of interest.
A non-transitory computer-readable memory storing instructions which, when executed by one or more processors, cause the one or more processors to:
- present a captured image on a display, the image being captured by an image capture device;
- detect a geographic position of a handheld communication device and a camera direction of the image capture device;
- determine a field of view based on the geographic position and the camera direction;
- process map data describing streets, buildings, and points of interest near the geographic position of the handheld communication device;
- receive a search input for one or more points of interest within the field of view of the captured image displayed on the display of the handheld communication device;
- identify one or more points of interest in accordance with the received search input for the one or more points of interest that are:
- within the field of view of the captured image;
- within a certain distance of the geographic position;
- and
- obstructed by an in-screen object;
- and
- visually augment the captured image with an indication of each of the one or more identified points of interest.
A system comprising:
- a memory and one or more processors configured to:
- present a captured image on a display, the image being captured by an image capture device;
- detect a geographic position of a handheld communication device and a camera direction of the image capture device;
- determine a field of view based on the geographic position and the camera direction;
- process map data describing streets, buildings, and points of interest near the geographic position of the handheld communication device;
- receive a search input for one or more points of interest within the field of view of the captured image displayed on the display of the handheld communication device;
- identify one or more points of interest in accordance with the received search input for the one or more points of interest that are:
- within the field of view of the captured image;
- within a certain distance of the geographic position;
- and
- obstructed by an in-screen object;
- and
- visually augment the captured image with an indication of each of the one or more identified points of interest.
Dependencies are inferred from the claim text.