# US 8,280,405 B2 · Location based wireless collaborative environment with a visual user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,405 B2
- Document ID: US8280405B2
- Status: Granted
- Kind: B2
- Application number: 11/618,672
- Filed: 2006-12-29
- Published: 2007-10-18
- Granted: 2012-10-02
- Earliest claimed: 2005-12-29
- Assignees: Aechelon Technology, Inc.
- Inventors: Ignacio Sanz-Pastor; David L. Morgan, III; Javier Castellar
- Web page: https://patentgrep.com/patent/US8280405B2

## CPC

- H04L 67/148: Migration or transfer of sessions
- H04L 51/222: using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
- H04L 67/14: Session management (for real-time applications in data packet communications networks H04L65/1066)
- H04L 67/52: specially adapted for the location of the user terminal
- H04L 67/75: Indicating network or usage conditions on the user display
- H04W 4/02: Services making use of location information
- H04W 4/185: {by embedding added-value information into content, e.g. geo-tagging}
- H04W 8/24: Transfer of terminal data
- H04W 64/006: {with additional information processing, e.g. for direction or speed determination}
- H04W 92/18: between terminal devices
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A wireless networked device incorporating a display, a video camera and a geo-location system receives geo-located data messages from a server system. Messages can be viewed by panning the device, revealing the message's real world location as icons and text overlaid on top of the camera input on the display. The user can reply to the message from her location, add data to an existing message at its original location, send new messages to other users of the system or place a message at a location for other users. World Wide Web geo-located data can be explored using the system's user interface as a browser. The server system uses the physical location of the receiving device to limit messages and data sent to each device according to range and filtering criteria, and can determine line of sight between the device and each actual message to simulate occlusion effects.

## Claims

### Claim 1

A method for wireless collaboration, the method comprising:
sending an update request from a first device to a message server, the update request including first location data associated with a current position of the first device;
displaying on a screen of the first device an image captured by a camera of the first device;
receiving from the message server a first message, the first message originated by a second device and including second location data independent of location of the second device and describing a location associated with the first message;
determining, by the first device, whether a location identified by the second location data is visible on the displayed image captured by the camera of the first device; and
responsive to the identified location being visible on the displayed image, rendering at least a portion of the first message on the screen of the first device at a point overlaying the position of the identified location.

### Claim 2 (depends on 1)

The method of claim 1 wherein the update request includes a second message, the second message addressed to a third device.

### Claim 3 (depends on 1)

The method of claim 1 wherein the update request includes a second message, the second message addressed to a plurality of devices.

### Claim 4 (depends on 1)

The method of claim 1 wherein rendering the first message on the screen of the first device further comprises displaying an icon at the location of the first message.

### Claim 5 (depends on 1)

The method of claim 1 wherein rendering the first message on the screen of the first device further comprises displaying text at the location of the first message.

### Claim 6 (depends on 5)

The method of claim 5 wherein the text includes a sender of the first message.

### Claim 7 (depends on 5)

The method of claim 5 wherein the text includes a subject of the first message.

### Claim 8 (depends on 5)

The method of claim 5 wherein the text includes a time of the first message.

### Claim 9 (depends on 5)

The method of claim 5 wherein the text includes a range from a current location of the first device to the location of the first message.

### Claim 10 (depends on 1)

The method of claim 1 wherein the location of the first message includes latitude and longitude coordinates.

### Claim 11 (depends on 10)

The method of claim 10 wherein the location of the first message includes elevation coordinates.

### Claim 12 (depends on 1)

The method of claim 1 wherein the location of the first message includes geolocation tags.

### Claim 13 (depends on 12)

The method of claim 12 wherein the geolocation tags are specified using XML.

### Claim 14 (depends on 1)

The method of claim 1 wherein the update request further includes a maximum range, and a distance from the current position of the first device to the location associated with the first message is less than the maximum range.

### Claim 15

A device for wireless collaboration, the device comprising:
a geolocation device adapted to determine a current position of the device;
a video camera adapted to capture an image;
a display screen, adapted to display the image captured by the video camera;
a wireless network interface adapted to send an update request from the device to a message server, the update request including the current position of the device determined by the geolocation device, and further adapted to receive from the message server a first message, the first message originated by a second device and including second location data associated with the first message;
a client message management module, adapted to determine whether a location identified by the second location data is visible on the image captured by the video camera; and
a graphics rendering engine, adapted to render at least a portion of the first message on the display screen at a point overlaying the position of the identified location, responsive to a determination by the client message management module that the location identified by the second location data is visible on the image captured by the video camera.

### Claim 16 (depends on 15)

The device of claim 15, wherein the wireless network interface is further adapted to include in the update request a second message, the second message addressed to a third device.

### Claim 17 (depends on 15)

The device of claim 15, wherein the wireless network interface is further adapted to include in the update request a second message, the second message addressed to a plurality of devices.

### Claim 18 (depends on 15)

The device of claim 15 wherein the rendered portion of the first message includes an icon at the location of the first message.

### Claim 19 (depends on 15)

The device of claim 15 wherein the rendered portion of the first message includes test at the location of the first message.

### Claim 20 (depends on 19)

The device of claim 19 wherein the text includes a sender of the first message.

### Claim 21 (depends on 19)

The device of claim 19 wherein the text includes a subject of the first message.

### Claim 22 (depends on 19)

The device of claim 19 wherein the text includes a time of the first message.

### Claim 23 (depends on 19)

The device of claim 19 wherein the text includes a range from a current location of the first device to the location of the first message.

### Claim 24 (depends on 15)

The device of claim 15 wherein the second location data includes latitude and longitude coordinates.

### Claim 25 (depends on 24)

The device of claim 24 wherein the second location data includes elevation coordinates.

### Claim 26 (depends on 24)

The device of claim 24 wherein the second location data includes geolocation tags.

### Claim 27 (depends on 15)

The device of claim 15 wherein the wireless network interface is further adapted to include in the update request a maximum range, and a distance from the current position of the device to the location identified by the second location data is less than the maximum range.

### Claim 28

A computer program product for wireless collaboration, the computer program product stored on a non-transitory computer-readable medium and including instructions adapted to cause a processor to carry out the steps of:
sending an update request from a first device to a message server, the update request including first location data associated with a current position of the first device;
displaying on a screen of the first device an image captured by a camera of the first device;
receiving from the message server a first message, the first message originated by a second device and including second location data independent of a location of the second device and describing a location associated with the first message;
determining, by the first device, whether a location identified by the second location data is visible on the displayed image captured by the camera of the first device; and
responsive to the identified location being visible on the displayed image, rendering at least a portion of the first message on the screen of the first device at a point overlaying the position of the identified location.
