# US 8,788,496 B2 · Visual organization of information via associated geospatial data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,788,496 B2
- Document ID: US8788496B2
- Status: Granted
- Kind: B2
- Application number: 12/894,845
- Filed: 2010-09-30
- Published: 2011-04-14
- Granted: 2014-07-22
- Earliest claimed: 2009-09-30
- Assignees: Trimble Navigation Limited
- Applicants: George Derrick Darby, Jr.; Mark Smith; William Quintrell
- Inventors: George Derrick Darby, Jr.; Mark Smith; William Quintrell
- Web page: https://patentgrep.com/patent/US8788496B2

## CPC

- G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q 50/08: Construction
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

In a method of organizing information, a plurality of diverse data items is accessed. The diverse data items are related to a physical location. The diverse data items that are accessed comprise at least a non-visual data item and a visual imagery data item, and include geospatial data associated with the individual accessed data items. The diverse data items are parsed by data type and stored in a data store such that the diverse data items are accessible by one or more of the geospatial data associated with the individual data items. Diverse data items related to the physical location are processed to produce an integrated image displayable via a web viewer. The processing occurs in response to receiving a request regarding the physical location. The integrated image comprises an integration of at least two of the stored diverse data items.

## Claims

### Claim 1

A method of organizing information, said method comprising:
accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items, said diverse data items comprising at least a non-visual data item and a visual imagery data item;
parsing said diverse data items by data type;
storing said diverse data items in a data store such that said diverse data items are accessible by one or more of said geospatial data associated with said individual data items; and
in response to receiving a request regarding said physical location, processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer, said integrated image comprising an integration of at least two of said stored diverse data items, wherein said at least two of said stored diverse data items comprises a first image of an as-built condition of said object of interest at said physical location and a second image of a design of said object of interest, wherein said processing comprises:
overlaying said first image with said second image; and
adjusting an opacity of at least one of said first image and said second image such that said first image and said second image may be overlapped without obscuring visible content of either said first image or said second image.

### Claim 2 (depends on 1)

The method as recited in claim 1, further comprising:
preprocessing said diverse data items based upon a determined data type for each diverse data item.

### Claim 3 (depends on 1)

The method as recited in claim 1, further comprising providing said integrated image in response to said request.

### Claim 4 (depends on 1)

The method as recited in claim 1, wherein said accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items further comprises:
additionally accessing time of creation data associated with least one of said diverse data items.

### Claim 5 (depends on 1)

The method as recited in claim 1, wherein said accessing a plurality of diverse data items related to a physical location comprises:
accessing at least one non-visual data item from an image capture device.

### Claim 6 (depends on 1)

The method as recited in claim 1, wherein said accessing a plurality of diverse data items related to a physical location comprises:
accessing a tabular data item associated with a geolocation.

### Claim 7 (depends on 1)

The method as recited in claim 1, wherein said accessing a plurality of diverse data items related to a physical location comprises:
accessing at least one non-visual sensor data item from a position determining device, said at least one non-visual sensor data item comprising three dimensional coordinate information about one or more points associated with said physical location.

### Claim 8 (depends on 1)

The method as recited in claim 1, wherein said accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items comprises:
accessing at least one of said data items wherein said geospatial data associated therewith comprises position data associated with a design of an object of interest designed for said physical location.

### Claim 9 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer comprises:
including geospatial content presented in a compact image format with displayable dimensions that are smaller than a full image view of said integrated image.

### Claim 10 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer comprises:
associating said visual imagery data item with a geolocation received from a positioning device to create a geolocated image.

### Claim 11 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer comprises:
associating said visual imagery data item with a location on a map.

### Claim 12 (depends on 11)

The method as recited in claim 11, wherein said associating said visual imagery data item with a location on a map comprises:
creating a link between said visual imagery data item and a location reference indicator located on said map.

### Claim 13 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer comprises:
processing said diverse data items in conjunction with a selected time span such that only said diverse data items with an associated time of creation or embedded time information which comply with said selected time span are accessed for production of said integrated image.

### Claim 14 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
accessing a database containing design documentation for an object of interest at said physical location; and
associating said design documentation with said integrated image.

### Claim 15 (depends on 14)

The method as recited in claim 14, wherein said accessing design documentation further comprises:
accessing upcoming steps in a construction project timeline file; and
associating said upcoming steps with said integrated image.

### Claim 16 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
preparing a report detailing geocoded information associated with said physical location; and
associating said report with said integrated image.

### Claim 17 (depends on 16)

The method as recited in claim 16, wherein said preparing a report detailing geocoded information associated with said physical location comprises:
preparing said report to present said geocoded information in a format selected from the group of formats consisting of DXF, DWG, KML, GeoTIFF, and GeoJPEG.

### Claim 18 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
accessing weather data for said physical location; and
associating said weather data with said integrated image.

### Claim 19 (depends on 18)

The method as recited in claim 18, wherein said accessing weather data for said physical location comprises:
associating only said weather data which comprises a selected time span received in said request regarding said physical location.

### Claim 20 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
creating an annotation disposed in said integrated image.

### Claim 21 (depends on 20)

The method as recited in claim 20, wherein said creating a series of annotations disposed in said integrated image comprises:
creating said annotation wherein said annotation is selected a set of icons that include prepackaged formats for displaying textual notations and prepackaged shapes.

### Claim 22 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
accessing non-visual data regarding a geolocated path of a machine while performing a selected operation at said physical location; and
associating said geolocated path with said integrated image.

### Claim 23 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
accessing non-visual data regarding current and previous locations of a mobile object of interest; and
associating with said integrated image one or more of said current and previous locations of said object of interest which coincide with said physical location.

### Claim 24 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
accessing non-visual data regarding operational details of a machine while performing a selected operation at said physical location; and
associating said operational details with said integrated image.

### Claim 25 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer further comprises:
accessing non-visual data in the form of a point cloud of geolocated data points representative of features associated with an object of interest at said physical location;
processing said point cloud to create a visual display of said features; and
associating said features with said integrated image.

### Claim 26 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer comprises:
processing said diverse data items in conjunction with a data privilege of said request such that only said diverse data items consistent with data privilege are accessed for production of said integrated image.

### Claim 27 (depends on 1)

The method as recited in claim 1, wherein said processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer comprises:
processing said diverse data items related to said physical location such that a particular data type of processed data items is formatted to be displayable in said integrated image in a manner specified by said request.

### Claim 28

A non-transitory computer-readable storage medium having computer-readable instructions stored thereon, which, when executed, caused a computer system to perform a method of organizing information, said method comprising:
accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items, said diverse data items comprising at least a non-visual data item and a visual imagery data item;
parsing said diverse data items by data type;
preprocessing said diverse data items based upon a determined data type for each diverse data item; and
storing said preprocessed diverse data items in a data store such that said preprocessed diverse data items are accessible by said geospatial data associated with said individual diverse data items;
in response to receiving a request regarding said physical location, processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer, said integrated image comprising an integration of at least two of said stored diverse data items, wherein said at least two of said stored diverse data items comprises a first image of an as-built condition of said object of interest at said physical location and a second image of a design of said object of interest, wherein said processing comprises:
overlaying said first image with said second image; and
adjusting an opacity of at least one of said first image and said second image such that said first image and said second image may be overlapped without obscuring visible content of either said first image or said second image.

### Claim 29 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein said accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items further comprises:
additionally accessing time of creation data associated with least one of said diverse data items.

### Claim 30 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein said accessing a plurality of diverse data items related to a physical location comprises:
accessing at least one non-visual data item from an image capture device.

### Claim 31 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein said accessing a plurality of diverse data items related to a physical location comprises:
accessing a tabular data item associated with a geolocation.

### Claim 32 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein said accessing a plurality of diverse data items related to a physical location comprises:
accessing at least one non-visual sensor data item from a position determining device, said at least one non-visual sensor data item comprising three dimensional coordinate information about one or more points associated with said physical location.

### Claim 33 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein said accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items comprises:
accessing at least one of said data items wherein said geospatial data associated therewith comprises position data associated with a design of an object of interest designed for said physical location.

### Claim 34 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein said preprocessing said diverse data items based upon a determined data type for each diverse data item further comprises:
combining a plurality of said diverse data items of differing data types into a single digital file.

### Claim 35

An information organizing system, said system comprising:
a data item accessor configured for accessing a plurality of diverse data items related to a physical location, said diverse data items including geospatial data associated with individual data items of said diverse data items, said diverse data items comprising at least a non-visual data item and a visual imagery data item;
a data type parser configured for parsing said diverse data items by data type;
a preprocessor configured for preprocessing said diverse data items based upon a determined data type for each diverse data item;
a data store configured for storing said preprocessed diverse data items such that said preprocessed diverse data items are accessible by said geospatial data associated with said individual data items;
a request receiver configured for receiving a request regarding said physical location; and
a request processor configured for processing said diverse data items related to said physical location to produce an integrated image displayable via a web viewer, said integrated image comprising an integration of at least two of said stored diverse data items, wherein said at least two of said stored diverse data items comprises a first image of an as-built condition of said object of interest at said physical location and a second image of a design of said object of interest, wherein said processing comprises overlaying said first image with said second image, and wherein said processing further comprises adjusting an opacity of at least one of said first image and said second image such that said first image and said second image may be overlapped without obscuring visible content of either said first image or said second image.

### Claim 36 (depends on 35)

The system of claim 35, wherein said request processor is further configured for processing said diverse data items related to said physical location such that a particular data type of processed data items is formatted to be displayable in said integrated image in a manner specified by said request.

### Claim 37

A method of visually displaying diverse data items via a web viewer, said method comprising:
sending, from said web viewer, a request for information related to a physical location;
in response to sending said request, receiving an integrated image formatted for displaying via said web viewer, said integrated image processed from a plurality of diverse data items related to said physical location, said integrated image comprising an integration of at least two previously stored diverse data items related to said physical location and a first image of an as-built condition of an object of interest at said physical location overlaid with a second image of a design of said object of interest, wherein said stored diverse data items comprise at least a non-visual data item and a visual imagery data item, and wherein geospatial data is associated with individual data items of said stored diverse data items;
adjusting an opacity of at least one of said first image and said second image such that said first image and said second image may be overlapped without obscuring visible content of either said first image or said second image; and
displaying said integrated image via said web viewer.

### Claim 38 (depends on 37)

The method as recited in claim 37, wherein said sending, from said web viewer, a request for information related to a physical location further comprises:
sending, from said web viewer, said request for said information related to said physical location and a specification of a display parameter for formatting a particular data type of said data items.

### Claim 39 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to format geocoded Joint Photographic Experts Group (GeoJPEG) files to be represented as selectable pushpins located at geolocations on a web viewer displayable map.

### Claim 40 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to format surveying points of a surveying work order file to be rendered at respective geolocations of said survey points on a web viewer displayable map.

### Claim 41 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to format geocoded data files to be represented at their associated geolocations on a web viewer displayable map.

### Claim 42 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to format geocoded weather data to be represented at associated geolocations on a web viewer displayable map.

### Claim 43 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to extract geocoded data points from a data structure and represent said points at associated geolocations as markers on a web viewer displayable map.

### Claim 44 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to display a representation of a tracked object at a real-time geolocation of said tracked object on a web viewer displayable map.

### Claim 45 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to display a surveying data point cloud as a raster representation at associated geolocations on a web viewer displayable map.

### Claim 46 (depends on 38)

The method as recited in claim 38, wherein said sending a specification of a display parameter for formatting a particular data type of said data items comprises:
sending said specification to display recorded geocoded trip data at associated geolocations on a web viewer displayable map, wherein said trip data includes a route and one or more of recorded audio, recorded video, and an image associated with geolocations of said route.

### Claim 47 (depends on 1)

The method of claim 1, wherein said at least two of said stored diverse data items comprises a third image of project schedule information, comprising alphanumeric numbers, describing a remaining project schedule, said method further comprising:
overlaying said first and second image with said third image.