# US 10,503,343 B2 · Integrated graphical user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,503,343 B2
- Document ID: US10503343B2
- Status: Granted
- Kind: B2
- Application number: 13/176,750
- Filed: 2011-07-06
- Published: 2013-01-10
- Granted: 2019-12-10
- Earliest claimed: 2011-07-06
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Andreas Juergen Lachenmann; Matthias Günter Neugebauer; Wolfgang Manousek; Mark A. Hillebrand; Holger Christoph Kenn
- Inventors: Andreas Juergen Lachenmann; Matthias Günter Neugebauer; Wolfgang Manousek; Mark A. Hillebrand; Holger Christoph Kenn
- Web page: https://patentgrep.com/patent/US10503343B2

## CPC

- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 8/38: for implementing user interfaces
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system described herein includes a receiver component that receives a first graphical user interface of a first computer-executable application and a second graphical user interface of a second computer-executable application. The system also includes an integration component that automatically causes a portion of the first graphical user interface and a portion of the second graphical user interface to be simultaneously displayed on a display screen in an integrated graphical user interface that appears to an end user as being a single application.

## Claims

### Claim 1

A method executed by a computing system in an automobile, the method comprising:
receiving a first graphical user interface of a first computer-executable application, the first graphical user interface comprises data that is indicative of an operating condition of the automobile;
receiving a second graphical user interface of a second computer-executable application, wherein the second graphical user interface is received by way of a user interface remoting protocol and from a mobile computing device that is external to the computing system;
accessing a data store that comprises a configuration, the configuration defining display parameters when a first portion of the first graphical user interface and a second portion of the second graphical user interface are displayed together in an integrated graphical user interface on a display screen in the automobile, the display parameters identifying the first portion of the first graphical user interface, the second portion of the second graphical user interface to include in the integrated graphical user interface, the display parameters further identifying a position of the first portion relative to the second portion in the integrated graphical user interface; and
displaying the first portion of the first graphical user interface and the second portion of the second graphical user interface in the integrated graphical user interface on the display screen based upon contents of the configuration, the integrated graphical user interface configured to appear to an end user as belonging to a single computer-executable application.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first computer-executable application executes in a logical computing partition of the computing system, and the second computer-executable application executes on the mobile device, and further wherein the first graphical user interface is received from the computing partition.

### Claim 3 (depends on 2)

The method of claim 2, wherein the logical computing partition executes a first operating system and the mobile computing device executes a second operating system.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
detecting that user input has been received for one of the first computer-executable application or the second computer-executable application in the integrated graphical user interface; and
selectively transmitting the user input to the one of the first computer-executable application or the second computer-executable application responsive to detecting that the user input has been received.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
receiving a third graphical user interface from a third computer-executable application; and
causing a portion of the third graphical user interface to be overlaid on the first portion of the first graphical user interface that is displayed in the integrated graphical user interface based at least in part upon contents of the configuration.

### Claim 6 (depends on 1)

The method of claim 1, wherein locations, shapes, and sizes of the first portion of the first graphical user interface and the second portion of the second graphical user interface that are included in the integrated graphical user interface are one of defined at the pixel level in the configuration or dynamically modified at runtime.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first computer-executable application and the second computer-executable application are developed by first and second developers, respectively, and wherein the configuration is developed by a third developer.

### Claim 8 (depends on 1)

The method of claim 1, the second computer-executable application being a navigation application.

### Claim 9 (depends on 1)

The method of claim 1, the first graphical user interface generated by the first computer-executable application, the second graphical user interface generated by the second computer-executable application.

### Claim 10

An automobile comprising: a display screen;
at least one processor; and
memory that comprises instructions that, when executed by the at least one processor, cause the at least one processor to perform acts comprising:
receiving a first graphical user interface of a first computer-executable application, the first graphical user interface generated by the first computer-executable application, the first computer-executable application configured to cause data that is indicative of an operating condition of the automobile to be presented in the first graphical user interface;
receiving, by way of a user interface remoting protocol and from a mobile computing device, a second graphical user interface of a second computer-executable application that is executing on the mobile computing device, the second graphical user interface generated by the second computer-executable application, the second computer-executable application configured to cause second data to be presented in the second graphical user interface; and a display parameters identifying the first portion of the first graphical user interface, the second portion of the second graphical user interface to include in the integrated graphical user interface, the display parameters further identifying a position of the first portion relative to the second portion in the integrated graphical user interface;
causing at least a portion of the first graphical user interface and at least a portion of the second graphical user interface to be simultaneously displayed on the display screen in an integrated graphical user interface, the integrated graphical user interface configured to cause the data and the second data to appear as though the data and the second data were generated by a same computer-executable application.

### Claim 11 (depends on 10)

The system of claim 10, wherein the first computer-executable application is executing at a computing system of the automobile and the second computer-executable application is executing at the mobile computing device.

### Claim 12 (depends on 11)

The system of claim 11, wherein the computing system of the automobile executes a first operating system and the mobile computing device executes a second operating system.

### Claim 13 (depends on 10)

The system of claim 10, the acts further comprising accessing a data store that comprises a configuration, the configuration defining the portion of the first graphical user interface and the portion of the second graphical user interface that are included in the integrated user interface.

### Claim 14 (depends on 13)

The system of claim 13, wherein the configuration defines, by pixels, the portion of the first graphical user interface and the portion of the second graphical user interface that are to be displayed in the integrated graphical user interface.

### Claim 15 (depends on 10)

The system of claim 10, the second computer-executable application being a navigation application.

### Claim 16 (depends on 10)

The system of claim 10, the mobile computing device being a mobile telephone.

### Claim 17

A computer-readable data storage medium in a computing system of an automobile, the computer-readable storage medium comprising instructions that, when executed by a processor of the computing system, cause the processor to perform acts comprising:
receiving a first graphical user interface of a first computer-executable application executing in a logical partition of the computing system, the first graphical user interface comprises data generated by the first computer-executable application, the data is indicative of an operating condition of the automobile;
receiving, from a mobile computing device and by way of a user interface remoting protocol, a second graphical user interface of a second computer-executable application executing on the mobile computing device, wherein the second graphical user interface comprises second data generated by the second computer-executable application;
based upon predefined display parameters:
selecting a portion of the first graphical user interface that is to be displayed in an integrated graphical user interface on a display of the automobile;
selecting a portion of the second graphical user interface that is to be displayed in the integrated graphical user interface on the display of the automobile;
selecting a first position on the display to display the portion of the first graphical user interface;
selecting a second position on the display to display the portion of the second graphical user interface; and
causing the portion of the first graphical user interface and the portion of the second graphical user interface to be concurrently displayed on the display in the integrated graphical user interface at the first position and the second position, respectively, wherein the predefined display parameters identify the portion of the first graphical user interface, the first position on the display, the portion of the second graphical user interface, and the second position on the display.

### Claim 18 (depends on 17)

The computer-readable data storage medium of claim 17, wherein the data is indicative of velocity of the vehicle.

### Claim 19 (depends on 17)

The computer-readable data storage medium of claim 17, wherein the second computer-executable application is a navigation application.

### Claim 20 (depends on 17)

The computer-readable data storage medium of claim 17, wherein the mobile computing device is a mobile phone.
