Head mounted display system receiving three-dimensional push notification

A method for use with a head-mounted display system, the method comprising:

• executing an application program in a volumetric operating system, wherein executing the application program includes outputting an application program virtual object for display on a head-mounted display at a first location in a physical environment, wherein the application program virtual object is displayed to occupy a first volume of space in the physical environment;
• receiving a three-dimensional push notification at the application program via an application program interface (API) of one or more APIs included in the volumetric operating system, the three-dimensional push notification including location data indicating a second location relative to the first location in the physical environment;
• determining whether a three-dimensional push notification virtual object is to be displayed inside or outside a field of view of a user;
• generating the three-dimensional push notification virtual object based on the three-dimensional push notification;
• and
• responsive to determining that the three-dimensional push notification virtual object is to be displayed inside the field of view, outputting the three-dimensional push notification virtual object for display on the head-mounted display at the second location, wherein the three-dimensional push notification virtual object is displayed to occupy a second volume of space in the physical environment;
• responsive to determining that the three-dimensional push notification virtual object is to be displayed outside the field of view, outputting an indication of a direction toward the second location;
• and
• receiving an interaction input via at least one input device, wherein the interaction input includes an interaction with the three-dimensional push notification virtual object within the second volume of space.

A head-mounted display system, comprising:

• a head-mounted display configured to display one or more virtual objects in a physical environment;
• at least one input device;
• and
• a processor configured to:
• receive a three-dimensional push notification at an application program via an application program interface (API) of one or more APIs included in a volumetric operating system, wherein:
• the three-dimensional push notification indicates a first location in the physical environment of an application program virtual object included in the one or more virtual objects, wherein the application program virtual object is displayed to occupy a first volume of space in the physical environment;
• the application program virtual object is associated with the application program;
• and
• the three-dimensional push notification indicates a second location relative to the first location in the physical environment;
• determine whether a three-dimensional push notification virtual object is to be displayed inside or outside a field of view of a user;
• generate the three-dimensional push notification virtual object based on the three-dimensional push notification;
• responsive to determining that the three-dimensional push notification virtual object is to be displayed inside the field of view, output the three-dimensional push notification virtual object for display on the head-mounted display at the second location, wherein the three-dimensional push notification virtual object occupies a second volume of space in the physical environment;
• and
• responsive to determining that the three-dimensional push notification virtual object is to be displayed outside the field of view, output an indication of a direction toward the second location;
• receive an interaction input via the at least one input device, wherein the interaction input includes an interaction with the three-dimensional push notification virtual object within the second volume of space.