US 12,222,920 B1Granted

Data store selection and consistent routing using a pointer table

AssigneeAmazon Technologies, Inc.

InventorsTao Zhang, Sneha Hulivan Girisha, Christopher Yue Ng

Life of this patent

Estimating the term…

Loading patent…

Abstract

A subscription storage service of a provider network may be used to select a particular datastore to store a topic subscription record for an IoT device (e.g., after the IoT device subscribes to an MQTT topic). The service may select the particular datastore based on the type of the subscription (e.g., non-wildcard vs. wildcard subscription) and one or more criteria associated with the topic (e.g., subscribe operation TPS for the topic). This may allow the service to store wildcard subscriptions to a different structure and/or datastore (e.g., a “trie” structure of an in-memory data store), while offloading the storage of non-wildcard subscriptions to another type of datastore (e.g., a key-value store) that has lower performance and/or operational cost to store data.

Claims20

Dependent claims

A system, comprising:

one or more processors and one or more memories, wherein the one or more memories have stored thereon instructions, which when executed by the one or more processors, cause the one or more processors to implement subscription storage service for a plurality of clients of a provider network, wherein the subscription storage service is configured to, for individual clients of the subscription storage service:
receive a request to store subscription information for a subscription to a topic for an edge device, wherein the subscription is for a concrete type of subscription to the topic, and wherein the subscription storage service manages information for concrete types of subscriptions and wildcard types of subscriptions according to a publish-subscribe protocol;
determine whether an entry for the subscription to the topic for the edge device exists in a datastore pointer table;
and
in response to a determination that the entry for the subscription to the topic for the edge device does not exist in the datastore pointer table:
determine, based on the concrete type of the subscription and one or more criteria associated with the topic, that a first datastore is to be used as a target datastore to store the subscription information that indicates the subscription to the topic for the edge device, wherein the first datastore is associated with concrete topics and a second datastore is associated with wildcard topics;
add a new entry to the datastore pointer table, wherein the new entry indicates the first datastore as the target datastore to store the subscription information;
and
store the subscription information to the first datastore.

6 more elements

A method, comprising:

performing, by one or more computing devices of a provider network:
receiving, from an edge device, a request to store data;
determining, based on an attribute of the data, a type of the data to be stored for the edge device;
determining whether an entry that identifies the edge device and the type of the data to be stored for the edge device exists in a datastore pointer table;
and
in response to determining that the entry that identifies the edge device and the type of the data to be stored for the edge device does not exist in the datastore pointer table:
determining, based on the type of the data to be stored for the edge device and one or more criteria associated with the type of the data, that a first datastore is to be used as a target datastore to store the data, wherein the target datastore also stores data of the same type for one or more other edge devices based on previous requests to store data, and wherein the first datastore is selected from among different datastores based on the type of the data, and wherein the first datastore implements a data structure for storing the type of the data;
adding the entry to the datastore pointer table, wherein the entry indicates the first datastore as the target datastore for the type of the data to be stored for the edge device;
and
storing the data to the first datastore.

7 more elements

One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more processors cause the one or more processors to:

receive, from an edge device, a message that comprises data;
determine, based on an attribute of the data, a type of the data to be stored for the edge device;
determine whether an entry that identifies the edge device and the type of the data to be stored for the edge device exists in a datastore pointer table;
in response to a determination that the entry that identifies the edge device and the type of the data to be stored for the edge device does not exist in the datastore pointer table:
determine, based on the type of the data to be stored for the edge device and one or more criteria associated with the type of the data, that a first datastore is to be used as a target datastore to store the data, wherein the target datastore also stores data of the same type for one or more other edge devices based on previous messages, and wherein the first datastore is selected from among different datastores based on the type of the data, and wherein the first datastore implements a data structure for storing the type of the data;
adding the entry to the datastore pointer table, wherein the entry indicates the first datastore as the target datastore for the type of the data to be stored for the edge device;
and
storing the data to the first datastore.

5 more elements

Dependencies are inferred from the claim text.