Vehicle-based data optimization

A system for optimizing data storage and processing in a connected vehicle system, the system comprising:

• at least one network interface configured to receive a plurality of encoded vehicle messages from one or more roadside transmission units operable connected to the at least one network interface;
• a computer readable medium operably coupled to the at least one network interface and configured to store each of the encoded vehicle messages;
• and
• at least one processor operably coupled to the at least one network interface and the computer readable medium, the at least one processor being configured to:
• decode the stored encoded messages to produce a plurality of decoded vehicle messages,
• analyze each of the plurality of decoded vehicle messages to identify one or more deduplicated and unique messages, wherein the at least one processor is configured to analyze each of the plurality of decoded vehicle messages to identify one or more deduplicated and unique messages by being further configured to:
• receive at least one searching criteria included in the a user request received from at least one of the one or more transmission units, the at least one searching criteria comprising at least one message field identifier for filtering the stored encoded messages based upon the at least one message field identifier, and
• filter the plurality of decoded vehicle messages based upon the at least one searching criteria, to produce a filtered set of encoded messages, store each of the one or more deduplicated and unique messages on the computer readable medium,
• perform further processing on the one or more deduplicated and unique messages based upon the user request to generate at least one user-requested output, and
• transmit the generated output from the at least one network interface to the at least one of the one or more transmission units associated with the received user request.