System and method for automated personalized and community-specific eating and activity planning, linked to tracking system with automated multimodal item identification and size estimation system

A system for nutritional management, comprising:

• one or more computing devices;
• a nutritional management unit that is capable of being connected to and interacting with each of the one or more computing devices over a link, each of the one or more computing devices communicating data directly to the nutritional management unit;
• and
• the nutritional management unit further comprising a nutritional tracking unit that uses multimodal recognition including image analysis of pixel color and texture and distance of an image of a food to determine the identity, portion size, caloric value and nutritional value of the food from the image, and by using geolocation data, barcode analysis and voice recordings to subset the image analysis search space to the available foods at a particular food venue, and a recommendation unit that delivers personalized recommendations to a user, based on user data, to balance the caloric and nutritional value, wherein the personalized recommendations include physical activity, sleep duration recommendations for the user, recommended recipes, recommended grocery list items and recommended prepared meals from restaurants, and connect such recommendations to actions the user can take in real-time including the digital purchase of a food or activity gear.