Intelligent digital image scene detection

In a digital medium environment for managing digital images, a system configured to recognize scenes depicted within the digital images, the system comprising:

• at least one processor;
• and
• a non-transitory computer readable medium comprising instructions that, when executed by the at least one processor, cause the system to:
• analyze, by at least one processor, a digital image captured by a user client device to determine, for each of a plurality of object tags, a probability that the object tag associates with the digital image;
• determine, for each of the plurality of object tags, a similarity score for each of a plurality of scene categories;
• based on the similarity scores and the determined probabilities that the plurality of object tags associate with the digital image, determine, for each of the plurality of scene categories, a probability that the digital image belongs to the scene category;
• and
• identify, based on the determined probability for each of the plurality of scene categories, a designated scene category for the digital image.