Generating semantic scene graphs utilizing template graphs for digital image modification

A non-transitory computer-readable medium storing instructions thereon that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

• generating an image analysis graph providing a structural template of nodes and edges corresponding to characteristics potentially represented in one or more digital images;
• generating a real-world class description graph providing contextual information with respect to semantic areas potentially represented in the one or more digital images;
• generating a behavioral policy graph that assigns behaviors to object classes based on object relationships potentially represented in the one or more digital images;
• generating, for a digital image via pre-processing before receiving one or more user interactions for modifying the digital image, a semantic scene graph portraying a plurality of objects utilizing the image analysis graph, the real-world class description graph, and the behavioral policy graph;
• and
• modifying the digital image using the semantic scene graph in response to detecting one or more user interactions with the digital image by:
• determining pixels corresponding to an object portrayed within the digital image;
• identifying at least one of an object attribute or an object relationship that is associated with the object within the digital image via the semantic scene graph;
• and
• modifying the pixels corresponding to the object based on at least one of the object attribute or the object relationship associated with the object via the semantic scene graph.

A system comprising:

• at least one memory device;
• and
• at least one processor configured to cause the system to:
• determine a plurality of objects portrayed in a digital image;
• determine an object class for each object from the plurality of objects;
• determine relationships between pairs of objects from the plurality of objects;
• generate a semantic scene graph for the digital image using a combination of pre-generated template graphs by:
• generating a structure having a plurality of nodes representing the plurality of objects and a plurality of edges connecting the plurality of nodes in accordance with a first pre-generated template graph comprising an image analysis graph having a structural template of nodes and edges;
• associating one or more object attributes with each object based on the object class of each object in accordance with a second pre-generated template graph comprising a real-world class description graph having object attributes for a plurality of object classes;
• and
• assigning each object one or more behaviors based on the relationships between the pairs of objects in accordance with a third pre-generated template graph comprising a behavioral policy graph that assigns behaviors to object classes based on object relationships;
• and
• modify the digital image using the semantic scene graph in response to detecting one or more user interactions with the digital image by:
• determining pixels corresponding to an object portrayed within the digital image;
• identifying at least one of an object attribute or an object relationship that is associated with the object within the digital image via the semantic scene graph;
• and
• modifying the pixels corresponding to the object based on at least one of the object attribute or the object relationship associated with the object via the semantic scene graph.