Detecting and predicting object events from images
AssigneeInternational Business Machines Corporation
InventorsAndrea Giovannini, Frederik Frank Flöther, Florian Graf, Stefan Ravizza, Erik Rueger
Life of this patent
Estimating the term…
Abstract
A method for event predictions is provided. The method includes receiving input data. The method further includes identifying an object in the input data with the identified object associated with a first node in a knowledge graph. The method further includes determining a second node of a first object event with the second node related to the first node in the knowledge graph. The method further includes contextualizing the identified input object with the first object event.
Claims12
A computer-implemented method comprising:
- relating, in a knowledge graph, nodes of first objects with nodes of second objects and with nodes of object events, wherein the knowledge graph is structured into multiple hierarchical levels, at least one such level consisting of nodes for objects, and at least one such level consisting of nodes for object events;
- receiving input data, the input data comprising an input image;
- identifying a first object and a second object in the input image, the identified first object associated with a first node in the knowledge graph, the identified second object associated with a second node in the knowledge graph;
- ranking a set of object events based on probability using the knowledge graph, the probability based on a number of edges in the knowledge graph between each node corresponding to object events and the first and second node;
- predicting a first object event occurring within a time vicinity based on the ranking.
A system comprising:
- a memory;
- and
- a processor in communication with the memory, the system configured to perform a method comprising:
- relating, in a knowledge graph, nodes of first objects with nodes of second objects and with nodes of object events, wherein the knowledge graph is structured into multiple hierarchical levels, at least one such level consisting of nodes for objects, and at least one such level consisting of nodes for object events;
- receiving input data, the input data comprising an input image;
- identifying a first object and a second object in the input image, the identified first object associated with a first node in the knowledge graph, the identified second object associated with a second node in the knowledge graph;
- ranking a set of object events based on probability using the knowledge graph, the probability based on a number of edges in the knowledge graph between each node corresponding to object events and the first and second node;
- predicting a first object event occurring within a time vicinity based on the ranking.
A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more computing systems to cause the one or more computing systems to perform a method comprising:
- relating, in a knowledge graph, nodes of first objects with nodes of second objects and with nodes of object events, wherein the knowledge graph is structured into multiple hierarchical levels, at least one such level consisting of nodes for objects, and at least one such level consisting of nodes for object events;
- receiving input data, the input data comprising an input image;
- identifying a first object and a second object in the input image, the identified first object associated with a first node in the knowledge graph, the identified second object associated with a second node in the knowledge graph;
- ranking a set of object events based on probability using the knowledge graph, the probability based on a number of edges in the knowledge graph between each node corresponding to object events and the first and second node;
- predicting a first object event occurring within a time vicinity based on the ranking.
Dependencies are inferred from the claim text.