System and method for automatically detecting and interactively displaying information about entities, activities, and events from multiple-modality natural language sources

A non-transitory computer program storage device embodying instructions executable by a processor to automatically extract and organize information from a plurality of data sources, the non-transitory computer program storage device comprising storage memory configured to store:

• instruction code for applying to the data sources a natural language processing information extraction pipeline that includes an automatic detection of entities;
• instruction code for identifying information about detected entities by analyzing products of the natural language processing pipeline;
• instruction code for grouping identified information into equivalence classes containing equivalent information;
• instruction code for creating at least one displayable representation of the equivalence classes;
• instruction code for computing an order in which the at least one displayable representation is displayed;
• and
• instruction code for producing a combined representation of the equivalence classes that respects an order in which said displayable representation is displayed.