Universal intelligent recognition, identification, and classification of AI-processed binary large objects using a computable formal grammar

A system comprising a memory storing instructions and a processor coupled to the memory, wherein the processor is configured to:

• receive data comprising a first binary large object;
• detect, in the first binary large object, one or more objects;
• for each of the one or more detected objects, determine data coordinates within the first binary large object;
• for each of the one or more detected objects, determine, by applying a machine-implemented object characterization algorithm to a portion of the first binary large object defined by the data coordinates, attributes of the detected objects without applying the machine-implemented object characterization algorithm to the entire first binary large object;
• generate, based on the detected objects, a representation of the first binary large object, wherein the representation is compliant with an object recognition grammar (ORG) and encodes at least one of a type of the detected objects, spatial relationships of the detected objects, and logical relationships of the detected objects;
• access an indexed data repository storing a plurality of indexed binary large object representations and use the indexed data repository to determine whether the generated representation matches a predefined representation for a known class of binary large objects;
• and
• responsive to determining that the generated representation matches the predefined representation, classify the first binary large object as an object from the known class of binary large objects, wherein
• the processor is configured to generate the representation of the first binary large object by, for each detected object:
• determining an inferred identity and a characteristic description of the object based on the coordinates and/or the attributes of the object;
• and
• generating a text string indicating the inferred identity and at least a portion of the characteristic description of the object;
• and
• arranging the generated text strings according to the ORG, wherein the arranged text strings are hierarchical and tokenized, supporting efficient parsing and comparison.

A non-transitory computer-readable storage medium containing program instructions for causing a processor to perform a method comprising steps of:

• by a processor:
• receiving data comprising a first binary large object;
• detecting, in the first binary large object, one or more objects;
• for each of the one or more detected objects, determining data coordinates within the first binary large object;
• for each of the one or more detected objects, determining, by applying a machine-implemented object characterization algorithm to a portion of the first binary large object defined by the data coordinates, attributes of the detected objects without applying the machine-implemented object characterization algorithm to the entire first binary large object, wherein the machine-implemented object characterization algorithm comprises at least one of an AI-based detection algorithm, a rule-based detection algorithm, or a hybrid AI-and-rule-based detection algorithm;
• generating, based on the detected objects, a representation of the first binary large object, wherein the representation is compliant with an object recognition grammar (ORG) and encodes at least one of a type of the detected objects, spatial relationships of the detected objects, and logical relationships of the detected objects;
• accessing an indexed data repository storing a plurality of indexed binary large object representations and using the indexed data repository to determine whether the generated representation matches a predefined representation for a known class of binary large objects;
• and
• responsive to determining that the generated representation matches the predefined representation, classifying the first binary large object as an object from the known class of binary large objects,
• wherein generating the representation of the first binary large object comprises for each detected object:
• determining an inferred identity and a characteristic description of the object based on the coordinates and/or the attributes of the object;
• and
• generating a text string indicating the inferred identity and at least a portion of the characteristic description of the object;
• and
• arranging the generated text strings according to the ORG, wherein the arranged text strings are hierarchical and tokenized, supporting efficient parsing and comparison.