# US 11,308,258 B1 · Textbook content reorganization based on classroom analytics > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,308,258 B1 - Document ID: US11308258B1 - Status: Granted - Kind: B1 - Application number: 17/110,422 - Filed: 2020-12-03 - Granted: 2022-04-19 - Earliest claimed: 2020-12-03 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: John S. Werner; Tyler Gross; Arkadiy O. Tsfasman; Brandon M. Kobilka - Web page: https://patentgrep.com/patent/US11308258B1 ## CPC - G06F 40/106: Display of layout of documents; Previewing - G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor - G06F 40/194: Calculation of difference between files - G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries - G06V 20/40: in video content (extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44) - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Aspects receiving, by a processor, observation data about an activity. The processor identifies overlapping content between the observation data and a base electronic document. The order of the overlapping content in the observation data is compared, by the processor, to the order of the overlapping content in the base electronic document. The processor changes an order of content in the base electronic document to create a modified electronic document in response to the order of the overlapping content in the observation data being different than the order of the overlapping content in the base electronic document. ## Claims ### Claim 1 A method comprising: receiving, by a processor, observation data about an activity; codifying the observation data to create codified observation data, the codifying comprising using natural language understanding (NLU) to normalize content of the observation data into categories; identifying, by a content identification module executing on the processor, overlapping content of the observation data and a base electronic document, the content identification module trained using training data that includes user feedback on overlapping contents previously identified by the content identification module, the identifying comprising comparing the codified observation data to a codified base electronic document that comprises content of the base electronic document normalized into the categories; comparing, by the processor, an order of the overlapping content in the observation data to an order of the overlapping content in the base electronic document; changing, by the processor, an order of content in the base electronic document to create a modified electronic document based at least in part on the order of the overlapping content in the observation data being different than the order of the overlapping content in the base electronic document, wherein the modified electronic document comprises an index of entries that point to portions of the base electronic document. ### Claim 2 (depends on 1) The method of claim 1, wherein the activity is a learning activity in a classroom and the base electronic document is a textbook. ### Claim 3 (depends on 2) The method of claim 2, further comprising receiving feedback from a teacher of the learning activity, wherein an order of the modified electronic document is responsive to the feedback from the teacher. ### Claim 4 (depends on 1) The method of claim 1, wherein the activity is a workplace procedure and the base electronic document is an instruction manual. ### Claim 5 (depends on 1) The method of claim 1, further comprising receiving feedback from a participant of the activity, wherein an order of the modified electronic document is responsive to the feedback from the participant. ### Claim 6 (depends on 1) The method of claim 1, further comprising analyzing the base electronic document, the analyzing comprising extracting keywords from the base electronic document and developing keyword associations, wherein the identifying overlapping content is further responsive to one or both of the extracted keywords and the keyword associations. ### Claim 7 (depends on 1) The method of claim 1, wherein the observation data comprises one or both of visual data and audio data. ### Claim 8 (depends on 1) The method of claim 1, wherein the observation data comprises one or both of data extracted from smart tools and data extracted from uploaded documents. ### Claim 9 (depends on 1) The method of claim 1, wherein: the content in the base electronic document comprises a plurality of portions each stored at a storage location on a storage device; the base electronic document comprises a second index comprising entries that point to the storage locations on the storage device in the order of the content in the base electronic document. ### Claim 10 (depends on 1) The method of claim 1, wherein the modified electronic document has the same content as the base electronic document. ### Claim 11 (depends on 1) The method of claim 1, wherein the base electronic document is a previously modified electronic document. ### Claim 12 A system comprising: one or more processors for executing computer-readable instructions, the computer-readable instructions controlling the one or more processors to perform operations comprising: receiving, by a processor, observation data about an activity; codifying the observation data to create codified observation data, the codifying comprising using natural language understanding (NLU) to normalize content of the observation data into categories; identifying, by a content identification module executing on the processor, overlapping content of the observation data and a base electronic document, the content identification module trained using training data that includes user feedback on overlapping contents previously identified by the content identification module, the identifying comprising comparing the codified observation data to a codified base electronic document that comprises content of the base electronic document normalized into the categories; comparing, by the processor, an order of the overlapping content in the observation data to an order of the overlapping content in the base electronic document; and changing, by the processor, an order of content in the base electronic document to create a modified electronic document based at least in part on the order of the overlapping content in the observation data being different than the order of the overlapping content in the base electronic document, wherein the modified electronic document comprises an index of entries that point to portions of the base electronic document. ### Claim 13 (depends on 12) The system of claim 12, wherein the activity is a learning activity in a classroom and the base electronic document is a textbook. ### Claim 14 (depends on 13) The system of claim 13, wherein the operations further comprise receiving feedback from a teacher of the learning activity, wherein an order of the modified electronic document is responsive to the feedback from the teacher. ### Claim 15 (depends on 12) The system of claim 12, wherein the operations further comprise receiving feedback from a participant of the activity, wherein an order of the modified electronic document is responsive to the feedback from the participant. ### Claim 16 (depends on 12) The system of claim 12, wherein the operations further comprise analyzing the base electronic document, the analyzing comprising extracting keywords from the base electronic document and developing keyword associations, wherein the identifying overlapping content is further responsive to one or both of the extracted keywords and the keyword associations. ### Claim 17 (depends on 12) The system of claim 12, wherein the observation data comprises one or both of visual data and audio data. ### Claim 18 (depends on 12) The system of claim 12, wherein the modified electronic document has the same content as the base electronic document. ### Claim 19 A computer program product comprising a non-transitory computer-readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors to cause the one or more processors to perform operations comprising: receiving, by a processor, observation data about an activity; codifying the observation data to create codified observation data, the codifying comprising using natural language understanding (NLU) to normalize content of the observation data into categories; identifying, by a content identification module executing on the processor, overlapping content of the observation data and a base electronic document, the content identification module trained using training data that includes user feedback on overlapping contents previously identified by the content identification module, the identifying comprising comparing the codified observation data to a codified base electronic document that comprises content of the base electronic document normalized into the categories; comparing, by the processor, an order of the overlapping content in the observation data to an order of the overlapping content in the base electronic document; and changing, by the processor, an order of content in the base electronic document to create a modified electronic document based at least in part on the order of the overlapping content in the observation data being different than the order of the overlapping content in the base electronic document, wherein the modified electronic document comprises an index of entries that point to portions of the base electronic document. ### Claim 20 (depends on 19) The computer program product of claim 19, wherein the operations further comprise analyzing the base electronic document, the analyzing comprising extracting keywords from the base electronic document and developing keyword associations, wherein the identifying is further responsive to one or both of the keywords and the keyword associations.