# US 11,298,062 B2 · Multi-purpose interactive cognitive platform > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,298,062 B2 - Document ID: US11298062B2 - Status: Granted - Kind: B2 - Application number: 16/752,138 - Filed: 2020-01-24 - Published: 2020-08-13 - Granted: 2022-04-12 - Earliest claimed: 2017-02-01 - Assignees: Conflu3Nce Ltd - Applicants: Conflu3Nce Ltd - Inventors: Tami Robyn Ellison - Web page: https://patentgrep.com/patent/US11298062B2 ## CPC - A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety} - A61B 5/055: involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging - A61B 5/168: {Evaluating attention deficit, hyperactivity} - A61B 5/372: Analysis of electroencephalograms - G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training - G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems - G16H 50/30: for calculating health indices; for individual health risk assessment - A61B 5/01: Measuring temperature of body parts {; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue} (clinical contact thermometers G01K13/20) - A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition - A61B 5/024: Measuring pulse rate or heart rate - A61B 5/0263: {using NMR} - A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)} - A61B 5/1116: {Determining posture transitions} - A61B 5/4082: {Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette} - A61B 5/4088: {Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia} - A61B 5/486: {Biofeedback (using electroencephalography [EEG] A61B5/375)} - A61B 5/6802: {Sensor mounted on worn items} - A61B 5/686: {Permanently implanted devices, e.g. pacemakers, other stimulators, biochips (A61B5/6861 takes precedence)} - A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract An interactive multi-purpose interactive cognitive platform is provided that uses image-based interactivities and may use enriched visual stimuli for diagnoses, treatment, and to evaluate and assess the progress and/or treatment of cognitive diseases and/or conditions with cognitive impacts. The platform may be used for performance enhancement training. The platform may include a graphical user interface. The platform is designed to cooperatively engage multiple cognitive domains using interactivities-embedded assessments. The images and image sets may involve the application of Gestalt principles for assessments and may be personalized address individual user preferences. The multi-purpose interactive cognitive platform may be used to produce diagnostics and/or treatment plans for specific cognitive conditions and diseases with a cognitive component. The multi-purpose interactive cognitive platform may be used for gaming, stress reduction, mindfulness, skills development, training, and/or performance enhancement for those without cognitive problems and/or for those interested in maintaining their cognitive health. ## Claims ### Claim 1 A method comprising: sending, by a machine, one or more interactivities to a user, the one or more interactivities including at least one image, the one or more interactivities including at least requesting image input, the image input including at least a manipulation of an image element associated with the at least one image, the machine including at least a processor system having one or more processors and a memory system; receiving, at the machine, the image input from the user; and assessing the image input from the user, by the machine, and based on the assessment determining a score that is indicative of cognitive status of the user; wherein the one or more interactivities include at least an interactivity in which a user is presented with one or more elements of the at least one image, the at least one image being composed of one or more images, and the user is asked to identify information of the at least one image indicative of whether a figure-ground relationship is perceived. ### Claim 2 (depends on 1) The method of claim 1, further comprising adjusting an interactivity of the one or more interactivities, as the user is engaged with a platform using the method, during the interactivity of the one or more interactivities in which the image input was received. ### Claim 3 (depends on 1) The method of claim 1, wherein the assessing is based on information gathered during a session including one or more interactivities, where information is gathered prior to the one or more interactivities, when no interactivity is running. ### Claim 4 (depends on 1) The method of claim 1, wherein the assessing is based on information gathered during one or more interactivities. ### Claim 5 (depends on 1) The method of claim 1, wherein the assessing is based on information gathered during multiple sessions of the user. ### Claim 6 (depends on 1) The method of claim 1, wherein the assessing is based on information gathered from multiple users. ### Claim 7 (depends on 1) The method of claim 1, wherein the assessing is based on at least physiological data or biometrics data. ### Claim 8 (depends on 1) The method of claim 1, further comprising receiving input from multiple clinicians related to an interactivity protocol and creating an interactivity protocol based on the input from the multiple clinicians. ### Claim 9 (depends on 1) The method of claim 1, further comprising creating an interactivity based on assessing user interactions with the interactivity created using a composite of two or more interleaved images of the multi-image set. ### Claim 10 (depends on 1) The method of claim 1, the assessing including at least an assessment based on a word list associated with a composite of two or more images, at multiple time points. ### Claim 11 (depends on 1) The method of claim 1, wherein the one or more interactivities include an interactivity in which a user is presented with parts of the at least one image and asked to reconstruct a single image, the single image being composed of one or more images. ### Claim 12 (depends on 1) The method of claim 1, wherein the one or more interactivities include at least an interactivity in which a user is presented with the at least one image, and the at least one image is composed of one or more images; the at least one image having a missing par and the user is asked to fill in the missing part of the at least one image. ### Claim 13 (depends on 1) The method of claim 1, wherein the one or more interactivities include at least an interactivity in which a user is offered a range of activities that the user may choose from. ### Claim 14 (depends on 1) The method of claim 1, wherein the one or more interactivities include at least an interactivity in which a user is presented with an image of the at least one image and asked to identify parts of the image that was presented; where the image that was presented is a composite image of multiple component images, in which parts of each component image are mixed with parts of others of the component images. ### Claim 15 (depends on 1) The method of claim 1, the assessment being based on a decision pattern. ### Claim 16 (depends on 1) The method of claim 1, the assessment being based on error analysis in placements of elements of the at least one image, when reconstructing, matching or identifying at least a portion of the at least one image. ### Claim 17 (depends on 1) The method of claim 1, the assessment being based on reaction time. ### Claim 18 (depends on 1) The method of claim 1, wherein the one or more interactivities include at least one interactivity from which multiple scores are derived which include at least a first score for a first domain of cognition and a second score for a second domain of cognition. ### Claim 19 A method comprising: sending, by a machine, one or more interactivities to a user, the one or more interactivities including at least one image, the one or more interactivities including at least requesting image input, the image input including at least a manipulation of an image element associated with the at least one image, the machine including at least a processor system having one or more processors and a memory system; receiving, at the machine, the image input from the user; and assessing the image input from the user, by the machine, and based on the assessment determining a score that is indicative of cognitive status of the user; wherein the one or more interactivities include at least an interactivity in which the user is presented with a composite image set and is asked to identify aspects of the composite image indicative of whether there is a perception of dimensions that is based on a figure-ground relationship. ### Claim 20 A method comprising: sending, by a machine, one or more interactivities to a user, the one or more interactivities including at least one image, the one or more interactivities including at least requesting image input, the image input including at least a manipulation of an image element associated with the at least one image, the machine including at least a processor system having one or more processors and a memory system; receiving, at the machine, the image input from the user; and assessing the image input from the user, by the machine, and based on the assessment determining a score that is indicative of cognitive status of the user; determining, by a machine, one or more contiguities of an image, the contiguity being a group of picture elements that are adjacent to one another the group of picture elements form an image element that extends at least as much horizontally as vertically and that extends horizontally across most the image; determining, by the processor system, a value that represents characteristics of the one or more contiguities that are in the image; and determining, by the machine, which images to include in an interactivity based on the value associated with aspects of the contiguities and a skill level of the user. ### Claim 21 A method comprising: sending, by a machine, one or more interactivities to a user, the one or more interactivities including at least one image, the one or more interactivities including at least requesting image input, the image input including at least a manipulation of an image element associated with the at least one image, the machine including at least a processor system having one or more processors and a memory system; receiving, at the machine, the image input from the user; and assessing the image input from the user, by the machine, and based on the assessment determining a score that is indicative of cognitive status of the user; the image input being received via a tangible user interface (TUI). ### Claim 22 (depends on 21) The method of claim 21, the tangible user interface comprising physical pieces having portions of the at least one image. ### Claim 23 (depends on 21) The method of claim 21, the tangible user interface comprising physical props. ### Claim 24 (depends on 21) The method of claim 21, the tangible user interface comprising individual image manipulatives, the individual image manipulatives have portions of the image on a substrate, the individual image manipulatives being sections that fit together, and that can be separated and combined together in different ways. ### Claim 25 A system comprising: a processor system having one or more processors, and a memory system, the memory system storing one or more machine instructions, which when implemented, causes the system to implement a method including at least, sending, by the system, one or more interactivities to a user, the one or more interactivities including at least one image, the one or more interactivities including at least requesting image input, the image input including at least a manipulation of an image element associated with the at least one image; receiving, at the system, the image input from the user; and assessing the image input of the user by the system, and based on the assessment determining a score or scores that are indicative of cognitive abilities of the user; wherein the one or more interactivities include at least an interactivity in which a user is presented with a composite image set and is asked to identify aspects of a composite image indicative of whether the user perceives a figure-ground relationship, the composite image being based on the composite image set. ### Claim 26 (depends on 25) The system of claim 25, the method further comprising adjusting an interactivity of the one or more interactivities, as the user is engaged with a platform using the method, during a session in which the assessment occurred. ### Claim 27 (depends on 25) The system of claim 25, wherein the assessing is based on information gathered during a session including one or more interactivities, where information is gathered prior to the one or more interactivities, when no interactivity is running. ### Claim 28 (depends on 25) The system of claim 25, wherein the assessing is based on information gathered during one or more interactivities. ### Claim 29 (depends on 25) The system of claim 25, wherein the assessing is based on information gathered during multiple sessions of the user. ### Claim 30 (depends on 25) The system of claim 25, wherein the assessing is based on information gathered from multiple users. ### Claim 31 (depends on 25) The system of claim 25, wherein the assessing is based on at least physiological data or biometrics data. ### Claim 32 (depends on 25) The system of claim 25, the method further comprising receiving input from multiple clinicians related to an interactivity protocol and creating an interactivity protocol based on the input from the multiple clinicians. ### Claim 33 (depends on 25) The system of claim 25, the method, further comprising creating an interactivity based on the assessing, the interactivity created including at least a composite of two or more interleaved images of at least one multi-image set. ### Claim 34 (depends on 25) The system of claim 25, the assessing including at least an assessment based on a word list associated with a composite of two or more images, at multiple time points. ### Claim 35 (depends on 25) The system of claim 25, wherein the one or more interactivities include at least an interactivity in which a user is presented with parts of an image and asked to reconstruct a single image, the single image being composed of one or more images. ### Claim 36 (depends on 25) The system of claim 25, wherein the one or more interactivities include at least an interactivity in which a user is presented with an image that is composed of one or more images; the image, that is composed of one or more images, having a missing part and the user is asked to fill in the missing part of the image. ### Claim 37 (depends on 25) The system of claim 25, wherein the one or more interactivities include at least an interactivity in which a user is offered a range of activities that the user may choose from. ### Claim 38 (depends on 25) The system of claim 25, wherein the one or more interactivities include at least an interactivity in which a user is presented with an image and asked to identify parts of the image; where the image is a composite image of multiple component images, in which parts of each image are mixed with parts of other images. ### Claim 39 (depends on 25) The system of claim 25, the assessment being based on a decision pattern. ### Claim 40 (depends on 25) The system of claim 25, the assessment being based on error analysis in placements of elements of an image when reconstructing, matching, or identifying at least a portion of an image. ### Claim 41 (depends on 25) The system of claim 25, the assessment being based on reaction time. ### Claim 42 (depends on 25) The system of claim 25, wherein the one or more interactivities include at least one interactivity from which multiple scores are derived which include at least a first score for a first domain of cognition and a second score for a second domain of cognition. ### Claim 43 (depends on 25) The system of claim 25, wherein the one or more interactivities include at least an interactivity in which a user is presented with the at least one image, and the at least one image is composed of one or more images; the interactivity including at least requesting the user to match a piece of the at least one image with at least another part of the at least one image. ### Claim 44 A system comprising: a processor system having one or more processors, and a memory system, the memory system storing one or more machine instructions, which when implemented, causes the system to implement a method including at least, sending, by a machine, one or more interactivities to a user, the one or more interactivities including at least one image, the one or more interactivities including at least requesting image input, the image input including at least a manipulation of an image element associated with the at least one image, the machine including at least a processor system having one or more processors and a memory system; receiving, at the machine, the image input from the user; and assessing the image input of the user by the machine, and based on the assessment determining a score that is indicative of a cognitive status of the user; the image input being received via a tangible user interface (TUI). ### Claim 45 (depends on 44) The system of claim 44, the tangible user interface including at least a sensor for sensing the user's grip strength. ### Claim 46 (depends on 44) The system of claim 44, the tangible user interface including at least a sensor for sensing the user's grasp. ### Claim 47 (depends on 44) The system of claim 44, the tangible user interface including at least a sensor for sensing the user's galvanic skin response. ### Claim 48 (depends on 44) The system of claim 44, the tangible user interface including at least a sensor for sensing the user's pulse. ### Claim 49 (depends on 44) The system of claim 44, the tangible user interface including at least a sensor for sensing the user's blood pressure. ### Claim 50 (depends on 44) The system of claim 44, the tangible user interface including one or more sensors for sensing behavioral biometric input. ### Claim 51 (depends on 44) The system of claim 44, the tangible user interface including one or more sensors for tracking user movements. ### Claim 52 (depends on 44) The system of claim 44, the tangible user interface including at least a headset that produces an augmented reality image. ### Claim 53 (depends on 44) The system of claim 44, the tangible user interface including at least a headset having a display that produces a virtual reality image.