Multimodal cognitive collaboration and cybernetic knowledge exchange with visual neural networking streaming augmented medical intelligence
OwnerJames Paul Smurroinventor
Life of this patent
Estimating the term…
Loading patent…
OwnerJames Paul Smurroinventor
Estimating the term…
The invention enables multimodal cognitive communications, collaboration, consultation and instruction between and among heterogeneous networked teams of persons, machines, devices, neural networks, robots and algorithms during various stages of medical disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting. The invention enables both synchronous and asynchronous multiparty collaboration with multichannel, multiplexed streaming imagery data, including interactive curation, multisensory annotation and metadata tagging, as well as multi-formatted encapsulation, saving and sharing of collaborated imagery data as packetized augmented intelligence. The invention acquires both live stream and archived medical modality imagery from network-connected medical devices, cameras, signals and sensors, as well as multiomic data [phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic] maps and clinical data sets from structured reports and clinical documents, including biometric maps and movies, hapmaps, heat maps and data stream visualizations. The invention also acquires both medical and non-medical streaming imagery data from image data repositories, documents and structured reports, workstations and mobile devices, as well as from wearable computing, signals and sensors. The invention enables networked teams to interactively communicate, concurrently collaborate and bi-directionally exchange multichannel multiplexed imagery data streams, singly or together, in real time or asynchronously, generally by curating, annotating and tagging imagery information objects. The invention encapsulates and saves collaborated imagery data, together with multisensory annotations and metadata tags, in standard file formats as packetized augmented intelligence. The invention enables recursive cognitive enrichment of clinical cognitive vismemes, and saves packetized imagery information objects, multisensory annotations and metadata tags in native file formats [PDF, MPEG, JPEG, XML, XMPP, QR,TIFF, RDF, RDF/XML, SVG and DAE] as well as in formats compliant with standards for digital communications in medicine [DICOM]. The invention enables live stream multicasting of multimodal cognitive instruction and collaborative knowledge exchange with multisensory [visual, auditory, haptic] annotation of streaming imagery data, as well as secure, encrypted transmission of streaming augmented intelligence across file sharing data networks for informatics-enabled learning, specialist skills acquisition and accelerated knowledge exchange.
A network system enabling multichannel multiplexed communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data during collaboration sessions, practiced by and among at least one or more participant cognitive collaborants, including persons, machines, devices, neural networks, robots and algorithms, and heterogeneous networked teams composed thereof, the network system enabling both synchronous and asynchronous multimodal cognitive communications, collaboration, consultation and instruction, including recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data during various stages of medical disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, allowing each participant cognitive collaborant to capture, retrieve and concurrently view at least one source of streaming medical modality imagery data, and at least one or more sources of heterogeneous streaming imagery data, medical and non-medical streaming imagery data, and combinations thereof including images, video, modality imagery, audio, video and haptic wave forms and files, multiomic-phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic—maps and clinical data sets, biometric maps and movies, hapmaps, heat maps, data stream visualizations, structured reports, and clinical documents, both live and archived streaming imagery data, enabling both synchronous and asynchronous multimodal cognitive communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data in collaboration sessions practiced by and among at least one or more participant cognitive collaborants during various stages of medical disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, each participant cognitive collaborant able to view, curate, annotate and tag the heterogeneous streaming imagery data, comprising;
A method enabling multichannel multiplexed communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data practiced by and among at least one or more participant cognitive collaborants, including persons, machines, devices, neural networks, robots and algorithms, and heterogeneous networked teams composed thereof, persons, the network system enabling both synchronous and asynchronous multimodal cognitive communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data during various stages of medical disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, allowing each participant cognitive collaborant to capture, retrieve and concurrently view at least one source of streaming medical modality imagery data, and at least one or more sources of heterogeneous streaming imagery data, medical and non-medical streaming imagery data, and combinations thereof including images, video, modality imagery, audio, video and haptic wave forms and files, multiomic—phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic—maps and clinical data sets, biometric maps and movies, hapmaps, heat maps, data stream visualizations, structured reports, and clinical documents, both live and archived streaming imagery data, enabling both synchronous and asynchronous multimodal cognitive communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data in collaboration sessions practiced by and among at least one or more participant cognitive collaborants during various stages of medical disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting, each participant cognitive collaborant able to view, curate, annotate and tag the heterogeneous streaming imagery data, comprising;
A method enabling multichannel multiplexed communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, with streaming imagery data by participant cognitive collaborants, including persons, machines, devices, neural networks, robots and algorithms, and heterogeneous networked teams composed thereof, with modular and scalable clusters of gateway streamer servers configured to support multiple network topologies, including peer-to-peer, hub-and-spoke and mesh chord networks, and heterogeneous network combinations thereof, each gateway streamer server enabling neurosynaptic network connectivity enabling both synchronous and asynchronous multimodal cognitive communications, collaboration, consultation and instruction, as well as recursive cognitive enrichment and collaborative knowledge exchange, that includes viewing, curating, annotating and tagging, using at least one or more sources of multichannel, multiplexed heterogeneous streaming imagery data, including both medical and non-medical streaming imagery data, and combinations thereof, and together with images, video, modality imagery, waveforms, audio and haptic files, multiomic—phenotypic, genomic, metabolomic, pathomic, radiomic, radiopathomic and radiogenomic, pathomic, radiomic, radiopathomic and radiogenomic—maps and clinical data sets, biometric maps and movies, hapmaps, heat maps, data stream visualizations, structured reports, and clinical documents during various stages of medical disease management, including detection, diagnosis, prognosis, treatment, measurement, monitoring and reporting.
Dependencies are inferred from the claim text.