# US 12,223,716 B2 · Bioprocess system and method providing automated configuration detection > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,716 B2 - Document ID: US12223716B2 - Status: Granted - Kind: B2 - Application number: 18/525,144 - Filed: 2023-11-30 - Published: 2024-03-21 - Granted: 2025-02-11 - Earliest claimed: 2018-05-30 - Assignees: Cytiva Sweden AB - Applicants: Cytiva Sweden AB - Inventors: Petra Bangtsson; Johan Arthursson; Key Hyckenberg; Lotta Hedkvist - Web page: https://patentgrep.com/patent/US12223716B2 ## CPC - G06V 20/20: in augmented reality scenes - G06T 7/001: {using an image reference approach} - G06T 11/00: Two-dimensional [2D] image generation - G06T 2207/30164: Workpiece; Machine component - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method of automated configuration in a bioprocess system and to verify a process defined by a flow path representation. The method comprises the steps of: capturing one image of the bioprocess system comprising tubing for the fluid communication between units of the bioprocess system; analyzing the captured image to identify the tubing connecting units of the bioprocess system; producing a processed representation from the captured image wherein at least a part of the tubing is identified; and comparing the processed representation with the flow path representation to verify their functional concordance. ## Claims ### Claim 1 A method of automated configuration detection in a bioprocess system, the method comprises the steps of: forming a network of tubing in the bioprocess system, wherein the network of tubing is a network of disposable tubing for fluid communication between units of the bioprocess system, capturing at least one of: one or more images and videos of the bioprocess system comprising the network of tubing; analyzing, in an analyzing routine, the at least one captured image and/or video to identify at least a part of the tubing connecting units of the bioprocess system; producing a processed representation from the at least one captured image and/or video wherein at least a part of the tubing connection is identified; verifying a process defined by a flow path representation in the bioprocess system, comprising comparing the processed representation with the flow path representation to verify their functional concordance. ### Claim 2 (depends on 1) The method according to claim 1, the processed representation is compared to the flow path representation to identify faulty connected and/or missing parts of the tubing. ### Claim 3 (depends on 1) The method according to claim 1, further comprising: producing an augmented live view image of the bioprocess system illustrating at least one step in the process represented by the flow path representation utilizing the processed representation to visually mark the part of the tubing and units engaged in the particular process step in the augmented live view image. ### Claim 4 (depends on 1) The method according to claim 1, wherein the analyzing step further comprises: determining if additional images and/or videos could be useful to extract information required to produce the processed representation and, if additional images and/or videos are determined as useful, issuing a notification to capture additional images and/or videos. ### Claim 5 (depends on 4) The method according to claim 4, wherein the analyzing step further comprises: determining if the tubing and optionally other features is sufficiently identified from the at least one captured image and/or video, and if determined as sufficient, continue to produce a processed representation, and if determined as not sufficient, continue to an evaluation of whether more images and/or videos should be captured; determining if more images and/or videos should be captured, and if more images and/or videos should be captured, proceeding to identification of problem areas, and if determined that more images and/or videos would not improve the processed representation, proceed to indication; indicating that certain part of the tubing and/or features are not identified, and proceed to produce a processed representation; identifying a problem area in the at least one captured image and/or video and proceed to selecting active action; selecting a suitable active action, from a predefined list of active actions based on an analysis of the problem area; informing the operator on the selected active action and how it should be performed and returning to the capturing step. ### Claim 6 (depends on 1) The method according to claim 1, wherein the verifying step further comprises: establishing a link between the flow path representation and the processed representation; producing an enhanced image in which the tubing and units belonging to a particular flow path have a common identification. ### Claim 7 (depends on 6) The method according to claim 6, further comprising providing setup assistance for a new process or modification of an existing system. ### Claim 8 (depends on 7) The method according to claim 7, further comprising: identifying or constructing a flow path graph representing a new process or a modified process; using the established link between the flow path representation and the processed representation to produce at least one of the following: an enhanced image of the bioprocess system illustrating how the tubing should be connected to the units; a series of enhanced images stepwise illustrating how each tubing connection, or a selection of tubing, should be connected to the units; and an augmented live view of the bioprocess system stepwise illustrating how each tubing connection, or a selection of tubing, should be connected to the units. ### Claim 9 A system for automated configuration detection in a bioprocess system, the system comprising: a bioprocess system arranged to run a process defined by a flow path representation, a memory configured to store instructions for the automated configuration detection, a processor configured to execute the instructions, a GUI and a camera, wherein the camera is adapted to capture at least one image and/or video of the bioprocess system comprising a network of tubing, wherein the network of tubing is a network of disposable tubing for fluid communication between units of the bioprocess system, and to transfer the least one image and/or video to the processor; when the instructions are executed by the processor, the processor is configured to: receive the at least one captured image and/or video from the camera, host an analyzing routine adapted to analyze the at least one captured image and/or video to identify at least a part of the tubing connecting units of the bioprocess system; produce a processed representation from the at least one captured image and/or video wherein at least a part of the tubing connection is identified; present the processed representation on the GUI; and verify the process in the bioprocess system by comparing the processed representation with the flow path representation to verify their functional concordance. ### Claim 10 (depends on 9) The system according to claim 9, when the instructions are executed by the processor.