# US 2024/0265699 A1 · System and method for automated optical analyte measurements via wearable smart devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0265699 A1
- Document ID: US20240265699A1
- Status: Published application
- Kind: A1
- Application number: 18/640,369
- Filed: 2024-04-19
- Published: 2024-08-08
- Earliest claimed: 2021-10-21
- Assignees: Roche Diabetes Care, Inc.
- Applicants: Roche Diabetes Care, Inc.
- Inventors: Alexander Steck; Bernhard Limburg; Fredrik Hailer; Max Berg
- Web page: https://patentgrep.com/patent/US20240265699A1

## CPC

- G01N 21/8483: {Investigating reagent band (test-element handling not specific to a test method G01N33/4875; analytical elements specific to chemical analysis of biological material G01N33/52; autometer with reagent band G01N35/04)}
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G01N 21/78: producing a change of colour
- G01N 33/525: {Multi-layer analytical elements}
- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06V 20/60: Type of objects
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/30004: Biomedical image processing
- G06T 2207/30196: Human being; Person
- G06T 2207/30204: Marker
- G01N: INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES (measuring or testing apparatus or processes other than immunoassay, involving enzymes or microorganisms C12M, C12Q)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for measuring an analyte include devices configured to perform an analyte testing operation. The devices include a wearable electronic device and a remote device operatively connected to each other and each having a processor, the processors cooperating with each other in the execution of program instructions to measure an analyte. The wearable electronic device includes a camera configured to generate a video stream, which is analyzed to identify missing test components, to identify the application of a body fluid on a test strip where the sample undergoes changes in one or more optical properties, the image of which is analyzed to determine a level of the analyte. The wearable electronic device further includes a head-up display (HUD) for providing output messages to the user relating to the performance and status of the analyte testing operation.

## Claims

### Claim 1

A system for measurement of an analyte comprising:
a wearable electronic device and a remote device, the wearable electronic device comprising:
a camera configured to generate a video stream;
a first communication transceiver configured to transmit and receive communications to and from a second communication transceiver at the remote device;
a head-up display (HUD);
a first memory configured to store program instructions; and
a first processor operatively connected to the first communication transceiver, the camera, and the first memory, the first processor being configured to execute the program instructions;
the remote device further comprising:
a second memory configured to store program instructions; and
a second processor operatively connected to the second transceiver and the second memory, the second transceiver configured to transmit and receive communications to and from the first communication transceiver;
the wearable electronic device and the remote device being operatively connected to each other, wherein the first processor and second processor cooperate to execute the program instructions to:
identify test components in the video stream and provide guidance to the user via the HUD of required test components not detected in the video stream;
identify the application of a bodily fluid sample to a deposit site on a test strip based on the video stream;
activate a timer in response to confirmation of the application of the bodily fluid sample;
after a minimum period of time and before a maximum period of time from the activation of the timer, generating via the camera at least one image of the test strip including at least a portion of a measurement site, the at least one image being captured after guidance to the user via the HUD for positioning the test strip a predetermined distance and angular orientation relative to the camera;
analyze optical properties of at least a portion of the measurement site within the image to determine a level of an analyte; and
display the level of the analyte on the HUD.

### Claim 2 (depends on 1)

The system of claim 1, wherein the program instructions proceed based on one or more inputs from the user upon completion of at least one of the steps of application of the bodily fluid sample to a deposit site of the test strip and generating the at least one image.

### Claim 3 (depends on 1)

The system of claim 1, wherein the program instructions proceed based on an automatic tracking of user activities and automatic identification of components required for the analyte testing operation, at least one of the first processor and second processor being configured for performing the automatic tracking and automatic identification via a video stream generated by the camera.

### Claim 4 (depends on 3)

The system of claim 3, wherein at least one of the first and second processors is further configured to:
identify a vial in the video stream generated by the camera based on at least one registration mark located on the vial depicted in the video stream;
identify an opening of the vial in the video stream based on at least one registration mark located on a lid of the vial; and
identify extraction of the test strip from the vial after the identification of the opening of the vial in the video stream based on at least one registration mark associated with the test strip depicted in the video stream.

### Claim 5 (depends on 4)

The system of claim 4, wherein the at least one registration mark associated with the vial further comprises an indicator formed on a label of the vial.

### Claim 6 (depends on 4)

The system of claim 4, wherein the at least one registration mark associated with the test strip further comprises an indicator formed on a surface of the test strip at a predetermined position relative to the deposit site.

### Claim 7 (depends on 6)

The system of claim 6, wherein at least one of the first and second processors is further configured to:
identify that a reverse side of the test strip is exposed in the video stream based on an absence of the indicator formed on the surface of the test strip; and
generate on the HUD an output message indicating that the test strip should be rotated to expose the surface of the test strip bearing the indicator.

### Claim 8 (depends on 3)

The system of claim 3, where at least one of the first and second processors is further configured to identify errors in extraction and handling of the test strip depicted in the video stream and provide guidance to the user via the HUD based on the errors.

### Claim 9 (depends on 1)

The system of claim 1, wherein the step of identifying the application of a bodily fluid sample occurs following guidance to the user via the HUD for correct application of the bodily fluid to the test strip.

### Claim 10 (depends on 3)

The system of claim 3, wherein at least one of the first and second processors is further configured to:
identify a finger of a user in the video stream;
generating guidance on the HUD for producing a bodily fluid sample following identification of the finger in the video stream;
identify contact between the finger and the deposit site in the video stream; and
identify the application of the fluid sample in response to a change in an optical property of the deposit site in the video stream after the contact between the finger and the deposit site.

### Claim 11 (depends on 3)

The system of claim 3, wherein at least one of the first and second processors is further configured to identify the application of the fluid sample in response to a change in an optical property of the deposit site in the video stream.

### Claim 12 (depends on 3)

The system of claim 3, wherein at least one of the first and second processors is further configured to generate on the HUD an output message informing the user that the measurement of the analyte in the fluid dose cannot be completed in response to no optical measurement of the measurement site being generated after the predetermined minimum time period has elapsed and prior to the predetermined maximum time period elapsing.

### Claim 13 (depends on 1)

The system of claim 1, the remote device further comprising a display operatively connected to the second processor, and wherein the operation further comprises displaying the level of the analyte on the display.

### Claim 14 (depends on 13)

The system of claim 13, wherein the remote device comprises a mobile electronic device.

### Claim 15 (depends on 14)

The system of claim 14, wherein the mobile electronic device comprises a smartphone where the program instructions comprise a software application stored on the second memory and executed by the second processor in communication with the first processor for directing the wearable electronic device in the performance of the analyte testing operation.

### Claim 16

A method for measuring an analyte using a wearable electronic device and a remote device, the wearable electronic device having a camera and a head-up display (HUD), wherein the wearable electronic device and the remote device are operatively connected to each other and having processors configured to cooperate to execute program instructions to:
identify test components in a video stream;
provide guidance to the user via the HUD of required test components not detected in the video stream;
identify the application of a bodily fluid sample to a deposit site on a test strip based on the video stream; activate a timer in response to confirmation of the application of the bodily fluid sample;
after a minimum period of time and before a maximum period of time from the activation of the timer, generate via the camera at least one image of the test strip including at least a portion of a measurement site, the at least one image being captured after guidance to the user via the HUD for positioning the test strip a predetermined distance and angular orientation relative to the camera;
analyze optical properties of at least a portion of the measurement site within the image to determine a level of an analyte; and
display the level of the analyte on the HUD.

### Claim 17 (depends on 16)

The method of claim 16, further comprising generating a video stream using the camera of the wearable electronic device, identifying one or more components required for the analyte testing operation including optionally a vial, one or more test strips, a color card, and a produced bodily fluid sample, and tracking user activities relating to said one or more components.

### Claim 18 (depends on 16)

The method of claim 16, further comprising identifying a vial in the video stream generated by the camera based on at least one registration mark located on the vial depicted in the video stream; identifying an opening of the vial in the video stream based on at least one registration mark located on a lid of the vial; and identifying the extraction of the test strip from the vial after the identification of the opening of the vial in the video stream based on at least one registration mark associated with the test strip depicted in the video stream.
