# US 2025/0378129 A1 · Recognition and processing of arithmetic handwriting strokes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0378129 A1
- Document ID: US20250378129A1
- Status: Published application
- Kind: A1
- Application number: 19/064,592
- Filed: 2025-02-26
- Published: 2025-12-11
- Earliest claimed: 2024-06-09
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Ryan S. DIXON; Aditya GALADA; Francisco ALVARO MUNOZ; Martin BRESLER; Peder BLEKKEN; Thomas DESELAERS
- Web page: https://patentgrep.com/patent/US20250378129A1

## CPC

- G06F 17/11: for solving equations {, e.g. nonlinear equations, general mathematical optimization problems (optimization specially adapted for a specific administrative, business or logistic context G06Q10/04)}
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06T 11/26: Drawing of charts or graphs
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems for electronic devices evaluate handwriting strokes, provided by a user to an electronic device, for math strokes and determine a result of the math strokes. The math strokes represent a mathematical expression and the result represents a solution to the mathematical expression. The result may be updated based on an update to the math strokes.

## Claims

### Claim 1

A method, comprising:
identifying mathematical handwriting strokes associated with mathematical operations;
grouping the mathematical handwriting strokes to identify one or more mathematical operands, operators, variables or symbols;
generating a mathematical evaluation request based on the grouped mathematical strokes;
sending the mathematical evaluation request to a calculator application;
receiving a result from the calculator application; and
displaying the result at a solution region that is proximate to at least some of the identified mathematical handwriting strokes.

### Claim 2 (depends on 1)

The method of claim 1, wherein identifying the mathematical handwriting strokes comprises identifying handwriting strokes at a display of an electronic device.

### Claim 3 (depends on 1)

The method of claim 1, further comprising subsequent to displaying the result:
identifying second mathematical strokes;
updating, based on the identified second mathematical strokes, the result; and
displaying the updated result at the solution region.

### Claim 4 (depends on 1)

The method of claim 1, further comprising determining whether the grouped mathematical strokes comprise a horizontally oriented mathematical expression or a vertically oriented mathematical expression.

### Claim 5 (depends on 4)

The method of claim 4, in response to determining whether the grouped mathematical strokes comprise the vertically oriented mathematical expression identifying a non-text handwriting stroke.

### Claim 6 (depends on 4)

The method of claim 4, in response to determining whether the grouped mathematical strokes comprise the horizontally oriented mathematical expression, identifying an equal sign within the horizontally oriented mathematical expression, wherein the solution region is proximate to the equal sign.

### Claim 7 (depends on 1)

The method of claim 1, wherein the calculator application is configured to:
determine an error in the grouped mathematical strokes; and
provide the error to a recognition system for evaluation of the error.

### Claim 8 (depends on 1)

The method of claim 1, wherein identifying mathematical strokes comprises identifying a shape of the mathematical strokes.

### Claim 9

A method, comprising:
at a first system process of a device:
receiving, from a first application that comprises handwritten strokes, a math request for a representation of handwritten strokes corresponding to mathematical symbols, wherein the math request includes at least a portion the handwritten strokes;
in response to receiving the math request:
identifying math strokes included in the handwritten strokes included in the math request and grouping the identified math strokes according to mathematical symbols; and
providing a representation of the grouped math strokes to the first application;
at a second system process of the device:
receiving, from the first application, the representation of the grouped math strokes along with additional information;
generating a graph result based on the representation of the grouped math strokes and the additional information; and
providing a representation of the graph result to a third system process of the device; and
at the third system process:
generating a synthesized handwriting representation of the graph result and sending the synthesized handwriting representation to the first application for display in a solution region.

### Claim 10 (depends on 9)

The method of claim 9, wherein the first application comprises a handwriting application configured to receive handwriting strokes from a user.

### Claim 11 (depends on 9)

The method of claim 9, wherein the second system process is configured to:
determine an error in the grouped math strokes; and
provide the error to the first system process for evaluation of the error.

### Claim 12 (depends on 9)

The method of claim 9, further comprising:
receiving, at the second system process, an update to one or more of the representation of the grouped math strokes along with additional information; and
generating, based on the update, an updated graph result.

### Claim 13 (depends on 9)

The method of claim 9, wherein the second system process comprises one or more of a calculator application or a recognition system.

### Claim 14 (depends on 9)

The method of claim 9, wherein the representation of the math strokes comprises a mathematical expression, and the graph result is based on the mathematical expression.

### Claim 15 (depends on 9)

The method of claim 9, wherein the math request comprises an equal sign or a non-text handwriting stroke.

### Claim 16

A non-transitory computer readable medium storing instructions of an application for controlling an electronic device to perform a method, the method comprising:
obtaining a representation of handwritten strokes;
generating a first math strokes request for the representation of handwritten strokes corresponding to mathematical symbols (e.g., variables, symbols, operands, operators, etc.), wherein the first math strokes request includes at least a portion the handwritten strokes;
providing the first math strokes request to an operating system via a math application program interface (API);
in response to the first math strokes request, obtaining a representation of grouped math strokes, wherein the grouped math strokes are grouped according to mathematical symbols;
generating a calculate request based on the representation of grouped math strokes and additional information related to the grouped math strokes;
providing the calculate request to the operating system via the math API;
as a response to the calculate request, obtaining a synthesized handwriting representation of a mathematical result via the math API; and
displaying the synthesized handwriting representation in a solution region.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein in response to detecting a stroke change defining updated strokes, the application sends a second math strokes request to the operating system, using the updated strokes, and in response to the updated strokes resulting in an updated mathematical result, the application receives and displays the synthesized handwriting representation of an updated mathematical result.

### Claim 18 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein:
the math strokes identify units of measure, and
the synthesized handwriting representation of the mathematical result comprises the units of measure.

### Claim 19 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein:
math strokes in the first math strokes request identify units of measure, and
the synthesized handwriting representation of the mathematical result is generated by performing unit conversion for mismatched units.

### Claim 20 (depends on 16)

The non-transitory computer readable medium of claim 16, further comprising storing the representation of grouped math strokes to generate a semantic understanding of the grouped math strokes and a relationship between the math strokes.
