# US 11,443,103 B2 · Reflowable content with annotations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,103 B2
- Document ID: US11443103B2
- Status: Granted
- Kind: B2
- Application number: 17/495,830
- Filed: 2021-10-07
- Published: 2022-04-07
- Granted: 2022-09-13
- Earliest claimed: 2020-10-07
- Assignees: Rakuten Kobo Inc.
- Applicants: Rakuten Kobo Inc.
- Inventors: Wai Lok Chan; Ramesh Mantha; Isabelle Knott; Harry Hutton; William Chaban
- Web page: https://patentgrep.com/patent/US11443103B2

## CPC

- G06F 40/169: Annotation, e.g. comment data or footnotes
- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 40/106: Display of layout of documents; Previewing
- G06F 40/109: Font handling; Temporal or kinetic typography
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for annotating dynamic content includes receiving a freeform annotation overlaid on dynamic content; determining whether the dynamic content changes; in response to a determination that the dynamic content changes, displaying an indicator corresponding to a region where the freeform annotation was created; determining whether the indicator is selected; in response to a determination that the indicator is selected, displaying a lightbox with the freeform annotation as it was overlaid on the dynamic content when it was created; determining whether the a revert button included in the lightbox is selected; and in response to a determination that the revert button is selected, displaying the freeform annotation overlaid on the dynamic content as it was created before the dynamic content changed.

## Claims

### Claim 1

A method for annotating dynamic content, comprising:
receiving a freeform annotation overlaid on dynamic content of a page, wherein receiving the freeform annotation overlaid on dynamic content further includes
calculating a bounding box of the freeform annotation; and
stretching the bounding box to be equal to a width of the page that displays the dynamic content;
calculating a bounding box for each sentence on the page;
determining whether the stretched bounding box of the freeform annotation intersects one or more of the bounding boxes of the sentences;
in response to a determination that the stretched bounding box of the freeform annotation intersects one or more of the bounding boxes of the sentences, generating a list to include the at least one or more intersecting bounding boxes of the sentences;
generating a cropped image of the dynamic content, wherein the cropped image includes at least the freeform annotation and the at least one or more intersecting bounding boxes of the sentences; and
saving the cropped image and saving an image of the freeform annotation;
determining whether the dynamic content changes; and
in response to a determination that the dynamic content changes, displaying an indicator corresponding to a region on the page where the freeform annotation was created, wherein a selection of the indicator displays the cropped image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
determining whether the indicator is selected; and
in response to a determination that the indicator is selected, displaying a lightbox with the freeform annotation as it was overlaid on the dynamic content when it was created.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
determining whether a revert button included in the lightbox is selected; and
in response to a determination that the revert button is selected, displaying the freeform annotation overlaid on the dynamic content as it was created before the dynamic content changed.

### Claim 4 (depends on 1)

The method of claim 1, wherein displaying an indicator corresponding to a region where the freeform annotation was created includes
in response to the determination that the dynamic content changes, calculating a new bounding box for each of the bounding boxes added to the list; and
placing the indicator based on a union of the new bounding boxes.

### Claim 5 (depends on 4)

The method of claim 4, wherein displaying a lightbox with the freeform annotation as it was overlaid on the dynamic content when it was created includes
in response to the user selecting the indicator, superimposing the saved image of the freeform annotation and the saved cropped image; and
displaying the superimposed images as a pop-up.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
in response to the determination that the dynamic content changes, determining whether the annotation will remain on a screen containing the dynamic content if the annotation is linearly transformed to fit over top of the dynamic content it is associated with.

### Claim 7

An electronic device, comprising:
a processor;
circuitry configured to
receive a freeform annotation overlaid on dynamic content of a page, wherein the circuitry for receiving the freeform annotation overlaid on dynamic content is further configured to
calculate a bounding box of the freeform annotation, and
stretch the bounding box to be equal to a width of the page that displays the dynamic content,
calculate a bounding box for each sentence on the page,
determine whether the stretched bounding box of the freeform annotation intersects one or more of the bounding boxes of the sentences,
in response to a determination that the stretched bounding box of the freeform annotation intersects one or more of the bounding boxes of the sentences, generate a list to include the at least one or more intersecting bounding boxes of the sentences,
generate a cropped image of the dynamic content, wherein the cropped image includes at least the freeform annotation and the at least one or more intersecting bounding boxes of the sentences, and save the cropped image and save an image of the freeform annotation,
determine whether the dynamic content changes, and
in response to a determination that the dynamic content changes, display an indicator corresponding to a region where the freeform annotation was created, wherein a selection of the indicator displays the cropped image.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the circuitry is further configured to
determine whether the indicator is selected, and
in response to a determination that the indicator is selected, display a lightbox with the freeform annotation as it was overlaid on the dynamic content when it was created.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the circuitry is further configured to
determine whether a revert button included in the lightbox is selected, and
in response to a determination that the revert button is selected, display the freeform annotation overlaid on the dynamic content as it was created before the dynamic content changed.

### Claim 10 (depends on 7)

The electronic device of claim 7, wherein the circuitry for displaying an indicator corresponding to a region where the freeform annotation was created is further configured to
in response to the determination that the dynamic content changes, calculate a new bounding box for each of the bounding boxes added to the list, and
place the indicator based on a union of the new bounding boxes.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the circuitry for displaying a lightbox with the freeform annotation as it was overlaid on the dynamic content when it was created is further configured to
in response to the user selecting the indicator, superimpose the saved image of the freeform annotation and the saved cropped image, and
display the superimposed images as a pop-up.

### Claim 12 (depends on 7)

The electronic device of claim 7, wherein the circuitry is further configured to
in response to the determination that the dynamic content changes, determine whether the annotation will remain on a screen containing the dynamic content if the annotation is linearly transformed to fit over top of the dynamic content it is associated with.

### Claim 13

An e-reader, comprising:
a processor;
circuitry configured to
receive an annotation overlaid on reflowable text, wherein the circuitry for receiving the annotation overlaid on reflowable text is further configured to
calculate a bounding box of the annotation, and
stretch the bounding box to be equal to a width of a page that displays the reflowable text,
calculate a bounding box for each sentence on the page,
determine whether the stretched bounding box of the annotation intersects one or more of the bounding boxes of the sentences,
in response to a determination that the stretched bounding box of the annotation intersects one or more of the bounding boxes of the sentences, generate a list to include the at least one or more intersecting bounding boxes of the sentences,
generate a cropped image of the reflowable text, wherein the cropped image includes at least the annotation and the at least one or more intersecting bounding boxes of the sentences, and
save the cropped image and save an image of the annotation,
determine whether the reflowable text changes, and
in response to a determination that the reflowable text changes, display an indicator corresponding to a region where the annotation was created, wherein a selection of the indicator displays the cropped image.

### Claim 14 (depends on 13)

The e-reader of claim 13, wherein the circuitry is further configured to
determine whether the indicator is selected, and
in response to a determination that the indicator is selected, display a lightbox with the annotation as it was overlaid on the reflowable text when it was created.

### Claim 15 (depends on 14)

The e-reader of claim 14, wherein the circuitry is further configured to
determine whether a revert button included in the lightbox is selected, and
in response to a determination that the revert button is selected, display the annotation overlaid on the reflowable text as it was created before the reflowable text changed.

### Claim 16 (depends on 13)

The e-reader of claim 13, wherein the circuitry for displaying an indicator corresponding to a region where the annotation was created is further configured to
in response to the determination that the reflowable text changes, calculate a new bounding box for each of the bounding boxes added to the list, and
place the indicator based on a union of the new bounding boxes.

### Claim 17 (depends on 16)

The e-reader of claim 16, wherein the circuitry for displaying a lightbox with the annotation as it was overlaid on the dynamic content when it was created is further configured to
in response to the user selecting the indicator, superimpose the saved image of the annotation and the saved cropped image, and
display the superimposed images as a pop-up.