# US 2015/0106754 A1 · Adding, deleting digital notes from a group of digital notes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106754 A1
- Document ID: US20150106754A1
- Status: Published application
- Kind: A1
- Application number: 14/514,568
- Filed: 2014-10-15
- Published: 2015-04-16
- Earliest claimed: 2013-10-16
- Assignees: 3M Innovative Properties Company
- Applicants: 3M Innovative Properties Company
- Inventors: Guruprasad Somasundaram; Cristin E. Moran; David M. Mahli; Diane R. Wolk; Richard J. Moore; Pontus Axelsson; Michael Rotstein; Roland Persson
- Web page: https://patentgrep.com/patent/US20150106754A1

## CPC

- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- H04L 51/08: Annexed information, e.g. attachments
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

In general, the disclosure describes techniques for creating and manipulating software notes representative of physical notes. A computing device includes a processor, an image collection module configured to receive an input image of an environment having a plurality of physical notes, an image processing engine configured to identify the plurality of physical notes in the input image and generate a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image, and a graphical user interface configured to display the input image overlaid with the plurality of digital notes in place of the identified plurality of notes on a first portion of the graphical user interface and to display a set of one or more of the digital notes on a second portion of the graphical user interface.

## Claims

### Claim 1

A method comprising:
receiving, by a computing device, an input image of an environment having a plurality of physical notes;
processing the input image with the computing device to identify the plurality of physical notes in the input image;
generating, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;
displaying, on a first portion of a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of notes; and
displaying, by the computing device, a set of one or more of the plurality of digital notes on a second portion of the graphical user interface, wherein each of the digital notes in the set of digital notes displayed in the second portion corresponds to a respective one of the plurality of digital notes displayed in the first portion and overlaid on the input image.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving, by the computing device, a user input selecting for deletion at least one of the plurality of digital notes displayed in the first portion of the graphical user interface; and
removing, by the computing device and from the set of digital notes displayed in the second portion of the graphical user interface, digital notes that correspond to the digital notes of the first portion of the graphical user interface selected for deletion.

### Claim 3 (depends on 1)

The method of claim 1, wherein the plurality of digital notes from the first portion is greater than the plurality of digital notes in the second portion, the method further comprising:
receiving, by the computing device, a user input selecting at least one of the digital notes from the first portion that is not displayed in the second portion; and
adding, by the computing device, the selected digital note from the first portion to the set of digital notes displayed on the second portion.

### Claim 4 (depends on 2)

The method of claim 2, further comprising:
receiving, by the computing device, a user input selecting a subset of the plurality of digital notes; and
grouping, by the computing device, the selected subset of digital notes to form one or more groups.

### Claim 5 (depends on 4)

The method of claim 4, wherein the one or more groups are organized according to a group hierarchy defined by the user input.

### Claim 6

A computer system configured to:
receive, by a computing device, an input image of an environment having a plurality of physical notes;
process the input image with the computing device to identify the plurality of physical notes in the input image;
generate, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;
display, on a first portion of a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of notes; and
display, by the computing device, a set of one or more of the plurality of digital notes on a second portion of the graphical user interface, wherein each of the digital notes in the set of digital notes displayed in the second portion corresponds to a respective one of the plurality of digital notes displayed in the first portion and overlaid on the input image.

### Claim 7

A non-transitory computer-readable medium comprising instructions that cause a programmable processor to:
receive, by a computing device, an input image of an environment having a plurality of physical notes;
process the input image with the computing device to identify the plurality of physical notes in the input image;
generate, by the computing device, a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image;
display, on a first portion of a graphical user interface of the computing device, the input image overlaid with the plurality of digital notes in place of the identified plurality of notes; and
display, by the computing device, a set of one or more of the plurality of digital notes on a second portion of the graphical user interface, wherein each of the digital notes in the set of digital notes displayed in the second portion corresponds to a respective one of the plurality of digital notes displayed in the first portion and overlaid on the input image.

### Claim 8

A computing device comprising:
a processor;
an image collection module executable by the processor and configured to receive an input image of an environment having a plurality of physical notes;
an image processing engine executable by the processor and configured to identify the plurality of physical notes in the input image and generate a plurality of digital notes corresponding to the plurality of notes identified in the input image, wherein the plurality of digital notes include information represented by the plurality of notes in the input image; and
a graphical user interface configured to display the input image overlaid with the plurality of digital notes in place of the identified plurality of notes on a first portion of the graphical user interface and to display a set of one or more of the digital notes on a second portion of the graphical user interface.

### Claim 9 (depends on 8)

The device of claim 8, wherein the image collection module includes an image capture device configured to capture the input image.

### Claim 10 (depends on 8)

The device of claim 8, wherein the image collection module includes a communication interface configured to receive the input image.

### Claim 11 (depends on 10)

The device of claim 10, wherein the communication interface includes a wireless communication device configured to receive the input image.

### Claim 12 (depends on 10)

The device of claim 10, wherein the communication interface includes a wired communication device configured to receive the input image.

### Claim 13 (depends on 8)

The device of claim 8, wherein the user interface is further configured to:
receive a user input selecting for deletion at least one of the plurality of digital notes displayed in the first portion of the graphical user interface; and
remove, from the set of digital notes displayed in the second portion of the graphical user interface, any of the digital notes that correspond to the digital notes of the first portion of the graphical user interface selected for deletion.

### Claim 14 (depends on 8)

The device of claim 8, wherein the plurality of digital notes from the first portion is greater than the plurality of digital notes in the second portion the image, and wherein the processing engine is further configured to:
receive a user input selecting at least one of the plurality of digital notes from the first portion that is not in the second portion; and
add the selected plurality of digital notes from the first portion to the second portion.

### Claim 15 (depends on 8)

The device of claim 8, wherein the image processing engine is further configured to:
receive a user input selecting at least one of the plurality of digital notes between the first portion and the second portion; and
group the selected plurality of digital notes between the first portion and the second portion to form one or more groups.

### Claim 16 (depends on 15)

The device of claim 15, wherein the one or more groups are organized accordingly to a group hierarchy defined by the user input.

### Claim 17 (depends on 15)

The device of claim 15, wherein the image processing engine is further configured to display indications of the one or more groups in conjunction with the plurality of digital notes presented on the first portion.

### Claim 18 (depends on 15)

The device of claim 15, wherein the image processing engine is further configured to display indications of the one or more groups in conjunction with the plurality of digital notes presented on the second portion.
