Site News  |   Monitor Keywords  |   Monitor Archive  |   Organizer  |   Account Info  |

Organizing, editing, and rendering digital ink

Organizing, editing, and rendering digital ink description/claims

This application is a continuation of prior U.S. application Ser. No. 11/019,479, filed Dec. 23, 2004, which is a divisional of U.S. application Ser. No. 10/103,700 (now U.S. Pat. No. 7,120,872), filed Mar. 25, 2002, both of which are incorporated herein by reference.

Aspects of the present invention are directed generally to apparatuses and methods for controlling a graphical user interface (GUI). More particularly, aspects of the present invention relate to capturing and/or storing electronic or digital ink.

Typical computer systems, especially computer systems using graphical user interface (GUI) systems, such as Microsoft WINDOWS®, are optimized for accepting user input from one or more discrete input devices, such as a keyboard for entering text, and a pointing device, such as a mouse with one or more buttons, for operating the user interface. The ubiquitous keyboard and mouse interface provides for fast creation and modification of documents, spreadsheets, database fields, drawings, photos and the like. However, a significant gap exists between the flexibility provided by the keyboard and mouse interface compared with non-computer (i.e., standard) pen and paper. With the standard pen and paper, a user edits a document, writes notes in a margin, draws pictures and other shapes, links separate sets of notes by connecting lines or arrows, and the like. In some instances, a user may prefer to use a pen to mark-up a document rather than review the document on-screen because of the ability to freely make notes outside of the confines of the keyboard and mouse interface.

Some computer systems permit a user to draw on a screen. For example, the Microsoft READER application permits one to add digital ink (also referred to herein as “electronic ink” or “ink”) to a document. The system stores the ink and provides it to a user when requested. Other applications (for example, drawing applications as known in the art associated with the Palm 3.x and 4.x and PocketPC operating systems) permit the capture and storage of drawings. These drawings may include other properties associated with the ink strokes used to make up the drawings. For instance, line width and color may be stored with the ink. One goal of these systems is to replicate the look and feel of physical ink being applied to a piece of paper.

One activity normally reserved for physical ink and paper is note taking. Personal notes are unique as each user. Some users take notes using complete sentences, while others jot down thoughts or concepts and then link the concepts using arrows and the like. The latter type of notes tends to be written at different locations on a page. Additionally, some revisit notes later and add further thoughts, clarify and/or edit previously recorded notes. The value present in handwritten notes may rest not only in the actual text of the information recorded, but also in the layout of the notes and the juxtaposition of some notes with others. Further value may be added in the speed at which users take notes.

The transition from an ink pen and physical paper note taking arrangement to a computer-based note taking arrangement may prove difficult. While computer-based note taking systems can provide advantages including handwriting recognition functionality and written text reformatting, users may quickly become disoriented when the computer-based system does not function as expected.

A number of systems for electronically capturing, rearranging, and displaying handwriting as digital ink are known (for example, the InkWriter® system from Aha! Software, now owned by Microsoft Corporation of Redmond, Wash.). These systems capture ink strokes and group the strokes into characters and words. Writing in multiple regions on a page, as many users do, can quickly confuse these systems, for example, if information intended to be separate notes is combined by the system into a single, incoherent note. Also, in some existing systems, drag selection (akin to holding down a mouse button and dragging to select text in a text editor) may select large areas of blank space (i.e., white space) on the page. When this selected text is cut and pasted (using standard computer-based text editing concepts), the large volume of selected blank space may produce an unintended and surprising result. This result is counterintuitive to the average computer user because conventional text editing systems work differently. The unfamiliar operation of a note taking system compared to known text based systems effectively creates barriers to adoption of stylus-based computing systems.

The present invention provides flexible and efficient systems, methods, and data structures for organizing, editing, and rendering digital ink.

Aspects of the present invention are directed to improved systems, methods and data structures for associating captured ink words and text words in flows and editing the flows. In some examples, a user's interactions are confined to a single active flow of ink and/or text words. In other examples, space may be inserted or minimized inside a flow. In additional examples, the shape of a flow may be reorganized around another flow or flows on the page. In yet other examples, the flow to which new ink strokes belong may be determined based on the relationships of the new ink strokes to existing flows.

These and other features and aspects of the invention will be apparent upon consideration of the following detailed description.

The foregoing summary, as well as the following detailed description, may be better understood when read in conjunction with the accompanying drawings, which are included by way of example, and not by way of limitation with regard to the claimed invention.

FIG. 1 illustrates a schematic diagram of an exemplary general-purpose digital computing environment that may be used to implement various aspects of the present invention.

FIG. 2 illustrates an exemplary pen-based computing system that may be used in accordance with various aspects of the present invention.

• Provisional Patent
• Utility Patent

• What Is a Patent?
• What Is a Trademark or Servicemark?
• What Is a Copyright?
• Patent Laws