Document annotation and manipulation in a data processing system

A data processing system provides annotation of a document with annotations inputted through an electronic tablet, a keyboard and an audio assembly. The annotations are entered in a modeless operation of the three input streams. Input by the tablet utilizes a two ended pen. One end of the pen is used for writing annotations to be added to a document and the second end of the pen is used for erasing the added written annotations. Files record the annotations made to the document in a manner which allows a time sequenced playback of the annotations including handwritten, typed and voiced annotations. A state machine of various procedures and controllers which call the procedures is used for processing the annotations as they are made, for replaying the annotations at a subsequent desired time, and for printing the annotations.