Skip Navigation

Abbot: a Conversion Tool for Text Interoperability

What is TokenX?

TokenX is a multi-document text visualization, analysis, and play tool designed for the XML document tree. It was created by Brian L. Pytlik Zillig, who is the digital initiatives librarian at the Electronic Text Center. The tool was developed with the support of the Center for Digital Research in the Humanities at the University of Nebraska–Lincoln.

TokenX website at the University of Nebraska–Lincoln

What can TokenX do?

TokenX is designed to provide an easy-to-use interface for text analysis and visualization. The features currently available are:

  • text highlighting based on patterns in words
  • keyword in context
  • replacing words with blocks
  • word concordances sorted alphabetically or by frequency
  • word usage statistics
  • word substitution
  • user-selected replacement of words with images
  • creative exploration

How do I use TokenX?

You can use TokenX with any XML-formatted text available on the web, or try it out with pre-selected sample files. Simply visit the TokenX website at the University of Nebraska–Lincoln and enter your file information.

Where can I find TokenX used?

TokenX Demo & download
TokenX installation on the Willa Cather Archive site
TokenX installation on the Journals of the Lewis and Clark Expedition Online site
TokenX installation on the Walt Whitman Archive site
TokenX installation on the Envisaging the West site
TokenX installation on the Buffalo Bill, Rough Riders, and the Manly Image site
TokenX installation on the Railroads and the Making of Modern America site
TokenX installation for the Utah Expedition site
TokenX installation for the Framing Red Power site
TokenX installation for The Wild West Show and the Progressive Image of American Indians

Articles that cite TokenX

Cohen, Matt. "Transgenic Deformation: Literary Translation and the Digital Archive." The Walt Whitman Archive. http://www.whitmanarchive.org/about/articles/anc.00165.html.
Schreibman, Susan. Hanlon, Ann. "Determining Value for Digital Humanities Tools: Report on a Survey of Tool Developers"
http://digitalhumanities.org/dhq/vol/4/2/000083/000083.html