*** This version of Confluence is for testing only and contains a copy of content from June 29th 2026. No changes will be preserved. ***
-
Created by
Michelle A. Paolillo, last updated on Mar 17, 2015
3 minute read
Preparation
This page is a companion to the Olin Workshop called Text Mining: Hands-On Exploration
Please do bring a laptop! If you have one, bring your own. If you do not have one, please feel free to check one out at the Olin circulation desk. Having a laptop will allow you to participate in the exercises and get the most out of class.
No special software will be needed. All exercises will be done through a Web browser, without any special plugins.
Agenda
Presentation
There will be a presentation (about 30 minutes) during which your questions and comments are welcome. My aim is to discuss as much as is useful to you. Please feel free to chime in at any time.
Exercises
Voyant
There will be exercise time using Voyant, a low barrier text analysis tool that delivers a rich, interactive interface. All exercises will be demonstrated, so no prior knowledge of the tool is required. The room is equipped with a jack to allow easy sharing of your desktop on the screen, so if you discover something that you would like to share and discuss, we can easily do so. Please feel free to bring your own material for upload and analysis to the workshop, understanding that upload of any material will be subject to the Voyant privacy policy. Sample texts and URLs for analysis are listed below for experimentation, in case you run low on ideas.
- Sample texts for upload are below, courtesy of Project Gutenberg. Download plain text version to your local machine for upload into the Voyant interface
- Crane, Stephen, 1871-1900. The Red Badge of Courage: An Episode of the American Civil War.
- Montessori, Maria, 1870-1952. (George, Anne E., Translator). The Montessori Method
- Upham, Charles Wentworth, 1802-1875. Salem Witchcraft, Volumes I and II
- Sample URLS: copy and paste into the Voyant upload browser window to get started.
- DSPS Press - http://blogs.cornell.edu/dsps/
- Copyright Law of the United States of America and Related Laws Contained in Title 17 of the United States Code - http://www.copyright.gov/title17/92preface.html
- Niagara Falls (Wikipedia) - http://en.wikipedia.org/wiki/Niagara_Falls
- Sample Visualization
nGrams
We will also explore Google's nGram tool. nGrams depict the frequency of a word or word phrase by publication year. Note that many modifications can be made to refine the analysis, so please consider the links below as starting points. Syntax for refinement is found on the About page.
- nGram tool - delete the words and supply your own.
- Names of New York City
- Spanish words in English publications
- Frequency for which Roland Barthes has been cited in various languages
- Terms related to racial integration
- "Ebola" 1975-2008 in various languages (compare with data from WHO on Ebola outbreaks and a map of official languages of African countries)
Immersion
Immersion is a tool for discovering the connections in a corpus of email. It analyzes the flow data (information found in email headers) and represents these as a network of entities. The analysis is done in real time on the flow data for which you provide credentials. The display is rich and interactive.
By design, Immersion collects only header information (From, To, Cc and Timestamp). However, using the actual flow data from your account may cause concerns regarding privacy - Be sure to read over the FAQs to understand what information you are granting access to, and how it will be used. If you do not like the terms of the tool, you can experience it with their demo data.
Viewshare
Viewshare is a free tool provided by the Library of Congress that allows you to generate and customize interactive maps, timelines, facets, and tag cloud visualizations of digital collections.