*** This version of Confluence is for testing only and contains a copy of content from June 29th 2026. No changes will be preserved. ***
| Table of Contents |
|---|
Preparation
This page is a companion to a guest lecture prepared for ARCH 3819/ARCH5819.
| Table of Contents |
|---|
Class Preparation
Please bring a laptop! If you have one, bring your own. If you do not have own one, please feel free to check one out at the Olin circulation desk. Having a laptop will allow you to participate in the explorations and make discussion more meaningfulOur explorations are intended to be participatory.
No special software will be needed. All explorations will be done through a Web browser, without any special plugins.
Discussion of terms
There will be a short discussion where we define terms (at least loosely) that should give us so that we might use a common language for our discussion and critique of these tools and their strategies.
Explorations
All analysis tools will be demonstrated; no prior knowledge of any tools will be required. The room is equipped with video input to allow easy sharing of your desktop on the screen, so if . If you discover something that you would like to share and discuss, we can easily do so.
Word Frequencies
| Expand | ||
|---|---|---|
| ||
Voyant is a low barrier text analysis tool that delivers |
...
an interactive interface and a variety of visualizations.
|
...
|
...
|
...
|
...
Sample texts and URLs for analysis are listed below for experimentation, but feel free to use other source data that interests you.
|
...
|
...
|
...
|
...
|
...
|
...
|
...
|
...
...
...
...
|
...
...
|
...
nGrams
nGrams depict the frequency of a word or word phrase and are most often depicted over publication year. We have two nGram tools, each leveraging different source data.
Google's nGram Viewer. Note that many modifications can be made to refine the analysis, so please consider the The links below as starting points. Syntax for refinement is Dynamic modifications can be made at any point. Rules for syntax can be found on the About page.
- Data: Primary source data was from selected volumes from Google Books (methodology is described here).
- Analysis: Secondary data of ngrams derived through algorithms that tokenize text and then count the frequencies of those tokens. Secondary data of tokens, counts, frequencies, and publication dates. Tool is integrated with secondary data.
- Visualization:
...
- Simple line graph plots of ngram frequency over publication date from secondary data.
- Examples
nGram tool - delete the words and supply your own.- Names of New York City
- Spanish words in English publications
- Frequency for which Roland Barthes has been cited in various languages
- Terms related to racial integration
- "Ebola" 1975-2008 in various languages (compare with data from WHO on Ebola outbreaks and a map of official languages of African countries)
HathiTrust Research Center (HTRC) Bookworm
Network Analysis
Data:
Analysis:
Visualization:
Immersion is a tool for discovering the connections in a corpus of email. It analyzes the flow data (information found in email headers) and represents these as a network of entities. The analysis is done in real time on the flow data for which you provide credentials. The display is rich and interactive.
- Data: Primary source data is the openly viewable texts from the HathiTrust Research Center (publications mostly pre-1923).
- Analysis: HTRC algorithms tokenize text and then count the frequencies of those tokens. Secondary data includes tokens, counts, frequencies, publication dates, etc. arranged in SOLR indexes.
- Visualization: Simple line graph plots of ngram frequency over publication date of the secondary data. Tool has faceting control as well that leverage enriched bibliographic metadata of the texts comprising the primary data.
- Examples
- Spanish Words in English publications
- Various words for "creole"
- Mystery (contrast fiction and nonfiction)
Network Analysis
Example: Linked Jazz is an interactive visualization of various types of connections between notable Jazz artists.
- Data: Transcripts of oral histories from the archives of several institutions. (See https://linkedjazz.org/data-sources/ for explanation.)
- Analysis: Entities (names of Jazz artists) are extracted, and relationships analyzed by both automated and human (crowd-sourced) means. (See https://linkedjazz.org/data-productionworkflow-draft/ for details.) RDF triples (linked data) created.
- Visualization: Nodes and connecting edges that represent entities and relationships between them.
Immersion is a tool for analyzing and depicting connections in email. By design, Immersion collects only header information (From, To, Cc and Timestamp).
...
The FAQ describes what information you
...
grant access to,
...
how it will be used
...
, and how to delete your data when you are done. You can also explore with demo data.
- Data: Gmail, Yahoo or MS Exchange (unhosted only) mail account.
- Analysis: Done in real time. Immersion parses mail headers for flow information.
- Visualization: Displays entities (senders, receivers, etc.) as nodes and sending/receiving connections as lines. The slider at the foot of the visualization controls for time. Size of nodes pertains to volume of mail sent.
Gephi is a commonly used network analysis tool that is much more flexible and powerful. It requires local installation.
| Expand | ||
|---|---|---|
| ||
Spatial and Temporal RepresentationViewshare is |
Spatial and Temporal Representation
Data:
Analysis:
Visualization:
...
a free tool provided by the Library of Congress that |
...
generates interactive maps |
...
and timelines |
...
with facets for digital collections. |
...
The tool presupposes |
...
the setup of a user account and |
...
data in columnar form that includes location and/or time related data fields |
...
. A few helpful tutorials are available |
...
.
|
Test visualization of digital collections from Cornell University Hip Hop Collection created with Viewshare |
Image Analysis
Ukiyo-e.org is a database and image similarity analysis engine, created by John Resig to aide researchers in the study of Japanese woodblock prints.
- Data: Over 213,000 digital copies of prints from 24 institutions, and their cataloging metadata. Metadata is indexed and searchable. Details are noted in the about page.
- Analysis: Image search uses the TinEye matching engine to determine edges in an uploaded sample and compares with analyzed edges in database, returning probable matches.
- Visualization: Tiled images of "hits" for easy comparison, with URL links to their metadata in the source institution's catalog.
| Gallery | ||||||
|---|---|---|---|---|---|---|
|