Page History

...

• Bring text to play with in Voyant. Input format can be plain text, a PDF (with OCR), a MS Word Document or a URL for HTML analysis. Upload of any material will be subject to the Voyant privacy policy, so bring text you can safely share.
• Bring a laptop to support your explorations.
• Optionally - the intrepid may want to get obtain a login to the HTRC Portal, create a workset and run a few algorithms in advance of this lecture.   A Documentation for obtaining a sign-on is required and the documentation for the portal is helpful.

Going down the rabbit hole: anatomy of a digital book

...

HathiTrust Research Center (HTRC) Bookworm.  Again, consider these links as starting points.  Rules for faceting ad controls are available on the HTRC wiki. 

• monster in fiction/non-fiction/unknown
• mystery (contrast fiction and nonfiction)
• various words for "creole"
• "phonograph" in three languages

...

• How easily can these examples above be refined and improved?
• Compare the various interfaces, especially as to the affordances and the limits of each. 
• What additional elements of control would be useful that aren't available?
• When we see unexpected wave forms, what do we make of these? 
  
  • Are Do these important constitute discoveries or flawserrors?  How can we distinguish?
  • Would the flaws be due to the data, the metadata, the algorithms?

...

HathiTrust Research Center (HTRC) is a collaborative research center (jointly managed by Indiana University and the University of Illinois) dedicated to developing cutting-edge software tools and cyberinfrastructure that enable advanced computational access to large amounts of digital text. A basic orientation of HTRC services is available, and features and steps for each are documented on the HTRC community wiki.  We will be spending time in the HTRC Portal looking at the results of a few algorithms. 

• Dunning log likelihood
• Entity entity extraction
  • What are entities?
  • False positives/false negatives (omissions)
  Dunning log likelihood
• Clustering - topic modeling
  • define and defer for Mimno

...