Page History

...

• Note the different views of the book. What types of digital files do you think it likely that a digital book is composed of?
• How are the these files likely to be made?
• What functions might each type facilitatetypes of uses are each suited for?

(2) Now consider explore the controls at he top of the page turner, and explore those. 

• There is a box labeled "search in this text".  What can you deduce about the book from this functionality? 
• The arrows move the view back and forth in the book. The sections allow for jumping to chapter starts.  What must enable this functionWhat do the other controls do?  Is there a way to summarize this class of controls?  What underlying logic might you predict that coordinates these functions? (Food for thought...)

(3) What might this page be?  (It also has this view.) Is this also part of the book?  When and how might it be used?

Diving deeper into text:

OCR processes are not perfect. Consider some areas of special challenge:

• poor image quality (resolution, warp, skew, crop)
• language specific challenges - Arapaho gospel of St. Luke
• books where characters vary - from "standard"
  • handwritten manuscripts, block printed books
  • early font styles
• Unexpected arrangement
• Roman/non Roman
• • , many non-Roman alphabets (Panjabi example)
• character-based writing systemsSpecial character sets: Japanese done well, and not so well
• language specific challenges - Arapaho gospel of St. Luke
• Mixed languages: Latin/Greek, German/Greek

What are the opportunity points that the structure and arrangement of a book afford?

• Which of the views in HathiTrust are easiest read by humans?
• Which can be read by machines?

• Unexpected arrangement

Computational analysis of text

We count words - tokenization; why tokenize?

Let's look again at the Arapaho gospel of St. Luke.  Switch to text view.

• What is a word?
• What isn't a word? 
  
  • Punctuation
  • page numbers
  • grammatical constructs of various languages (ex: negation, especially in French; passive reflexive in Spanish)
• What words do we prefer not to count?
  
  • headers/footers
  • preface
  • indexes
  • title pages
  • abstracts

What are the opportunity points that the structure and arrangement of a book afford?

• How do challenges with OCR intersect with strategies for computational analysis of text?
• What might be effective strategies to deal with these challenges?

Introducing Control - "Microanalysis" and Voyant

...