...
How is a digital book made? How does the structure relate to it's functionality? What opportunities does this afford us in terms of text analysis?
(1) Let's consider Consider this book: Alice's Adventures in Wonderland. Explore the controls on the right side of the page turner.
- Note the different views of the book. What types of digital files do you think it likely that are likely to make up the parts of a digital book is composed of?
- How are these files likely to be made?
- What For what types of uses are each suited for?
(2) Now explore the controls at he top of the page turner.
...
(3) What might this page be? (It also has this view.) Is this also part of the book? When and how might it be used?
(4) Diving deeper into text. OCR processes are not perfect. Consider some areas of special challenge:
...
Computational analysis of text
We count words tokens - tokenization; why tokenize? What are strategies for tokenization?
Let's look again at the Arapaho gospel of St. Luke. Switch to text view.
- What is a word?
- What isn't a word?
- Punctuation
- page numbers
- grammatical constructs of various languages (ex: negation, especially in French; passive reflexive in Spanish)
- Are there words we prefer not to count in this example?
- Can you think of other types of words you might not want What words do we prefer not to count?
- headers/footers
- preface
- indexes
- title pages
- abstracts
...