Whole-BookRecognitionusingMutual-Entropy-DrivenModel.pptVIP

Whole-Book Recognition using Mutual-Entropy-Driven Model Adaptation Pingping Xiu* Henry S. Baird Whole-Book Recognition Motivation Millions of books are being scanned cover-to-cover with OCR results available on the web. Many documents are strikingly isogenous, containing only a small fraction of all possible languages, words, typefaces, image qualities, layout styles, etc. Research in the last decade or so shows that isogeny can be exploited to improve recognition fully automatically. ( Nagy Baird (1994), Hong (1995), Sarkar (2000), Veeramachaneni (2002), Sarkar, Baird Zhang, (2003) ) Given: a book’s images, an initial buggy OCR transcription, a dictionary that might be incomplete … can we: improve recognition accuracy substantially fully automatically? Fully-Automatic Model Adaptation Two models: initialized from the input iconic: a character-image classifier linguistic: a dictionary (list of valid words) Look for disagreements between the two models: measure mutual entropy between two probability distributions: a posteriori probabilities of character classes a posteriori probabilities of word classes Automatically correct both models to reduce disagreement: We illustrate this approach on a small test set of real book-image data. We show that we can drive improvements in both models, and can lower recognition error rate. Defining ‘Disagreements’ Mutual Entropy (ME): Character-level ME: Word-level ME: Passage-level ME: Model-Adaptation Policies How to correct the iconic model: characters with largest character-level disagreement first How to correct the linguistic model: words with largest word-level disagreement first Minimize this objective function: drive passage-level mutual entropy down Test experimentally: can this policy achieve unsupervised improvement? does it work better, the longer the passage length? Experimental Design – Training Experimental Design – Testing Character classification: highly erroneous Word classi