RESULTS FROM A PERFORMANCE EVALUATION OF HANDWRITTEN ADDRESS RECOGNITION SYSTEMS FOR THE UNITED STATES POSTAL SERVICE

Donald P. D'AMATO

Mitretek Systems, Inc., 7525 Colshire Drive, McLean, VA, 22102­7400 USA
E­mail: ddamato@mitretek.org

Edward J. KUEBERT and Alfred LAWSON

United States Postal Service, 8403 Lee Highway, Merrifield, VA, 22082­8101 USA
E­mail: ekuebert@email.usps.gov, alawson@email.usps.gov

For a cost­incentive­based procurement (known as HIP), the U.S. Postal Service (USPS) developed a methodology to predict the recognition performance of Remote Computer Reader (RCR) systems for handwritten letter mail. Very high volumes of mail in the United States mean that slight changes in mail piece finalization and error rates have substantial cost consequences. Thus, high measurement precision and carefully truthed data are required. Because of considerable regional and seasonal variability in address quality, the HIP evaluation required large, representative databases of images and confirmation using high volumes of live­mail. At least four RCR versions were evaluated in HIP. In comparison to a baseline RCR system, the final HIP RCR system achieved the considerable gain of approximately 33 percent in the finalization rate for an image database, while reducing the error rate to about 2.5 percent. Live­mail measurements from 25 diverse sites corroborated the database results and illustrated the high variability in address quality and consequent recognition performance. USPS' testing confirmed that evaluation with sufficiently large and representative databases is an effective means for predicting performance on live­mail.

In: L.R.B. Schomaker and L.G. Vuurpijl (Eds.)
Proceedings of the Seventh International Workshop on Frontiers
in Handwriting Recognition, September 11-13 2000, Amsterdam,
Nijmegen: International Unipen Foundation,
ISBN 90-76942-01-3
pp. 189-198.