Book title recognition for smart library with deep learning

Document Type

Conference Proceeding

Publication Date



Department of Applied Computing; Center for Cyber-Physical Systems


A library usually holds thousands of books and each book is assigned to a unique position so that the visitors can find the books easily by checking the database of the library. However, the misplaced books bring troubles for readers to find them. Therefore, finding out these misplaced books and rearranging them is one of the important jobs for librarians. In this paper, a convolutional-neural-network-based book label recognition algorithm is proposed to help librarians finding out the misplaced books by scanning the book labels. The algorithm is divided into two parts: the first part applies image processing techniques to extract the characters of the labels attached to each book from the images of the bookshelves. The second part uses convolutional neural networks (CNNs) to train a classifier for recognizing characters. In this part, a CNN with four convolutional layers is designed to train classifiers for classifying characters and numbers that are used for the recognition of the text.

Publisher's Statement

© 2018 Society of Photo-Optical Instrumentation Engineers (SPIE). Publisher's version of record:

Publication Title

Proceedings Mobile Multimedia/Image Processing, Security, and Applications 2018