Two Stream Neural Networks with Traditional CNN and Gabor CNN for Object Classification

Abstract : Image classification is still a hot and challenging task in the field of computer vision. With the combination of traditional CNN and Gabor CNN, we designed color-texture convolutional neural networks. We believe that color and texture is the most important feather to describe an object. So the original image, which main consist of color information, and the image processed by Gabor, which contain the texture information, input two stream networks separately is a natural idea. And merging the output of two stream at the end of network to complete the task of classification. We design a simple but effective network structure and test it on Cifar-10, STL-10 and NWPU-RESISC45 dataset. The result shows that the network achieve a well accuracy and proves that our idea is feasible