A Multi-Column Deep Framework for Recognizing Artistic Media

We present a multi-column structured framework for recognizing artistic media from artwork images. We design the column of our framework using a deep neural network. Our key idea is to recognize the distinctive stroke texture of an artistic medium, which plays a key role in distinguishing artistic m...

Full description

Bibliographic Details
Main Authors: Heekyung Yang, Kyungha Min
Format: Article
Language:English
Published: MDPI AG 2019-11-01
Series:Electronics
Subjects:
cnn
Online Access:https://www.mdpi.com/2079-9292/8/11/1277
Description
Summary:We present a multi-column structured framework for recognizing artistic media from artwork images. We design the column of our framework using a deep neural network. Our key idea is to recognize the distinctive stroke texture of an artistic medium, which plays a key role in distinguishing artistic media. Since stroke texture is in a local scale, the whole image is not proper for recognizing the texture. Therefore, we devise two ideas for our framework: Sampling patches from an input image and employing a Gram matrix to extract the texture. The patches sampled from an input artwork image are processed in the columns of our framework to make local decisions on the patch, and the local decisions from the patches are merged to make a final decision for the input artwork image. Furthermore, we employ a Gram matrix, which is known to effectively capture texture information, to improve the accuracy of recognition. Our framework is trained and tested using two real artwork image datasets: <i>WikiSet</i> of traditional artwork images and <i>YMSet</i> of contemporary artwork images. Finally, we build <i>SynthSet</i>, which is a collection of synthesized artwork images from many computer graphics literature, and propose a guideline for evaluating the synthesized artwork images.
ISSN:2079-9292