April 28, 2016

Отличная работа (и статья) о том, как с помощью нейронной сети превращать грязные карандашные наброски в рисунок в чистых линиях. На последнем инвесторском звонке гугла была красивая фраза "Мы превращаемся из mobile-first в AI-first компанию". Это конечно большое маркетологическое преувеличение, но показывает куда движется мир hi.cs.waseda.ac.jp/~esimo/en/research/sketch/

Edgar Simo-Serra・Sketch Simplification

We present a novel technique to simplify sketch drawings based on learning a series of convolution operators. In contrast to existing approaches that require vector images as input, we allow the more general and challenging input of rough raster sketches such as those obtained from scanning pencil sketches. We convert the rough sketch into a simplified version which is then amendable for vectorization. This is all done in a fully automatic way without user intervention. Our model consists of a fully convolutional neural network which, unlike most existing convolutional neural networks, is able to process images of any dimensions and aspect ratio as input, and outputs a simplified sketch which has the same dimensions as the input image. In order to teach our model to simplify, we present a new dataset of pairs of rough and simplified sketch drawings. By leveraging convolution operators in combination with efficient use of our proposed dataset, we are able to train our sketch simplification model. Our approach…