Google’s Inceptionism

Google is in the news this week with their trippy neural net visualizations they call inceptionism.

google_inception_visualization_007

Inception was Google’s code name for a 22-layer deep convolutional neural network described in Christian Szegedy et al., Going Deeper with Convolutions, http://arxiv.org/abs/1409.4842 .

However, the idea for generating the trippy visualizations seems to have come from this paper which describes what they call saliency visualization:

  • Karen Simonyan, Andrea Vedaldi, Andrew Zisserman, Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps, http://arxiv.org/abs/1312.6034.

The rest of this article suggests ideas for how a new visualization such as inceptionism could be added to neural2d.

Continue reading →

ball-and-stick-illustration-1454x150

Blender ball-and-stick figures (and free wallpaper)

Free wallpapers:

neural2d-16x16-8x8-radius-2x2-Bneural2d-4x4-9x4x4neural2d-16x16-8x8-radius-2x2-A

The ball-and-stick illustrations used in the neural2d documentation were made with Blender. This article documents the Python scripting used to generate the connectors (sticks) between the neurons (the spheres) for the benefit of any Blender users who are trying to do something similar.

Continue reading →

layers-icon-148x148

Generalized layer depths

In neural2d, convolution network layers and pooling layers typically have a depth > 1, where the depth equals the number of kernels to train.

Previously, neural2d imposed certain restrictions on how layers with depth could be connected. The assumption was that if you wanted to go from a convolution network layer to a regular layer, the destination regular layer would have a depth of one.

There was no good reason to impose such a restriction, so neural2d now allows you to define regular layers with depth and connect them in any way to any other kind of layer. This means you can now insert a sparsely connected regular layer in between two convolution network layers with depth > 1 while preserving the depth of the pipeline.

Continue reading →