机器学习 深度学习
Hello there! I'm Jason, a Ph.D.studentcandidate in Computer Science at Cornell. My research focuses on training and understanding neural networks for computer vision and robotics. I work withHod Lipsonand theCornell Creative Machines Laband sometimes as a visiting student withYoshua Bengioand theLISA Labat U. Montreal. My work is supported by aNASA Space Technology Research Fellowship. This summer of 2015 I'm in London working atGoogle DeepMind.
Jason Yosinski http://yosinski.com/
Understanding Neural Networks Through Deep Visualization
ICML DL Workshop paper|video|code and more info »
Recent years have produced great advances in training large, deep neural networks (DNNs), including notable successes in training convolutional neural networks (convnets) to recognize natural images. However, our understanding of how these models work, especially what computations they perform at intermediate layers, has lagged behind. Here we introduce two tools for better visualizing and interpreting neural nets. The first is a set of new regularization methods for finding preferred activations using optimization, which leads to clearer and more interpretable images than had been found before. The second tool is an interactive toolbox that visualizes the activations produced on each layer of a trained convnet. You can input image files or read video from your webcam, which we've found fun and informative. Both tools are open source.Read more »
Deep Neural Networks are Easily Fooled
Deep neural networks (DNNs) have recently been doing very well at visual classification problems (e.g. recognizing that one image is of a lion and another image is of a school bus). A recent study bySzegedy et al.showed that changing an image (e.g. of a lion) in a way imperceptible to humans can cause a network to label the image as something else entirely (e.g. mislabeling a lion a library). Here we show a related result: it is easy to produce images that are completely unrecognizable to humans, but that state-of-the-art DNNs believe to be recognizable objects with 99.99% confidence (e.g. labeling with certainty that white noise static is a lion). We show methods of producing fooling images both with and without the class gradient in pixel space. The results shed light on interesting differences between human vision and state-of-the-art DNNs.Read more »
How Transferable are Features in Deep Neural Networks?
Many deep neural networks trained on natural images exhibit a curious phenomenon: they all learn roughly the same Gabor filters and color blobs on the first layer. These features seem to begeneric— useful for many datasets and tasks — as opposed tospecific— useful for only one dataset and task. By the last layer featuresmustbe task specific, which prompts the question: how do features transition from general to specific throughout the network? In this paper, presented at NIPS 2014, we show the manner in which features transition from general to specific, and also uncover a few other interesting results along the way.Read more
Generative Stochastic Networks
First arXiv paper|ICML paper|Latest arXiv paper
Unsupervised learning of models for probability distributions can be difficult due to intractable partition functions. We introduce a general family of models called Generative Stochastic Networks (GSNs) as an alternative to maximum likelihood. Briefly, we show how to learn the transition operator of a Markov chain whose stationary distribution estimates the data distribution. Because this transition distribution is a conditional distribution, it's often much easier to learn than the data distribution itself. Intuitively, this works by pushing the complexity that normally lives in the partition function into the “function approximation” part of the transition operator, which can be learned via simple backprop. We validate the theory by showing several successful experiments on two image datasets and with a particular architecture that mimics the Deep Boltzmann Machine but without the need for layerwise pretraining.
EndlessForms.com
Watch the two minute intro video.Users on EndlessForms.com collaborate to produce interesting crowdsourced designs. Since launch, over 4,000,000 shapes have been seen and evaluated by human eyes. This volume of user input has produced somereally cool shapes. EndlessForms has received somefavorable press.Evolve your own shape »
