🔬 Research
Distill.pub
Understanding Convolutions on Graphs
Understanding the building blocks and design choices of graph neural networks.
Distill.pub
30 articles
🔬 Research
Distill.pub
A Gentle Introduction to Graph Neural Networks
What components are needed for building learning algorithms that leverage the structure and properties of graphs?
🔬 Research
Distill.pub
Adversarial Reprogramming of Neural Cellular Automata
Reprogramming Neural CA to exhibit novel behaviour, using adversarial attacks.
🔬 Research
Distill.pub
Weight Banding
Weights in the final layer of common visual models appear as horizontal bands. We investigate how and why.
🔬 Research
Distill.pub
Branch Specialization
When a neural network layer is divided into multiple branches, neurons self-organize into coherent groupings.
🔬 Research
Distill.pub
Multimodal Neurons in Artificial Neural Networks
We report the existence of multimodal neurons in artificial neural networks, similar to those found in the human brain.
🔬 Research
Distill.pub
Self-Organising Textures
Neural Cellular Automata learn to generate textures, exhibiting surprising properties.
🔬 Research
Distill.pub
Visualizing Weights
We present techniques for visualizing, contextualizing, and understanding neural network weights.
🔬 Research
Distill.pub
Curve Circuits
Reverse engineering the curve detection algorithm from InceptionV1 and reimplementing it from scratch.
🔬 Research
Distill.pub
High-Low Frequency Detectors
A family of early-vision neurons reacting to directional transitions from high to low spatial frequency.
🔬 Research
Distill.pub
Naturally Occurring Equivariance in Neural Networks
Neural networks naturally learn many transformed copies of the same feature, connected by symmetric weights.
🔬 Research
Distill.pub
Understanding RL Vision
With diverse environments, we can analyze, diagnose and edit deep reinforcement learning models using attribution.
🔬 Research
Distill.pub
Communicating with Interactive Articles
Examining the design of interactive articles by synthesizing theory from disciplines such as education, journalism, and visualization.
🔬 Research
Distill.pub
Thread: Differentiable Self-organizing Systems
A collection of articles and comments with the goal of understanding how to design robust and general purpose self-organizing systems.
🔬 Research
Distill.pub
Self-classifying MNIST Digits
Training an end-to-end differentiable, self-organising cellular automata for classifying MNIST digits.
🔬 Research
Distill.pub
Curve Detectors
Part one of a three part deep dive into the curve neuron family.
🔬 Research
Distill.pub
Exploring Bayesian Optimization
How to tune hyperparameters for your machine learning model using Bayesian optimization.
🔬 Research
Distill.pub
An Overview of Early Vision in InceptionV1
An overview of all the neurons in the first five layers of InceptionV1, organized into a taxonomy of 'neuron groups.'
🔬 Research
Distill.pub
Visualizing Neural Networks with the Grand Tour
By focusing on linear dimensionality reduction, we show how to visualize many dynamic phenomena in neural networks.
🔬 Research
Distill.pub
Thread: Circuits
What can we learn if we invest heavily in reverse engineering a single neural network?
🔬 Research
Distill.pub
Zoom In: An Introduction to Circuits
By studying the connections between neurons, we can find meaningful algorithms in the weights of neural networks.
🔬 Research
Distill.pub
Growing Neural Cellular Automata
Training an end-to-end differentiable, self-organising cellular automata model of morphogenesis, able to both grow and regenerate specific patterns.
🔬 Research
Distill.pub
Visualizing the Impact of Feature Attribution Baselines
Exploring the baseline input hyperparameter, and how it impacts interpretations of neural network behavior.