The first few articles of the Circuits project will be focused on early vision in InceptionV1 — for our purposes, the five convolutional layers leading up to the third pooling layer. Over the course of these layers, we see the network go from raw pixels up to sophisticated boundary detection , basic shape detection (eg. curves , circles , spirals , triangles ), eye detectors , and even crude detectors for very small heads . Along the way, we see a variety of interesting intermediate features, including Complex Gabor detectors (similar to some classic “complex cells” of neuroscience), black and white vs color detectors , and small circle formation from curves . Studying early vision has two major advantages as a starting point in our investigation. Firstly, it’s particularly easy to study : it’s close to the input, the circuits are only a few layers deep, there aren’t that many different neurons, 1 and the features seem quite simple. Secondly, early vision seems most likely to be universal : to have the same features and circuits form across different architectures and tasks. 链接地址： https://distill.pub/2020/circuits/early-vision/