We’ve created activation atlases (in collaboration with Google researchers), a brand new methodology for visualizing what interactions between neurons can constitute. As AI techniques are deployed in increasingly more delicate contexts, having a greater figuring out in their interior decision-making processes will allow us to establish weaknesses and examine screw ups.
