What Constructor Theory reveals about Deep Learning
(W)hat should be built in, as their complexity is endless; instead we should build in only the meta-methods that can find and capture this arbitrary complexity. Essential to these methods is that they can find good approximations, but the search for them should be by our methods, not by us.” — Richard Sutton
What is an explanation? I’ve been beating around the bush around this for quite some ti...