• The chaos of deep neural networks

    From sean.c4s.vn@gmail.com@21:1/5 to All on Thu Oct 19 23:17:31 2017
    I noted some connections between deep neural networks and chaos theory/fractals on my blog site:
    http://randomprojectionai.blogspot.com/2017/10/why-you-should-use-wide-neural-networks.html
    It would be troublesome if deep networks turn out to be evolved (or otherwise learned) fractal blobs. For surely the computational cost will always be great.
    However if there is no significantly cheaper way, then I accept paying the toll keeper.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Sean O'Connor@21:1/5 to All on Thu Nov 2 20:50:39 2017
    Or not troublesome because if you ensemble a number of different nets and average over them any chaotic responses in all or some part of the output will cancel out to low level Gaussian noise by the central limit theorem.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)