Skip to content

"Neural Network" Might not be a Neural Network. #6

Description

@ikyman

Neural networks famously have many circles.
Image
Many Circles, many Arrows! Wowie!

Too bad! This Surfeit of circles is a red herring, a bamboozlement! For anyone using a pre-built Machine Learning Library, this nice colorful circle diagram gets thrown out of the window in favour of "Layers".

I named my Struct "NeuralNet". Much like a NeuralNet in Tensorflow, there are no circles nor any arrows pointing from circles to other circles. At the coding level, it's very similar.

Splitting at hairs, though, there is a minor difference.
Image

Whenever I used Tensorflow, I got diddly Squat. 15 minutes for absolutely nothing useful whatsoever. That's even if my Tensorflow structure compiled, which It often didn't.

I wanted my implementation to fail early and fail fast. To do this, I cross-check the current output dimensions with any potential new layer. A by-product of this is that each Layer is one massive Matrix instead of a swarm of little matrixies. I'm finding the task of drawing a diagram with many bubbles and many arrows to indeed be quite difficult!

Again, this slipped by because no-body uses all the little circles unless they want to impress someone with a neat pictograph.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions