Neural Network ai evolution?

I've created a small simulation game and I have a basic neural network in place, each "creature" in my game has random weights on it's nodes and they all behave differently.

Their goal is to stay inside a circular "safe zone" that moves around the center of the game world. After 1000 generations of evolution not a single one of them makes any attempt to follow the circle around, so I was thinking I either..

1. Don't know how to train them properly

2. Don't know how to find who should live/ die.

3. Using the wrong input/ outputs.

Here is the diagram of the brain (ignore the numbers)

Can anyone shed any light on what my issue is here? I'm sorry if this is vague I've only been using these for a couple of hours. But to elaborate on my question, what kind of inputs/ outputs should I be using with my neural network and what is the general procedure (in respect to my evolution approach) to train them to do the correct thing?? Could the error be caused by the number of nodes in the hidden layer or something?

• are you using normalized (0..1) values for input? – dnk drone.vs.drones Oct 13 '15 at 14:40
• No. should that be a thing I should change? How can I normalize a distance when there is no "max distance" ? – Shaun Wild Oct 13 '15 at 14:41
• As far as I know NN require normalized values in input and returns normalized values as output. I suggest you to define a max distance – dnk drone.vs.drones Oct 13 '15 at 14:43
• I normalized the angle to be 0...1 instead of 0...360 and did dist sq from 0...1 instead of 0...100^3, they still seem to just move around aimlessly generation after generation. – Shaun Wild Oct 13 '15 at 14:47
• I don't know much about neural networks. In generational algorithms, you have a stage where you assess "fitness" (or "how good are we?"). Do you have that stage, and are you using the appropriate mechanism to tell how "good" the creature did (distance to the center?) – ashes999 Oct 13 '15 at 16:12