Why neural networks struggle with the Game of Life