Sorry, I've run into a problem again.
My network now is as simple as this:
TNNetInput.Create(512, 512, 1),
TNNetConvolutionReLU.Create(24, 7, 0, 1, 0).InitUniform(0),
TNNetConvolutionReLU.Create(1, 5, 0, 1, 0).InitUniform(0)
Though, I run out of memory in
procedure TNNetConvolutionBase.SetPrevLayer(pPrevLayer: TNNetLayer);
when it tries to allocate 502x502x5x5x24 Volume, which is ~600MB.
As I understand, it's needed to optimize convolution calculation, but in my 32 bit application I just can't allocate that much, and my real network needs many more layers.
Is there any way to workaround this problem?
For me it's better to run it slowly than not to run at all. =)
Thanks!