Edit: Issue resolved. Switching to Linear worked, since output was typically -1 to 1, and ReLU ranges positive.
I'm having another "0 Output" issue. All my outputs show 0, even though everything seemed to run correctly.
I started with the Hypotenuse example, and changed the first layer to allow for 22 features:
N.AddLayer( TNNetInput.Create(22) );
NN.AddLayer( TNNetFullConnectReLU.Create(32) );
NN.AddLayer( TNNetFullConnectReLU.Create(32) );
NN.AddLayer( TNNetFullConnectReLU.Create(1) );
The datapoint creation was also changed:
Result.Add(
TNNetVolumePair.Create(
TNNetVolume.Create([Features[6], Features[7], Features[8], Features[9],
Features[10], Features[11], Features[12], Features[13], Features[14],
Features[15], Features[16], Features[17], Features[18], Features[19],
Features[20], Features[21], Features[22], Features[23], Features[24],
Features[25], Features[26], Features[27]]),
TNNetVolume.Create([noutputs[28]/50])
The output is typically a number from -50 to 50, and usually -20 to 20.
I used weird indexing because it made it easier to visualize where pieces of a .csv file are going -- the features are columns 6-27, and the desired output is in 28 (and 29).
Any idea how I blew this up?