Recent

Author Topic: Conscious Artificial Intelligence - Project Update  (Read 50187 times)

Dzandaa

  • Jr. Member
  • **
  • Posts: 89
  • From C# to Lazarus
Re: Conscious Artificial Intelligence - Project Update
« Reply #135 on: December 09, 2022, 11:45:22 am »
Dr Schuler  :D,


Congratulation!!!

Great job.

B->
Dzandaa

schuler

  • Full Member
  • ***
  • Posts: 206
Re: Conscious Artificial Intelligence - Project Update
« Reply #136 on: December 10, 2022, 04:26:26 am »
@metis and @Dzandaa,
Thank you!

@Thaddy,
Quote
Well, with a last name like that, you obviously felt the pressure to become a scholar.
You certainly have a point.


schuler

  • Full Member
  • ***
  • Posts: 206
Re: Conscious Artificial Intelligence - Project Update
« Reply #137 on: December 10, 2022, 04:46:52 am »
... the coding continues ...

The paper Searching for Activation Functions describes the search for a better activation function than ReLU. In their work, the authors found Swish to be the best replacement for ReLU. The downside of Swish is: it requires a lot of computation to calculate it. Later, the paper Searching for MobileNetV3 introduces the Hard Swish activation function. The Hard Swish gives similar results to Swish with a lot less computation.

I've just added to the source code the Hard Swish implementation and done new runs comparing ReLU, Swish and Hard Swish. Follow source codes and results.

Source codes are:

Results are (CIFAR-10 test classification accuracy):

Looks pretty good to me!

:) Wish everyone happy pascal coding. :)
« Last Edit: December 11, 2022, 03:21:32 am by schuler »

Dzandaa

  • Jr. Member
  • **
  • Posts: 89
  • From C# to Lazarus
Re: Conscious Artificial Intelligence - Project Update
« Reply #138 on: December 10, 2022, 04:10:42 pm »
Hi,
thank you for the update.

Have you tested the "mish" activation?
https://ai-scholar.tech/en/articles/treatise/mish-ai-374

It seems easy to implement.

B->
Dzandaa

schuler

  • Full Member
  • ***
  • Posts: 206
Re: Conscious Artificial Intelligence - Project Update
« Reply #139 on: December 11, 2022, 04:14:55 am »
@Dzandaa,
It looks good.

I've just added a feature request to this: https://github.com/joaopauloschuler/neural-api/issues/106 .

schuler

  • Full Member
  • ***
  • Posts: 206
Re: Conscious Artificial Intelligence - Project Update
« Reply #140 on: December 21, 2022, 06:14:42 pm »
DrDub from GitHub coded a simple web server for a neural network that receives an image and classifies it. I did plenty of updates on the top of his code. The code can be found at:

https://github.com/joaopauloschuler/neural-api/tree/master/examples/ResNet/server

schuler

  • Full Member
  • ***
  • Posts: 206
Re: Conscious Artificial Intelligence - Project Update
« Reply #141 on: January 09, 2023, 05:34:18 pm »
 :) Hello :)
Just finished updating the autoencoder example: https://github.com/joaopauloschuler/neural-api/tree/master/examples/VisualAutoencoder .

This example uses the freshly tested (but coded long ago) TNNetUpsample layer for increasing resolution in the decoder side. TNNetUpsample converts channels (depth) into spatial data. For example, a 128x128x256 activation map will be converted to 256x256x64. This layer type does a similar job to Tensorflow's tf.nn.depth_to_space.

 :) Wish everyone happy pascal coding :)

 

TinyPortal © 2005-2018