AI, NLP and CAI: Text Generation with Convolutional Neural Networks in Pascal

[schuler]

Hello
All 3 chat bots now use planning and reflection (they critique their own work) when coding in pascal:

* https://chatgpt.com/g/g-6BrAwhTQ9-free-pascal-developer-neural-api
* https://poe.com/CAI-NEURAL-API-FREE.
* https://poe.com/CAI-NEURAL-API.

This is an output example:

Code: Pascal  [Select][+][-]

1. Human: How the Byte Pair Encoding algorithm will look like in Free Pascal?
2.  
3. Poe:
4. <planning>
5. To provide an implementation of the Byte Pair Encoding (BPE) algorithm in Free Pascal, I'll follow these steps:
6. 1. Define the necessary data structures
7. 2. Implement the core BPE algorithm functions
8. 3. Create a simple main program to demonstrate the usage
9. 4. Add comments for clarity
10. 5. Ensure the code follows Free Pascal conventions and best practices
11. </planning>
12. ...
13. <candidate-solution>
14. Here's an implementation of the Byte Pair Encoding algorithm in Free Pascal:
15. ...
16. </candidate-solution>
17.  
18. <reflexion>
19. The provided implementation of the Byte Pair Encoding algorithm in Free Pascal covers the essential aspects of the algorithm and demonstrates its usage. It includes:
20. Necessary data structures (TStringList and TPairFrequency)
21. Core BPE algorithm functions (CountPairs, GetMostFrequentPair, MergePair, and BPE)
22. A simple main program to demonstrate the usage
23. Comments for clarity
24. Adherence to Free Pascal conventions and best practices
25. The code is well-structured and should be easy to understand for those familiar with Pascal-like languages. It uses generics (TFPGList and TFPGMap) for type-safe collections, which is a modern feature in Free Pascal.
26.  
27. However, to improve the implementation, we could consider the following enhancements:
28.  
29. Add error handling for file I/O to allow loading vocabulary from a file
30. Implement tokenization of new text using the learned BPE merges
31. Add an option to save the learned merges for later use
32. Optimize the pair counting process for larger vocabularies
33. Let's create an improved version incorporating these enhancements.
34. </reflexion>
35. ...
36. <candidate-solution>
37. Here's an improved implementation of the Byte Pair Encoding algorithm in Free Pascal with the planned enhancements:
38. ...
39.  

I wish everyone happy pascal coding.

[schuler]

Hello,
I've just gave a go to the google notebooklm to produce audio files around the subject of Pascal with Artificial Intelligence. I must say that I'm really impressed with the result:

* https://www.youtube.com/watch?v=2nnlE0k_1QQ
* https://www.youtube.com/watch?v=IZy0yQAbvWA

I'm finding that google's notebooklm is a strong promoter of pascal...

Have fun

[schuler]

Just to comment that I have just started experimenting Claude 3.7 for pascal programming at:
* https://poe.com/CAI-NEURAL-API

My first impression is positive. Curious to know what is your opinion.

This is an example done with a free account at poe:
* https://poe.com/s/osNsewIb69hIVVOdQHMq

[Mongkey]

awesome!!! Thank you for your great works.

[microxa]

Hello,

Starting from version 1877, the StringManipulation example did not work correctly, at least on the 32-bit version.
In any case, it was an interesting quest.
https://sourceforge.net/p/cai/svncode/1877

Is it possible to add a pre-made training file tinystories.txt to the NLP examples?

Does it really take more than a day to prepare it?

And yes, I'm joining the congratulations, it's truly a great job!
p.s
It turned out to be quite simple to implement batch multiplication using SSE/2/3
(thanks for the trick with double haddps), but unfortunately it didn't help much.
Apparently, this approach would work better on a more powerful processor like Xeon diamond rapid