I would like to make a small announcement. On Sunday, I will probably give a presentation at the Pascal Conference in Sundern-Hagen about my PALM project, which is an LLM interference engine in Pascal. It also includes a GUI that allows you to chat with an LLM. The entire project includes:
- The multithreaded/parallelized LLM interference engine called PALM itself in Pascal, including AVX2/FMA3 inline assembler code for the performance-critical parts. It is compatible with many LLM models, such as LLaMA2, LLaMA3.x, Mistral (with and without Mix Of Experts), Qwen2.5, Qwen3 (with and without Mix Of Experts), Phi, Gemma, and so on. Basically, it works with all LLM models that use the LLaMa2/LLaMA3 basic architecture with a few possible minor deviations (different layer normalization variants, different activation functions, different RoPE/YaRN variants, and so on).
- Its own Jinja2-compatible template engine called Pinja in Pascal for processing prompt templates of the respective LLM models.
- Its own LCL/VCL/FMX-compatible MarkDown/BasicHTML rendering engine in Pascal to display the chat outputs of the LLMs in an appealing way, where the MarkDown text is first converted internally into simple HTML and then rendered attractively in the GUI using this simple HTML with its own minimal HTML rendering engine.
- And an own GUI, which is available in three variants: LCL (FPC/Lazarus), VCL (Delphi), and FMX (Delphi), which allows you to chat with the LLMs, and so on. The LCL variant runs most flawlessly, whereas the FMX variant is the most modern, but also has some quirks due to FMX itself. The VCL variant lies somewhere in between.
It has not yet been decided whether the entire project will become open source later on. There are a few considerations I still need to make. But I will definitely give the presentation at the Pascal conference. And depending on the feedback, I will then decide how to proceed.
And here's a little preview video of the LCL version of the GUI:
https://youtu.be/K6HY_vxY6a4 as a teaser, so to speak
See you then. See you at the Pascal Conference in Sundern-Hagen
Recent
