Recent

Author Topic: Forum is so SLOOOW... Again!  (Read 9704 times)

lainz

  • Hero Member
  • *****
  • Posts: 4593
  • Web, Desktop & Android developer
    • https://lainz.github.io/
Re: Forum is so SLOOOW... Again!
« Reply #30 on: August 01, 2024, 12:44:18 am »
I'm subscribed to the Kotlin forums, and I get only one or two posts a week, so here is more active than the Kotlin forums...

Maybe they use other places to talk...

Joanna

  • Hero Member
  • *****
  • Posts: 1072
Re: Forum is so SLOOOW... Again!
« Reply #31 on: August 01, 2024, 04:13:06 am »
I just looked at the stats
Quote
Online Today: 4111
Online Ever: 4111
(Today at 12:17:29 am)
I seriously doubt that there are 4111 pascal programmers visiting the forum today. More likely pascal haters trying to ddos the forums.
✨ 🙋🏻‍♀️ More Pascal enthusiasts are needed on IRC .. https://libera.chat/guides/ IRC.LIBERA.CHAT  Ports [6667 plaintext ] or [6697 secure] channel #fpc  #pascal Please private Message me if you have any questions or need assistance. 💁🏻‍♀️

Marc

  • Administrator
  • Hero Member
  • *
  • Posts: 2611
Re: Forum is so SLOOOW... Again!
« Reply #32 on: August 06, 2024, 09:37:07 am »
I was on a vacation the past 3 weeks.
After a mail from Martin I tried to fix something remotely using my phone. There I don't have the complete overview I normally have on my desktop.
What happens recently is that more and more AI bots try to "learn" from our forum. The bad thing is that they don't honor some or all of the robots.txt settings. Resulting in several queries per second.
There isn't some automate (yet) to detect these bots, but I've some logs to make manual detection easier.
I still keep an eye on them.

Marc

//--
{$I stdsig.inc}
//-I still can't read someones mind
//-Bugs reported here will be forgotten. Use the bug tracker

cdbc

  • Hero Member
  • *****
  • Posts: 1515
    • http://www.cdbc.dk
Re: Forum is so SLOOOW... Again!
« Reply #33 on: August 06, 2024, 11:13:03 am »
Hi Marc
Glad to have you back, I hope you enjoyed your vacation  :)
Regards Benny
If it ain't broke, don't fix it ;)
PCLinuxOS(rolling release) 64bit -> KDE5 -> FPC 3.2.2 -> Lazarus 2.2.6 up until Jan 2024 from then on it's: KDE5/QT5 -> FPC 3.3.1 -> Lazarus 3.0

Joanna

  • Hero Member
  • *****
  • Posts: 1072
Re: Forum is so SLOOOW... Again!
« Reply #34 on: August 06, 2024, 02:26:59 pm »
I was on a vacation the past 3 weeks.
After a mail from Martin I tried to fix something remotely using my phone. There I don't have the complete overview I normally have on my desktop.
What happens recently is that more and more AI bots try to "learn" from our forum. The bad thing is that they don't honor some or all of the robots.txt settings. Resulting in several queries per second.
There isn't some automate (yet) to detect these bots, but I've some logs to make manual detection easier.
I still keep an eye on them.

Marc
Sounds horrible. Isn’t there a way to automatically ban things that are too fast to be human?
« Last Edit: September 11, 2024, 02:30:02 pm by Joanna »
✨ 🙋🏻‍♀️ More Pascal enthusiasts are needed on IRC .. https://libera.chat/guides/ IRC.LIBERA.CHAT  Ports [6667 plaintext ] or [6697 secure] channel #fpc  #pascal Please private Message me if you have any questions or need assistance. 💁🏻‍♀️

cdbc

  • Hero Member
  • *****
  • Posts: 1515
    • http://www.cdbc.dk
Re: Forum is so SLOOOW... Again!
« Reply #35 on: September 05, 2024, 09:25:36 am »
Hi
Nahh, forum is playing up again...  :(
Regards Benny
If it ain't broke, don't fix it ;)
PCLinuxOS(rolling release) 64bit -> KDE5 -> FPC 3.2.2 -> Lazarus 2.2.6 up until Jan 2024 from then on it's: KDE5/QT5 -> FPC 3.3.1 -> Lazarus 3.0

Joanna

  • Hero Member
  • *****
  • Posts: 1072
Re: Forum is so SLOOOW... Again!
« Reply #36 on: September 07, 2024, 11:39:45 pm »
Quote
Online Today: 3436
Online Ever: 4376
(September 01, 2024
Either a heck of a lot of people have suddenly decided to program in pascal or we are getting attacked by bots.. which is more likely.
✨ 🙋🏻‍♀️ More Pascal enthusiasts are needed on IRC .. https://libera.chat/guides/ IRC.LIBERA.CHAT  Ports [6667 plaintext ] or [6697 secure] channel #fpc  #pascal Please private Message me if you have any questions or need assistance. 💁🏻‍♀️

Martin_fr

  • Administrator
  • Hero Member
  • *
  • Posts: 10300
  • Debugger - SynEdit - and more
    • wiki
Re: Forum is so SLOOOW... Again!
« Reply #37 on: September 08, 2024, 12:34:33 am »
Quote
Online Today: 3436
Online Ever: 4376
(September 01, 2024
Either a heck of a lot of people have suddenly decided to program in pascal or we are getting attacked by bots.. which is more likely.
The answer is 3 (well 42, but...)

Why are those the 2 only options?
Even just combining: bots/people  and attack/non-attack gives 4 options.

And how to you define an attack? By the effect it actually has, or by the effect that is desired by the one doing it?

Because, if it is by the effect, then if there were that many people interested, their interest would be an attack. But if it is a matter of the indent, then bots (or people) may come for other reasons yet have that effect. And of course there are plenty more ways to define what counts as what ....

It's a bit like tourists in Venice (and other very popular destinations). They do cause problems. Yet you wouldn't call it an attack. Well,  I wouldn't.

Anyway, while I don't know the background to this particular instance, in the past we had bots, but not with the aim of attacking. Actually with kind of something like interest. AI bots were simple coming to "learn". Which actually, if it weren't for the side effects wouldn't be automatically bad, since they could later provide the information to those seeking it, and that would further the cause of Pascal (keep it in the loop).


Joanna

  • Hero Member
  • *****
  • Posts: 1072
Re: Forum is so SLOOOW... Again!
« Reply #38 on: September 08, 2024, 02:01:39 am »
If the 4376 were pascal enthusiasts I would call that success. :D
Why does it take 4376 bots to learn about pascal though? Can you tell who owns all these bots? And more importantly don’t they increase the cost of operating the forums by consuming so much bandwidth that people who actually use pascal can’t do anything?  :o
✨ 🙋🏻‍♀️ More Pascal enthusiasts are needed on IRC .. https://libera.chat/guides/ IRC.LIBERA.CHAT  Ports [6667 plaintext ] or [6697 secure] channel #fpc  #pascal Please private Message me if you have any questions or need assistance. 💁🏻‍♀️

Gustavo 'Gus' Carreno

  • Hero Member
  • *****
  • Posts: 1149
  • Professional amateur ;-P
Re: Forum is so SLOOOW... Again!
« Reply #39 on: September 08, 2024, 02:36:36 am »
Hey Y'all,

I'm getting some intermittent issues when I'm accessing the forums.

Every so often my browser will not be able to connect and display the "Unable to connect" screen.
If I press refresh, then it connects, but displays content, only about 30s to 1m.

Then everything is OK and it's quick... But some time passes and I get it again. And this has been going on for quite a while.

I hate intermittent issues cuz they are the worst to suss out. Sorry I can't provide more clues.


EDIT: It happened again, while trying to send this exact reply, as shown on the image.

Cheers,
Gus
Lazarus 3.99(main) FPC 3.3.1(main) Ubuntu 23.10 64b Dark Theme
Lazarus 3.0.0(stable) FPC 3.2.2(stable) Ubuntu 23.10 64b Dark Theme
http://github.com/gcarreno

Martin_fr

  • Administrator
  • Hero Member
  • *
  • Posts: 10300
  • Debugger - SynEdit - and more
    • wiki
Re: Forum is so SLOOOW... Again!
« Reply #40 on: September 08, 2024, 12:25:30 pm »
If the 4376 were pascal enthusiasts I would call that success. :D
Why does it take 4376 bots to learn about pascal though? Can you tell who owns all these bots? And more importantly don’t they increase the cost of operating the forums by consuming so much bandwidth that people who actually use pascal can’t do anything?  :o

Or as I wrote:
if it weren't for the side effects

Well, as I understand it / from what I hear: It's a counting issue of the forum software. 

BrunoK

  • Hero Member
  • *****
  • Posts: 582
  • Retired programmer
Re: Forum is so SLOOOW... Again!
« Reply #41 on: September 08, 2024, 02:04:43 pm »
Or as I wrote:
if it weren't for the side effects

Well, as I understand it / from what I hear: It's a counting issue of the forum software.
You should also consider the fact that the Google and others search engines need to build their own indexes so that interested people can query them, thus need to crawl sites it indexes. Maybe are they a bit to greedy request wise.
I have been surprised that sometimes google searching things was more fruitful than searching the forum for information that point to the forum, lazarus/free pascal wiki or documentation.

Joanna

  • Hero Member
  • *****
  • Posts: 1072
Re: Forum is so SLOOOW... Again!
« Reply #42 on: September 09, 2024, 07:55:32 am »
I’m curious what exactly do the bots do when they come to forums? Read every thread consecutively?
✨ 🙋🏻‍♀️ More Pascal enthusiasts are needed on IRC .. https://libera.chat/guides/ IRC.LIBERA.CHAT  Ports [6667 plaintext ] or [6697 secure] channel #fpc  #pascal Please private Message me if you have any questions or need assistance. 💁🏻‍♀️

Marc

  • Administrator
  • Hero Member
  • *
  • Posts: 2611
Re: Forum is so SLOOOW... Again!
« Reply #43 on: September 09, 2024, 12:29:35 pm »
Hi Gus,

In the timeframe around your post (02:30:00 - 02:36:36) I only see some regular users. Nothing indicating that the server was busy.

Marc


Hey Y'all,

Then everything is OK and it's quick... But some time passes and I get it again. And this has been going on for quite a while.

I hate intermittent issues cuz they are the worst to suss out. Sorry I can't provide more clues.


EDIT: It happened again, while trying to send this exact reply, as shown on the image.
//--
{$I stdsig.inc}
//-I still can't read someones mind
//-Bugs reported here will be forgotten. Use the bug tracker

Gustavo 'Gus' Carreno

  • Hero Member
  • *****
  • Posts: 1149
  • Professional amateur ;-P
Re: Forum is so SLOOOW... Again!
« Reply #44 on: September 10, 2024, 08:15:51 am »
Hey Marc,

In the timeframe around your post (02:30:00 - 02:36:36) I only see some regular users. Nothing indicating that the server was busy.

Thanks for going deep into the logs !!

Then I guess the culprit is my very bad connection. It's always a thing to consider and sometimes I forget that I have such issues.

Cheers,
Gus
Lazarus 3.99(main) FPC 3.3.1(main) Ubuntu 23.10 64b Dark Theme
Lazarus 3.0.0(stable) FPC 3.2.2(stable) Ubuntu 23.10 64b Dark Theme
http://github.com/gcarreno

 

TinyPortal © 2005-2018