Recent

Author Topic: Forum slow  (Read 7267 times)

TRon

  • Hero Member
  • *****
  • Posts: 3930
Re: Forum slow
« Reply #15 on: April 25, 2024, 08:59:44 am »
Thank you cdbc. I believe it is related to the forum server as well.

Code: [Select]
https://forum.lazarus.freepascal.org/index.php/topic,67083.msg515497/topicseen.html#new
Request Timing
Blocked: 0 ms
DNS Resolution: 2 ms
Connecting: 20 ms
TLS Setup: 2.03 s
Sending: 0 ms
Waiting: 25.06 s
Receiving: 0 ms

https://forum.lazarus.freepascal.org/index.php?action=dlattach;attach=19068;type=avatar
Request Timing
Blocked: -1 ms
DNS Resolution: 0 ms
Connecting: 0 ms
TLS Setup: 0 ms
Sending: 0 ms
Waiting: 16.52 s
Receiving: 0 ms

https://forum.lazarus.freepascal.org/index.php?action=dlattach;topic=67083.0;attach=62400;image
Request Timing
Blocked: -1 ms
DNS Resolution: 0 ms
Connecting: 0 ms
TLS Setup: 0 ms
Sending: 0 ms
Waiting: 16.51 s
Receiving: 0 ms

Loading of the theme images takes an average of 8 seconds per image... for getting the editor page that I am currently editing in it was around 4.9 seconds per image. Either the server cache needs to be cleaned, some issue with the HD/drive cache, the server is under full attack for these images (a crawler is able to do that when configured wrongly or simultaneously used in tens/hundreds) or hosting got issues.
I do not have to remember anything anymore thanks to total-recall.

Zvoni

  • Hero Member
  • *****
  • Posts: 2821
Re: Forum slow
« Reply #16 on: April 25, 2024, 09:07:28 am »
Win10 Pro 64Bit here.

Between every single click(s) i can go to our coffee-machine to refill my cup.....
One System to rule them all, One Code to find them,
One IDE to bring them all, and to the Framework bind them,
in the Land of Redmond, where the Windows lie
---------------------------------------------------------------------
Code is like a joke: If you have to explain it, it's bad

MarkMLl

  • Hero Member
  • *****
  • Posts: 8190
Re: Forum slow
« Reply #17 on: April 25, 2024, 09:14:16 am »
Confirmed from the UK, while other sites are OK. So it's definitely something nearer the server than the users.

MarkMLl
MT+86 & Turbo Pascal v1 on CCP/M-86, multitasking with LAN & graphics in 128Kb.
Logitech, TopSpeed & FTL Modula-2 on bare metal (Z80, '286 protected mode).
Pet hate: people who boast about the size and sophistication of their computer.
GitHub repositories: https://github.com/MarkMLl?tab=repositories

Marc

  • Administrator
  • Hero Member
  • *
  • Posts: 2622
Re: Forum slow
« Reply #18 on: April 25, 2024, 09:20:54 am »
Yes it is. Martin notified me about it last week, but at the times I checked everything was snappy. Until this morning.
I looks like some search engine is indexing us (not honoring the robots.txt)

Marc
//--
{$I stdsig.inc}
//-I still can't read someones mind
//-Bugs reported here will be forgotten. Use the bug tracker

Zvoni

  • Hero Member
  • *****
  • Posts: 2821
Re: Forum slow
« Reply #19 on: April 25, 2024, 09:35:02 am »
Yes it is. Martin notified me about it last week, but at the times I checked everything was snappy. Until this morning.
I looks like some search engine is indexing us (not honoring the robots.txt)

Marc

Redirect the IP of that search engine to a page showing a "middlefinger"?
One System to rule them all, One Code to find them,
One IDE to bring them all, and to the Framework bind them,
in the Land of Redmond, where the Windows lie
---------------------------------------------------------------------
Code is like a joke: If you have to explain it, it's bad

BrassGear

  • New Member
  • *
  • Posts: 22
  • Cusom Software Creator
    • CM-Works
Re: Forum slow
« Reply #20 on: April 25, 2024, 09:42:45 am »
Between every single click(s) i can go to our coffee-machine to refill my cup.....

But every cup makes you faster.

After that maintenance, the server seems to be back to normal. :)
« Last Edit: April 25, 2024, 09:59:36 am by BrassGear »

Zvoni

  • Hero Member
  • *****
  • Posts: 2821
Re: Forum slow
« Reply #21 on: April 25, 2024, 09:59:03 am »
Now it's running again as i'm used to (meaning quick as hell)
One System to rule them all, One Code to find them,
One IDE to bring them all, and to the Framework bind them,
in the Land of Redmond, where the Windows lie
---------------------------------------------------------------------
Code is like a joke: If you have to explain it, it's bad

Marc

  • Administrator
  • Hero Member
  • *
  • Posts: 2622
Re: Forum slow
« Reply #22 on: April 25, 2024, 09:59:19 am »
I reduced the load a bit, it should be a bit better now
//--
{$I stdsig.inc}
//-I still can't read someones mind
//-Bugs reported here will be forgotten. Use the bug tracker

Thaddy

  • Hero Member
  • *****
  • Posts: 16520
  • Kallstadt seems a good place to evict Trump to.
Re: Forum slow
« Reply #23 on: April 25, 2024, 10:26:35 am »
Most robots respect fail2ban  ::) ;D
May have to define a subrange /24, though, for the intrusive traffic.
But I am sure they don't want the Trumps back...

Marc

  • Administrator
  • Hero Member
  • *
  • Posts: 2622
Re: Forum slow
« Reply #24 on: April 25, 2024, 10:42:08 am »
When looking at some of the IP blocks, I noticed they all were owned by amazon. Some googling resolved in ClaudeBot made by anthropic.com.
I've blocked this bot from accessing this forum

Update:
In the past 15 mins, it got already 3283 times rejected

Marc
« Last Edit: April 25, 2024, 10:45:00 am by Marc »
//--
{$I stdsig.inc}
//-I still can't read someones mind
//-Bugs reported here will be forgotten. Use the bug tracker

Thaddy

  • Hero Member
  • *****
  • Posts: 16520
  • Kallstadt seems a good place to evict Trump to.
Re: Forum slow
« Reply #25 on: April 25, 2024, 11:16:10 am »
Works like charm, Marc. Tnx!
But I am sure they don't want the Trumps back...

Thaddy

  • Hero Member
  • *****
  • Posts: 16520
  • Kallstadt seems a good place to evict Trump to.
Re: Forum slow
« Reply #26 on: April 25, 2024, 11:26:16 am »
@Marc
One remark: based on your info I investigated a bit and it seems it is actually github's hubot. Github acknowledges that there may be some issues, since they are upgrading their systems. That fits with the time span from the recent responsiveness issues.

So it is one thing that we now have a responsive forum, but what about github?
Are we using it? (I thought not, we use gitlab, but I may be wrong)
« Last Edit: April 25, 2024, 11:31:12 am by Thaddy »
But I am sure they don't want the Trumps back...

Thaddy

  • Hero Member
  • *****
  • Posts: 16520
  • Kallstadt seems a good place to evict Trump to.
Re: Forum slow
« Reply #27 on: April 25, 2024, 11:37:54 am »
Something funny: github is owned by Microsoft, but you had to block an Amazon range instead of an Azure range... :o 8-)
But I am sure they don't want the Trumps back...

Marc

  • Administrator
  • Hero Member
  • *
  • Posts: 2622
Re: Forum slow
« Reply #28 on: April 25, 2024, 11:40:47 am »
It reports itself as "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"

I don't think this one is related to github if you visit anthropic.com
//--
{$I stdsig.inc}
//-I still can't read someones mind
//-Bugs reported here will be forgotten. Use the bug tracker

Thaddy

  • Hero Member
  • *****
  • Posts: 16520
  • Kallstadt seems a good place to evict Trump to.
Re: Forum slow
« Reply #29 on: April 25, 2024, 11:53:39 am »
I think this is related. You may want to implement some rate limiter if you value AI enough to gather our forum's information. That would also help mitigate the issue and is less intrusive. But I will leave that up to you. OTOH ignoring robots.txt is not a nice way to operate.
But I am sure they don't want the Trumps back...

 

TinyPortal © 2005-2018