Anubis activated

[Marc]

Hi, for those who didn't have noticed, yesterday evening I've activated Anubis on the forum.
Since Anubis several times triggered a false positive when I was browsing sites, I initially didn't want to install it.
The last weeks the amount of requests became unmanageable and made the forum unresponsive. Yesterday it was the last straw. I hope the browsing experience on the forum will improve with it.

[creaothceann]

Working fine for me. Thank you!

[cdbc]

Hi Marc
Thanks mate 
I've seen the cute little /Canadian/ a couple of times, from last night to now 
Good an you, mate, it seems to work just fine; The other situation was unbearable as you said...
Regards Benny

[rvk]

Yeah, I also saw the anime-style Anubis-girl character briefly just now.
Just once... the next time it might have been too fast or skipped the check.

Hope it helps 

[440bx]

I noticed that Anubis had become a forum gatekeeper and, at least so far, it has not caused any problems for me.

One thing I've noticed since Anubis is that the number of guests is usually much, much smaller than it used to be when Anubis wasn't around.

question:

Are there some A.I bots that behave decently when scraping the site ?  I ask because it might be worthwhile to give such bots a way to do the scraping if their parent company agrees to follow very strict rules to ensure the bot never becomes a performance problem.  The idea in the back of my mind is that, allowing some bots to scrape the forum may actually be in our best interest because that could allow some A.I bots to be better trained in FPC which has the potential of being a plus to every FPC user.

[creaothceann]

Are there some A.I bots that behave decently when scraping the site ?

Additionally, Anubis exempts Common Crawl "so [other] scrapers have less incentive to scrape".[1]

[440bx]

Thank you creaothceann, that answers my question and, now I am sure that Marc also knows this. 

[Joanna]

It’s good to get rid of the scraping bots. Unfortunately Anubis blocks me on some web browsers because the browsers don’t allow cookies apparently.

[rvk]

It’s good to get rid of thescrping bots. Unfortunately Anubis blocks me on some web browsers because the browsers don’t allow cookies apparently.

Did the forum work without cookies in the past?
(Weren't cookies always needed for login?)

[JanRoza]

For me Anubis is no problem at all, it's lightning fast so hardly any delay to go to the forum. 👍

[Joanna]

It’s good to get rid of thescrping bots. Unfortunately Anubis blocks me on some web browsers because the browsers don’t allow cookies apparently.

Did the forum work without cookies in the past?
(Weren't cookies always needed for login?)

Cookies were needed for login but not just viewing the forum in the course of a conversation. Things like hey look at this wiki page or forum thread now get me an error page when i click on them. Things that were once easy annd routine are now impossible. Unless I open a new web browser. Yay what next?
I usually give up after the link gives me the error message to be honest.

[Martin_fr]

Cookies were needed for login but not just viewing the forum in the course of a conversation. Things like hey look at this wiki page or forum thread now get me an error page when i click on them. Things that were once easy annd routine are now impossible. Unless I open a new web browser. Yay what next..

Please complain to those who attacked us.

[Paolo]

Thanks, it seems ok.
In the past days, other than cookies screen, I saw sistematically "database error".

[Marc]

It’s good to get rid of thescrping bots. Unfortunately Anubis blocks me on some web browsers because the browsers don’t allow cookies apparently.

Did the forum work without cookies in the past?
(Weren't cookies always needed for login?)

The forum can work with or without cookies. If no cookies are accepted, the forum uses the PHPSESSID to track the session.
Then the IA scrapers came. Those scrapers don't use cookies, so filtering them was easy. Any client without cookie got the "cookies needed" page. The same time those IPs/subnets got blocked if they kept trying. One problem here is that a scraper needs to hit the forum first to get detected. And processing the initial php took to many resources when the amount of bots increased.
So welcome in the new reality.



@Joa

[Marc]

Thanks, it seems ok.
In the past days, other than cookies screen, I saw sistematically "database error".

That database error had nothing to do with the scraping bots and only affected users with an "full" (most parts with 4 digits)  ipv6 addresses. That is fixed.