Support

Admin Tools

#19551 onpage.org bot

Posted in ‘Admin Tools for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Admin Tools version
n/a

Latest post by nicholas on Thursday, 13 March 2014 11:45 CDT

Wednesday, 12 March 2014 14:22 CDT

user62150
The onpage.org bot get's blocked. But in the Security Exceptions Log it's not listed at all.

The support team of onpage.org wrote me to give the UserAgent OnPageBot access to the website because the IP always changes. How can I do this?

Thanks

Wednesday, 12 March 2014 17:53 CDT

nicholas
Unfortunately you can't whitelist a specific bot in your old version of Admin Tools. You'd have to first upgrade your PHP to a more recent version (yours is over 3 years old), install Admin Tools 2.6.2 and use its new domain whitelisting feature to white list onpage.org.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Wednesday, 12 March 2014 18:12 CDT

user62150
Thanks for the message. I just want to test this service and the update process is too much work. I need a workaround.

I can start the crawling manually so for me it would be easier to deactivate the Admintools for just a few minutes. I deactivated the plugin "System - Admin Tools" but the bot still gets the status code 423. How can I deactivate the Admintools completely?
Should I also use the standard Joomla htaccess file?

Thanks

Thursday, 13 March 2014 02:37 CDT

nicholas
Hm, wait. 423 is not a valid HTTP code. Is it by any chance 403? That would make sense so I am continuing to help you assuming that you meant 403, NOT 423. We have to see why the bot is blocked.

First go to Admin Tools, Web Application Firewall, Configure WAF. Make sure "Log security exceptions" is set to Yes; if it's not, set it to Yes and click on Save. Now try reproducing your issue. Immediately after that, please go to Admin Tools, Web Application Firewall, Security Exceptions Log. The latest log entry at the top should have the date and time of when the issue occurred. Please copy the Reason and Target URL here so that we can further help you.

If the reason is "tmpl= in URL" then please go to Admin Tools, Web Application Firewall, Configure WAF and set the "Allow site templates" to Yes.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Thursday, 13 March 2014 11:03 CDT

user62150
Thanks. But there is nothing listed in the Security Exceptions Log.

So I asked the provider to check the server log and they found the problem: The OnPageBot has the user agent GoogleBot and for this reason gets blocked.

But thanks for your help!

Thursday, 13 March 2014 11:45 CDT

nicholas
You're welcome!

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!