Support

Akeeba Backup for Joomla!

#8808 Backup problems in post-processing

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by nicholas on Saturday, 12 March 2011 15:19 CST

user13999
Akeeba vs: 3.2
Php: 5.2.14
MySQl: 5.0.91
Joomla: 1.5.22
Godaddy.com is my host

Ok i never got the error message below until i tried to use the post processing Amazon S3 backup. I have tried starting at 20mb and then got one error message. then i went to 12 and got a different error message then finally went to around 8 mb and got the following message. Attached is the logs.

Thanks,
Stephen
This was first error when i was using 20 size jpa, but i only found 12.5 mb of first file on Amazon: AEUtilAmazons3::uploadMultipart(): [RequestTimeout] Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.

this was my last Error message:

The backup operation has been halted because an error was detected.
The last error message was:

AJAX Loading Error
HTTP Status: 500 (Internal Server Error)
Internal status: error
XHR ReadyState: 4
Raw server response:
Internal Server Error

The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator and inform them of the time the error occurred, and anything you might have done that may have caused the error.

More information about this error may be available in the server error log.
Apache Server at www.mynuffworld.com Port 80

nicholas
Akeeba Staff
Manager
Try setting the part size for split archives to 2000Mb and retry backing up. If that fails, send me a Personal Message (I am user "nicholas") with the URL to your site and Super Administrator login information. In that case, please include a link back to this post so that I know why you're sending me the PM.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
PM Sent..

nicholas
Akeeba Staff
Manager
There seems to be some kind of host-specific issue. Can you request access to the PHP error log from your host? I want to find out what PHP error is hidden behind that 500 Internal Server Error. It doesn't seem to be something in Akeeba Backup's code. I tried using smaller part sizes and it works until a random point in time, where the server throws a 500 error instead of uploading the file.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
I updated my logs and will run a backup with the last settings. Then i will publish the logs. Thanks again for your help.

Also i got up to 49 files in my amazon s3 account... So it works just something stops like you say... I hope we can increase it to 20mb... 5 is a lot of files.

user13999
Hey bud,

Just got done running the back up and everything worked this time.... All files are on my Amazon s3 and no post script error... Not sure what was changed. I will keep an eye on it to make sure nothing happens in the future. I have attached the log of the successful transfer in case you wanted to see it.

Only question i have is this, there were 50 files saved. However in my S3 i only see 48. .jpa and jpa50 are both missing. the first and last file!

Thanks,
Stephen

nicholas
Akeeba Staff
Manager
I think that the backup issues are connected to server load. Your last backup seems to be taken during an off-peak hour for your server. I recommend using the native CRON script to schedule your backup instead of using the back-end backup or the Lazy Scheduling plug-in. Why? The native CRON script runs in the context of the command-line version of PHP. This is not bound by the limitations of the web server, but you may have to talk to your host to add the job at the "safe list" so that it doesn't get aborted due to high server load. Usually it's sufficient to notify your host that this is a backup job running once per day to convince them.

Regarding the S3 problem you reported, I can see in your log that the files have been transferred. Can you please re-check if the files are in the S3 account? Can you also check if the files are on your server, in the backup output directory? Thanks!

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
After looking a second time the .jpa and .jpa50 were in my Amazon s3..Also are stored on my server.

I will try and setup the cron jobs soon. And report back my findings. Thanks again for all your help... Nicholas.. This is truly the best support for a component i have ever received.

nicholas
Akeeba Staff
Manager
I'm glad it's working! Sometimes it takes a while for Amazon S3 to list the last files transferred. The highest numbered part and the .jpa file are both transferred last. Thank you for your kind words, too :)

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user6558
I am having the same issue when enabling upload to S3. I have set splite size to 1500MB.

The backup operation has been halted because an error was detected.
The last error message was:

AJAX Loading Error
HTTP Status: 500 (Internal Server Error)
Internal status: error
XHR ReadyState: 4
Raw server response:
Internal Server Error
The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator, and inform them of the time the error occurred, and anything you might have done that may have caused the error.

Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request.

nicholas
Akeeba Staff
Manager
First, make sure that you're using Akeeba Backup 3.2.3. Releases earlier than 3.2 were not capable of multi-part uploads and such a high part size would not allow them to operate. Also try disabling the "Use SSL" option in Akeeba Backup's Configuration page, in the Amazon S3 settings.

If that doesn't work, the connection speed between your host and Amazon S3 is too low. Since we can't do anything about the speed of the conenction, we have to do something about the timeout limit of PHP itself. You can ask your host to increase the PHP maximum execution time in their php.ini to a higher value (around 60-90 seconds). This should be adequate for transferring your backup archives to Amazon S3.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
Hey Nicholas,

I tried the command line feature and get failed here is my command line:

/web/cgi-bin/php5 "$HOME/html/mynuffworld2011/administrator/components/com_akeeba/backup.php"

My backup works if i manually backup site so i still have that working.

here is the command line log.

Thanks,
stephen

nicholas
Akeeba Staff
Manager
You are getting a timeout after 90 seconds. Some web hosts are configured to allow CRON jobs to run for no more than 90 seconds. This is not enough for a complete site backup and transferring it to a remote storage location. Please talk to your host. Most likely they can add your user to the "safe list" so that you can run a CRON job which takes more than this amount of time.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
Ok. Thanks for the info.... I am going to try doing this by using http://www.cronless.com. I have to use them for my jomsocial.... it uses a web address to work, so would i just point it to this address:

http://www.mynuffworld.com/administrator/components/com_akeeba/backup.php

Thanks,
Stephen

nicholas
Akeeba Staff
Manager
This will not work because a. CRON PHP scripts DENY being accessed from the web (for a very good security reason) b. running a script from the web imposes further time restrictions, usually at 30 seconds and c. these web-based pseudo-CRON services do not support split jobs. Please read our documentation. As I said, the on;y workaround is talking to your host.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
Roger that. How much time does the script need typically?

user6558
Still the same error! What can I do?

I am using Akeeba Backup 3.2.3. with the "Use SSL" option disabled in Akeeba Backup's Configuration page, in the Amazon S3 settings.

PHP maximum execution time is set to 150 seconds.

nicholas
Akeeba Staff
Manager
The exact time required for a full backup to be taken depends on many variables such as the size of your database, the size and number of your site's files, the speed of your server and the connection speed between your server and Amazon S3. There is no "typical" number, as this could be anywhere from about a minute to an excess of an hour. On your site, I guess it's around 4-5 minutes.

PHP time limit is one thing. As I implied in my previous posts, this was not a limiting factor in your case. Your PHP installation does not use Safe Mode, therefore backup.php was able to reset it to no limit. But this is not the only timeout limit imposed on a CRON job. The server's operating system can be configured to impose a time limit on processes launched by the CRON daemon and this is what is going on in your case. All processes launched by the CRON daemon are limited to 90 seconds of execution time before they are killed. You have no control over that setting; only your host does.

This is why I asked you to talk to your host. They can add you to the list of "safe users", whose processes launched by the CRON daemon are not bound by a time limit. This is the only way to launch a successful CRON backup of your site.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user13999
i can add it to my php.ini file.

Would it look like this?

max_execution_time = 90

nicholas
Akeeba Staff
Manager
No. Please read the second paragraph of my previous reply. The problem is not in the PHP level. It's in the Operating System level and you don't have access to it. Your host has to do the necessary changes for you. If you copy them my previous post they'll be able to help you very fast and accurately.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user6558
I have the Linux root shell access, but I don't know where to change the required settings. Can you give me some instructions about where exactly to set these?

nicholas
Akeeba Staff
Manager
Each Linux distribution has its own place for these settings. If you have CPanel, Plesk or another commercial control panel system you have to perform those changes from within that control panel system. Given that I know nothing about your server setup, I don't really know how to help you. Who set your machine up? This is the person most equipped to help you. For all I know, Ubuntu Server and Mandriva Linux (the two distros I work with) do not impose such a limit. CentOS with CPanel does impose such a limit, but -according to the tech support of my host- if you have root CPanel access you can assign the account to the "safe list" which doesn't have a limit. Where that option is, I have no idea; my host never told me.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!