Support

Akeeba Backup for Joomla!

#28433 Large site (19GB) - backup failure

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by duanemitchell on Wednesday, 20 September 2017 08:04 CDT

duanemitchell
Please look at the bottom of this page (under Support Policy Summary) for our support policy summary, containing important information regarding our working hours and our support policy. Thank you!

EXTREMELY IMPORTANT: Please attach a ZIP file containing your Akeeba Backup log file in order for us to help you with any backup or restoration issue. If the file is over 2Mb, please upload it on your server and post a link to it.

Description of my issue:

I am trying to backup a large site. 19GB of files, mostly images. It is hosted on NameCheap with an "unlimted" space and use account. But, of course, it is limited. The backup fails after producing 3 archives of 2GB each and then a partial of about 250MB. I assume a full backup will be 8 or more of these 2GB archives. My question is can I download the archives that did get produced using ftp. Then delete the from Akeeba backup folder. Next rerun the backup and deleting the archives as they are produced a second time to make more space for the remaining backup archives? So if I delete parts .jo1, jo2, and .jo3 after downloading them, then rerun the backup, delete these same parts as they are recreated in order to make space for the new parts will I be able to use them to restore the website?

If you have any other suggestions I'd be happy to hear them as well. I have successfully run this backup in the past but the host must have made some changes.

Thank you.

Duane Mitchell

tampe125
Akeeba Staff
Hello Duane,

usually hosts will give you some disk space, then when you're close to the limit, give you a little more and so on. My guess is that doubling your large site is breaking this mechanism: your sites grows faster than the space your host is giving you.
However, despair not!
You can setup a post processing engine with the options Process each part immediately and Delete archive after processing checked. In this way as soon as an archive part is completed, it will uploaded to the remote server and the deleted, without filling your disk quota.
As final note, I'd suggest you to lower your part size: please set it to 100Mb, otherwise you'll get timeout errors while trying to upload them.

Davide Tampellini

Developer and Support Staff

🇮🇹Italian: native 🇬🇧English: good • 🕐 My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

duanemitchell
That sounds great. I do have it going to S3 as post processing but did not know about processing each part. I set that up as you described. I don't see where to set the part size? Maybe that is different in this older version of Akeeba Backup? This host is also running a obsolete version of PHP.

duanemitchell
I found where to set the part size. Ignore that question.

I'm trying it with the 2GB part size because I find that transferring from one host to another is very fast. Maybe not so much on NameCheap but we'll see.

Thanks!

tampe125
Akeeba Staff
Great!
Let me know if you need more help.

Davide Tampellini

Developer and Support Staff

🇮🇹Italian: native 🇬🇧English: good • 🕐 My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

duanemitchell
This worked out well. I made the part size 500MB. That meant Akeeba could upload the part to S3 and then delete it on the localhost while the backup process is ongoing and consuming disk space against the quota. I did not hit my disk quota limit and have the process shut down.

There were 35 parts of about 500MB each. For some reason it failed to upload two during the backup. The error referred to Amazon S3 as where the problem lied. So I downloaded them using ftp because I didn't know what would happen or if the upload process would continue or not. It did. It continued to upload the parts after those two errors. Also, after the backup was completed it went back to those two parts and successfully uploaded them. Then it cleaned up and ended the process. About 12 hours in all. Very impressive.

Thanks for your help.

tampe125
Akeeba Staff
Thank you!
So I guess everything worked fine, right?

Davide Tampellini

Developer and Support Staff

🇮🇹Italian: native 🇬🇧English: good • 🕐 My time zone is Europe / Rome (UTC +1)
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

duanemitchell
Yes it did. Just had to make sure that the archive parts got uploaded to S3 and deleted faster than new archive parts used up more disk space. That's where setting the correct part size comes in. I used 500MB part sizes. That worked.

Let's close this ticket. Thanks!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!