Support

Akeeba Backup for Joomla!

#9071 Upload to S3 occasionally fails part way

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by nicholas on Tuesday, 27 September 2011 05:39 CDT

Sunday, 25 September 2011 05:40 CDT

rbradbury
Mandatory information about my setup:

Have I read the related troubleshooter articles above before posting (Backup files not being uploaded; Unreadable directories; )? Yes
Have I searched the forum before posting? Yes
Have I read the documentation before posting (Configuration; Upload to Amazon S3)? Yes
Joomla! version: (1.5.23)
PHP version: (5.3.6)
MySQL version: (5.1.56)
Host: (Rochen)
Akeeba Backup version: (3.3.4)

EXTREMELY IMPORTANT: Please attach your Akeeba Backup log file in order for us to help you with any backup or restoration issue.

Description of my issue:
AEUtilAmazons3::putObject(): [56] Recv failure: Connection reset by peer
Since transferring 2 websites to Rochen 2 weeks ago {Akeeba was a great help with this!], 1 site does not reliably backup every night via CRON. For example, only 3 of the last 7 days were successful. There is also an error that 4 main website directories are not readable although the backup size (2.3GB) is similar to that obtained on the previous host. Permissions are 755. I have therefore discounted that warning for the moment.

The main issue is that some of the .jpa files do not get uploaded to S3. I have disabled multipart operation; reduced file sizes; tweaked fine tuning; tried processing each part immediately all to no avail. SSL is not used. The other site runs reliably although its backup is only 1GB.

I'm out of ideas and would appreciate your advice!

Regards

Bob

Sunday, 25 September 2011 11:57 CDT

nicholas
Hello Bob,

Hm, let's try something. Set the part size to a value between 200 and 300Mb (I believe it's currently set to 100Mb, right?). if this doesn't work, please send me back the log file.

Another thing to try is to set the backup to take place at a different time of the day. Try moving the CRON job 2-3 hours later. If the server is busy serving requests of other sites, it is possible that a network error may occur which will prevent the upload of the backup parts.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Tuesday, 27 September 2011 04:28 CDT

rbradbury
Hi Nic

Thanks for your suggestions. I changed part size from 100Mb to 200Mb and adjusted the CRON job timing to run straight away. It was successful in transferring all files to S3. I then reset the job to run 2.5 hours later than previously (now around 08:45) and again it completed successfully this morning. So things seem OK.

Do you have any thoughts on why the CRON email flags four of the main website directories as unreadable before the packing steps begin? As previously noted, the archive size indicates that these are being read but I will do a restore to check.

email extract
-------------
Last Tick : 2011-09-27 08:51:58 GMT+0100 (BST)
Domain : Packing
Step : -
Substep :
Memory used : 6.45 Mb
Warnings : POTENTIAL PROBLEMS DETECTED; 4 warnings issued (see below).
Unreadable directory /home/laverdaf/forum
Unreadable directory /home/laverdaf/gallery
Unreadable directory /home/laverdaf/wiki
Unreadable directory /home/laverdaf/smf

Regards

Bob

Tuesday, 27 September 2011 04:33 CDT

nicholas
Hi Bob,

I think I know what the problem is. You have added an Off-Site Directory Inclusion for the four directories under /home/laverdaf. However, I seriously doubt that these folders even exist. These folders are stored under your web site's root (that would be /home/laverdaf[/b]/public_html[/b]), not your user account directory (/home/laverdaf). Moreover, since these directories are already inside your web root, you MUST NOT add them as Off-Site Directory Inclusions. They are not off the site, they are under the site and already backed up. Just remove your off-site inclusions and you'll be just fine.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Tuesday, 27 September 2011 05:38 CDT

rbradbury
Nic - spot on! Thanks again. I'm off to sit in the corner with my dunces's hat on.

BTW, I'm seriously impressed with your continued refinements...for example, the ability to call S3 uploads back on to the webserver. Perhaps I should have made more use of the pop-up help dialogue boxes! Excellent work.

Bob

Tuesday, 27 September 2011 05:39 CDT

nicholas
He he! Practice makes perfect and I've already got 5 years of experience ;) Thank you for your kind words!

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!