Support

Akeeba Backup for Joomla!

#13334 Amazon GLACIER support?

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by nicholas on Tuesday, 21 August 2012 09:51 CDT

user33100
only a short question: as Amazon AWS now offers GLACIER as a new service which seems to be perfect for long-time-storing and backups i would like to know whether you plan to implement support for it or whether it is still working as you also support S3????

nicholas
Akeeba Staff
Manager
Most likely not and I will explain why. Amazon Glacier is designed to be like magnetic tape backups: it takes a very long time to perform the write operation and it doesn't return true unless the write operation has finished successfully. This has some implications:
  • You need to pass the SHA-256 checksum of each file being uploaded. This is a computationally very expensive checksum which requires a lot of CPU power, memory and time to perform. This will lead the backup to crash under most circumstances.
  • Writing data to Glacier can take minutes to hours. Each backup step has a window of a mere 10-90 seconds (usually around just 10 seconds) to perform the file transfer and receive the success message. Any longer than that and the backup process times out.
  • Furthermore, the design of Glacier makes it a very bad choice for storing at-hand backups. If you want to retrieve a backup archive from Glacier you will have to typically wait for four hours. When your site is down this is an eternity.


For these reasons Glacier is not a good choice for storing at hand backups. It is a very good choice, however, for archiving backups of historic versions of your site, i.e. backups taken 3 months ago or earlier. In its latest newsletter, Amazon says that in the following months it will allow you to create bucket policies for data retention. It shall be possible to have Amazon automatically move old backups to Glacier. When that feature is available and in conjunction with Akeeba Backup's "Maximum backup age" quota you can have automatic archiving of historic versions of your site. The typical scenario would be keeping daily backups for the last 30 days, never delete backups taken –let's say– the first day of each month and have Amazon automatically move files older than 3 months from S3 to Glacier.

That's how I envision Glacier and Akeeba Backup working together. And it actually makes perfect sense. Akeeba Backup will be provisioning backups to S3 for easy retrieval and restoration, Amazon itself will be archiving old versions of your backups to Glacier in case you need to revive –for any reason– and old version of your site.

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user33100
THX for fast and(!) great in detail answer.
Your idea in part two of your answer makes perfect sense. so in a few month you will probably get some more subscribers as the S3-storage-feature is only available in the professional version....

nicholas
Akeeba Staff
Manager
Yes, seems so :) Amazon S3 is by far the best storage option for backups that I've tried. Glacier makes perfect sense as a complementary service. It looks like Amazon is years ahead of its competition :)

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!