Support

Akeeba Backup for Joomla!

#8411 Amazon S3 and quota management

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by nicholas on Wednesday, 21 April 2010 05:38 CDT

trendup
I’ve just tested the upload to Amazon S3 data processing file and it works fine.
I see that if I have checked the count quota in “Quota management” works for local backup but not for S3 files.
Is there a way to delete old backup on S3 space?

trendup
May be enough giving to the archive name a static name without -[DATE]-[TIME] or is there a better solution?

dlb
The quota only works on the files stored on your site's server. It took me a minute to figure out what you meant by a static file name. :D I would worry that you would get a confirmation message, "Do you really want to overwrite this file?" and it would just sit there until you confirmed it. Or, worse yet, you would get a timeout error.

Nicholas probably has something on his todo list about this, I'll ask him to comment.


Dale L. Brackin
Support Specialist


us.gifEnglish: native


Please keep in mind my timezone and cultural differences when reading my replies. Thank you!


????
My time zone is EST (UTC -5) (click here to see my current time in Philadelphia, PA)

trendup
It took me a minute to figure out what you meant by a static file name. :D

You are right :D
"Do you really want to overwrite this file?" and it would just sit there until you confirmed it. Or, worse yet, you would get a timeout error.

I tried this morning with some cron backup and the files named site-[HOST] are overwritten.
I don’t know what could happen if I have backup files splitted – for example – in 5MB and I have an initial backup like:
site-myhost.com.jpa 5MB
site-myhost.com.j01 5MB
site-myhost.com.j02 2MB
then the site becomes smaller and in a new backup I could get:
site-myhost.com.jpa 5MB
site-myhost.com.j01 3MB

In the folder I’ll have the old site-myhost.com.j02 too. Will give an error the Kickstart decompression or jpa format knows how may pieces contain an archive?

nicholas
Akeeba Staff
Manager
The reason for quotas not being effective with cloud backup is that querying the cloud server for the count and size of existing backup archives is a very time consuming process which could lead to timeouts. To better understand how time consuming it is, try installing a desktop utility - such as CloudBerry - and get a listing of a S3 directory containing hundreds of files. It certainly takes its time!

Regarding the use of a static filename, yes it is possible. Even if your backup archive grows smaller (though I can't see how) Kickstart and eXtract are aware of this. I haven't tested this case, but as far as I can see, there should be no problem except with JPA archives, as they do not have an end-of-archive marker yet. However, it's rather easy to figure this out yourself. If you have extraneous backup parts they would have a timestamp much further in the past than the rest of your backup archive parts, so you don't need to download them.

The best approach I've found to manually managing quotas is doing some housekeeping. In any case, it's a good idea to keep the last week's or month's backups in the cloud, just in case your site was hacked in the meantime and you didn't catch wind of this issue. It's easier to start with a "last known good" state of your site and then start transferring changed data from the compromised site to the last known good state. In order to do this, keep on backing up your site daily to the cloud. Every week connect to your cloud storage with a desktop utility and remove old backup archives. After all, the default naming scheme includes host, date and time stamps in the archive name. Sorting the listing by name ascending is an easy way to have a per site and date ordered list which you can manage quite easily. Well, this is what I do :)

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!