Support

Site Restoration

#41745 cannot see files in s3 bucket

Posted in ‘Site restoration’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

PHP version
8.2
CMS Type
Joomla!
CMS Version
5.2.5
Backup Tool Version
10.0.2 professional
Kickstart version
n/a

Latest post by nicholas on Tuesday, 25 March 2025 15:47 CDT

Monday, 24 March 2025 12:25 CDT

jvezinaNrel

I backed up my production site on an aws s3 bucket. I see it in the list of managed backups and if I go directly to the s3 bucket, I see it there too.

I want to restore it on my test server. The test server is configured for the aws s3 bucket and I can back it up there too. It's backup is listed on the managed backup page.

However, from my test server, I can't see the production backup (or vice versa).

If I go to the Import Archives from S3 page, I put in the key & secret (no place for the bucket name) and connect. I don't see any subdirectories or files.

How can I restore the production backup on the test server via the s3 bucket?

Monday, 24 March 2025 15:51 CDT

nicholas

Are you using the same connection information, including the Access and Secret Key?

If you are using different Access and Secret Keys it's very likely that you are using keys from two different IAM users. The access of uploaded files is set to PRIVATE which means only the owner (creating user) of the files can see them. A different IAM user would not see them. The idea behind private access is that two sites using the same bucket but different IAM users wouldn't be able to see each other's files for improved security isolation between the two sites. The downside is that if you have two sites which need to see each other's files they need to use the same IAM user (not necessarily the same Access and Private Key pair, but one belonging to the same IAM user at any rate).

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Tuesday, 25 March 2025 12:08 CDT

jvezinaNrel

we are using the same IAM user for both servers.

If I add the backup record to the test server, it shows up and allows me to download the backup to the server. Unfortunately, when I try to do a restore, it errors on the 3rd (2G) file - saying it's corrupt.

Not sure what we're missing here.

thanks - always so helpful.

Tuesday, 25 March 2025 15:47 CDT

nicholas

If you are using the same S3 bucket, with the same IAM user, there is no reason to not be able to see the files. Therefore, one of those statements must be false.

Regarding the backup archive, do check if you are backing up an error log that's ever increasing in size. This can cause the backup to be corrupt – I've already found out why, and written a workaround for the next release.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!