π 28 July - Problem with Batch downloads failing - Now Resolved π
Sorry - we had a minor issue overnight.
Customers reported an issue with batch downloading this morning.
We investigated and discovered our zipping server was failing.
All batch downloads and downloads with attachments are zipped on the fly before download.
Single downloads without zipping continued to work without fail.
Root cause: Let's Encrypt, one of the internet's major certificate providers, rolled out a new certificate structure this year ("Generation Y"). It adds one extra link to the chain of trust behind each certificate. The library we use to talk to Fly's API (flame) has a hardcoded limit on how many links it will accept, and that limit is one short of what's now required β so it rejects Fly's certificate as invalid, even though it's perfectly legitimate..
This is now fixed at NZST 09:20- all systems back to normal.