Occasional Errors while accessing IBL dataset

Occasionally, while fetching data, I get the following error:
InternalError: (3, "Error writing file '/rdsdbdata/tmp/MYuRQnWS' (Errcode: 28 - No space left on device)")

Detailed stack trace here: https://pastebin.com/JVnJ89Sf
Code that generated this error: https://pastebin.com/v7iE9GGX

My pod-mates and I only face this error occasionally. Usually around 18:00 UTC - 20:00 UTC, if it helps. I’ve decided to make python pickles of the relevant data later on, when I can access it again so that I don’t need to keep downloading the data every time.

But is this a known problem? Are there any temporary workarounds?

3 Likes

Did this get solved? We are looking into it.