Validation process on OpenNeuro is stuck

,
1

hey =)

I’ve been usen the great feature of adding participants to an existing dataset.
For some reason the validator keeps “thinking” for several days.

On the one hand I am still able to add new data, but it is somewhat futile if there is a problem with the data.

Thanks,
Roni

2

Could you share which dataset is experiencing this problem?

3

Hi - I’m having the same problem. I haven’t published the dataset yet but after the initial upload I’m adding some files that weren’t uploaded but the “validation pending” wheel keeps rotating.

First couple of file additions were smooth, but the validation pending has been stuck for almost a couple of hours now, after I added the third file.

Is there a reason this happens ?

4

hi @Arsh

Thank you for your message! This is likely due to a validator timeout. May you please clarify which dataset you are referencing (I see a few from you today)? To retrigger the validation - may you please upload another file (or a minor edit of another)?

Thank you,
Franklin

5

Hi Franklin,

Thank you for your quick response! I was referring to this dataset - https://openneuro.org/datasets/ds003377

I tried adding a couple of files but the validation pending step still doesn’t complete.

6

hi @Arsh

Thank you for clarifying the dataset and adding a few files. I’ll take a further look into this and follow up!

Thank you,
Franklin

7

Great, thanks a lot!

8

hi @Arsh

quick follow up - the development team looked further into this and resolved the issue. We anticipate deploying this patch later this week.

Thank you,
Franklin

9

Thank you for the update @franklin ! I believe this is the issue tracking the bug https://github.com/OpenNeuroOrg/openneuro/issues/1890 ? I’ll keep an eye out for any new updates

10

@Arsh yep! and the associated PR: https://github.com/OpenNeuroOrg/openneuro/pull/1891

11

@Arsh quick update - the fix has been released and the validation was complete on your dataset. It appears there are a few minor errors - perhaps removing and reuploading those files will resolve it.

Thank you,
Franklin

12

Thanks a lot @franklin! appreciate all the help :slight_smile:

yes, I think reuploading those files should fix it. I’ll give it a shot tomorrow.

1 Like
13

Hi @franklin - I was able to resolve the two errors and completed the validation successfully.

but I made the silly mistake of deleting the entire dataset while hoping to delete a snapshot. So, I re-uploaded the dataset here https://openneuro.org/datasets/ds003390 but I’m having the same issue with validation being stuck.

It’s been about 12 hours or so since I uploaded it so just wanted to check in with you to see if I need to be doing something differently?

Thank you,
Arsh

14

hi @Arsh

Thank you for your message, darn we’ll need to take a closer look. This may take us a bit of time to do due to this being a holiday week. I apologize for this inconvenience.

Thank you,
Franklin

15

Thank you the update @franklin! We really appreciate your help. I don’t expect too many issues with the validation process at this point so it can wait.

16

hi @Arsh

Writing over a quick update - we have a proposed fix to this issue. The patch is undergoing final reviews and then it can be packaged up into a release

Thank you,
Franklin

1 Like
17

Thanks @franklin ! I’ll keep an eye for the new release.

18

hi @Arsh

It appears the validation fix uptook on your dataset. Looks like there were some errors from the upload. Perhaps the empty files can be removed and reuploaded.

Thank you,
Franklin

19

@franklin
hi, I’m having the same problem and I haven’t published the dataset yet. I tried to solve the problem in various ways but it dose not work. My dataset here https://openneuro.org/datasets/ds004218/, which has the issue with validation being stuck.
It’s important for me.
Looking forward to your reply as soon as possible.
Thanks a lot!
Yunhao