ABCD data bids open neuro on AWS

fmriprep
bids
abcd

#1

Hey, I getting ready to do some analyses on ABCD data. I was wondering if anyone had preprocessed the data into bids format and used fMRIprep/open neuro on it already using AWS/ developed a pipeline? I am a noob on AWS and if someone has already figured this out I would be pretty excited.
Grace


#2

@tsalo - may have done this. (not the AWS part, but likely the ABCD dicoms to BIDS part)


#3

Ah thanks @satra ! @tsalo would love to pick your brain/AWS your code!


#4

@grace-shearrer I am not aware of anyone having done this yet, and I am part of the ABCD consortium! :slight_smile:

@ChrisGorgolewski showed me a tool recently you may want to check out or try?

Also, I started some heudiconv code for trying to make good BIDS filenames from ABCD DICOMs, but did not get very far.

~Eric


#5

Thanks! This is very cool. I am mostly struggling to get oriented on AWS right now, but when i get that figured out I will give this a shot


#6

@grace-shearrer I’m sorry to say that I have only worked on ABCD data acquired at FIU. I haven’t tried downloading the data from NDAR yet. I do have a heuristics file for heudiconv that works for FIU’s ABCD data, but I am not sure if data from NDAR will have the same file structure. If you’re interested in trying it out, you can see it here. We’ve also written some code to assign the IntendedFor field for field maps based on the sequence number, which might be useful.

Please let me know if there’s any way I can help.


#7

Awesome! Thanks so much! I am gonna limp through this AWS/NDAR and I will give your heuristics file a try with the pyBIDS above :slight_smile:


#8

Hi, I have been working to download data from NDAR- I was wondering if you have any tips on selecting and downloading only the rsfMRI or DTI files? Currently I have to open one page at a time and select them individually to download them.


#9

@esalman What interface do you have access through? There may be a MUCH easier way with AWS or NDA maybe?


#10

I am accessing from the web interface at http://ndar.nih.gov. I am not aware about any other ways to access actually.


#11

@esalman Yes, then you’re already accessing it the standard way and I think you’re right there’s no way to filter by MRI data type. If you email the NDA helpdesk, they can get you going with pulling the data using AWS instead of their web interface. Then you can pick and choose what data you want in an automated command-line way with the AWS command-line interface (CLI). Let me know if you need more links or email addresses. NDA helpdesk is just NDAHelp@mail.nih.gov. And at the bottom of this page they pretty much say what I just said:

https://data-archive.nimh.nih.gov/abcd


#12

Hey @esalman, I am also trying to work through the NDAR/miNDAR/AWS. It is annoying you can’t filter by MR sequence in the web interface. BUT you can download the text file only ABCD, and then you have the links to the individual scan sequences. With the code available at their github page you can get it to download only the sequences you want by giving it a list of the aws links https://github.com/NDAR/AWS-Download


#13

Hey @earl and @grace-shearrer, thank you so much for your help. I did make a list of files that I actually want to download- I am going to take a look at the script on GitHub to see if I can download through the list.


#14

NP! Good to know there are others in the same position as me :slight_smile:


#15

I was also wondering about that until I saw this question pop up in the email digest. I had a brief look at the script and it looks like I can program it to download through my list. I will post an update if I can manage to do it.