I am studying individual differences by doing mvpa for each ROI of each individual subject. I need some suggestions on feature selection. For now, I am just using univariate feature selection with cross-validation. I have 3 related questions:
I know there are several different feature selection strategies to use. I’m wondering what are the pros and cons of each of the strategy in my case?
In one of the previous posts, it is recommended to select the same amount of voxels in each ROI for better comparison. How necessary is that? If I have to do that, where in the algorithm should this be added? Could anyone give me a script example?
How necessary it is to use regularization after feature selection?
Thank you for your answer! I have two follow-up questions.
As I’ve mentioned, I want to look at individual differences across subjects. Shall I select the same amount of voxels for every ROI for every subject? If yes, how to decide the suitable amount of voxel?
What do you mean by a ‘small’ regularization?
Thanks for the clarification, Bertrand!
it is important to establish correspodence across subjects in the prediction task - so if you pick p ROIs (or the stats derived from them), you must feed ML model with features in the exact same order (which will require the same number of features). It is possible to have different number of voxels per ROI, but the stats you derive from can have the same dimensionality across the subjects. So keep that in mind.