Removing outlier is a ‘dangerous’ territory as it is too easy to come up with reasons why you should remove certain subjects after you have seen the results which brings you into p hacking territory.
If you have got good evidence that the subject was not doing the task properly (missed most responses for example) you’d have a better ground for rejecting it that just saying “brain activation looks different”.