Memory Issue When Processing Large Amount of Data

7

You would create a file, e.g., plugin.yml with contents:

plugin: LegacyMultiProc
plugin_args: {maxtasksperchild: 1, memory_gb: 250, n_procs: 16, raise_insufficient: false}

And then pass --use-plugin plugin.yml.