At one point I tried something as mentioned here:
But I found it kind of annoying as I needed to modify my jupyter notebook config quite a bit to get this to work, and had to redo everything I spun up a new VM...
One thing I've done in other scripts uses a LinePrinter class... which will keep overwriting the current output buffer wth the latest code... I'm not sure how hard it would be to add this function into the run.py for streaming STDOUT....
Print things to stdout on one line dynamically
output = "Processed: %d files " % (files_found )