AVRO shutdown detection is only in the loop that processes new files. Flushing and status saving is done anyway