This only happens with 8 workers and above. So I tried to increase the amount of memory from 64M to 128M (-m 128 instead of -m 64). Now I can use 10 workers and it doesn't crash. So there is a high probability this issue is due to lack of memory and that somewhere an allocation fails and it's not reported.