The riemann REPL server is a bit of a special case. Since it controls almost every aspect of Riemann–and can shut those aspects down–it needs to live above them. While you usually start a repl server from the config file, it is not bound to the usual config lifecycle and won’t be shut down or interrupted during config reload.