hey i also got the same issue. but i was completely weird.
can you please check in which account your MS CRM Email Router service running.
please chance to some domain account, feasibly to the crmadmin accout and try to do so.
cause email router talks to the server properly so that it load the users and queue.
hope this will work for you, i have done in that way.
regards,
yes.sudhanshu