I used get-mailboxstatistics to get a list of mailboxes on the server.
I then manually removed one of the mailboxes using:
Use the EMC to remove a mailbox
In the console tree, navigate to Recipient Configuration > Mailbox.
In the result pane, select the mailbox you want to remove.
In the action pane, under the name of the mailbox, click Remove.
A warning appears asking, Are you sure you want to remove 'mailbox name'? Click Yes to remove the mailbox.
Source: https://technet.microsoft.com/en-US/library/bb125192(v=exchg.141).aspx
When I re-ran the get-mailboxstatistics command, the mailbox I removed, still came up in the list from the statistics.
Why is that and how do I properly remove a mailbox?