When a domain was added to Mail but never connected or verified, Inbox shows Remove with the domain's name beside Connect or Verify, for team admins. It asks first, as Remove domain does on the domain's page, and returns to Inbox, where you can add another domain. A domain on Magpie's nameservers, or with anything that stops its removal, is still removed from its own page.
Remove an unverified domain from Mail's Inbox
While Mail has no mailboxes, a team admin can remove a domain that was added but never verified from Inbox, beside Connect or Verify.