I'm guessing, by vSphere server , you mean vCenter Server.
The vCenter Server works on different authentication. It can authenticate using its local accounts or AD or SSo.
But ESXi servers can be accessed only using root users. So accessing ESXi directly is totally different from accessing vCenter.