Need to fix the DNS in this issue. Please make sure client is able to ping the ESXi host by its FQDN and IP Address.
In my case, all the ESXi Hosts registered with FQDN in vCenter and details updated in host file (sadly no DNS records for ESXi Hosts). So I just need to update the host file and it starts working for any problematic/new client.