Hello, that is exactly what I am trying to do. If it isn't supposed to be possible, what exactly did these guys do in order to get it to work? I am essentially just attempting to do the same thing these guys have done right now https://www.pugetsystems.com/labs/articles/Multi-headed-VMWare-Gaming-Setup-564/
These guys basically just run everything locally straight off of their ESXi host, where showed that they plug their monitors, and mice/keyboards straight into the host. They do this by passing through USB controllers.
Thanks