Installing the Unified Remote server without the driver may help you resolve some specific connection issues. These steps will, however, make the remote unable to interact with elevated programs (ones that have been launched as an admin).
Firstly, make sure that no installation of Unified Remote is present on your system - so go ahead and uninstall any version you may have installed.
Now you want to reinstall the server. Proceed with the install untill you get to the screen that reads Input Simulation.
Make sure that the "Enable driver input simulation (recommended)" checkbox is NOT checked, as this will install the driver.
Proceed with install as usual. Please do remember that installing the server in this way may create issues with Windows' built in UAC (User Account Control), causing you to be unable to interact with some software.