Just stumbled over this great article by Jason Boche. There have been a lot of issues regarding the svga driver and Windows 2008 R2. Basicly before 4.0 update 1 you had to disable the vmware tools svga driver and use the generic windows. From Update 1 you can use the driver provided by vmware tools. Unfortunately it is not automatically installed so you must go to device manager and upgrade driver. The driver path is:

C:\Program Files\Common Files\VMware\Drivers\wddm_video

After driver installation your mouse will be smooth when using the Remote Console from your vSphere client.