Ok, the problem is that Max 2011 is not officially supported until Vray 1.50 SP5. The sp4a is not compatible on your Max version.
To solve this problem, please go to the Chaos Group website and download the free upgrade to latest Vray 1.50 SP5 for your 3dsmax.