Citrix Edgesight 5.2 SP1 : Could not create the Java Virtual Machine.

This issue appear on my Presentation Server 4 HR5, 32bit only, x64 servers (Windows 2003 & 2008) were fine after deploying Citrix Edgesight Agent for XenApp 5.2 SP1. (build 5.2.3012.0)

Impacted applications :

All java applications using more than 706mb of reserved memory, command line example :

 c:\Progra~1\Java\jre1.5.0_07\bin\javaw -Xms8m -Xmx1024m -Dcai.starter.jvm.options=”-Xms8m -Xmx1024m” -classpath d:\xxxxxxxxxxxxx

Visual Studio 2008 Pro SP1 x64 crashes when Citrix Edgesight 5.2SP1 is installed, process CL.exe.

Reminder :

-Xmsn
Specify the initial size, in bytes, of the memory allocation pool. This value must be a multiple of 1024 greater than 1MB. Append the letter k or K to indicate kilobytes, or m or M to indicate megabytes. The default value is 2MB.      

-Xmxn
Specify the maximum size, in bytes, of the memory allocation pool. This value must a multiple of 1024 greater than 2MB. Append the letter k or K to indicate kilobytes, or m or M to indicate megabytes. The default value is 64MB. 

Affected system : Microsoft Windows 2003 R2 Sp2 x32 with Citrix Presentation Server 4 HR5

Error message :

Or

C:\Program Files\Java\jre1.5.0_07\bin>java.exe -Xmx1024M -version
Error occurred during initialization of VM
Could not reserve enough space for object heap
Could not create the Java virtual machine.

Even if the Presentation Server all have 4Gb of ram,  and freshly rebooted (567mb memory occupation) the java application doesn’t want to start. I first uninstall Citrix Edgesight, and checked everything was fine, it was fine with prior Edgesight for XenApp’s version.

Someone had the same issue, only one person posted this issue with a java application on Citrix’s forums : http://forums.citrix.com/thread.jspa?threadID=261266&tstart=0 

About the Visual Studio 2008 SP1 x64 the process CL.exe seems the one to exclude to make it work.

Workaround :

To avoid EdgeSight for XenApp agent “blocking” a process, you need to hade the executable program to the following registry key :

HKLM\SYSTEM\CurrentControlSet\Services\rskcore 
 
Key : UviProcessExcludes
 
Value : "rotatelogs.exe;java.exe;javaw.exe;cl.exe" (for my case)

You need to keep in mind, adding file to this registry key excluding them from statistics (information to confirm)

Update 30 march 2010 : There is no fix yet for this issue, Edgesight for XenApp 5.3 next version should include the fix, but not before Q2 2010…

Post author