Server:
Windows 2003
2GB RAM
Vault 3.5.2
SQL 2005
~1GB repository
folder security is not enabled
Clients:
slightly different HW configurations though test case for logs 3.2Ghz Pentium 4 with 2GB RAM
XP Pro
Vault 3.5.2 client
'automatically refresh every x minutes' option is disabled
search tab set to 'don't search'
server and test client hard drives have been defragmented
The issue is with the Vault GUI client responsiveness in essentially any operation.
Expanding a tree or clicking on a new tree in the repository usually takes 15-60 seconds to refresh, even on a nearly empty leaf.
Right clicking anywhere typically takes 10-20 seconds to even bring up the right click context menu.
Get latest, checkin, checkout operations take about 10-20 seconds to start, then rapidly log information saying the operation completed (regardless whether 1 file is involved or a few dozen), then takes 15-60 seconds of 'working' to refresh the display.
This appears to definitely be a client issue. During all of these operations, the client CPU is at 100% (or 50% on dual core or hyperthreaded CPU), the client hard drive is active but not thrashing, and the SQL server CPU and hard drive are nearly idle. This slowness has been observed on four different client machines, though most timings and logging have been done from one specific one. I've searched the Sourcegear support already for other information on slowness, performance optimization, etc. and have followed what guidelines I've seen. We've followed Vault from version 2.x up to now hoping for performance improvement with each upgrade and being disappointed.
The last bit of information and the only other clue I've seen is from enabling client side logging on all classes. When I do this during any of the 100% CPU times, the log quickly consists of thousands of lines along the lines of:
Code: Select all
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 824
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0413 mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0413 created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1656 (Vault_WF_-1342397900)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1656
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0416 mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1656
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0416 mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0416 created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2728 (Vault_WF_-1342397850)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2728
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\041D mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2728
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\041D mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\FILES\INTLTRNS\041D created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2436 (Vault_WF_-1342384869)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2436
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0804 mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2436
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0804 mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\FILES\INTLTRNS\0804 created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2044 (Vault_WF_1547217576)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2044
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\mips mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2044
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\FILES\mips mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\FILES\mips created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2428 (Vault_WF_407844287)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2428
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\lost+found mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2428
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\lost+found mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\lost+found created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2284 (Vault_WF_1824897867)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2284
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\lost+found\files.cf396fa527fa41bb8a622be33cc44948\arm mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2284
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\lost+found\files.cf396fa527fa41bb8a622be33cc44948\arm mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\lost+found\files.cf396fa527fa41bb8a622be33cc44948\arm created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1732 (Vault_WF_439412539)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1732
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\lost+found\HW.6c969bf21099448a9f7278dc717b7424 mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1732
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\lost+found\HW.6c969bf21099448a9f7278dc717b7424 mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\lost+found\HW.6c969bf21099448a9f7278dc717b7424 created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2060 (Vault_WF_1292376123)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2060
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2060
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2512 (Vault_WF_-2022335148)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2512
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\ChmiGdiTest mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2512
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\ChmiGdiTest mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\ChmiGdiTest created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1340 (Vault_WF_-472128882)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1340
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\FileSysTest mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1340
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\FileSysTest mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\FileSysTest created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2328 (Vault_WF_174905712)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2328
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\FSbench mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2328
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\FSbench mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\FSbench created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2344 (Vault_WF_185537609)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2344
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\fSelect mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2344
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\fSelect mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\fSelect created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1396 (Vault_WF_-1660654269)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1396
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Alarm mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1396
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Alarm mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Alarm created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2300 (Vault_WF_976176518)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2300
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Button mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2300
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Button mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Button created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1736 (Vault_WF_-899032404)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1736
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1736
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2000 (Vault_WF_-1658555391)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2000
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Gauge mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2000
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Gauge mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Gauge created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1556 (Vault_WF_-1659080612)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1556
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Graph mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1556
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Graph mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\Graph created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 2396 (Vault_WF_-349379659)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 2396
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\ImageList mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 2396
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\ImageList mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\ImageList created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1548 (Vault_WF_-1634904052)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1548
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\MultiStateList mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1548
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\MultiStateList mutex released
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf for C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\MultiStateList created
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Created mutex 1944 (Vault_WF_-2091796676)
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Took mutex 1944
9/17/2007 6:10:59 PM <wf>: [GUIClientWorkerThread:4676] wf C:\WINCE500\platform\RABASE\PROJECTS\CHMI_Dev\Predator\Components\MultiStatePB mutex locked
9/17/2007 6:10:59 PM <mutex>: [GUIClientWorkerThread:4676] Released mutex 1944
Please let me know any insight and suggestions on these slow Vault client issues and suggestions for fixing them. Thanks.
Aaron