System.Web.HttpException (0x800704CD)

[hwapdc]

Hi
Lately I have seen a huge amount of entries like this in Vault.log
---23-03-2013 01:36:20 Read_Only--robot03.pdc.xx(10.117.68.138)--SSL Disabled System.Web.HttpException (0x800704CD): The remote host closed the connection. The error code is 0x800704CD.
at System.Web.Hosting.IIS7WorkerRequest.RaiseCommunicationError(Int32 result, Boolean throwOnDisconnect)
at System.Web.HttpResponse.Flush(Boolean finalFlush, Boolean async)
at System.IO.BufferedStream.Write(Byte[] array, Int32 offset, Int32 count)
at VaultLib.VaultStreamHeader.WriteToStream(Stream s)
at VaultServiceSQL.VaultSqlSCC.GetDeltaChainForFullFile(VaultSqlConn conn, Int64 nObjVerID, Int32 nBufSize, String strFileToken, Stream stream, ListDictionary ldDataStreams, RunningCRC32 crc, UInt32& nCRC) at System.Web.Hosting.IIS7WorkerRequest.RaiseCommunicationError(Int32 result, Boolean throwOnDisconnect)
at System.Web.HttpResponse.Flush(Boolean finalFlush, Boolean async)
at System.IO.BufferedStream.Write(Byte[] array, Int32 offset, Int32 count)
at VaultLib.VaultStreamHeader.WriteToStream(Stream s)
at VaultServiceSQL.VaultSqlSCC.GetDeltaChainForFullFile(VaultSqlConn conn, Int64 nObjVerID, Int32 nBufSize, String strFileToken, Stream stream, ListDictionary ldDataStreams, RunningCRC32 crc, UInt32& nCRC)
----23-03-2013 01:36:20 Read_Only--robot03.pdc.xx(10.117.68.138)--SSL Disabled System.Web.HttpException (0x800704CD): The remote host closed the connection. The error code is 0x800704CD.
at System.Web.Hosting.IIS7WorkerRequest.RaiseCommunicationError(Int32 result, Boolean throwOnDisconnect)
at System.Web.HttpResponse.Flush(Boolean finalFlush, Boolean async)
at System.IO.BufferedStream.Write(Byte[] array, Int32 offset, Int32 count)
at VaultLib.VaultStreamHeader.WriteToStream(Stream s)
at VaultServiceSQL.VaultSqlSCC.GetDeltaChainForFullFile(VaultSqlConn conn, Int64 nObjVerID, Int32 nBufSize, String strFileToken, Stream stream, ListDictionary ldDataStreams, RunningCRC32 crc, UInt32& nCRC) at System.Web.Hosting.IIS7WorkerRequest.RaiseCommunicationError(Int32 result, Boolean throwOnDisconnect)
at System.Web.HttpResponse.Flush(Boolean finalFlush, Boolean async)
at System.IO.BufferedStream.Write(Byte[] array, Int32 offset, Int32 count)
at VaultLib.VaultStreamHeader.WriteToStream(Stream s)
at VaultServiceSQL.VaultSqlSCC.GetDeltaChainForFullFile(VaultSqlConn conn, Int64 nObjVerID, Int32 nBufSize, String strFileToken, Stream stream, ListDictionary ldDataStreams, RunningCRC32 crc, UInt32& nCRC)
-
Background
Version 6.1.0.531
Vault is running at dedicated Web Server.
4 cores, 42 GB RAM.
Last week the IIS worker processes were using 16 GB RAM so I added more RAM.
SQL Server running the Vault DBs is running ok, no performance issue can be detected.
DB Sizes
sgVault 229947 MB
sgVaultIndex 21853 MB

vault.config
<?xml version="1.0" encoding="utf-8"?>
<!-- The path to this file must be set in web.config -->
<!-- HWA 21:31 19-03-2013
<TreeManagerSize> changed from -1 to 222
<DBBufferSizeKB> changed from 256 to 2048
-->
<appSettings>
<WorkingDirectory>%SYSTEMROOT%\Temp</WorkingDirectory>
<CachingStrategy>1</CachingStrategy>
<FileCacheEnabled>False</FileCacheEnabled>
<FileCachePath>%SYSTEMROOT%\Temp\sgvault\filecache</FileCachePath>
<FileCacheDiskSizeMb>100</FileCacheDiskSizeMb>
<AuthHeader>_authHdr</AuthHeader>
<VaultContentType>application/octet-stream</VaultContentType>
<DownloadQryParam>DownloadToken</DownloadQryParam>
<TxQryParam>TxToken</TxQryParam>
<FileQryParam>FileToken</FileQryParam>
<ShelveQryParam>ShelveToken</ShelveQryParam>
<DBBufferSizeKB>2048</DBBufferSizeKB>
<TreeManagerSize>222</TreeManagerSize>
<WebBufferSizeBytes>32768</WebBufferSizeBytes>
<ChainLimit>20</ChainLimit>
<FullText>50</FullText>
<VaultContentLengthHeader>Content-Length</VaultContentLengthHeader>
<LogLevel>Quiet</LogLevel>
<OverWriteLogOnStartup>False</OverWriteLogOnStartup>
<ArchiveLog>Daily</ArchiveLog>
<LogFilePath>%SYSTEMROOT%\Temp\sgvault</LogFilePath>
<LogReverseDNSLookup>True</LogReverseDNSLookup>
<SqlCommandTimeout>360</SqlCommandTimeout>
<SaveFullTreeInterval>2000</SaveFullTreeInterval>
<VerifyTreeIntegrity>False</VerifyTreeIntegrity>
<TreeDeltaCompresionThreshold>1000</TreeDeltaCompresionThreshold>
<MaxDownload>10240000</MaxDownload>
<GetFileCheckBatchSize>256</GetFileCheckBatchSize>
<DelayThreshold>10</DelayThreshold>
<DelayDurationSeconds>30</DelayDurationSeconds>
<CheckoutListDaysToExpire>5</CheckoutListDaysToExpire>
<AllowRepositories>*</AllowRepositories>
<FindinFilesWordChars>A-Za-z0-9_</FindinFilesWordChars>
<ServerURL>http://svrVault.pdc.xx/VaultService</ServerURL>
</appSettings>

Hints
Any suggestions or hints are appreciated.
Should I change <TreeManagerSize> back to -1 and <DBBufferSizeKB> back to 256.
I changed <DBBufferSizeKB> because the Vault clients used in automated tests are downloading a huge number of files (easyly 10000+) including large image files and databases.

[Beth]

The things you've changed so far won't help the error you posted. In fact, the tree manager size being smaller will make the network have more traffic.

Have your users noticed any problems?

If users are getting errors, then the errors in the server log could be from users stopping transactions.

[hwapdc]

The users are automatic test suites downloading tons of files from the Vault Server.
Yes, they are complaining - downloads are often not completed.
The Vault Server has plenty of RAM (42 GB).
Would it make sense to set tree manager size to eg. 512 or even higher?
We are seeing a lot of requests from the Vault Server to SQL Server.
Would a high tree manager size reduce the load to the SQL Server.
Basically I need to configure the Vault Server for caching as many files as possible so they are ready when the clients (automatic test suites) are doing get-latest. At present it seems Vault Server is requesting the same files from the SQL Server over and over again. Again I would like to configure Vault Server for optimal performance for clients downloading the same files over and over again.

[Beth]

The tree manager size should go back to its original setting of -1 to cut down on network traffic. It will cut-down on the number of requests that has to be made of the server.

To troubleshoot users not getting their downloads, I'll need to see a Vault client log (%temp%\VaultGUIclient.txt) that shows the issue and the corresponding Vault server log. This will be easier if we take this offline.

Could you send an email to support at sourcegear.com (attn: Beth) with a link to this forum thread?

[hwapdc]

Our automated test sute uses vault.exe - not vaultguiclient.exe.
Where can the log file for vault.exe be found?
vault.exe HELP does not indicate where to found the log file.

[Beth]

The Vault.exe needs additional configuration for logging (
http://support.sourcegear.com/viewtopic.php?t=1534).

Where a Vault GUI client is installed, make a copy of the VaultGUIClient.exe.config and name the copy Vault.exe.config. Place the Vault.exe.config in the same directory as Vault.exe.

Edit the Vault.exe.config to logging = "true" and classes to log = "all".

Then the next time the error happens, send the vault.log from the client and the sgvault.log from the server.

[Beth]

Currently discussing this issue offline.

HS: 227886