Error on server "Critical Error downloading file!"

[jvel]

Vault Standard 5.1.2 (19281), server and clients.

Our Vault users are complaining of sporadic failures during various operations such as getting a branch, viewing the history of a branch, merging a branch. Looking at the server log (which is something I don't do often), I can see errors such as this:

----07/02/2013 08:41:26 paulh--xdsl-89-0-1-165.netcologne.de(89.0.1.165)--SSL Disabled Critical Error downloading file! The remote host closed the connection. The error code is 0x80072746.
at System.Web.Hosting.ISAPIWorkerRequestInProcForIIS6.FlushCore(Byte[] status, Byte[] header, Int32 keepConnected, Int32 totalBodySize, Int32 numBodyFragments, IntPtr[] bodyFragments, Int32[] bodyFragmentLengths, Int32 doneWithSession, Int32 finalStatus, Boolean& async)
at System.Web.Hosting.ISAPIWorkerRequest.FlushCachedResponse(Boolean isFinal)
at System.Web.Hosting.ISAPIWorkerRequest.FlushResponse(Boolean finalFlush)
at System.Web.HttpResponse.Flush(Boolean finalFlush)
at System.Web.HttpResponse.Flush()
at System.Web.HttpWriter.WriteFromStream(Byte[] data, Int32 offset, Int32 size)
at System.Web.HttpResponseStream.Write(Byte[] buffer, Int32 offset, Int32 count)
at System.IO.BufferedStream.Write(Byte[] array, Int32 offset, Int32 count)
at VaultServiceSQL.VaultSqlSCC.GetDeltaChainForFullFile(VaultSqlConn conn, Int64 nObjVerID, Int32 nBufSize, String strFileToken, Stream s, ListDictionary ldDataStreams, RunningCRC32 crc, UInt32& nCRC)
at VaultServiceAPILib.VaultFileCacheManager.GetDeltaChainForFullFile(VaultSqlConn vsConn, Int32 nRepID, Int64 nTargetObjVerID, Int32 nBufSize, String strFileToken, Stream sFullFileStream, RunningCRC32 crc, UInt32& nCRC)
at VaultServiceAPILib.VaultDelta.CreateFullFile(VaultSqlConn vsConn, Int32 nRepID, Int64 nObjVerID, String strFileToken, Boolean& deltaIfAvailable, Stream sFullFileStream, RunningCRC32 crc, UInt32& nCRC)
at VaultServiceAPILib.VaultDelta.DeltaCreate(VaultSqlConn vsConn, Int32 nRepID, Int64 nBaseObjVerID, Int64 nTargetObjVerID, String strFileToken, Stream sDeltaStream, RunningCRC32 crc, UInt32& nCRC)
at VaultServiceAPILib.VaultServiceAPI.GetVaultFile(Int32 nRepID, VaultIntDnldItem& vidi, String strFileToken, Stream s, Boolean bSeekToOrigin, Boolean bFolderExportCalcCRC, UInt32& nCRC)
at VaultService.VaultFileDownload.Page_Load(Object sender, EventArgs e)


often followed by other exceptions. Looking back over the logs from 2012-2013, I can see this used to happen a couple of times every month, but this year it's been several occurrences per week. I'm not aware of any changes on our system that may have exacerbated this. It isn't specific to any user.

We've tried clearing the cache on the client workstations. We've tried iisreset on the Vault server. We have always run your recommended maintenance tasks on the SQL Server (scheduled every weekend). I'm not seeing any errors in the SQL Server logs.

Can you make any recommendations? I'm happy to make any of our server logs available. (By the way, we are not yet ready to upgrade to Vault 6.)

Regards,
John

[Beth]

Does this error seem to happen on only certain branches?

Are the errors on Gets on branches isolated to certain machines, or have all machines given that error at some time?

Are the users with error on the Gets remote or local to the network?

[jvel]

I should have said...

Vault IIS server is Windows Server 2003 R2, Standard x64 Edition, Service Pack 2.
The hardware is Dell Server PE2950, Intel Xeon CPU, X5355 @ 2.66GHz, 4GB RAM.

Vault database server is Windows Server 2003 R2, Standard Edition (32bit), Service Pack 2.
The hardware is Dell Server PE2950, Intel Xeon CPU, E5420 @ 2.50GHz, 4GB RAM.
The database is SQL Server 2005 (9.0.3042).

I know these machines are outdated, but they're not under my direct control.

[jvel]

Hi Beth,
This is happening on several different branches, and in fact several (at least two) repositories. Our branches are mostly short-lived, and normally used by a single developer, on just one workstation. Next time it happens, I will try the same operation on another workstation. The users having the problem are local.
Regards,
John

[Beth]

What are the sizes of your sgvault.mdf, sgvault_log.ldf, sgmaster.mdf, and sgmaster_log.ldf?

I would like to see your full server log. Could you send then log in an email to support at sourcegear.com (attn: Beth) with a link to this forum thread?

[jvel]

The file sizes are as follows:

sgmaster.mdf = 3.18 MB
sgmaster_1.LDF = 1.73 GB
sgvault.mdf = 33.4 GB
sgvault_1.ldf = 176 MB

I'm emailing the server log files right now.

[Beth]

Email received.

HS: 227395