trying to checkin a 55mb file will timeout after 10 minutes

[icnocop]

Hello.

SourceGear Vault v4.0.5

Trying to checkin a 55mb file will cause a timeout after 10 minutes.

Vault Client GUI Messages:

[4/25/2008 5:10:43 AM] Preparing data to begin transaction
[4/25/2008 5:10:43 AM] Beginning transaction
[4/25/2008 5:10:43 AM] Create folder $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition
[4/25/2008 5:10:43 AM] Add $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition/readme.txt
[4/25/2008 5:10:43 AM] Add $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition/SQLEXPR.EXE
[4/25/2008 5:20:43 AM] Upload for item $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition/SQLEXPR.EXE failed, retrying...
[4/25/2008 5:30:43 AM] Upload for item $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition/SQLEXPR.EXE failed, retrying...
[4/25/2008 5:40:43 AM] Upload for item $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition/SQLEXPR.EXE failed, retrying...
[4/25/2008 5:40:43 AM] Ending the transaction
[4/25/2008 5:40:43 AM] Upload for item $/Company/Third Party/Microsoft/Microsoft SQL Server 2005 Express Edition/SQLEXPR.EXE failed too many times, aborting transaction.
Please verify your network settings using the Options dialog under the Tools menu in the Vault GUI Client.
The specific error was "The operation has timed out"
An exception was encountered during the transaction. Exception: The operation has timed out at System.Net.HttpWebRequest.GetResponse()
at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)
at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)
[4/25/2008 5:40:44 AM] Transaction failed
[4/25/2008 5:40:46 AM] Transaction failed


Vault Client GUI Network Settings:

[x] use chunked encoding ...
[x] use expect ...
[x] request database delta ...
[x] use the system default proxy ...

Vault Server log:

----4/24/2008 10:53:23 PM Rami--company.local(192.168.xxx.xxx)--SSL Disabled VaultFileUpload.aspx encountered: FailFileInvalidCheckSum
----4/24/2008 11:13:23 PM Rami--company.local(192.168.xxx.xxx)--SSL Disabled VaultFileUpload.aspx encountered: FailFileInvalidCheckSum
----4/24/2008 11:13:23 PM Rami--company.local(192.168.xxx.xxx)--SSL Disabled VaultFileUpload.aspx encountered: an exception while calculating the CRC for AddFile. Error in the application.

vault.config:

<SqlCommandTimeout>3600</SqlCommandTimeout>

IIS Default Web site (VaultService):

Connection timeout: 900 seconds

IIS VaultService Virtual Directory Application Configuration

[x] enable session state
session timeout: 4320 minutes
asp script timeout: 90 seconds

IIS VaultService Application Pool:

Recycling
[ ] recycle worker processes ...
[ ] recycle worker process ...
[ ] recycle worker processes at the following times ...
Performance
[ ] shutdown worker processes ...

Any ideas?

Thank you.

[jeremy_sg]

As an experiment, can you try to upload the file from the server machine, connecting to localhost? That would eliminate any network issues.

[icnocop]

Hello Jeremy,

I was able to upload the file using a machine directly connected to the same network as the vault web server.

I was previously connected through a vpn connection.

Thank you.

[icnocop]

Hello again.

I am experiencing this 10 minute timeout issue again.

SourceGear Vault v4.1.2

In this instance, the machine uploading files is on the same network but on a different machine than the vault server.
This is happening using the vault nant tasks with a large change list which includes 3 files that are about 100mb each.

The vault server is on Windows Server 2003 R2 Enterprise SP2

The iis application pool used by vaultservice is set to not recycle worker processes and to not shutdown idle worker processes

SqlCommandTimeout in vault.config is set to 3600 so I would have expected the timeout to occur after 60 minutes.

The only time value I see set for 10 minutes is in the Vault GUI Client General Options "Automatically refresh every [10] minutes". Would this setting have any affect on timeouts?

What else can I try?

Thank you.

Here is part of the vault server log that indicates the error(s)

----8/31/2008 10:22:38 PM sgvaultsystem--()--
System Started
Version 4.1.2.18185
Cache Level = 1
DataBase Buffer Size (KB) = 256
LogFile Path = C:\WINDOWS\Temp\sgvault
Log Level = Quiet
Archive Log = Weekly
ReverseDNS Lookup = True
Maximum HTTP Request Length = 102400
Overwrite Log on Startup = False
Session Timeout = 4320
SGVault Working Directory = C:\WINDOWS\Temp
SGVault Server URL =
Identity = NT AUTHORITY\NETWORK SERVICE

...
----9/1/2008 12:05:42 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled System.IO.FileNotFoundException: Could not find file 'C:\WINDOWS\Temp\c5beb2dd-2869-43c4-8e5f-f05253c6890d.vlt'.
File name: 'C:\WINDOWS\Temp\c5beb2dd-2869-43c4-8e5f-f05253c6890d.vlt'
at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access)
at VaultServiceSQL.VaultSqlSCC.StoreFileContentsInDB(VaultSqlConn conn, String strFile, Int64 nFileLen, Byte[] fileptr, Int32 nBufLen) at System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access)
at VaultServiceSQL.VaultSqlSCC.StoreFileContentsInDB(VaultSqlConn conn, String strFile, Int64 nFileLen, Byte[] fileptr, Int32 nBufLen)
----9/1/2008 12:06:02 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled System.Data.SqlClient.SqlException: Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.ReadSniError(TdsParserStateObject stateObj, UInt32 error)
at System.Data.SqlClient.TdsParserStateObject.ReadSni(DbAsyncResult asyncResult, TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.ReadPacket(Int32 bytesExpected)
at System.Data.SqlClient.TdsParserStateObject.ReadBuffer()
at System.Data.SqlClient.TdsParserStateObject.ReadByte()
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionPreYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransaction(TransactionRequest transactionRequest, String name, IsolationLevel iso, SqlInternalTransaction internalTransaction)
at System.Data.SqlClient.SqlInternalTransaction.Rollback()
at System.Data.SqlClient.SqlTransaction.Rollback()
at VaultServiceSQL.VaultSqlConn.RollbackTransaction() at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.ReadSniError(TdsParserStateObject stateObj, UInt32 error)
at System.Data.SqlClient.TdsParserStateObject.ReadSni(DbAsyncResult asyncResult, TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.ReadPacket(Int32 bytesExpected)
at System.Data.SqlClient.TdsParserStateObject.ReadBuffer()
at System.Data.SqlClient.TdsParserStateObject.ReadByte()
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionPreYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransaction(TransactionRequest transactionRequest, String name, IsolationLevel iso, SqlInternalTransaction internalTransaction)
at System.Data.SqlClient.SqlInternalTransaction.Rollback()
at System.Data.SqlClient.SqlTransaction.Rollback()
at VaultServiceSQL.VaultSqlConn.RollbackTransaction()
----9/1/2008 12:06:02 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/1/2008 12:06:02 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled Unable to begin SQL transaction for deleting pending transaction objects for TxID 29001
----9/1/2008 12:06:02 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled (3bd83266-ee5b-4838-bf25-bbea480b57b4) EndTx (Revision - 0) returned: FailFileStreamError
----9/1/2008 12:06:02 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled (3bd83266-ee5b-4838-bf25-bbea480b57b4) CheckIn: $/Root/Product/Directory/ABigFile.exe returned: FailFileStreamError
----9/1/2008 12:06:02 AM AutomationUser--AutomationServer(192.168.0.10)--SSL Disabled (3bd83266-ee5b-4838-bf25-bbea480b57b4) CheckIn: $/Root/Product/Directory/AnotherBigFile.exe returned: FailFileStreamError
...

[jeremy_sg]

I've added a registry setting to control this timeout in 4.1.3. If you would like to try a prerelease build, then please email support at sourcegear.com ATTN: jeremy with a link to this thread.

[tidwelle]

Go to Tools | Options | Network Settings and make sure that "Use chunked encoding..." is checked.

[Beth]

What version of Vault are you using?

Check what your IIS upload limit is in your Vault admin web page under advanced settings.