Can't upload large files to Vault

If you are having a problem using Vault, post a message here.

Moderator: SourceGear

Post Reply
tomt84
Posts: 109
Joined: Tue Dec 20, 2005 4:44 am
Location: Manchester

Can't upload large files to Vault

Post by tomt84 » Thu May 28, 2009 2:38 am

Hi

Trying to upload a couple of large files to Vault as part of a large "add to vault" operation from Visual Studio 2005 (on a web application solution)

I have altered the maxRequestLength attribute of the httpRuntime element in vaultservice\web.config to 1024000 (1000 megabytes), which is big enough for the files in question (148MB and 9.4MB)

Visual Studio's output window is returning some errors from Vault, see below. The upload is failing.

Do you have any other suggestions on what else to tweak to allow these large uploads?

Thanks
Tom

Code: Select all

    Upload for item $/Websites/ourproduct/Source/videos/tom6sept07/Joe's Sales Movie.wmv failed, retrying...
    Upload for item $/Websites/ourproduct/Source/videos/tom6sept07/Joe's Sales Movie.wmv failed, retrying...
    Upload for item $/Websites/ourproduct/Source/videos/tom6sept07/Joe's Sales Movie.wmv failed, retrying...
Ending the transaction
Transaction failed
Transaction failed
Upload for item $/Websites/ourproduct/Source/videos/tom6sept07/Joe's Sales Movie.wmv failed too many times, aborting transaction.  
        Please verify your network settings using the Options dialog under the Tools menu in the Vault GUI Client.  
        The specific error was "The underlying connection was closed: An unexpected error occurred on a send."
An exception was encountered during the transaction.  Exception: The underlying connection was closed: An unexpected error occurred on a send.   at System.Net.HttpWebRequest.GetResponse()
   at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)
   at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)
InnerException: Unable to write data to the transport connection: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full.   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   at System.Net.Connection.Write(ScatterGatherBuffers writeBuffer)
   at System.Net.ConnectStream.ResubmitWrite(ConnectStream oldStream, Boolean suppressWrite)
InnerException.InnerException: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full   at System.Net.Sockets.Socket.MultipleSend(BufferOffsetSize[] buffers, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)

    Upload for item $/Websites/ourproduct/Source/videos/hs/9/9.avi failed, retrying...
    Upload for item $/Websites/ourproduct/Source/videos/hs/9/9.avi failed, retrying...
    Upload for item $/Websites/ourproduct/Source/videos/hs/9/9.avi failed, retrying...
Upload for item $/Websites/ourproduct/Source/videos/hs/9/9.avi failed too many times, aborting transaction.  
        Please verify your network settings using the Options dialog under the Tools menu in the Vault GUI Client.  
        The specific error was "The server returned an unknown error header: FailFileTokenError"
An exception was encountered during the transaction.  Exception: The server returned an unknown error header: FailFileTokenError   at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)
   at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)
Tom Fanning
Top
Beth
Posts: 8550
Joined: Wed Jun 21, 2006 8:24 pm
Location: SourceGear
Contact:
Contact Beth

Re: Can't upload large files to Vault

Post by Beth » Thu May 28, 2009 8:05 am

Look inside your Vault Server Log around the time you performed that action. Are any errors logged there? Can you post the first few errors listed?
Beth Kieler
SourceGear Technical Support
Top
tomt84
Posts: 109
Joined: Tue Dec 20, 2005 4:44 am
Location: Manchester

Re: Can't upload large files to Vault

Post by tomt84 » Thu May 28, 2009 9:49 am

Hi Beth

No errors listed in sgvault.log, just the logins and logouts from our build system.

What's next?

Thanks
Tom
Tom Fanning
Top
Beth
Posts: 8550
Joined: Wed Jun 21, 2006 8:24 pm
Location: SourceGear
Contact:
Contact Beth

Re: Can't upload large files to Vault

Post by Beth » Thu May 28, 2009 10:26 am

There was no login for your name?

Check your Event Viewer logs on your computer. Any errors logged there?

Start up Client Side Logging for either the Classic or Enhanced Client. Then try the upload again. Check your client log. Any errors there?

What happens if you try to add general files with the Vault GUI client? Do you have a test repository you can try that with? You might want to try a dummy repository just to test this out with, and then you can delete that test repository when we're finished troubleshooting. Deleting a repository won't hurt your database.
Beth Kieler
SourceGear Technical Support
Top
tomt84
Posts: 109
Joined: Tue Dec 20, 2005 4:44 am
Location: Manchester

Re: Can't upload large files to Vault

Post by tomt84 » Fri May 29, 2009 5:54 am

Sorry, yes, my logins were there fine.

Nothing in Event Viewer on the client or server (application or system logs) for the period of the transfer.

Uploading one of the files with the Vault GUI client results in a "Check in/commit transaction failed" error with the following message:

Code: Select all

[29/05/2009 12:33:10] Preparing data to begin transaction
[29/05/2009 12:33:30] Beginning transaction
[29/05/2009 12:33:30]     Add $/Websites/ourproduct/Joe's Sales Movie.wmv
[29/05/2009 12:34:35]     Upload for item $/Websites/ourproduct/Joe's Sales Movie.wmv failed, retrying...
[29/05/2009 12:35:40]     Upload for item $/Websites/ourproduct/Joe's Sales Movie.wmv failed, retrying...
[29/05/2009 12:36:45]     Upload for item $/Websites/ourproduct/Joe's Sales Movie.wmv failed, retrying...
[29/05/2009 12:36:45] Ending the transaction
[29/05/2009 12:36:45] Transaction failed
[29/05/2009 12:36:45] Transaction failed
[29/05/2009 12:36:45] Upload for item $/Websites/ourproduct/Joe's Sales Movie.wmv failed too many times, aborting transaction.  
        Please verify your network settings using the Options dialog under the Tools menu in the Vault GUI Client.  
        The specific error was "The underlying connection was closed: An unexpected error occurred on a send."
An exception was encountered during the transaction.  Exception: The underlying connection was closed: An unexpected error occurred on a send.   at System.Net.HttpWebRequest.GetResponse()
   at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)
   at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)
InnerException: Unable to write data to the transport connection: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full.   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   at System.Net.Connection.Write(ScatterGatherBuffers writeBuffer)
   at System.Net.ConnectStream.ResubmitWrite(ConnectStream oldStream, Boolean suppressWrite)
InnerException.InnerException: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full   at System.Net.Sockets.Socket.MultipleSend(BufferOffsetSize[] buffers, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
Client is version 4.1.4.18402
Server is version 4.1.3.18336

Is the version difference likely to cause this problem? Upgrading our server is an out-of-hours job that takes a bit of time because we run CruiseControl.NET, so I like to test everything thoroughly after an upgrade, so I thought I'd ask if it's worth doing sooner rather than later.

Here's the log from the Vault GUI client

Code: Select all

29/05/2009 12:44:47 <generic>: [Main:888] Emergency logging enabled in Windows Forms client
29/05/2009 12:45:00 <mutex>: [GUIClientWorkerThread:112] Took mutex 1248
29/05/2009 12:45:00 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetItems
29/05/2009 12:45:00 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 12:33:10  _lastSyncTime:29/05/2009 12:33:10
29/05/2009 12:45:00 <mutex>: [GUIClientWorkerThread:112] Released mutex 1248
29/05/2009 12:45:00 <mutex>: [GUIClientWorkerThread:112] Took mutex 1080
29/05/2009 12:45:00 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetComment
29/05/2009 12:45:00 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 10:28:41  _lastSyncTime:29/05/2009 10:28:41
29/05/2009 12:45:00 <mutex>: [GUIClientWorkerThread:112] Released mutex 1080
29/05/2009 12:45:00 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.LocalRefreshEvent
29/05/2009 12:45:00 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ChangeSetItemsChangedEvent
29/05/2009 12:45:00 <repositoryexplorer>: [Main:888] refresh requested updateKnown is False
29/05/2009 12:45:00 <statussearch>: [GUIClientWorkerThread:112] StatusSearchScan run with DONTSEARCH. Reporting empty search results.
29/05/2009 12:45:05 <busy>: [GUIClientWorkerThread:112] Setting GUI to busy from AddFilesFolders
29/05/2009 12:45:05 <addfilesfolders>: [GUIClientWorkerThread:112] Adding files or folders to: $/Websites/ourproduct
29/05/2009 12:45:05 <addfileexplorer>: [Main:888] AddDirectories for C: Started
29/05/2009 12:45:05 <addfileexplorer>: [Main:888] AddDirectories for C: Finished
29/05/2009 12:45:24 <addfileexplorer>: [Main:888] AddDirectories for C:\Documents and Settings\admintom\Desktop\ourproduct\ourproduct.co.uk\videos\tom6sept07 Started
29/05/2009 12:45:24 <addfileexplorer>: [Main:888] AddDirectories for C:\Documents and Settings\admintom\Desktop\ourproduct\ourproduct.co.uk\videos\tom6sept07 Finished
29/05/2009 12:45:24 <addfileexplorer>: [Main:888] AddDirectories for C:\Documents and Settings\admintom\Desktop\ourproduct\ourproduct.co.uk\videos\tom6sept07 Started
29/05/2009 12:45:24 <addfileexplorer>: [Main:888] AddDirectories for C:\Documents and Settings\admintom\Desktop\ourproduct\ourproduct.co.uk\videos\tom6sept07 Finished
29/05/2009 12:45:27 <addfilesfolders>: [GUIClientWorkerThread:112] Got back 1 change set items.
29/05/2009 12:45:27 <mutex>: [GUIClientWorkerThread:112] Took mutex 1248
29/05/2009 12:45:27 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetItems
29/05/2009 12:45:27 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 12:33:10  _lastSyncTime:29/05/2009 12:33:10
29/05/2009 12:45:27 <refresh>: [GUIClientWorkerThread:112] Serialized CacheMember_ChangeSetItems
29/05/2009 12:45:27 <mutex>: [GUIClientWorkerThread:112] Released mutex 1248
29/05/2009 12:45:27 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ChangeSetItemsChangedEvent
29/05/2009 12:45:27 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ChangeSetItemsChangedEvent
29/05/2009 12:45:27 <commit>: [GUIClientWorkerThread:112] Beginning commit with 1 items
29/05/2009 12:45:27 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:45:27 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:45:27 <commit>: [GUIClientWorkerThread:112] Creating requests.
29/05/2009 12:45:27 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:45:27 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:45:27 <commit>: [GUIClientWorkerThread:112] CreateRequest for AddFile: $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:45:27 <createrequest>: [GUIClientWorkerThread:112] createrequest started for $/Websites/ourproduct/Joe's Sales Movie.wmv ChangeSetItem_AddFile
29/05/2009 12:45:28 <mrd>: [GUIClientWorkerThread:112] Creating request for AddFile: $/Websites/ourproduct/Joe's Sales Movie.wmv; server-synched path for AddFile: $/Websites/ourproduct/Joe's Sales Movie.wmv is $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:45:29 <createrequest>: [GUIClientWorkerThread:112] createrequest finished for $/Websites/ourproduct/Joe's Sales Movie.wmv ChangeSetItem_AddFile
29/05/2009 12:45:29 <commit>: [GUIClientWorkerThread:112]   -> file is  $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:45:29 <mrd>: [GUIClientWorkerThread:112] ChangeSetItems after finalize sort:
29/05/2009 12:45:29 <mrd>: [GUIClientWorkerThread:112] AddFile: $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:45:29 <commit>: [GUIClientWorkerThread:112] Total size of files:  155912486
29/05/2009 12:45:29 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:45:29 <connection>: [GUIClientWorkerThread:112] BeginTx started.
29/05/2009 12:45:29 <connection>: [GUIClientWorkerThread:112] BeginTx finished.
29/05/2009 12:45:29 <commit>: [GUIClientWorkerThread:112]   -> after BeginTx, file is $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:45:29 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:45:29 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:45:29 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:45:29 <upload>: [Upload_0:1096] uploading item: $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:45:29 <connection>: [Upload_0:1096] UploadFile started.
29/05/2009 12:45:29 <connection>: [Upload_0:1096] UploadFile finished.
29/05/2009 12:45:29 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:45:30 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent

lots of these lines removed

29/05/2009 12:46:31 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:32 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:33 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:33 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:34 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:34 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:46:34 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:34 <upload>: [Upload_0:1096] uploading item: $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:46:34 <connection>: [Upload_0:1096] UploadFile started.
29/05/2009 12:46:34 <connection>: [Upload_0:1096] UploadFile finished.
29/05/2009 12:46:35 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:36 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:46:36 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent

lots of these lines removed

29/05/2009 12:47:38 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:39 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:39 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:40 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:40 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:47:40 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:40 <upload>: [Upload_0:1096] uploading item: $/Websites/ourproduct/Joe's Sales Movie.wmv
29/05/2009 12:47:40 <connection>: [Upload_0:1096] UploadFile started.
29/05/2009 12:47:40 <connection>: [Upload_0:1096] UploadFile finished.
29/05/2009 12:47:41 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:42 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:42 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:43 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:47:44 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent

lots of these lines removed

29/05/2009 12:48:43 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:48:43 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:48:44 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:48:45 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:48:45 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:48:45 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ProgressChangedEvent
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] EndTx started.
29/05/2009 12:48:45 <eventengine>: [Upload_0:1096] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:48:45 <generic>: [Upload_0:1096] Failed uploading item $/Websites/ourproduct/Joe's Sales Movie.wmv because of an exception 
29/05/2009 12:48:45 <generic>: [Upload_0:1096]  [System.Net.Sockets.SocketException: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full
   at System.Net.Sockets.Socket.MultipleSend(BufferOffsetSize[] buffers, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)]An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full
   at System.Net.Sockets.Socket.MultipleSend(BufferOffsetSize[] buffers, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
[System.IO.IOException: Unable to write data to the transport connection: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full. ---> System.Net.Sockets.SocketException: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full
   at System.Net.Sockets.Socket.MultipleSend(BufferOffsetSize[] buffers, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   --- End of inner exception stack trace ---
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   at System.Net.Connection.Write(ScatterGatherBuffers writeBuffer)
   at System.Net.ConnectStream.ResubmitWrite(ConnectStream oldStream, Boolean suppressWrite)]Unable to write data to the transport connection: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full.
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   at System.Net.Connection.Write(ScatterGatherBuffers writeBuffer)
   at System.Net.ConnectStream.ResubmitWrite(ConnectStream oldStream, Boolean suppressWrite)
[System.Net.WebException: The underlying connection was closed: An unexpected error occurred on a send. ---> System.IO.IOException: Unable to write data to the transport connection: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full. ---> System.Net.Sockets.SocketException: An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full
   at System.Net.Sockets.Socket.MultipleSend(BufferOffsetSize[] buffers, SocketFlags socketFlags)
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   --- End of inner exception stack trace ---
   at System.Net.Sockets.NetworkStream.MultipleWrite(BufferOffsetSize[] buffers)
   at System.Net.Connection.Write(ScatterGatherBuffers writeBuffer)
   at System.Net.ConnectStream.ResubmitWrite(ConnectStream oldStream, Boolean suppressWrite)
   --- End of inner exception stack trace ---
   at System.Net.HttpWebRequest.GetResponse()
   at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)
   at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)]The underlying connection was closed: An unexpected error occurred on a send.
   at System.Net.HttpWebRequest.GetResponse()
   at VaultClientOperationsLib.ClientInstance.UploadItem(ChangeSetItem item, String txID, Byte[]& streamBuffer, Int32& bytesWrittenThisFile, Boolean bIsImport)
   at VaultClientOperationsLib.UploadThread.ProcessCommand(UploadThreadCommand command, UploadThreadCommandResult& outputResult)

29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] EndTx finished.
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refresh started
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] delta passed in was null, retrieving one
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] calling GetRepositoryStructure(6, 5052, -1, ref, 01/07/1850 00:00:00)
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetRepositoryStructure started.
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] GetRepositoryStructure started
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Calling client service GetRepositoryStructure(6, 5052, -1, 01/07/1850 00:00:00, ref, ref, ref)
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Client service GetRepositoryStructure returned: dtLatestCheck 01/07/1850 00:00:00, nReturnDestRevision 5052, rd not null True
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] GetRepositoryStructure finished
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetRepositoryStructure finished.
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 836
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Serialized CacheMember_LastStructureGetTime
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 836
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] GetRepositoryStructure returned: returnedRevision 5052, newLatestDate 01/07/1850 00:00:00, delta not null: True
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] RefreshCheckOutList started
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] Call GetCheckOutListChanges(Rep 6, Rev 23187, LastUpdt 01/07/1850 00:00:00)
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetCheckOutListChanges started.
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetCheckOutListChanges finished.
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] GetCheckOutListChanges returned: Rev 23187 completeList False, newLastUpdt 01/07/1850 00:00:00
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] New items:
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] 	<null>
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] Release items:
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] 	<null>
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] Source and target check out list revisions are both 23187, and last locking date match.  Returning with no update
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] RefreshCheckOutList finished
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Applying server delta to the server-synched repository
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Done updating tree cache with pending changes.  ServerReposRevID: 5052  PendingChangeRevID: 5052
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Repository.Update finished, calling SaveRepositoryIfNothingOnDisk()
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 860
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] SaveIfNothingOnDisk: not saving
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 860
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refreshing working folder associations from disk
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 864
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_WorkingFolderAssignments
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 10:46:03  _lastSyncTime:29/05/2009 10:46:03
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 864
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refreshing all change set items without notify
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 1248
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetItems
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 12:45:27  _lastSyncTime:29/05/2009 12:45:27
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 1248
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 1080
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetComment
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 10:28:41  _lastSyncTime:29/05/2009 10:28:41
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 1080
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Calling UpdateKnownChanges_RefreshKnown with notify
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ChangeSetItemsChangedEvent
29/05/2009 12:48:45 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Calling NotifyTreeStructureChanged
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.TreeStructureChangedEvent
29/05/2009 12:48:45 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refresh finished
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.MessageEvent
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.CommitWarningEvent
29/05/2009 12:48:45 <busy>: [GUIClientWorkerThread:112] Setting GUI to unbusy from AddFilesFolders.
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 1248
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetItems
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 12:45:27  _lastSyncTime:29/05/2009 12:45:27
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 1248
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 1080
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetComment
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 10:28:41  _lastSyncTime:29/05/2009 10:28:41
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 1080
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.LocalRefreshEvent
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ChangeSetItemsChangedEvent
29/05/2009 12:48:45 <statussearch>: [GUIClientWorkerThread:112] StatusSearchScan run with DONTSEARCH. Reporting empty search results.
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Auto refresh begun
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refresh started
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] delta passed in was null, retrieving one
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] calling GetRepositoryStructure(6, 5052, -1, ref, 01/07/1850 00:00:00)
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetRepositoryStructure started.
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] GetRepositoryStructure started
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Calling client service GetRepositoryStructure(6, 5052, -1, 01/07/1850 00:00:00, ref, ref, ref)
29/05/2009 12:48:45 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:48:45 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Client service GetRepositoryStructure returned: dtLatestCheck 01/07/1850 00:00:00, nReturnDestRevision 5052, rd not null True
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] GetRepositoryStructure finished
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetRepositoryStructure finished.
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 836
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Serialized CacheMember_LastStructureGetTime
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 836
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] GetRepositoryStructure returned: returnedRevision 5052, newLatestDate 01/07/1850 00:00:00, delta not null: True
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] RefreshCheckOutList started
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] Call GetCheckOutListChanges(Rep 6, Rev 23187, LastUpdt 01/07/1850 00:00:00)
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetCheckOutListChanges started.
29/05/2009 12:48:45 <connection>: [GUIClientWorkerThread:112] GetCheckOutListChanges finished.
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] GetCheckOutListChanges returned: Rev 23187 completeList False, newLastUpdt 01/07/1850 00:00:00
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] New items:
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] 	<null>
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] Release items:
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] 	<null>
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] Source and target check out list revisions are both 23187, and last locking date match.  Returning with no update
29/05/2009 12:48:45 <checkoutlist>: [GUIClientWorkerThread:112] RefreshCheckOutList finished
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Applying server delta to the server-synched repository
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Done updating tree cache with pending changes.  ServerReposRevID: 5052  PendingChangeRevID: 5052
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Repository.Update finished, calling SaveRepositoryIfNothingOnDisk()
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 860
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] SaveIfNothingOnDisk: not saving
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 860
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.StatusMessageEvent
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refreshing working folder associations from disk
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 864
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_WorkingFolderAssignments
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 10:46:03  _lastSyncTime:29/05/2009 10:46:03
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 864
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refreshing all change set items without notify
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 1248
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetItems
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 12:45:27  _lastSyncTime:29/05/2009 12:45:27
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 1248
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Took mutex 1080
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Did not UpdateObjectFromDisk in VaultClientOperationsLib.CacheMember_ChangeSetComment
29/05/2009 12:48:45 <cache>: [GUIClientWorkerThread:112] Cache file LastWriteTime:29/05/2009 10:28:41  _lastSyncTime:29/05/2009 10:28:41
29/05/2009 12:48:45 <mutex>: [GUIClientWorkerThread:112] Released mutex 1080
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Calling UpdateKnownChanges_RefreshKnown with notify
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.ChangeSetItemsChangedEvent
29/05/2009 12:48:45 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Calling NotifyTreeStructureChanged
29/05/2009 12:48:45 <eventengine>: [GUIClientWorkerThread:112] Event fired: VaultClientOperationsLib.TreeStructureChangedEvent
29/05/2009 12:48:45 <repositoryexplorer>: [Main:888] refresh requested while we were disabled
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Refresh finished
29/05/2009 12:48:45 <refresh>: [GUIClientWorkerThread:112] Auto refresh finished
29/05/2009 12:48:45 <statussearch>: [GUIClientWorkerThread:112] StatusSearchScan run with DONTSEARCH. Reporting empty search results.
Tom Fanning
Top
Beth
Posts: 8550
Joined: Wed Jun 21, 2006 8:24 pm
Location: SourceGear
Contact:
Contact Beth

Re: Can't upload large files to Vault

Post by Beth » Fri May 29, 2009 10:43 am

I think the key error to look at is "An operation on a socket could not be performed because the system lacked sufficient buffer space or because a queue was full." Check out this user's solution: Vault Connection Problem. Are you able to perform the same action to reduce the number of protocol bindings?

In the Vault GUI client under Tools->Options->Network Settings, try checking "Use chunked encoding to reduce memory consumption during file uploads." Or, if this is already checked, try unchecking it.

Also, try changing the SQL Server timeout in the Vault.config file. It's Vault.config in the Vault Service Directory.
Look for the line: <SQLCommandTimeout>360<SQLCommandTimeOut>. Set it to something larger, like 3600 or 7200.

It is recommended that you have the client and server match. I don't know if that would be the root cause or not, but it can save you some headaches later as well if you perform the upgrade.
Beth Kieler
SourceGear Technical Support
Top
tomt84
Posts: 109
Joined: Tue Dec 20, 2005 4:44 am
Location: Manchester

Re: Can't upload large files to Vault

Post by tomt84 » Tue Jun 02, 2009 7:38 am

"Use chunked encoding" was unticked - ticking it in the Vault GUI client fixed the issue in both the GUI client and the VS enhanced client, although the check-in took a VERY long time (mostly paused at the Completing Transaction stage)

Thanks
Tom
Tom Fanning
Top
Beth
Posts: 8550
Joined: Wed Jun 21, 2006 8:24 pm
Location: SourceGear
Contact:
Contact Beth

Re: Can't upload large files to Vault

Post by Beth » Mon Jun 08, 2009 3:21 pm

Thanks for the update.

You might want to take a look at the following KB article on improving performance: http://support.sourcegear.com/viewtopic.php?t=4206.
Beth Kieler
SourceGear Technical Support
Top
Post Reply

Return to “Support (Vault)”