Failure during a simple file move

This forum is now locked, since Gold Support is no longer offered.

Moderator: SourceGear

Locked
sheats
Posts: 5
Joined: Mon Apr 18, 2005 11:09 am
Location: Los Alamos, NM

Failure during a simple file move

Post by sheats » Mon Jan 23, 2006 10:40 am

We are currently running:

Code: Select all

Version Check:  This Vault client is version 3.1.6.3658
Version Check:  Your Vault server is version 3.1.6.3658
I am getting a failure on a simple file move from one folder to another. The file is not checked out or pinned or anything. Here is the text:

Code: Select all

[1/23/2006 9:28:50 AM] Preparing data to begin transaction
[1/23/2006 9:28:50 AM] Beginning transaction
[1/23/2006 9:28:52 AM]     Move $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/OpenDir.dcr
[1/23/2006 9:28:52 AM] Ending the transaction
[1/23/2006 9:29:37 AM] An error occurred while trying to end a transaction.
[1/23/2006 9:29:37 AM] An exception was encountered during the transaction.  Exception: 1 : Failure   at System.Web.Services.Protocols.SoapHttpClientProtocol.ReadResponse(SoapClientMessage message, WebResponse response, Stream responseStream, Boolean asyncCall)
   at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
   at VaultClientNetLib.ClientService.VaultService.EndTx(String strTxID, Int32 nTxAction, DateTime& dtTxBegin, Int64& nNewRevision, VaultResponseItem[]& responses)
   at VaultClientNetLib.VaultConnection.EndTx(String strTxID, Int64& nNewRevision, VaultResponseItem[]& responses, Int32 nAction, DateTime& txBeginDate)
   at VaultClientOperationsLib.ClientInstance.Commit(ChangeSetItemColl givenItems, Boolean keepCheckedOut, Boolean removeLocalCopy, Boolean bIsImport, DateTime dateImport, Int32 nUserIDImport, Int64& nRevID)
[1/23/2006 9:29:37 AM] Transaction failed
[1/23/2006 9:29:37 AM] Transaction failed
Any ideas? Since it is a Monday morning, it could be that I just haven't had enough caffeine yet, but this seems pretty odd.

Thanks,

Matt Sheats
HYTEC, Inc.

lbauer
Posts: 9736
Joined: Tue Dec 16, 2003 1:25 pm
Location: SourceGear

Post by lbauer » Mon Jan 23, 2006 11:21 am

Looks like a network error. Any corresponding error in the Vault server log file?
Linda Bauer
SourceGear
Technical Support Manager

sheats
Posts: 5
Joined: Mon Apr 18, 2005 11:09 am
Location: Los Alamos, NM

System Log Information

Post by sheats » Mon Jan 23, 2006 4:52 pm

Indeed, I have several entries in the system log that may be of interest:

First thing this morning I tried to move several files. That failed in the server with this log entry:

Code: Select all

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager Signal - Tx End   - TxID:94441 CacheLockId:37865 RepID:10 

----1/23/2006 9:21:47 AM  Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Critical Error! Exception of type System.OutOfMemoryException was thrown.

 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         ***Tree cache would have been flushed here*** 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         (fed87238-9eaf-4146-af50-49f8e23ce49f) EndTx (Revision - 0) returned: Failure 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (fed87238-9eaf-4146-af50-49f8e23ce49f) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/OpenDir.dcr to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (fed87238-9eaf-4146-af50-49f8e23ce49f) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/OpenDir.hpp to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (fed87238-9eaf-4146-af50-49f8e23ce49f) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/TOpenDir.bpi to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (fed87238-9eaf-4146-af50-49f8e23ce49f) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/TOpenDir.bpl to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (fed87238-9eaf-4146-af50-49f8e23ce49f) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/TOpenDir.lib to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Getting repository Structure-> Rep ID: 10 Base: 94440 Target: -1 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager: cache matches repository revision and folder security hasn't changed.  Returning cached tree, revID 94440 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled            VaultServiceAPI::GetRepositoryTreeDelta() UserID:4 RepID:10 Base:94440 Target:94440  Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff. 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         GetRepositoryStructure returned: Success 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Getting list of checkout changes. 

----1/23/2006 9:21:47 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         GetCheckOutListChanges returned: Success

Not much later I tried to just move a single file and received the following. Note that it doesn't indicate a failure on the server side, but it most certainly failed on my client side. In fact this is the attempt that I logged in my original message.

Code: Select all

----1/23/2006 9:28:01 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Getting repository Structure-> Rep ID: 10 Base: 94440 Target: -1 

----1/23/2006 9:28:01 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager: cache matches repository revision and folder security hasn't changed.  Returning cached tree, revID 94440 

----1/23/2006 9:28:01 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled            VaultServiceAPI::GetRepositoryTreeDelta() UserID:4 RepID:10 Base:94440 Target:94440  Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff. 

----1/23/2006 9:28:01 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         GetRepositoryStructure returned: Success 

----1/23/2006 9:28:01 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Getting list of checkout changes. 

----1/23/2006 9:28:01 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         GetCheckOutListChanges returned: Success 

----1/23/2006 9:28:54 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         BeginTx beginning transaction 

----1/23/2006 9:28:54 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager: cache matches repository revision and folder security hasn't changed.  Returning cached tree, revID 94440 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         (f3633464-8c66-4a0f-9b13-4a0b8bfbcf52) BeginTx returned: Success 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (f3633464-8c66-4a0f-9b13-4a0b8bfbcf52) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/OpenDir.dcr to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Success 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Ending transaction 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Attempting to acquire repository lock. 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Acquired repository lock. 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager Signal - Tx Begin - CacheLockId:38330 

----1/23/2006 9:28:56 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager: A transaction is pending, but it belongs to the current user.  Returning cached tree, revID 94440
Finally I restarted my client, logged in again (after you mentioned it might be a network error), and I received this message in the server log:

Code: Select all

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager Signal - Tx End   - TxID:94444 CacheLockId:38330 RepID:10 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Critical Error! Exception of type System.OutOfMemoryException was thrown.

 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         ***Tree cache would have been flushed here*** 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         (f3633464-8c66-4a0f-9b13-4a0b8bfbcf52) EndTx (Revision - 0) returned: Failure 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled                     (f3633464-8c66-4a0f-9b13-4a0b8bfbcf52) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/OpenDir.dcr to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Getting repository Structure-> Rep ID: 10 Base: 94440 Target: -1 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         TreeManager: cache matches repository revision and folder security hasn't changed.  Returning cached tree, revID 94440 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled            VaultServiceAPI::GetRepositoryTreeDelta() UserID:4 RepID:10 Base:94440 Target:94440  Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff. 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         GetRepositoryStructure returned: Success 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         Getting list of checkout changes. 

----1/23/2006 9:29:42 AM     Sheats--grind.hytecinc.local(10.25.40.96)--SSL Disabled         GetCheckOutListChanges returned: Success

So that's the whole story. I'm not sure what the "out of memory" errors really dictate. The server itself seems perfectly happy. We last rebooted the machine about 2 weeks ago.

Thanks, Matt

lbauer
Posts: 9736
Joined: Tue Dec 16, 2003 1:25 pm
Location: SourceGear

Post by lbauer » Mon Jan 23, 2006 5:02 pm

Is your Vault server using a lot of RAM when you try these move operations?
Linda Bauer
SourceGear
Technical Support Manager

sheats
Posts: 5
Joined: Mon Apr 18, 2005 11:09 am
Location: Los Alamos, NM

Memory use

Post by sheats » Mon Jan 23, 2006 5:33 pm

It spikes a good bit when I do the operation. About 140 megs. Afterwords the OS only seems to regain about half of it. I went from 2.68 GBs in use to 2.74 GBs of use after the operation. The height of the operation showed 2.84 GBs in use.

We have 4 GBs of RAM in the machine. Of course that doesn't help inside Windows' 2GB per process limit...

Matt

jclausius
Posts: 3702
Joined: Tue Dec 16, 2003 1:17 pm
Location: SourceGear
Contact:

Post by jclausius » Tue Jan 24, 2006 8:53 am

Matt - try a recycle of the IIS server (iisreset), and then try the move. Does that work?
Jeff Clausius
SourceGear

sheats
Posts: 5
Joined: Mon Apr 18, 2005 11:09 am
Location: Los Alamos, NM

Safe?

Post by sheats » Tue Jan 24, 2006 9:46 am

Is that safe to do on a busy server or should I wait until people have gone home for the day?

I used to know these things but honestly Vault has run so smoothly for a long time now that I've forgotten. :)

jclausius
Posts: 3702
Joined: Tue Dec 16, 2003 1:17 pm
Location: SourceGear
Contact:

Post by jclausius » Tue Jan 24, 2006 10:01 am

The sooner the better. If you can find some time early or at lunch, that would help.

The Out of Memory error is important, and I want to force the server's tree to be reloaded from the db.
Jeff Clausius
SourceGear

sheats
Posts: 5
Joined: Mon Apr 18, 2005 11:09 am
Location: Los Alamos, NM

No good

Post by sheats » Tue Jan 24, 2006 11:06 am

I did the iisreset, reconnected my client, and attempted the move again. Same failure.

Client:

Code: Select all

[1/24/2006 10:03:16 AM] Preparing data to begin transaction
[1/24/2006 10:03:16 AM] Beginning transaction
[1/24/2006 10:03:16 AM]     Move $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/TOpenDir.bpi
[1/24/2006 10:03:16 AM] Ending the transaction
[1/24/2006 10:03:46 AM] An error occurred while trying to end a transaction.
[1/24/2006 10:03:46 AM] An exception was encountered during the transaction.  Exception: 1 : Failure   at System.Web.Services.Protocols.SoapHttpClientProtocol.ReadResponse(SoapClientMessage message, WebResponse response, Stream responseStream, Boolean asyncCall)
   at System.Web.Services.Protocols.SoapHttpClientProtocol.Invoke(String methodName, Object[] parameters)
   at VaultClientNetLib.ClientService.VaultService.EndTx(String strTxID, Int32 nTxAction, DateTime& dtTxBegin, Int64& nNewRevision, VaultResponseItem[]& responses)
   at VaultClientNetLib.VaultConnection.EndTx(String strTxID, Int64& nNewRevision, VaultResponseItem[]& responses, Int32 nAction, DateTime& txBeginDate)
   at VaultClientOperationsLib.ClientInstance.Commit(ChangeSetItemColl givenItems, Boolean keepCheckedOut, Boolean removeLocalCopy, Boolean bIsImport, DateTime dateImport, Int32 nUserIDImport, Int64& nRevID)
[1/24/2006 10:03:46 AM] Transaction failed
[1/24/2006 10:03:50 AM] Transaction failed
And Server:

Code: Select all

----1/24/2006 10:03:56 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	TreeManager Signal - Tx End   - TxID:94520 CacheLockId:266 RepID:10 
----1/24/2006 10:03:56 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	Critical Error! Exception of type System.OutOfMemoryException was thrown.
 
----1/24/2006 10:03:56 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	***Tree cache would have been flushed here*** 
----1/24/2006 10:03:56 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	(632ed3d2-29c7-48cc-8c02-f52eea4912e2) EndTx (Revision - 0) returned: Failure 
----1/24/2006 10:03:56 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled		(632ed3d2-29c7-48cc-8c02-f52eea4912e2) Move: $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/TOpenDir.bpi to $/Core Components/Vendor Libraries/Trunk/TOpenDirectory 3.02/BCB 6 returned: Failure 
----1/24/2006 10:03:56 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	Getting repository Structure-> Rep ID: 10 Base: 94519 Target: -1 
----1/24/2006 10:04:00 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	TreeManager: cache matches repository revision and folder security hasn't changed.  Returning cached tree, revID 94519 
----1/24/2006 10:04:00 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	VaultServiceAPI::GetRepositoryTreeDelta() UserID:4 RepID:10 Base:94519 Target:94519  Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff. 
----1/24/2006 10:04:00 AM    Sheats--strain.hytecinc.local(10.25.40.97)--SSL Disabled	GetRepositoryStructure returned: Success


What next?

Matt

lbauer
Posts: 9736
Joined: Tue Dec 16, 2003 1:25 pm
Location: SourceGear

Post by lbauer » Tue Jan 24, 2006 11:20 am

We'll need to take a look at your database. Please contact me offline at linda at sourcegear.com and we'll get the process started.
Linda Bauer
SourceGear
Technical Support Manager

Locked