Some more details. When I attempt to get from a label in the UI the client hangs. In the event viewer I see this error:
Hanging application VaultGUIClient.exe, version 3.1.7.3719, hang module hungapp, version 0.0.0.0, hang address 0x00000000.
The message tab reads thus:
[2/14/2006 11:58:15 AM] Version Check: This Vault client is version 3.1.7.3719
[2/14/2006 11:58:15 AM] Version Check: Your Vault server is version 3.1.6.3658
[2/14/2006 11:58:15 AM] Version Check: SourceGear recommends that the client and server be the same version.
[2/14/2006 12:01:47 PM] Getting latest version of Trunk
[2/14/2006 12:32:23 PM] An exception was encountered during the get latest operation. Exception: The Vault server could not be contacted to perform the operation. Your network connection to the server may have been interrupted. Please verify your network settings using the Options dialog under the Tools menu in the Vault GUI Client.The underlying connection was closed: An unexpected error occurred on a receive.
Below are all the lines that mention the client login (releng) from the log (from the server under windows/temp/sgvault.log). Not that there are no further messages after the pair (at bottom) that seem to say the file down load has started.
----2/14/2006 11:58:13 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled Login
----2/14/2006 11:58:13 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetUserOptions returned: Success
----2/14/2006 11:58:13 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetRepositories returned: Success
----2/14/2006 11:58:14 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetUserList returned: Success
----2/14/2006 11:58:14 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled Getting repository Structure-> Rep ID: 1 Base: 146831 Target: -1
----2/14/2006 11:58:14 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146833
----2/14/2006 11:58:14 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:23 RepID:1 Base:146831 Target:146833 Calling VaultTreeManager.GetRepositoryDelta() - db tree diff.
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetRepositoryStructure returned: Success
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled Getting list of checkout changes.
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146833
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled VaultServiceAPI::GetCheckoutListChanges() Status:0 UserID:23 RepID:1 FolderSecurity:False BaseList:178703 Target List:178723 RefreshFlag:False
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetCheckOutListChanges returned: Success
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetUserEmailOptions returned Success
----2/14/2006 11:58:33 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146833
----2/14/2006 11:58:39 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled ListWatchers returned Success
----2/14/2006 11:58:39 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled ListCloakedObjects returned: Success
----2/14/2006 11:58:39 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetRepositoryOptions returned: Success
----2/14/2006 11:58:39 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetRepositories returned: Success
----2/14/2006 11:59:48 AM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146833
----2/14/2006 12:00:07 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled BeginLabelQuery returned: Success
----2/14/2006 12:00:08 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetLabelQueryItems returned: Success
----2/14/2006 12:00:08 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetLabelQueryItems returned: Success
----2/14/2006 12:01:01 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146834
----2/14/2006 12:01:14 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled GetLabelStructure returned: Success
----2/14/2006 12:01:52 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled Beginning label file download
----2/14/2006 12:01:52 PM RelEng--southwind.mathsoft.com(206.34.7.31)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146834
FailInvalidLabelObjID
Moderator: SourceGear
-
FrankArthorDrake
- Posts: 5
- Joined: Fri Feb 10, 2006 4:34 pm
log entries
Arthor - Mathsoft Release Engineer
Arthor:
The server log looks as if the label's structure was transferred, and the client made the first request for downloading labels. However, since no other message was received the files never made it back to the client.
From the looks of this, I'd say there's some sort of Firewall, Proxy Server, or other network interference preventing the client to request the files.
Is there anyway you can try the same command on the server itself using 127.0.0.1 as the server name? If that works correctly, then we know there is something about the network configuration interferring with Vault communications.
The server log looks as if the label's structure was transferred, and the client made the first request for downloading labels. However, since no other message was received the files never made it back to the client.
From the looks of this, I'd say there's some sort of Firewall, Proxy Server, or other network interference preventing the client to request the files.
Is there anyway you can try the same command on the server itself using 127.0.0.1 as the server name? If that works correctly, then we know there is something about the network configuration interferring with Vault communications.
Jeff Clausius
SourceGear
SourceGear
-
FrankArthorDrake
- Posts: 5
- Joined: Fri Feb 10, 2006 4:34 pm
I think i can do that tomorrow ... (I'm at home now - east coast time etc.)
But, note that many of the files *are* downloaded. Not all of them however - hard to say how many are not downloaded - maybe 15% or so.
I'm even able to get from a label if I select a sub folder. This folder was large (many subfolders and files). This suggests that there is no problem with firewall or proxy issues. I will ask our MIS team if anything has changed with our network but note also that I've been able to do this operation on a daily basis till late last week.
I also tested this from another machine with the same results - i.e. I can not get from a label from a top level directory. I.e. I can't get the trunk nor a branch of the trunk.
Both machines have the latest client so I am wondering if the new client has a problem with get from label. Could you verify that my combination of server version and client version work with get-from -label?
-Art
But, note that many of the files *are* downloaded. Not all of them however - hard to say how many are not downloaded - maybe 15% or so.
I'm even able to get from a label if I select a sub folder. This folder was large (many subfolders and files). This suggests that there is no problem with firewall or proxy issues. I will ask our MIS team if anything has changed with our network but note also that I've been able to do this operation on a daily basis till late last week.
I also tested this from another machine with the same results - i.e. I can not get from a label from a top level directory. I.e. I can't get the trunk nor a branch of the trunk.
Both machines have the latest client so I am wondering if the new client has a problem with get from label. Could you verify that my combination of server version and client version work with get-from -label?
-Art
Arthor - Mathsoft Release Engineer
Vault 3.1.7 is a part of our own build system through CC.Net, so the Command Line Client does work retrieving labels.
We'll wait to hear back tomorrow on a local run. That will help determine what circumstances this is happening.
I don't recall, but did you say a GET from within the Vault GUI client on the same label to a non-working folder also fails?
On a final note, can you also check your Vault Server's Windows Event Viewer logs. Is there anything that looks out of the ordinary in there?
We'll wait to hear back tomorrow on a local run. That will help determine what circumstances this is happening.
I don't recall, but did you say a GET from within the Vault GUI client on the same label to a non-working folder also fails?
On a final note, can you also check your Vault Server's Windows Event Viewer logs. Is there anything that looks out of the ordinary in there?
Jeff Clausius
SourceGear
SourceGear
Jeff,
I'm going to try the get label from the server just as a final verification. However it doesn't make sense to be that there is something blocking Get Label traffic and letting Get Latest Version traffic through.
Could this be a problem with 3.1.7 client and 3.1.6 server interaction?
I just did the following on my own computer (not the ones that Art was using).
I'm going to try the get label from the server just as a final verification. However it doesn't make sense to be that there is something blocking Get Label traffic and letting Get Latest Version traffic through.
Could this be a problem with 3.1.7 client and 3.1.6 server interaction?
I just did the following on my own computer (not the ones that Art was using).
- Exited and restarted the Vault 3.1.7 GUI client
- Set the working folder for our Trunk to a directory that doesn't exist, and let Vault create it for me.
- Right-click on the Trunk and Show Labels
- Right-click on a Label and Get Label click OK on dialog
- Vault GUI client takes a while but eventually returns a message about an error and then hangs.
- Kill the Vault GUI client via Task Manager and restart it.
- Right-click on the Trunk and Get Latest Version select Overwrite and click OK.
- Get Latest Version succeeded. There are a large number of entries in the server log.
- The working directory now contains 2.36GB in 39,048 files in 2641 folders
Jeff,
OK get label from the server following those same steps failed in the same way.
Here are the entries for the above from the server log:
I'm not sure if it is relevant but the Working folder state/baseline files are set to be stored in the working folder.
Also note that although the last entry in the server log is at 6:37pm the client didn't report an error until around 7:11pm.
Mike
OK get label from the server following those same steps failed in the same way.
- Started the Vault 3.1.7 GUI client on the Vault Server machine, specifying 127.0.0.1 as the server.
- Set the working folder for our Trunk to a directory that doesn't exist, and let Vault create it for me.
- Right-click on the Trunk and Show Labels
- Right-click on a Label and Get Label click OK on dialog
- Vault GUI client takes a while but eventually returns an error message box Get Latest Version failed for some files. See the Messages window for details.
- Dismiss the error msg and click on the close[X] for the Show Labels windows and the Vault GUI hangs.
Here are the entries for the above from the server log:
Code: Select all
----2/14/2006 6:32:08 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Login
----2/14/2006 6:32:08 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetUserList returned: Success
----2/14/2006 6:32:09 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetUserOptions returned: Success
----2/14/2006 6:32:09 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetRepositories returned: Success
----2/14/2006 6:32:11 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Getting repository Structure-> Rep ID: 1 Base: 146848 Target: -1
----2/14/2006 6:32:11 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146849
----2/14/2006 6:32:11 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:23 RepID:1 Base:146848 Target:146849 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----2/14/2006 6:32:12 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetRepositoryStructure returned: Success
----2/14/2006 6:32:12 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Getting list of checkout changes.
----2/14/2006 6:32:12 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146849
----2/14/2006 6:32:12 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultServiceAPI::GetCheckoutListChanges() Status:0 UserID:23 RepID:1 FolderSecurity:False BaseList:178834 Target List:178838 RefreshFlag:False
----2/14/2006 6:32:12 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetCheckOutListChanges returned: Success
----2/14/2006 6:32:13 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetUserEmailOptions returned Success
----2/14/2006 6:32:13 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146849
----2/14/2006 6:32:53 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled ListWatchers returned Success
----2/14/2006 6:32:53 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled ListCloakedObjects returned: Success
----2/14/2006 6:32:54 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetRepositoryOptions returned: Success
----2/14/2006 6:32:54 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetRepositories returned: Success
----2/14/2006 6:34:03 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146849
----2/14/2006 6:34:08 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled BeginLabelQuery returned: Success
----2/14/2006 6:34:08 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetLabelQueryItems returned: Success
----2/14/2006 6:34:09 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetLabelQueryItems returned: Success
----2/14/2006 6:34:31 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146849
----2/14/2006 6:36:22 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetLabelStructure returned: Success
----2/14/2006 6:37:19 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Beginning label file download
----2/14/2006 6:37:19 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 146849
Also note that although the last entry in the server log is at 6:37pm the client didn't report an error until around 7:11pm.
Mike
Mike:
There have been no reports of mis-match of client / server versions that would describe this.
The server logs are not very helpful. One thing that is weird, I don't see any VaultFileDownload.aspx messages. I'm assuming the server is in Debug log mode.
Let's try this from a different angle. Can you try something else?
There have been no reports of mis-match of client / server versions that would describe this.
The server logs are not very helpful. One thing that is weird, I don't see any VaultFileDownload.aspx messages. I'm assuming the server is in Debug log mode.
Let's try this from a different angle. Can you try something else?
- Set up Client Side Logging for all classes
- Start the Vault GUI Client
- Show the Label
- Get the Label
Jeff Clausius
SourceGear
SourceGear
Mike, Jeff asked me to step in here.
Be sure the Vault log is in debug mode, then try Jeff's suggestions.
Be sure the Vault log is in debug mode, then try Jeff's suggestions.
- Set up Client Side Logging for all classes
- Start the Vault GUI Client
- Show the Label
- Get the Label
Linda Bauer
SourceGear
Technical Support Manager
SourceGear
Technical Support Manager
Linda,
The server has had debug logging on this whole time (if you wanted to see a sample of the huge number of entries for Get Latest Version I can post them). I've just started the test with the client set up to log everything. I'll extract the bottom of the server log, and zip it along with the client log and send it to you.
Mike
ps I figured I might as well run this test again using the client on the Vault server machine, connecting to 127.0.0.1
The server has had debug logging on this whole time (if you wanted to see a sample of the huge number of entries for Get Latest Version I can post them). I've just started the test with the client set up to log everything. I'll extract the bottom of the server log, and zip it along with the client log and send it to you.
Mike
ps I figured I might as well run this test again using the client on the Vault server machine, connecting to 127.0.0.1
For those following this topic:
Linda and I have been trying different things and I've been sending lots of log files, but nothing has helped.
Today, I decided to test the theory that there were 2 issues, the 1st Art encountered with the old client, and the 2nd with the new client. And that the issue with the old client was fixed by Linda's original suggestion of clearing the cache files.
I checked with Art and the client he had originally been using before ugrading to 3.1.7 was 3.1.2. This old client had been working fine with our 3.1.6 Vault server.
So I uninstalled 3.1.7 and installed 3.1.2. And then I ran the same test that has been failing. A Get Label of our Trunk into a brand new directory that is also the working folder (I don't think the fact that it is the working folder is relevant, but that's what I'd been doing).
It worked! You can see the server log entries here showing that it took about 4 minutes before the server started sending back responses, which isn't close to the old 30 minute (1800 sec) IIS connection timeout, much less the 1 hour timeout I bumped it to. The entire process seemed to take approximately 20 minutes.
Linda,
I'm emailing you these log files, in the hopes that it may help you and Jeff figure out why the 3.1.2 client is working and the 3.1.7 client is not. (I haven't tried the 3.1.6 client.)
Mike
Linda and I have been trying different things and I've been sending lots of log files, but nothing has helped.
Today, I decided to test the theory that there were 2 issues, the 1st Art encountered with the old client, and the 2nd with the new client. And that the issue with the old client was fixed by Linda's original suggestion of clearing the cache files.
I checked with Art and the client he had originally been using before ugrading to 3.1.7 was 3.1.2. This old client had been working fine with our 3.1.6 Vault server.
So I uninstalled 3.1.7 and installed 3.1.2. And then I ran the same test that has been failing. A Get Label of our Trunk into a brand new directory that is also the working folder (I don't think the fact that it is the working folder is relevant, but that's what I'd been doing).
It worked! You can see the server log entries here showing that it took about 4 minutes before the server started sending back responses, which isn't close to the old 30 minute (1800 sec) IIS connection timeout, much less the 1 hour timeout I bumped it to. The entire process seemed to take approximately 20 minutes.
Code: Select all
----2/21/2006 12:05:24 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Beginning label file download
----2/21/2006 12:05:24 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 147087
[color=darkblue]...entries for other users here[/color]
----2/21/2006 12:09:26 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultLib.VaultRequestGetFile returned: SuccessRequireFileDownload
----2/21/2006 12:09:26 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultLib.VaultRequestGetFile returned: SuccessRequireFileDownload
[color=darkblue]... more of the above[/color]
----2/21/2006 12:09:27 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultLib.VaultRequestGetFile returned: SuccessRequireFileDownload
----2/21/2006 12:09:27 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled BeginDownloadLabelFiles returned: Success
----2/21/2006 12:09:52 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultFileDownload starting
----2/21/2006 12:09:52 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Downloading delta for Trunk/mpl/mpl.vssscc from 0 to 1035376
[color=darkblue]... more of the above[/color]
----2/21/2006 12:23:55 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Downloading delta for Trunk/Documentation/ResourceCenter/JP/qsheet/references/Calculus/trigident.xmcd from 0 to 1435609
----2/21/2006 12:23:55 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetLatest wrote 6922403 bytes to the Response Stream
----2/21/2006 12:23:55 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Ending download process
----2/21/2006 12:23:55 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled EndDownloadProcess returned: Success
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Getting repository Structure-> Rep ID: 1 Base: 147087 Target: -1
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 147088
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultServiceAPI::GetRepositoryTreeDelta() UserID:23 RepID:1 Base:147087 Target:147088 Calling VaultRepUtil.DiffRepTrees() - in-memory tree diff.
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetRepositoryStructure returned: Success
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled Getting list of checkout changes.
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled TreeManager: cache matches repository revision and folder security hasn't changed. Returning cached tree, revID 147088
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled VaultServiceAPI::GetCheckoutListChanges() Status:0 UserID:23 RepID:1 FolderSecurity:False BaseList:180082 Target List:180088 RefreshFlag:False
----2/21/2006 12:24:04 PM RelEng--locker.mathsoft.com(127.0.0.1)--SSL Disabled GetCheckOutListChanges returned: SuccessI'm emailing you these log files, in the hopes that it may help you and Jeff figure out why the 3.1.2 client is working and the 3.1.7 client is not. (I haven't tried the 3.1.6 client.)
Mike