Vault goes down when running the Advanced Obliterate Client

[dmurty]

We are using Vault 4.1.4 (18402) with MSSQL server 2000 SP4 running on Windows 2003 SP2. When running the Advanced Obliterate Client we get an event 1309 and no one is able to login to vault anymore. We have to restart IIS.

What can we do to prevent this?

Below is the full event details:

Event Type: Warning
Event Source: ASP.NET 2.0.50727.0
Event Category: Web Event
Event ID: 1309
Date: 2/18/2010
Time: 12:20:55 PM
User: N/A
Computer: HSI-DEV-RELEASE
Description:
Event code: 3005
Event message: An unhandled exception has occurred.
Event time: 2/18/2010 12:20:55 PM
Event time (UTC): 2/18/2010 8:20:55 PM
Event ID: 914df7720305440392f9890fcd8799c9
Event sequence: 9998
Event occurrence: 1
Event detail code: 0

Application information:
Application domain: /LM/W3SVC/1/Root/VaultService-1-129109875279553287
Trust level: Full
Application Virtual Path: /VaultService
Application Path: C:\inetpub\wwwroot\VaultService\
Machine name: HSI-DEV-RELEASE

Process information:
Process ID: 6060
Process name: w3wp.exe
Account name: NT AUTHORITY\NETWORK SERVICE

Exception information:
Exception type: InvalidOperationException
Exception message: Request format is unrecognized for URL unexpectedly ending in '/Ping'.

Request information:
Request URL: https://hsi-dev-release.2synergy.local: ... .asmx/Ping
Request path: /VaultService/VaultService.asmx/Ping
User host address: 10.0.0.31
User:
Is authenticated: False
Authentication Type:
Thread account name: NT AUTHORITY\NETWORK SERVICE

Thread information:
Thread ID: 1
Thread account name: NT AUTHORITY\NETWORK SERVICE
Is impersonating: False
Stack trace: at System.Web.Services.Protocols.WebServiceHandlerFactory.CoreGetHandler(Type type, HttpContext context, HttpRequest request, HttpResponse response)
at System.Web.Services.Protocols.WebServiceHandlerFactory.GetHandler(HttpContext context, String verb, String url, String filePath)
at System.Web.HttpApplication.MapHttpHandler(HttpContext context, String requestType, VirtualPath path, String pathTranslated, Boolean useAppConfig)
at System.Web.HttpApplication.MapHandlerExecutionStep.System.Web.HttpApplication.IExecutionStep.Execute()
at System.Web.HttpApplication.ExecuteStep(IExecutionStep step, Boolean& completedSynchronously)

[lbauer]

Are there any errors in the Vault Server log that correspond to the failure? It's possible the operation is timing out or using too many system resources.

[dmurty]

Here is an error the I found in the Vault Server Log:
----2/18/2010 7:37:15 PM admin--hsi-dev-nightly.2synergy.local(10.0.0.230)--SSL Enabled System.Data.SqlClient.SqlException: Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlDataReader.SetMetaData(_SqlMetaDataSet metaData, Boolean moreInfo)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()
at System.Data.SqlClient.SqlDataReader.get_MetaData()
at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)
at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior)
at VaultServiceSQL.VaultSqlSCC.DoGetObjectVersionList(VaultSqlConn conn, Int32 nUserID, Int64 nObjID, Int64 nStartVersion, UInt32 nSortFlag, VaultObjectVersionInfoColl& vrArray)
at VaultServiceSQL.VaultSqlSCC.GetObjectVersionList(VaultSqlConn conn, Int32 nUserID, Int64 nObjID, Int64 nStartVersion, UInt32 nSortFlag, VaultObjectVersionInfoColl& vrArray) at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlDataReader.SetMetaData(_SqlMetaDataSet metaData, Boolean moreInfo)
at System.Data.SqlClient.TdsParser.Run(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj)
at System.Data.SqlClient.SqlDataReader.ConsumeMetaData()
at System.Data.SqlClient.SqlDataReader.get_MetaData()
at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString)
at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, DbAsyncResult result)
at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method)
at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method)
at System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior)
at VaultServiceSQL.VaultSqlSCC.DoGetObjectVersionList(VaultSqlConn conn, Int32 nUserID, Int64 nObjID, Int64 nStartVersion, UInt32 nSortFlag, VaultObjectVersionInfoColl& vrArray)
at VaultServiceSQL.VaultSqlSCC.GetObjectVersionList(VaultSqlConn conn, Int32 nUserID, Int64 nObjID, Int64 nStartVersion, UInt32 nSortFlag, VaultObjectVersionInfoColl& vrArray)

[lbauer]

Looks like SQL Server is timing out. You can increase the timeout value in the Vault.config file in the Vault Service Directory on the Vault Server machine.

Look for this entry in the config file:

<SqlCommandTimeout>360</SqlCommandTimeout>

Make the value larger, like 7200.