Vault suddenly stopped working

[dangibson]

Windows 2003 R2
Vault 5.1.1.19215

I just posted this but I can see it in the forum so I'm reposting.

I installed Vault on 11 January 2011. Today (February 10) it suddenly stopped working.

It is no longer writing to the sgvault.log file. I've included the last entry below.

I've tried uninstalling, removing the sql databases, reinstalling (as aspnet/network service). It recreates the databases but I can't access the admin website - it just times out. I can't access vaultservice.asmx either - it times out also.

SQL Profiler shows no Vault activity.

I'm not sure why it is not writing to the sgvault.log file. I've deleted it to see if it would create a new one but it hasn't.

I don't know what to do next - please help.

----9/02/2011 5:44:58 PM --()-- System.Data.SqlClient.SqlException: A transport-level error has occurred when sending the request to the server. (provider: Shared Memory Provider, error: 0 - No process is on the other end of the pipe.)
at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.WriteSni()
at System.Data.SqlClient.TdsParserStateObject.WritePacket(Byte flushMode)
at System.Data.SqlClient.TdsParser.TdsExecuteTransactionManagerRequest(Byte[] buffer, TransactionManagerRequestType request, String transactionName, TransactionManagerIsolationLevel isoLevel, Int32 timeout, SqlInternalTransaction transaction, TdsParserStateObject stateObj, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransaction(TransactionRequest transactionRequest, String name, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnection.BeginSqlTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParserStateObject.WriteSni()
at System.Data.SqlClient.TdsParserStateObject.WritePacket(Byte flushMode)
at System.Data.SqlClient.TdsParser.TdsExecuteTransactionManagerRequest(Byte[] buffer, TransactionManagerRequestType request, String transactionName, TransactionManagerIsolationLevel isoLevel, Int32 timeout, SqlInternalTransaction transaction, TdsParserStateObject stateObj, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransactionYukon(TransactionRequest transactionRequest, String transactionName, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnectionTds.ExecuteTransaction(TransactionRequest transactionRequest, String name, IsolationLevel iso, SqlInternalTransaction internalTransaction, Boolean isDelegateControlRequest)
at System.Data.SqlClient.SqlInternalConnection.BeginSqlTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:44:58 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 1.
----9/02/2011 5:44:58 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:44:58 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 2.
----9/02/2011 5:44:59 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:44:59 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 3.
----9/02/2011 5:44:59 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:44:59 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 4.
----9/02/2011 5:45:00 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:45:00 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 5.
----9/02/2011 5:45:00 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:45:00 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 6.
----9/02/2011 5:45:01 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:45:01 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 7.
----9/02/2011 5:45:01 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:45:01 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 8.
----9/02/2011 5:45:02 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:45:02 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 9.
----9/02/2011 5:45:02 PM --()-- System.InvalidOperationException: Invalid operation. The connection is closed.
at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel) at System.Data.SqlClient.SqlConnection.GetOpenConnection()
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso, String transactionName)
at System.Data.SqlClient.SqlConnection.BeginTransaction(IsolationLevel iso)
at VaultServiceSQL.VaultSqlConn.BeginTransaction(IsolationLevel isolationlevel)
----9/02/2011 5:45:02 PM --()-- An error occurred deleting the session, eqviahvhp4k5vf45b32ltf45. Trying again - attempt 10.
----9/02/2011 5:45:03 PM --()-- An error occurred during the deletion of session, eqviahvhp4k5vf45b32ltf45. Please check that the session was removed from sgvault.dbo.tblsession in the database. Error: FailDBTransaction
----9/02/2011 5:45:12 PM --()-- Vault Failed to establish a connection to the database.
----9/02/2011 5:45:12 PM --()-- System.Data.SqlClient.SqlException: A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server)
at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Connect(ServerInfo serverInfo, SqlInternalConnectionTds connHandler, Boolean ignoreSniOpenTimeout, Int64 timerExpire, Boolean encrypt, Boolean trustServerCert, Boolean integratedSecurity, SqlConnection owningObject)
at System.Data.SqlClient.SqlInternalConnectionTds.AttemptOneLogin(ServerInfo serverInfo, String newPassword, Boolean ignoreSniOpenTimeout, Int64 timerExpire, SqlConnection owningObject)
at System.Data.SqlClient.SqlInternalConnectionTds.LoginNoFailover(String host, String newPassword, Boolean redirectedUserInstance, SqlConnection owningObject, SqlConnectionString connectionOptions, Int64 timerStart)
at System.Data.SqlClient.SqlInternalConnectionTds.OpenLoginEnlist(SqlConnection owningObject, SqlConnectionString connectionOptions, String newPassword, Boolean redirectedUserInstance)
at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, Object providerInfo, String newPassword, SqlConnection owningObject, Boolean redirectedUserInstance)
at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection)
at System.Data.ProviderBase.DbConnectionFactory.CreatePooledConnection(DbConnection owningConnection, DbConnectionPool pool, DbConnectionOptions options)
at System.Data.ProviderBase.DbConnectionPool.CreateObject(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionPool.UserCreateRequest(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionPool.GetConnection(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionFactory.GetConnection(DbConnection owningConnection)
at System.Data.ProviderBase.DbConnectionClosed.OpenConnection(DbConnection outerConnection, DbConnectionFactory connectionFactory)
at System.Data.SqlClient.SqlConnection.Open()
at VaultServiceSQL.VaultSqlConn.OpenConn()
at VaultServiceAPILib.VaultServiceAPISystem.GetOpenSqlConn(VaultSqlConn& conn) at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection)
at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj)
at System.Data.SqlClient.TdsParser.Connect(ServerInfo serverInfo, SqlInternalConnectionTds connHandler, Boolean ignoreSniOpenTimeout, Int64 timerExpire, Boolean encrypt, Boolean trustServerCert, Boolean integratedSecurity, SqlConnection owningObject)
at System.Data.SqlClient.SqlInternalConnectionTds.AttemptOneLogin(ServerInfo serverInfo, String newPassword, Boolean ignoreSniOpenTimeout, Int64 timerExpire, SqlConnection owningObject)
at System.Data.SqlClient.SqlInternalConnectionTds.LoginNoFailover(String host, String newPassword, Boolean redirectedUserInstance, SqlConnection owningObject, SqlConnectionString connectionOptions, Int64 timerStart)
at System.Data.SqlClient.SqlInternalConnectionTds.OpenLoginEnlist(SqlConnection owningObject, SqlConnectionString connectionOptions, String newPassword, Boolean redirectedUserInstance)
at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, Object providerInfo, String newPassword, SqlConnection owningObject, Boolean redirectedUserInstance)
at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection)
at System.Data.ProviderBase.DbConnectionFactory.CreatePooledConnection(DbConnection owningConnection, DbConnectionPool pool, DbConnectionOptions options)
at System.Data.ProviderBase.DbConnectionPool.CreateObject(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionPool.UserCreateRequest(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionPool.GetConnection(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionFactory.GetConnection(DbConnection owningConnection)
at System.Data.ProviderBase.DbConnectionClosed.OpenConnection(DbConnection outerConnection, DbConnectionFactory connectionFactory)
at System.Data.SqlClient.SqlConnection.Open()
at VaultServiceSQL.VaultSqlConn.OpenConn()
at VaultServiceAPILib.VaultServiceAPISystem.GetOpenSqlConn(VaultSqlConn& conn)
----9/02/2011 5:45:12 PM --()-- The connection to the database failed for VaultServiceAPI.Logout: FailDBConn

[lbauer]

What version of SQL Server are you using?

Is SQL Server running?

Did something change -- was there a Windows Update or a configuration change?

When you reinstalled, did you have existing databases, or did the installer create new databases?

[dangibson]

Yes SQL Server is running (SQL Server 2005). Other apps are running and can access it.

I removed the databases from SQL and reinstalled and it recreated the sql databases ok, but it still wasn't working (vaultservice.asmx just times out etc).

The server was rebooted so windows updates may have been applied.

Do you know why it wouldn't be updating the sgvault.log file?

[lbauer]

If Vault Server isn't working at all, then it has nothing to log. Or it doesn't log if it's not installed properly.

I'd suggest we schedule a remote assist session where I can take a closer look and we'll set something up. Contact me at support at sourcegear.com, Attn: Linda. Please include a link to this forum post.