Various problems this weekend

[Hans Olav Nymand]

Hi,


This weekend, starting Friday 10., we had some issues with our Vault 10.0 server.

We restart the IIS every evening around 23:30 which generally works well, and we did so also Thursday 9th without any problems and the Vault service worked fine after the restart.

However shortly after, at the 10th 00:06 we got this curious message 31 times almost in a row. We do see them from time to time, but rarely, so we are interested in learning what might be the cause in this case.
----10-08-2018 00:06:14 Read_Only--robot15.obfuscated.zz(10.117.69.162)--SSL Enabled System.Data.SqlClient.SqlException (0x80131904): Transaction (Process ID 76) was deadlocked on lock resources with another process and has been chosen as the deadlock victim. Rerun the transaction.
... 29 other istances of the error
----10-08-2018 00:10:13 Read_Only--robot45.obfuscated.zz(10.117.69.103)--SSL Enabled System.Data.SqlClient.SqlException (0x80131904): Transaction (Process ID 105) was deadlocked on lock resources with another process and has been chosen as the deadlock victim. Rerun the transaction.

We can of course provide the log-files.

Whether the other incident is related or not I cannot say, but it also happened this weekend. We got 11099 cases of the "The remote host closed the connection" error (Yes, that's 11 thousand and 99 cases)

First appeared:
----10-08-2018 19:36:05 Read_Only--robot136.obfuscated.zz(10.117.68.39)--SSL Enabled System.Web.HttpException (0x800704CD): The remote host closed the connection. The error code is 0x800704CD.

Last appeared:
----11-08-2018 06:35:38 Read_Only--robot132.obfuscated.zz(10.117.69.87)--SSL Enabled System.Web.HttpException (0x80070079): The remote host closed the connection. The error code is 0x80070079.

In the period from 10-08-2018 00:10 to 10-08-2018 19:36 Vault seems to have worked OK with a lot of people using it simultaneously. Also Friday 10th around 23:30 we restarted the IIS. Related to this we had another weird incident.

----10-08-2018 23:34:11 sgvaultsystem--()-- System Started [This is the start after our scheduled restat]
----10-08-2018 23:41:01 Obfuscated--obfuscated.obfuscated.zz(10.117.21.10)--SSL Enabled System.Data.SqlClient.SqlException (0x80131904): A transport-level error has occurred when receiving results from the server. (provider: TCP Provider, error: 0 - The semaphore timeout period has expired.) ---> System.ComponentModel.Win32Exception (0x80004005): The semaphore timeout period has expired
----10-08-2018 23:41:16 Obfuscated--obfuscated.obfuscated.zz(10.117.21.10)--SSL Enabled Vault Failed to establish a connection to the database.
----10-08-2018 23:41:31 Obfuscated--obfuscated.obfuscated.zz(10.117.21.10)--SSL Enabled Vault Failed to establish a connection to the database.
----10-08-2018 23:41:32 Obfuscated--obfuscated.obfuscated.zz(10.117.21.10)--SSL Enabled System.Data.SqlClient.SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server) ---> System.ComponentModel.Win32Exception (0x80004005): Access is denied
----10-08-2018 23:41:33 --()-- System.Data.SqlClient.SqlException (0x80131904): A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server) ---> System.ComponentModel.Win32Exception (0x80004005): Access is denied
----10-08-2018 23:41:37 sgvaultsystem--()-- System Started [The system did this by itself it seems]

Today, 13-08-2018 Vault works fine and has done so all day (so far)

Again we can of course provide log files.

Best regards, Hans Olav

[Tonya]

Hi Hans,

Thank you for the details. Yes, please send over your Vault Server log to support@sourcegear.com and refer to this forum post.

Tonya Nunn
SourceGear