2024-06-28 20:07:38,951 - DEBUG - ya.test - __init__: Reading variables from env_file at /home/github/.ya/build/build_root/cdf0/000dda/cloud/filestore/tests/fs_posix_compliance/qemu-kikimr-nemesis-test/test-results/py3test/chunk0/env.json.txt 2024-06-28 20:07:38,952 - DEBUG - ya.test - __init__: Variables loaded: ['KIKIMR_ROOT', 'KIKIMR_SERVER_PORT', 'NFS_SERVER_PORT', 'NFS_MON_PORT', 'NFS_DOMAIN', 'NFS_CONFIG_DIR', 'NFS_VHOST_ENDPOINT_STORAGE_DIR', 'QEMU_SET_READY_FLAG', 'NFS_VHOST_PORT', 'NFS_VHOST_SOCKET', 'VIRTIOFS_SOCKET_source_path', 'VIRTIOFS_PID_source_path', 'VIRTIOFS_SOCKET_build_path', 'VIRTIOFS_PID_build_path', 'VIRTIOFS_SOCKET_toolchain', 'VIRTIOFS_PID_toolchain', 'QEMU_SSH_KEY', 'QEMU_FORWARDING_PORT', 'TEST_ENV_WRAPPER', 'TEST_COMMAND_WRAPPER'] 2024-06-28 20:07:38,952 - DEBUG - ya.test - get_binary: Binary was found by /home/github/.ya/build/build_root/cdf0/000dda/cloud/filestore/apps/client/filestore-client 2024-06-28 20:07:38,952 - INFO - cloud.filestore.tests.python.lib.client - stop_endpoint: stopping endpoint: /home/github/.ya/build/build_root/cdf0/000dda/cloud/filestore/apps/client/filestore-client stopendpoint --socket-path /tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae --server-address localhost --server-port 7052 --verbose trace 2024-06-28 20:07:38,955 - DEBUG - ya.test - execute: Executing '['/home/github/.ya/build/build_root/cdf0/000dda/cloud/filestore/apps/client/filestore-client', 'stopendpoint', '--socket-path', '/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae', '--server-address', 'localhost', '--server-port', '7052', '--verbose', 'trace']' in 'None' (waiting) 2024-06-28 20:07:38,956 - DEBUG - ya.test - execute: Command pid: 250926 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) rc: 1 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) elapsed time (sec): 616.5393273830414 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) idrss: 0 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) inblock: 0 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) isrss: 0 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) ixrss: 0 2024-06-28 20:17:55,496 - DEBUG - ya.test - _save_outputs: Command (pid 250926) majflt: 0 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) maxrss: 88816 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) minflt: 1399 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) msgrcv: 0 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) msgsnd: 0 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) nivcsw: 5 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) nsignals: 0 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) nswap: 0 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) nvcsw: 5536 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) oublock: 272 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) stime: 0.08223899999999999 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) utime: 0.197481 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) wtime: 616.541 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) output: 2024-06-28 20:17:55,497 - DEBUG - ya.test - _save_outputs: Command (pid 250926) errors: 2024-06-28-20-07-38 :NFS_CLIENT INFO: cloud/filestore/libs/client/client.cpp:755: Connect to localhost:7052 2024-06-28-20-07-38 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605258972599 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-08-08 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-08-08 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 1, timeout: 500.000ms, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-08-08 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-08-09 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605289473580 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-08-39 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-08-39 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 2, timeout: 1.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-08-39 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-08-40 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605320474295 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-09-10 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-09-10 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 3, timeout: 1.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-09-10 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-09-11 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605351975246 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-09-41 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-09-41 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 4, timeout: 2.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-09-41 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-09-43 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605383976222 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-10-13 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-10-13 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 5, timeout: 2.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-10-13 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-10-16 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605416477185 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-10-46 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-10-46 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 6, timeout: 3.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-10-46 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-10-49 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605449478164 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-11-19 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-11-19 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 7, timeout: 3.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-11-19 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-11-22 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605482979264 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-11-52 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-11-52 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 8, timeout: 4.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-11-52 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-11-56 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605516980208 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-12-26 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-12-26 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 9, timeout: 4.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-12-26 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-12-31 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605551481283 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-13-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-13-01 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 10, timeout: 5.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-13-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-13-06 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605586482365 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-13-36 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-13-36 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 11, timeout: 5.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-13-36 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-13-41 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605621983252 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-14-11 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-14-11 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 12, timeout: 6.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-14-11 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-14-17 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605657984221 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-14-47 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-14-47 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 13, timeout: 6.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-14-47 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-14-54 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605694485260 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-15-24 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-15-24 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 14, timeout: 7.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-15-24 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-15-31 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605731486270 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-16-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-16-01 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 15, timeout: 7.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-16-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-16-08 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605768987251 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-16-38 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-16-38 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 16, timeout: 8.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-16-38 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-16-46 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605806988222 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-17-16 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-17-16 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 17, timeout: 8.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded) 2024-06-28-20-17-16 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed 2024-06-28-20-17-25 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605845489147 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae" 2024-06-28-20-17-55 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" } 2024-06-28-20-17-55 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed filestore-client "stopendpoint --socket-path /tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae --server-address localhost --server-port 7052 --verbose trace" failed: (NCloud::TServiceError) Retry timeout (2147483662). Deadline Exceededcloud/filestore/apps/client/lib/stop_endpoint.cpp:37: 2024-06-28-20-17-55 :NFS_CLIENT INFO: cloud/filestore/libs/client/client.cpp:630: Shutting down 2024-06-28-20-17-55 :NFS_CLIENT TRACE: cloud/storage/core/libs/grpc/executor.h:113: CLI1 executor's shutdown() started 2024-06-28 20:17:55,498 - ERROR - ya.test - _finalise: Execution failed with exit code: 1 ,std_out:b'' std_err:b'2024-06-28-20-07-38 :NFS_CLIENT INFO: cloud/filestore/libs/client/client.cpp:755: Connect to localhost:7052\n2024-06-28-20-07-38 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605258972599 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-08-08 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-08-08 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 1, timeout: 500.000ms, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-08-08 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-08-09 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605289473580 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-08-39 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-08-39 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 2, timeout: 1.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-08-39 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-08-40 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605320474295 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-09-10 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-09-10 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 3, timeout: 1.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-09-10 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-09-11 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605351975246 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-09-41 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-09-41 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 4, timeout: 2.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-09-41 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-09-43 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605383976222 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-10-13 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-10-13 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 5, timeout: 2.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-10-13 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-10-16 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605416477185 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-10-46 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-10-46 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 6, timeout: 3.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-10-46 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-10-49 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605449478164 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-11-19 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-11-19 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 7, timeout: 3.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-11-19 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-11-22 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605482979264 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-11-52 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-11-52 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 8, timeout: 4.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-11-52 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-11-56 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605516980208 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-12-26 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-12-26 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 9, timeout: 4.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-12-26 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-12-31 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605551481283 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-13-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-13-01 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 10, timeout: 5.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-13-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-13-06 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605586482365 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-13-36 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-13-36 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 11, timeout: 5.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-13-36 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-13-41 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605621983252 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-14-11 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-14-11 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 12, timeout: 6.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-14-11 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-14-17 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605657984221 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-14-47 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-14-47 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 13, timeout: 6.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-14-47 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-14-54 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605694485260 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-15-24 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-15-24 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 14, timeout: 7.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-15-24 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-15-31 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605731486270 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-16-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-16-01 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 15, timeout: 7.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-16-01 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-16-08 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605768987251 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-16-38 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-16-38 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 16, timeout: 8.000s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-16-38 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-16-46 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605806988222 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-17-16 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-17-16 :NFS_CLIENT WARN: cloud/filestore/libs/client/durable.cpp:182: TStopEndpointRequest #10309154574151137 retry request (retries: 17, timeout: 8.500s, error: E_GRPC_DEADLINE_EXCEEDED Deadline Exceeded)\n2024-06-28-20-17-16 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\n2024-06-28-20-17-25 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:294: StopEndpoint #10309154574151137 send request: Headers { Timestamp: 1719605845489147 RequestTimeout: 30000 } SocketPath: "/tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae"\n2024-06-28-20-17-55 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:323: StopEndpoint #10309154574151137 response received: Error { Code: 2147614724 Message: "Deadline Exceeded" }\n2024-06-28-20-17-55 :NFS_CLIENT TRACE: cloud/filestore/libs/client/client.cpp:349: StopEndpoint #10309154574151137 request completed\nfilestore-client "stopendpoint --socket-path /tmp/test.vhost.801769aa-020b-439b-b95e-20b3459155ae --server-address localhost --server-port 7052 --verbose trace" failed: (NCloud::TServiceError) Retry timeout (2147483662). Deadline Exceededcloud/filestore/apps/client/lib/stop_endpoint.cpp:37: \n2024-06-28-20-17-55 :NFS_CLIENT INFO: cloud/filestore/libs/client/client.cpp:630: Shutting down\n2024-06-28-20-17-55 :NFS_CLIENT TRACE: cloud/storage/core/libs/grpc/executor.h:113: CLI1 executor\'s shutdown() started\n'