Connection reset by peer error

[bethrusnak]

One of my users is getting the following error (don't know if others are or not as not that many use the service). It started recently, perhaps after Linux patches. Running on python 3.8 and on 3.9

ValueError: Error downloading Sammons_7042/210606_A00201R_0418_AHFFHTDRXY/Data/Intensities/BaseCalls/L001/C2.1/L001_2.cbcl
('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer'))

[johnbradley]

@bethrusnak I think this error is due to a networking problem connecting to the backing DHTS S3 data store. There is a service now ticket looking into fixing this networking problem. Once the networking problem is fixed your users should be able to download again.

[bethrusnak]

Thanks so much John! Will you let me know when it is fixed? From: John Bradley ***@***.***> Sent: Monday, June 21, 2021 12:48 PM To: Duke-GCB/DukeDSClient ***@***.***> Cc: Beth Rusnak ***@***.***>; Mention ***@***.***> Subject: Re: [Duke-GCB/DukeDSClient] Connection reset by peer error (#330) @bethrusnak<https://urldefense.com/v3/__https:/github.com/bethrusnak__;!!OToaGQ!8OlE0SqWZ_N28dnYb_dtgbN1HceCF_ANwWtFuoc3sLdYLLsmltG3qUukdkItGex73c8$> I think this error is due to a networking problem connecting to the backing DHTS S3 data store. There is a service now ticket looking into fixing this networking problem. Once the networking problem is fixed your users should be able to download again. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://urldefense.com/v3/__https:/github.com/Duke-GCB/DukeDSClient/issues/330*issuecomment-865188381__;Iw!!OToaGQ!8OlE0SqWZ_N28dnYb_dtgbN1HceCF_ANwWtFuoc3sLdYLLsmltG3qUukdkItb91oZHE$>, or unsubscribe<https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/ADVDM32RAIBCMQJLIMAVPP3TT5ULVANCNFSM47B5CNZQ__;!!OToaGQ!8OlE0SqWZ_N28dnYb_dtgbN1HceCF_ANwWtFuoc3sLdYLLsmltG3qUukdkItEgVhGLg$>.

[johnbradley]

Thanks so much John! Will you let me know when it is fixed?

Will do @bethrusnak

[johnbradley]

@bethrusnak I just received word that the networking problem has been fixed and DDS should be working fine again.
Please let me know if your users are still experiencing this issue. Thanks.

[bethrusnak]

Thanks John. My user had success downloading yesterday, although he said it was slow. From: John Bradley ***@***.***> Sent: Wednesday, June 23, 2021 12:06 PM To: Duke-GCB/DukeDSClient ***@***.***> Cc: Beth Rusnak ***@***.***>; Mention ***@***.***> Subject: Re: [Duke-GCB/DukeDSClient] Connection reset by peer error (#330) @bethrusnak<https://urldefense.com/v3/__https:/github.com/bethrusnak__;!!OToaGQ!8qR4QuXhO4hjuIJCm2eIM67KpDj7jClWcs1MdPIHb8KDPEeM3d2BlUYQjOGJW4KF8Ro$> I just received word that the networking problem has been fixed and DDS should be working fine again. Please let me know if your users are still experiencing this issue. Thanks. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://urldefense.com/v3/__https:/github.com/Duke-GCB/DukeDSClient/issues/330*issuecomment-866970184__;Iw!!OToaGQ!8qR4QuXhO4hjuIJCm2eIM67KpDj7jClWcs1MdPIHb8KDPEeM3d2BlUYQjOGJs_1_4a4$>, or unsubscribe<https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/ADVDM36P4ORXKLAJKDNCSPTTUIBAJANCNFSM47B5CNZQ__;!!OToaGQ!8qR4QuXhO4hjuIJCm2eIM67KpDj7jClWcs1MdPIHb8KDPEeM3d2BlUYQjOGJtB5fDc8$>.

[johnbradley]

@bethrusnak The problem was an overloaded intermediate server and DHTS has been working on getting the load down.
It should be faster now. I was seeing 70 MB/s downloading on HARDAC and 40 MB/s downloading on DCC earlier today.

[corinnestrawser]

I've been having this issue as well. Is there a work-around? Has anyone else been struggling with this again?

[johnbradley]

@cnhaines01 Are you consistently able to reproduce this problem or is it sporadic? Are you using a wired network connection? We have been seeing many intermittent problems lately with the DDS API servers. The DDS API servers have been scaled back. So setting the number of workers to use when uploading or downloading to say 4 or 2 may help. To do so update the upload or download workers in your .ddsclient config file. Please see the documentation for the upload_workers and download_workers settings.

[corinnestrawser]

It's been consistent. I was not using a wired network connection. I will try your suggestion- thank you!