➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author vstinner
Recipients David.Edelsohn, cstratak, pablogsal, vstinner, xtreak
Date 2020-08-28.08:32:34
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1598603555.84.0.357238231618.issue41642@roundup.psfhosted.org>
In-reply-to
Content 
> The buildbot server migrated to a new machine and is now behind a load balancer. tcp/80 (buildbot web page, HTTP) and tcp/9020 (used by buildbot workers) are both behind the load balancer.
> (...)
> Buildbot workers have a TCP keepalive option of 1 hour (3600 seconds) by default (...)

Ernest confirmed that there are edge load balancers for the PSF infra in DigitalOcean. He updated the load balancers to offer a full 24 hour timeout on buildbot TCP connections. (Yesterday around 17:30 UTC.)

It seems like it doesn't fix the issue. Example in server logs:

(...)
2020-08-28 08:21:55+0000 [Broker,50831,10.132.169.157] Worker.detached(koobs-freebsd-564d)
2020-08-28 08:23:25+0000 [Broker,50856,10.132.169.157] Worker.detached(koobs-freebsd-564d)
2020-08-28 08:24:55+0000 [Broker,50881,10.132.169.157] Worker.detached(koobs-freebsd-564d)
2020-08-28 08:26:26+0000 [Broker,50906,10.132.169.157] Worker.detached(koobs-freebsd-564d)
2020-08-28 08:27:56+0000 [Broker,50931,10.132.169.156] Worker.detached(koobs-freebsd-564d)
(...)
History
Date User Action Args
2020-08-28 08:32:35vstinnersetrecipients: + vstinner, David.Edelsohn, cstratak, pablogsal, xtreak
2020-08-28 08:32:35vstinnersetmessageid: <1598603555.84.0.357238231618.issue41642@roundup.psfhosted.org>
2020-08-28 08:32:35vstinnerlinkissue41642 messages
2020-08-28 08:32:34vstinnercreate