[2026-01-13 15:35:33,871][ INFO][PID:3871124] Marking build as starting [2026-01-13 15:35:34,052][ INFO][PID:3871124] Checking that /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/repodata/repomd.xml exists [2026-01-13 15:35:34,081][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:35:34,084][ INFO][PID:3871124] VM allocation process starts [2026-01-13 15:35:34,117][ INFO][PID:3871124] Trying to allocate VM: ResallocHost, ticket_id=794997, requested_tags=['copr_builder', 'arch_i386'] [2026-01-13 15:35:37,160][ INFO][PID:3871124] Allocated host ResallocHost, ticket_id=794997, hostname=18.205.38.240, name=aws_x86_64_spot_prod_01193325_20260113_152428, requested_tags=['copr_builder', 'arch_i386'] [2026-01-13 15:35:37,160][ INFO][PID:3871124] Allocating ssh connection to builder [2026-01-13 15:35:37,161][ INFO][PID:3871124] Checking that builder machine is OK [2026-01-13 15:36:37,232][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 18.205.38.240 port 22: Connection timed out [2026-01-13 15:36:47,236][ ERROR][PID:3871124] Re-try request for task on 'ResallocHost, ticket_id=794997, hostname=18.205.38.240, name=aws_x86_64_spot_prod_01193325_20260113_152428, requested_tags=['copr_builder', 'arch_i386']': Unable to finish after 1 SSH attempts [2026-01-13 15:36:47,237][ INFO][PID:3871124] Releasing VM back to pool [2026-01-13 15:36:47,275][ INFO][PID:3871124] Retry #1 (on other host) [2026-01-13 15:36:47,277][ INFO][PID:3871124] Checking that /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/repodata/repomd.xml exists [2026-01-13 15:36:47,278][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:36:47,279][ INFO][PID:3871124] VM allocation process starts [2026-01-13 15:36:47,306][ INFO][PID:3871124] Trying to allocate VM: ResallocHost, ticket_id=795028, requested_tags=['copr_builder', 'arch_i386'] [2026-01-13 15:36:52,307][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:36:57,312][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:02,313][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:05,479][ INFO][PID:3871124] Allocated host ResallocHost, ticket_id=795028, hostname=3.239.76.166, name=aws_x86_64_normal_prod_01193038_20260113_151953, requested_tags=['copr_builder', 'arch_i386'] [2026-01-13 15:37:05,484][ INFO][PID:3871124] Allocating ssh connection to builder [2026-01-13 15:37:05,489][ INFO][PID:3871124] Checking that builder machine is OK [2026-01-13 15:37:05,730][ INFO][PID:3871124] Running remote command: copr-builder-ready fedora-rawhide-i386 [2026-01-13 15:37:05,943][ INFO][PID:3871124] Red Hat subscription not needed for fedora-rawhide-i386 Builder is ready to be used [2026-01-13 15:37:05,944][ INFO][PID:3871124] Filling build.info file with builder info [2026-01-13 15:37:05,945][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:05,946][ INFO][PID:3871124] Not re-notifying FE and msg buses for the new host. [2026-01-13 15:37:05,947][ INFO][PID:3871124] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10004219-fedora-rawhide-i386 --chroot fedora-rawhide-i386 --detached [2026-01-13 15:37:06,301][ INFO][PID:3871124] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.239.76.166' (ED25519) to the list of known hosts. [2026-01-13 15:37:06,302][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 1 [2026-01-13 15:37:06,306][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.239.76.166 copr-rpmbuild-log [2026-01-13 15:37:11,324][ INFO][PID:3871124] Periodic builder liveness probe: alive [2026-01-13 15:37:11,328][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:16,333][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:21,343][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:26,345][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:31,346][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:36,355][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:41,357][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:46,359][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:51,360][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:37:56,362][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:01,365][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:06,370][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:11,372][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:16,374][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:21,378][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:26,379][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:31,383][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:36,387][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:41,396][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:46,398][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:51,400][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:38:56,403][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:01,405][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:06,407][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:11,408][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:16,409][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:21,414][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:26,416][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:31,419][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:36,421][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:41,423][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:46,425][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:51,426][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:39:56,437][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:01,444][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:06,451][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:11,453][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:16,457][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:21,459][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:26,463][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:31,466][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:36,468][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:41,469][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:46,472][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:51,473][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:40:56,477][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:01,478][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:06,483][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:10,457][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:41:11,485][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:16,487][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:20,458][WARNING][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-13 15:41:21,489][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:26,490][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:30,459][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 2 [2026-01-13 15:41:30,461][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.239.76.166 copr-rpmbuild-log [2026-01-13 15:41:31,491][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:36,492][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:41,494][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:46,497][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:51,498][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:41:56,500][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:01,501][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:06,502][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:11,504][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:16,507][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:21,512][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:26,513][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:30,529][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:42:31,515][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:36,516][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:40,534][WARNING][PID:3871124] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-13 15:42:41,517][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:46,518][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:50,535][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 3 [2026-01-13 15:42:50,539][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.239.76.166 copr-rpmbuild-log [2026-01-13 15:42:51,519][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:42:56,521][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:01,522][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:06,523][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:11,525][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:16,531][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:21,533][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:26,535][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:31,537][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:36,539][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:41,541][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:46,542][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:50,616][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:43:51,544][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:43:56,545][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:00,621][WARNING][PID:3871124] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-13 15:44:01,547][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:06,548][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:10,622][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 4 [2026-01-13 15:44:10,623][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.239.76.166 copr-rpmbuild-log [2026-01-13 15:44:11,549][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:16,550][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:21,551][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:26,552][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:31,553][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:36,554][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:41,556][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:46,559][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:51,560][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:44:56,561][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:01,564][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:06,565][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:10,677][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:45:11,566][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:16,567][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:20,689][ ERROR][PID:3871124] Giving up for unstable SSH, failures: 1768318880.4585426, 1768318960.5341725, 1768319040.6213686, 1768319120.689653 [2026-01-13 15:45:20,690][ ERROR][PID:3871124] Re-try request for task on 'ResallocHost, ticket_id=795028, hostname=3.239.76.166, name=aws_x86_64_normal_prod_01193038_20260113_151953, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-13 15:45:20,691][ INFO][PID:3871124] Releasing VM back to pool [2026-01-13 15:45:20,708][ INFO][PID:3871124] Retry #2 (on other host) [2026-01-13 15:45:20,709][ INFO][PID:3871124] Checking that /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/repodata/repomd.xml exists [2026-01-13 15:45:20,710][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:20,710][ INFO][PID:3871124] VM allocation process starts [2026-01-13 15:45:20,725][ INFO][PID:3871124] Trying to allocate VM: ResallocHost, ticket_id=795170, requested_tags=['copr_builder', 'arch_i386'] [2026-01-13 15:45:23,743][ INFO][PID:3871124] Allocated host ResallocHost, ticket_id=795170, hostname=3.234.252.91, name=aws_x86_64_normal_prod_01194340_20260113_153856, requested_tags=['copr_builder', 'arch_i386'] [2026-01-13 15:45:23,743][ INFO][PID:3871124] Allocating ssh connection to builder [2026-01-13 15:45:23,744][ INFO][PID:3871124] Checking that builder machine is OK [2026-01-13 15:45:24,098][ INFO][PID:3871124] Running remote command: copr-builder-ready fedora-rawhide-i386 [2026-01-13 15:45:24,315][ INFO][PID:3871124] Red Hat subscription not needed for fedora-rawhide-i386 Builder is ready to be used [2026-01-13 15:45:24,316][ INFO][PID:3871124] Filling build.info file with builder info [2026-01-13 15:45:24,328][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:24,331][ INFO][PID:3871124] Not re-notifying FE and msg buses for the new host. [2026-01-13 15:45:24,331][ INFO][PID:3871124] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10004219-fedora-rawhide-i386 --chroot fedora-rawhide-i386 --detached [2026-01-13 15:45:24,723][ INFO][PID:3871124] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.234.252.91' (ED25519) to the list of known hosts. [2026-01-13 15:45:24,724][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 1 [2026-01-13 15:45:24,725][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.234.252.91 copr-rpmbuild-log [2026-01-13 15:45:29,724][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:34,726][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:39,727][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:44,728][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:49,729][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:54,736][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:45:59,740][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:04,741][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:09,744][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:14,746][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:19,747][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:24,748][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:29,749][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:34,750][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:39,752][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:44,753][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:49,754][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:54,755][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:46:59,757][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:04,758][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:09,761][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:14,772][ INFO][PID:3871124] Periodic builder liveness probe: alive [2026-01-13 15:47:14,772][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:19,773][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:24,775][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:29,777][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:34,778][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:39,779][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:44,781][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:49,782][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:54,783][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:47:59,784][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:04,936][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:09,937][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:12,698][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:48:14,938][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:19,940][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:22,724][WARNING][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-13 15:48:24,942][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:29,944][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:32,726][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 2 [2026-01-13 15:48:32,728][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.234.252.91 copr-rpmbuild-log [2026-01-13 15:48:34,945][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:39,946][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:44,947][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:50,254][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:48:55,256][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:00,257][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:05,258][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:10,259][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:15,263][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:20,265][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:25,266][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:30,267][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:32,796][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:49:35,268][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:40,535][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:42,812][WARNING][PID:3871124] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-13 15:49:45,538][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:50,539][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:49:52,813][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 3 [2026-01-13 15:49:52,814][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.234.252.91 copr-rpmbuild-log [2026-01-13 15:49:55,541][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:00,542][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:05,544][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:10,545][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:15,546][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:20,649][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:25,682][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:30,824][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:35,825][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:41,028][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:46,030][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:51,034][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:50:52,881][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:50:56,037][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:01,039][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:02,888][WARNING][PID:3871124] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-13 15:51:06,040][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:11,042][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:12,888][ INFO][PID:3871124] Downloading the builder-live.log file, attempt 4 [2026-01-13 15:51:12,890][ INFO][PID:3871124] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.234.252.91 copr-rpmbuild-log [2026-01-13 15:51:16,049][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:21,054][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:26,056][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:31,058][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:36,062][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:41,063][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:46,064][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:51,066][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:51:56,068][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:52:01,069][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:52:06,075][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:52:11,097][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:52:12,960][ ERROR][PID:3871124] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-13 15:52:16,099][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:52:21,101][ INFO][PID:3871124] Checking for cancel request [2026-01-13 15:52:22,976][ ERROR][PID:3871124] Giving up for unstable SSH, failures: 1768319302.7248628, 1768319382.8122833, 1768319462.8882287, 1768319542.9766924 [2026-01-13 15:52:22,978][ ERROR][PID:3871124] Re-try request for task on 'ResallocHost, ticket_id=795170, hostname=3.234.252.91, name=aws_x86_64_normal_prod_01194340_20260113_153856, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-13 15:52:22,979][ INFO][PID:3871124] Releasing VM back to pool [2026-01-13 15:52:22,989][ ERROR][PID:3871124] Backend process error: Three host tried without success: {'3.234.252.91', '18.205.38.240', '3.239.76.166'} [2026-01-13 15:52:22,989][WARNING][PID:3871124] Switching not-finished job state to 'failed' [2026-01-13 15:52:22,990][ INFO][PID:3871124] Worker failed build, took 418.65875005722046 [2026-01-13 15:52:22,990][ INFO][PID:3871124] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "goddabrouquita8280", "project_name": "pythhon2", "project_dirname": "pythhon2", "submitter": "https://src.fedoraproject.org/user/churchyard", "ended_on": 1768319542.989768, "started_on": 1768319124.331018, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-i386", "arch": "i386", "buildroot_pkgs": [], "task_id": "10004219-fedora-rawhide-i386", "build_id": 10004219, "package_name": "python3.10", "package_version": "3.10.19-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/goddabrouquita8280/pythhon2/python3.10", "git_hash": "a20fa8cbb2d2d6cff39923c2148c3bb807962f1d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "goddabrouquita8280/pythhon2--https://src.fedoraproject.org/user/churchyard", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/goddabrouquita8280/pythhon2", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/goddabrouquita8280/pythhon2", "result_dir": "10004219-python3.10", "built_packages": "", "id": 10004219, "mockchain_macros": { "copr_username": "goddabrouquita8280", "copr_projectname": "pythhon2", "vendor": "Fedora Project COPR (goddabrouquita8280/pythhon2)" } } ] } [2026-01-13 15:52:23,051][ INFO][PID:3871124] Sending fedora-messaging bus message in build.end [2026-01-13 15:52:23,669][ INFO][PID:3871124] Compressing /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/10004219-python3.10/builder-live.log by gzip [2026-01-13 15:52:23,671][ INFO][PID:3871124] Running command 'gzip /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/10004219-python3.10/builder-live.log' as PID 4004596 [2026-01-13 15:52:23,672][ INFO][PID:3871124] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/10004219-python3.10/builder-live.log) [2026-01-13 15:52:23,673][ INFO][PID:3871124] Compressing /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/10004219-python3.10/backend.log by gzip [2026-01-13 15:52:23,674][ INFO][PID:3871124] Running command 'gzip /var/lib/copr/public_html/results/goddabrouquita8280/pythhon2/fedora-rawhide-i386/10004219-python3.10/backend.log' as PID 4004597