[2025-11-03 22:19:06,177][ INFO][PID:3479564] Marking build as starting [2025-11-03 22:19:06,814][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:19:06,814][ INFO][PID:3479564] VM allocation process starts [2025-11-03 22:19:06,832][ INFO][PID:3479564] Trying to allocate VM: ResallocHost, ticket_id=6000869, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-03 22:19:11,833][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:19:16,835][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:19:18,871][ INFO][PID:3479564] Allocated host ResallocHost, ticket_id=6000869, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_07806033_20251103_212217, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-03 22:19:18,872][ INFO][PID:3479564] Allocating ssh connection to builder [2025-11-03 22:19:18,873][ INFO][PID:3479564] Checking that builder machine is OK [2025-11-03 22:19:21,025][ INFO][PID:3479564] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-11-03 22:20:21,099][ ERROR][PID:3479564] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c149 port 22: Connection timed out [2025-11-03 22:20:31,100][ ERROR][PID:3479564] Re-try request for task on 'ResallocHost, ticket_id=6000869, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_07806033_20251103_212217, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-11-03 22:20:31,101][ INFO][PID:3479564] Releasing VM back to pool [2025-11-03 22:20:31,109][ INFO][PID:3479564] Retry #1 (on other host) [2025-11-03 22:20:31,110][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:20:31,111][ INFO][PID:3479564] VM allocation process starts [2025-11-03 22:20:31,120][ INFO][PID:3479564] Trying to allocate VM: ResallocHost, ticket_id=6000931, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-03 22:20:34,131][ INFO][PID:3479564] Allocated host ResallocHost, ticket_id=6000931, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_07806301_20251103_213543, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-03 22:20:34,132][ INFO][PID:3479564] Allocating ssh connection to builder [2025-11-03 22:20:34,133][ INFO][PID:3479564] Checking that builder machine is OK [2025-11-03 22:21:34,202][ ERROR][PID:3479564] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14a port 22: Connection timed out [2025-11-03 22:21:44,203][ ERROR][PID:3479564] Re-try request for task on 'ResallocHost, ticket_id=6000931, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_07806301_20251103_213543, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-11-03 22:21:44,203][ INFO][PID:3479564] Releasing VM back to pool [2025-11-03 22:21:44,211][ INFO][PID:3479564] Retry #2 (on other host) [2025-11-03 22:21:44,212][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:21:44,213][ INFO][PID:3479564] VM allocation process starts [2025-11-03 22:21:44,274][ INFO][PID:3479564] Trying to allocate VM: ResallocHost, ticket_id=6000945, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-03 22:21:47,315][ INFO][PID:3479564] Allocated host ResallocHost, ticket_id=6000945, hostname=2620:52:3:1:dead:beef:cafe:c2a3, name=vmhost_p09_01_prod_07805938_20251103_211921, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-03 22:21:47,316][ INFO][PID:3479564] Allocating ssh connection to builder [2025-11-03 22:21:47,316][ INFO][PID:3479564] Checking that builder machine is OK [2025-11-03 22:21:48,092][ INFO][PID:3479564] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-11-03 22:21:48,532][ INFO][PID:3479564] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-11-03 22:21:48,533][ INFO][PID:3479564] Filling build.info file with builder info [2025-11-03 22:21:48,534][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:21:48,534][ INFO][PID:3479564] Not re-notifying FE and msg buses for the new host. [2025-11-03 22:21:48,535][ INFO][PID:3479564] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9762027-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-11-03 22:21:49,233][ INFO][PID:3479564] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c2a3' (ED25519) to the list of known hosts. [2025-11-03 22:21:49,234][ INFO][PID:3479564] Downloading the builder-live.log file, attempt 1 [2025-11-03 22:21:49,236][ INFO][PID:3479564] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c2a3 copr-rpmbuild-log [2025-11-03 22:21:54,240][ INFO][PID:3479564] Periodic builder liveness probe: alive [2025-11-03 22:21:54,241][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:21:59,242][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:04,243][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:09,244][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:14,246][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:19,247][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:24,248][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:29,249][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:34,250][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:39,251][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:44,253][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:49,254][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:54,255][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:22:59,256][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:04,257][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:09,258][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:14,259][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:19,260][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:24,261][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:29,262][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:34,263][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:39,264][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:44,265][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:49,266][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:54,267][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:23:59,269][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:04,271][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:09,273][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:14,274][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:19,275][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:24,276][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:29,277][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:34,278][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:39,279][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:44,280][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:49,283][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:54,284][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:24:59,285][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:04,286][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:09,287][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:14,288][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:19,289][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:24,290][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:29,291][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:34,292][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:39,293][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:44,294][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:49,295][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:54,296][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:25:59,297][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:04,298][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:09,299][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:14,300][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:19,301][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:24,302][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:29,303][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:34,304][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:39,305][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:44,305][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:49,306][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:54,307][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:26:59,309][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:04,310][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:09,311][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:14,312][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:19,313][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:24,314][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:29,315][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:34,316][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:39,317][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:44,318][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:49,319][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:54,320][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:27:59,321][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:04,322][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:09,323][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:14,324][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:19,325][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:24,326][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:29,327][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:34,328][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:39,329][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:44,330][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:49,332][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:54,333][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:28:59,335][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:04,336][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:09,338][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:14,339][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:19,340][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:24,341][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:29,342][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:34,343][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:39,345][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:44,345][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:49,346][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:54,347][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:29:59,348][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:04,349][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:09,350][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:14,351][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:19,352][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:24,354][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:29,355][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:34,356][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:39,357][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:44,358][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:49,358][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:54,359][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:30:59,360][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:04,361][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:09,362][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:14,363][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:19,364][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:24,365][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:29,366][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:34,367][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:39,368][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:44,369][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:49,370][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:54,378][ INFO][PID:3479564] Periodic builder liveness probe: alive [2025-11-03 22:31:54,379][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:31:59,380][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:04,380][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:09,382][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:14,382][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:19,383][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:24,384][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:29,385][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:34,386][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:39,387][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:44,388][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:49,389][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:54,390][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:32:59,391][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:04,392][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:09,393][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:14,394][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:19,395][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:24,396][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:29,396][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:34,397][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:39,398][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:44,399][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:49,400][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:54,401][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:33:59,402][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:04,403][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:09,404][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:14,405][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:19,406][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:24,407][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:29,407][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:34,409][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:39,410][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:44,410][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:49,412][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:54,413][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:34:59,414][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:04,415][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:09,416][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:14,417][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:19,418][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:24,419][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:29,420][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:34,421][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:39,422][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:44,423][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:49,427][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:54,428][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:35:59,429][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:04,430][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:09,431][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:14,432][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:19,434][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:24,435][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:29,437][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:34,439][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:39,440][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:44,441][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:49,442][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:54,446][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:36:59,450][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:04,452][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:09,453][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:14,455][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:19,458][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:24,461][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:29,462][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:34,463][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:39,464][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:44,465][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:49,467][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:54,471][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:37:59,472][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:04,475][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:09,478][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:14,479][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:19,481][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:24,483][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:29,488][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:34,489][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:39,491][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:44,493][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:49,499][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:54,501][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:38:59,504][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:04,509][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:09,512][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:14,513][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:19,518][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:24,519][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:29,525][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:34,526][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:39,529][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:44,530][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:49,532][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:54,534][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:39:59,535][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:04,537][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:09,538][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:14,539][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:19,540][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:24,541][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:29,542][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:34,543][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:39,544][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:44,545][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:49,546][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:54,547][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:40:59,548][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:04,549][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:09,550][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:14,551][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:19,552][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:24,553][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:29,554][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:34,555][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:39,556][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:44,557][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:49,558][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:54,565][ INFO][PID:3479564] Periodic builder liveness probe: alive [2025-11-03 22:41:54,566][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:41:59,566][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:04,567][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:09,568][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:14,569][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:19,570][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:24,571][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:29,573][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:34,574][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:39,575][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:44,576][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:49,577][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:54,578][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:42:59,579][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:04,579][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:09,580][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:14,581][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:19,582][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:24,583][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:29,584][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:34,585][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:39,586][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:44,587][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:49,588][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:54,589][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:43:59,590][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:04,591][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:09,592][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:14,593][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:19,594][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:24,595][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:29,596][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:34,597][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:39,598][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:44,599][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:49,600][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:54,601][ INFO][PID:3479564] Checking for cancel request [2025-11-03 22:44:57,134][ INFO][PID:3479564] Downloading results from builder [2025-11-03 22:44:57,135][ INFO][PID:3479564] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a3]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps started [2025-11-03 22:44:57,136][ INFO][PID:3479564] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c2a3]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/build-09762027.rsync.log [2025-11-03 22:44:59,092][ INFO][PID:3479564] rsyncing finished. [2025-11-03 22:44:59,092][ INFO][PID:3479564] Releasing VM back to pool [2025-11-03 22:44:59,100][ INFO][PID:3479564] Searching for 'success' file in resultdir [2025-11-03 22:44:59,101][ INFO][PID:3479564] Going to sign pkgs from source: 9762027-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le [2025-11-03 22:44:59,101][ INFO][PID:3479564] Calling '/bin/sign -u psimovec#scipy-1.8.3@copr.fedorahosted.org -p' (attempt #1) [2025-11-03 22:44:59,453][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-openmpi-debuginfo-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:00,273][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-openmpi-debuginfo-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:00,274][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python-steps-3.6.0-47.fc44.src.rpm' (attempt #1) [2025-11-03 22:45:01,356][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python-steps-3.6.0-47.fc44.src.rpm [2025-11-03 22:45:01,357][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python-steps-debuginfo-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:01,921][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python-steps-debuginfo-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:01,922][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-mpich-debuginfo-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:02,612][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-mpich-debuginfo-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:02,613][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:03,305][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:03,305][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-debuginfo-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:04,082][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-debuginfo-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:04,083][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-openmpi-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:04,743][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-openmpi-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:04,744][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python-steps-debugsource-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:05,572][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python-steps-debugsource-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:05,573][ INFO][PID:3479564] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.8.3@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-mpich-3.6.0-47.fc44.ppc64le.rpm' (attempt #1) [2025-11-03 22:45:06,250][ INFO][PID:3479564] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/python3-steps-mpich-3.6.0-47.fc44.ppc64le.rpm [2025-11-03 22:45:06,251][ INFO][PID:3479564] Sign done [2025-11-03 22:45:06,251][ INFO][PID:3479564] Incremental createrepo run, adding 09762027-python-steps into https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3/fedora-41-ppc64le, (auto-create-repo=True) [2025-11-03 22:45:06,252][ INFO][PID:3479564] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le --add 09762027-python-steps --no-appstream-metadata' as PID 3634460 [2025-11-03 22:45:08,116][ INFO][PID:3479564] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le --add 09762027-python-steps --no-appstream-metadata) [2025-11-03 22:45:08,117][ INFO][PID:3479564] Getting build details [2025-11-03 22:45:08,117][ INFO][PID:3479564] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps [2025-11-03 22:45:08,118][ INFO][PID:3479564] Built packages: ['python-steps-debuginfo 3.6.0', 'python3-steps-mpich 3.6.0', 'python3-steps-debuginfo 3.6.0', 'python-steps-debugsource 3.6.0', 'python3-steps-openmpi 3.6.0', 'python3-steps-openmpi-debuginfo 3.6.0', 'python3-steps-mpich-debuginfo 3.6.0', 'python3-steps 3.6.0'] [2025-11-03 22:45:08,118][ INFO][PID:3479564] build details: {'built_packages': 'python-steps-debuginfo 3.6.0\npython3-steps-mpich 3.6.0\npython3-steps-debuginfo 3.6.0\npython-steps-debugsource 3.6.0\npython3-steps-openmpi 3.6.0\npython3-steps-openmpi-debuginfo 3.6.0\npython3-steps-mpich-debuginfo 3.6.0\npython3-steps 3.6.0'} [2025-11-03 22:45:08,118][ INFO][PID:3479564] Retrieving pubkey [2025-11-03 22:45:08,119][ INFO][PID:3479564] Calling '/bin/sign -u psimovec#scipy-1.8.3@copr.fedorahosted.org -p' (attempt #1) [2025-11-03 22:45:08,307][ INFO][PID:3479564] Added pubkey for user psimovec project scipy-1.8.3 into: /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/pubkey.gpg [2025-11-03 22:45:08,309][ INFO][PID:3479564] Finished build: id=9762027 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/scipy-1.8.3 chroot=fedora-41-ppc64le [2025-11-03 22:45:08,310][ INFO][PID:3479564] Worker succeeded build, took 1399.7754955291748 [2025-11-03 22:45:08,311][ INFO][PID:3479564] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.8.3", "project_dirname": "scipy-1.8.3", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": 1762209908.310405, "started_on": 1762208508.5349095, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9762027-fedora-41-ppc64le", "build_id": 9762027, "package_name": "python-steps", "package_version": "3.6.0-47", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.8.3/python-steps", "git_hash": "fe22a8708c03f90b2811cca770e6765c8db6cdf5", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.8.3--https://src.fedoraproject.org/user/music", "results": { "packages": [ { "name": "python-steps-debuginfo", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python3-steps-mpich", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python3-steps-debuginfo", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python-steps-debugsource", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python3-steps-openmpi", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python-steps", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "src" }, { "name": "python3-steps-openmpi-debuginfo", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python3-steps-mpich-debuginfo", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" }, { "name": "python3-steps", "epoch": null, "version": "3.6.0", "release": "47.fc44", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.8.3", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.8.3", "result_dir": "09762027-python-steps", "built_packages": "python-steps-debuginfo 3.6.0\npython3-steps-mpich 3.6.0\npython3-steps-debuginfo 3.6.0\npython-steps-debugsource 3.6.0\npython3-steps-openmpi 3.6.0\npython3-steps-openmpi-debuginfo 3.6.0\npython3-steps-mpich-debuginfo 3.6.0\npython3-steps 3.6.0", "id": 9762027, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.8.3", "vendor": "Fedora Project COPR (psimovec/scipy-1.8.3)" } } ] } [2025-11-03 22:45:08,367][ INFO][PID:3479564] Sending fedora-messaging bus message in build.end [2025-11-03 22:45:08,985][ INFO][PID:3479564] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/builder-live.log by gzip [2025-11-03 22:45:08,987][ INFO][PID:3479564] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/builder-live.log' as PID 3634681 [2025-11-03 22:45:09,011][ INFO][PID:3479564] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/builder-live.log) [2025-11-03 22:45:09,012][ INFO][PID:3479564] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/backend.log by gzip [2025-11-03 22:45:09,013][ INFO][PID:3479564] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.8.3/fedora-41-ppc64le/09762027-python-steps/backend.log' as PID 3634699