[2025-07-24 04:23:49,311][ INFO][PID:1216979] Marking build as starting [2025-07-24 04:23:49,367][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:23:49,368][ INFO][PID:1216979] VM allocation process starts [2025-07-24 04:23:49,403][ INFO][PID:1216979] Trying to allocate VM: ResallocHost, ticket_id=4085985, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 04:23:54,406][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:23:59,409][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:04,411][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:09,412][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:14,413][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:19,414][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:24,415][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:29,417][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:34,418][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:39,419][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:44,420][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:49,421][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:54,423][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:24:59,426][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:04,427][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:09,431][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:14,434][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:19,435][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:24,436][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:29,439][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:34,440][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:39,441][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:44,443][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:49,444][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:54,445][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:25:59,446][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:04,447][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:09,448][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:14,449][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:19,450][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:24,451][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:29,452][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:34,453][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:39,455][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:44,457][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:49,459][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:54,460][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:26:59,462][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:04,463][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:09,464][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:14,465][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:19,467][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:24,468][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:29,469][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:34,470][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:39,471][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:44,472][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:49,473][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:54,475][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:27:59,476][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:04,477][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:09,478][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:14,479][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:19,480][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:24,484][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:29,485][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:34,488][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:39,489][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:44,491][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:49,492][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:54,494][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:28:59,495][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:04,496][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:09,497][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:14,498][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:19,500][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:24,501][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:29,503][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:34,504][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:39,505][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:44,506][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:49,507][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:54,509][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:29:59,510][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:04,511][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:07,546][ INFO][PID:1216979] Allocated host ResallocHost, ticket_id=4085985, hostname=140.211.168.61, name=copr_osuosl_p09_prod_05777478_20250724_042633, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 04:30:07,546][ INFO][PID:1216979] Allocating ssh connection to builder [2025-07-24 04:30:07,547][ INFO][PID:1216979] Checking that builder machine is OK [2025-07-24 04:30:08,904][ INFO][PID:1216979] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 04:30:09,903][ INFO][PID:1216979] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 04:30:09,903][ INFO][PID:1216979] Filling build.info file with builder info [2025-07-24 04:30:09,904][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:09,905][ INFO][PID:1216979] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": null, "started_on": 1753331409.9052649, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9313654-fedora-42-ppc64le", "build_id": 9313654, "package_name": "R-GenomeInfoDbData", "package_version": "1.2.8-13", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-GenomeInfoDbData", "git_hash": "227a4f47b777b82401a0254bd543c2b44382f410", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09313654-R-GenomeInfoDbData", "built_packages": "", "id": 9313654, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-24 04:30:09,943][ INFO][PID:1216979] Sending fedora-messaging bus message in build.start [2025-07-24 04:30:10,690][ INFO][PID:1216979] Sending fedora-messaging bus message in chroot.start [2025-07-24 04:30:10,717][ INFO][PID:1216979] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313654-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 04:30:12,063][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 1 [2025-07-24 04:30:12,064][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-07-24 04:30:17,071][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 04:30:17,071][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:22,073][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:27,077][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:32,078][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:37,079][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:42,081][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:47,082][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:52,083][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:30:57,084][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:02,085][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:07,086][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:12,087][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:17,089][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:22,090][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:27,091][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:32,092][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:37,093][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:42,094][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:47,095][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:52,097][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:31:57,098][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:02,100][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:07,104][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:12,105][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:17,108][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:22,109][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:27,113][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:32,114][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:37,115][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:42,117][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:47,118][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:52,119][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:32:57,121][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:02,124][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:07,125][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:12,126][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:17,127][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:22,130][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:27,132][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:32,133][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:37,135][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:42,136][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:47,143][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:52,144][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:33:57,145][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:02,146][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:07,147][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:12,148][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:17,149][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:22,151][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:27,152][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:32,154][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:37,155][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:42,156][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:47,157][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:52,158][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:34:57,160][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:02,161][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:07,162][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:12,163][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:17,164][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:22,165][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:27,166][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:28,139][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 04:35:32,168][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:37,169][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:38,141][WARNING][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 04:35:42,171][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:47,172][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:48,142][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 2 [2025-07-24 04:35:48,144][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-07-24 04:35:52,175][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:35:57,176][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:02,177][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:07,179][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:12,180][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:17,182][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:22,183][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:27,184][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:32,185][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:37,186][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:42,188][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:47,189][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:48,283][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 04:36:52,190][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:57,191][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:36:58,288][WARNING][PID:1216979] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 04:37:02,192][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:07,194][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:08,289][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 3 [2025-07-24 04:37:08,291][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-07-24 04:37:12,195][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:17,196][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:22,198][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:27,199][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:32,200][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:37,202][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:42,203][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:47,204][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:52,206][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:37:57,207][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:02,208][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:07,210][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:08,429][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 04:38:12,212][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:17,213][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:18,432][WARNING][PID:1216979] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 04:38:22,214][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:27,217][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:28,433][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 4 [2025-07-24 04:38:28,434][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.61 copr-rpmbuild-log [2025-07-24 04:38:32,218][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:37,219][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:42,220][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:47,221][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:52,223][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:38:57,224][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:02,225][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:07,227][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:12,228][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:17,230][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:22,232][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:27,237][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:28,571][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 04:39:32,238][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:37,239][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:38,577][ ERROR][PID:1216979] Giving up for unstable SSH, failures: 1753331738.1410434, 1753331818.2883642, 1753331898.4326804, 1753331978.5768325 [2025-07-24 04:39:38,578][ ERROR][PID:1216979] Re-try request for task on 'ResallocHost, ticket_id=4085985, hostname=140.211.168.61, name=copr_osuosl_p09_prod_05777478_20250724_042633, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-24 04:39:38,578][ INFO][PID:1216979] Releasing VM back to pool [2025-07-24 04:39:38,588][ INFO][PID:1216979] Retry #1 (on other host) [2025-07-24 04:39:38,589][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:38,589][ INFO][PID:1216979] VM allocation process starts [2025-07-24 04:39:38,646][ INFO][PID:1216979] Trying to allocate VM: ResallocHost, ticket_id=4086149, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 04:39:43,648][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:48,649][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:53,650][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:39:58,651][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:03,653][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:06,751][ INFO][PID:1216979] Allocated host ResallocHost, ticket_id=4086149, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05777566_20250724_043643, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 04:40:06,752][ INFO][PID:1216979] Allocating ssh connection to builder [2025-07-24 04:40:06,753][ INFO][PID:1216979] Checking that builder machine is OK [2025-07-24 04:40:08,081][ INFO][PID:1216979] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 04:40:09,069][ INFO][PID:1216979] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 04:40:09,069][ INFO][PID:1216979] Filling build.info file with builder info [2025-07-24 04:40:09,070][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:09,071][ INFO][PID:1216979] Not re-notifying FE and msg buses for the new host. [2025-07-24 04:40:09,072][ INFO][PID:1216979] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313654-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 04:40:10,378][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 1 [2025-07-24 04:40:10,383][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 04:40:15,379][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:20,385][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 04:40:20,386][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:25,387][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:30,388][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:35,389][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:40,391][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:45,393][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:50,394][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:40:55,395][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:00,397][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:05,398][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:10,399][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:15,400][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:20,402][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:25,403][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:30,404][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:35,406][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:40,407][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:45,408][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:50,409][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:41:55,411][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:00,413][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:05,414][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:10,415][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:15,416][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:20,418][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:25,419][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:30,420][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:35,421][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:40,423][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:45,425][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:50,426][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:42:55,511][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:00,512][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:05,513][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:10,515][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:15,516][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:20,517][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:26,110][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:31,117][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:36,162][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:41,163][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:46,165][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:51,167][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:43:56,169][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:01,172][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:06,173][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:11,174][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:16,178][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:21,181][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:26,184][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:31,269][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:36,274][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:41,275][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:46,277][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:51,278][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:44:57,033][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:02,058][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:07,656][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:13,821][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:18,824][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:23,828][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:28,830][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:33,896][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:39,315][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:44,401][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:49,546][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:54,547][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:45:59,549][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:04,551][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:09,552][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:14,553][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:19,555][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:24,556][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:29,578][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:34,579][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:39,581][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:44,582][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:49,584][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:54,585][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:46:59,680][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:04,693][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:09,696][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:14,699][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:19,703][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:24,704][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:29,706][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:34,708][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:39,710][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:44,715][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:49,717][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:54,719][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:47:59,720][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:04,721][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:10,140][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:15,142][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:20,197][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:25,199][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:30,595][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:35,597][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:40,598][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:45,605][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:50,607][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:48:55,610][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:00,727][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:05,729][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:10,731][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:15,732][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:20,733][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:25,734][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:30,766][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:35,768][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:41,717][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:46,718][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:51,763][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:49:56,766][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:01,770][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:06,772][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:11,789][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:16,795][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:21,812][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 04:50:21,915][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:26,918][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:32,111][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:37,114][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:42,119][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:47,129][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:52,131][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:50:57,132][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:02,498][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:07,641][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:12,646][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:17,648][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:22,649][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:27,702][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:32,704][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:37,707][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:42,734][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:47,740][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:52,754][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:51:57,756][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:02,790][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:07,792][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:12,793][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:17,795][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:22,879][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:27,883][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:32,983][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:38,147][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:43,169][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:48,198][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:53,200][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:52:58,202][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:03,214][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:08,437][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:13,463][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:18,675][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:23,681][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:28,686][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:33,688][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:38,691][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:43,700][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:48,704][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:53,706][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:53:58,708][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:03,709][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:08,710][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:13,711][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:18,712][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:23,713][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:28,714][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:33,715][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:38,716][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:43,721][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:48,723][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:53,731][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:54:58,733][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:03,735][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:08,736][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:13,737][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:18,738][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:23,740][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:28,741][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:33,745][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:38,746][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:43,748][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:48,752][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:53,770][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:55:58,771][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:03,772][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:08,774][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:13,775][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:18,880][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:23,955][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:28,963][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:33,965][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:38,974][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:43,996][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:49,001][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:54,004][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:56:59,038][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:04,041][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:09,045][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:14,048][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:19,050][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:24,128][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:29,133][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:34,498][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:39,724][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:44,727][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:49,729][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:54,732][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:57:59,736][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:04,737][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:09,738][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:14,886][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:19,889][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:24,891][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:29,893][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:34,934][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:39,940][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:44,941][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:49,942][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:54,944][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:58:59,945][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:04,948][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:09,949][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:14,952][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:19,957][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:24,958][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:29,960][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:34,962][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:39,963][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:44,983][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:49,987][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:54,991][ INFO][PID:1216979] Checking for cancel request [2025-07-24 04:59:59,993][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:04,997][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:10,004][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:15,005][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:20,007][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:25,035][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 05:00:25,035][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:30,041][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:35,053][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:40,055][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:45,057][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:50,059][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:00:55,223][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:00,236][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:05,239][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:10,250][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:15,258][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:20,263][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:25,271][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:30,274][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:35,283][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:40,292][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:45,294][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:50,297][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:01:55,298][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:00,302][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:05,305][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:10,307][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:15,308][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:20,310][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:25,311][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:30,313][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:35,314][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:40,318][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:45,323][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:50,421][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:02:55,425][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:00,512][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:05,576][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:10,665][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:15,680][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:20,688][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:25,690][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:30,692][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:35,693][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:40,713][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:45,715][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:50,720][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:03:55,724][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:00,726][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:05,727][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:10,732][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:15,733][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:20,735][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:25,736][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:30,740][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:35,741][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:40,743][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:45,750][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:50,751][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:04:55,755][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:00,767][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:05,789][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:10,814][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:15,853][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:20,855][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:25,914][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:30,917][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:35,919][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:40,920][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:45,921][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:50,922][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:05:55,923][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:00,926][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:05,930][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:10,935][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:15,945][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:20,949][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:25,954][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:30,956][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:35,959][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:40,962][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:45,969][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:50,971][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:06:56,060][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:01,062][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:06,144][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:11,215][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:16,259][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:21,293][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:26,294][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:31,343][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:36,349][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:41,351][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:46,353][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:51,361][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:07:56,371][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:01,372][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:06,377][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:11,385][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:16,389][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:21,402][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:26,407][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:31,408][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:36,431][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:41,433][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:46,435][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:51,448][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:08:56,450][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:01,453][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:06,459][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:11,470][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:16,475][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:21,479][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:26,482][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:31,484][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:36,489][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:41,491][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:46,493][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:51,497][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:09:56,506][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:10:01,511][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:10:06,513][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:10:11,517][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:10:16,519][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:10:21,520][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:10:26,540][ INFO][PID:1216979] Periodic builder liveness probe: dead [2025-07-24 05:11:26,694][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.163 port 22 timed out [2025-07-24 05:12:36,884][ ERROR][PID:1216979] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.163 port 22 timed out [2025-07-24 05:13:47,024][ ERROR][PID:1216979] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.163 port 22 timed out [2025-07-24 05:14:57,093][ ERROR][PID:1216979] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-07-24 05:15:01,143][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:15:07,094][ ERROR][PID:1216979] Can't ssh to cancel build. [2025-07-24 05:15:11,144][WARNING][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:15:21,145][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 2 [2025-07-24 05:15:21,146][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:16:21,214][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:16:31,218][WARNING][PID:1216979] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:16:41,218][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 3 [2025-07-24 05:16:41,220][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:17:41,289][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:17:51,293][WARNING][PID:1216979] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:18:01,293][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 4 [2025-07-24 05:18:01,295][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:18:20,620][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:18:30,624][ ERROR][PID:1216979] Giving up for unstable SSH, failures: 1753334111.144538, 1753334191.2180266, 1753334271.2931333, 1753334310.6238866 [2025-07-24 05:18:30,625][ ERROR][PID:1216979] Re-try request for task on 'ResallocHost, ticket_id=4086149, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05777566_20250724_043643, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-24 05:18:30,626][ INFO][PID:1216979] Releasing VM back to pool [2025-07-24 05:18:30,640][ INFO][PID:1216979] Retry #2 (on other host) [2025-07-24 05:18:30,641][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:18:30,642][ INFO][PID:1216979] VM allocation process starts [2025-07-24 05:18:30,659][ INFO][PID:1216979] Trying to allocate VM: ResallocHost, ticket_id=4086683, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:18:35,661][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:18:40,663][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:18:45,664][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:18:50,666][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:18:55,667][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:00,669][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:05,670][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:10,671][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:15,672][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:20,676][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:25,678][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:30,679][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:35,681][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:40,682][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:45,683][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:50,684][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:19:55,685][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:00,686][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:05,688][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:10,689][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:15,690][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:20,691][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:25,693][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:30,697][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:35,702][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:40,703][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:45,705][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:50,707][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:20:55,708][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:00,709][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:05,710][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:10,712][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:15,715][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:20,716][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:25,718][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:30,720][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:35,722][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:40,728][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:45,730][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:48,769][ INFO][PID:1216979] Allocated host ResallocHost, ticket_id=4086683, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05778015_20250724_051716, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:21:48,770][ INFO][PID:1216979] Allocating ssh connection to builder [2025-07-24 05:21:48,771][ INFO][PID:1216979] Checking that builder machine is OK [2025-07-24 05:21:50,133][ INFO][PID:1216979] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 05:21:51,161][ INFO][PID:1216979] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 05:21:51,162][ INFO][PID:1216979] Filling build.info file with builder info [2025-07-24 05:21:51,167][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:21:51,168][ INFO][PID:1216979] Not re-notifying FE and msg buses for the new host. [2025-07-24 05:21:51,169][ INFO][PID:1216979] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313654-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 05:21:52,455][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 1 [2025-07-24 05:21:52,457][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:21:57,462][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 05:21:57,463][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:02,464][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:07,465][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:12,466][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:17,468][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:22,469][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:27,470][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:32,471][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:37,472][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:42,473][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:47,474][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:52,476][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:22:57,477][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:02,479][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:07,480][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:12,482][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:17,484][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:22,485][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:27,486][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:32,487][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:37,489][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:42,490][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:47,492][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:52,494][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:23:57,495][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:02,496][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:07,497][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:12,499][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:17,500][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:22,501][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:27,502][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:32,504][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:37,506][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:42,508][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:47,509][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:52,510][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:24:57,511][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:02,513][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:07,514][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:12,516][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:17,518][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:22,522][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:27,523][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:32,524][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:37,526][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:42,527][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:47,528][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:52,530][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:25:57,531][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:02,532][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:07,533][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:12,534][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:17,536][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:22,537][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:27,539][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:32,543][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:37,544][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:42,549][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:47,550][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:52,554][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:26:57,558][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:02,559][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:07,560][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:12,561][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:17,571][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:22,574][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:27,575][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:32,577][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:37,579][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:42,581][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:47,584][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:52,585][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:27:57,591][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:02,594][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:07,597][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:12,601][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:17,604][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:22,605][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:27,608][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:32,609][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:37,611][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:42,612][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:47,614][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:52,615][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:28:57,616][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:02,617][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:07,618][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:12,619][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:17,620][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:22,621][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:27,622][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:32,623][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:37,625][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:42,626][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:47,627][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:52,628][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:29:57,629][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:02,630][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:07,631][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:12,632][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:17,633][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:22,634][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:27,635][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:32,637][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:37,638][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:42,639][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:47,640][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:52,641][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:30:57,642][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:02,644][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:07,645][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:12,646][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:17,647][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:22,648][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:27,649][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:32,650][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:37,651][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:42,652][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:47,653][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:52,654][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:31:57,660][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 05:31:57,660][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:02,661][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:07,662][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:12,663][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:17,664][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:22,665][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:27,667][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:32,668][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:37,669][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:42,670][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:47,671][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:52,672][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:32:57,674][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:02,675][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:07,676][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:12,678][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:17,680][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:22,681][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:27,682][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:32,683][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:37,684][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:42,685][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:47,686][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:52,687][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:33:57,688][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:02,689][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:07,691][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:12,691][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:17,693][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:22,694][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:27,695][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:32,696][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:37,697][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:42,698][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:47,699][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:52,700][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:34:57,702][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:02,703][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:07,704][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:12,705][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:17,706][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:22,707][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:27,709][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:32,710][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:37,711][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:42,713][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:47,714][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:52,715][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:35:57,716][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:02,718][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:07,719][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:12,722][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:17,725][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:22,727][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:27,729][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:32,732][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:37,734][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:42,735][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:47,736][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:52,738][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:36:57,739][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:02,740][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:07,741][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:12,742][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:17,744][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:22,746][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:27,785][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:32,898][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:38,054][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:43,152][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:48,154][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:53,155][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:37:58,157][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:03,158][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:08,160][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:13,162][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:18,163][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:23,164][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:28,165][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:33,166][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:38,168][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:43,171][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:48,173][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:53,174][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:38:58,175][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:03,199][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:08,206][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:13,296][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:18,691][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:23,953][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:29,242][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:34,533][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:39,823][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:45,109][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:50,404][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:39:55,405][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:00,778][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:05,814][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:10,877][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:16,141][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:21,148][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:26,150][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:31,153][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:36,155][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:41,156][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:46,157][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:51,160][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:40:56,165][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:01,168][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:06,179][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:11,181][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:16,182][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:21,184][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:26,185][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:31,197][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:36,198][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:41,200][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:46,206][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:51,211][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:41:56,247][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:01,292][ INFO][PID:1216979] Periodic builder liveness probe: alive [2025-07-24 05:42:01,523][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:06,528][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:11,627][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:16,628][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:21,799][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:26,856][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:32,045][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:37,047][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:42,566][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:47,572][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:52,612][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:42:57,782][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:02,862][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:07,959][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:13,067][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:18,262][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:23,352][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:28,741][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:33,815][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:38,817][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:43,821][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:48,828][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:53,829][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:43:59,135][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:04,138][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:09,140][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:14,141][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:19,143][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:24,144][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:29,145][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:34,146][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:39,152][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:44,153][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:49,155][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:54,156][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:44:59,157][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:04,158][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:09,341][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:14,453][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:19,505][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:24,544][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:29,553][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:34,554][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:39,556][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:44,559][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:49,565][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:54,567][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:45:59,568][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:04,569][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:09,571][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:14,575][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:19,576][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:24,578][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:29,585][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:34,586][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:39,588][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:44,590][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:49,591][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:54,592][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:46:59,593][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:04,594][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:09,596][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:14,600][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:19,605][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:24,606][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:29,619][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:34,621][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:39,623][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:44,625][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:49,629][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:54,641][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:47:59,644][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:04,646][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:09,648][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:14,649][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:19,650][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:24,651][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:29,652][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:34,653][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:39,655][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:44,656][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:49,659][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:54,660][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:48:59,661][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:04,664][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:09,665][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:14,667][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:19,668][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:24,673][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:29,675][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:34,677][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:39,679][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:44,682][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:49,684][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:54,685][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:49:59,686][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:04,690][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:09,691][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:14,692][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:19,700][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:24,701][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:29,703][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:34,708][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:39,709][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:44,711][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:49,712][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:54,714][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:50:59,717][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:04,718][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:09,719][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:14,720][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:19,721][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:24,722][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:29,723][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:34,726][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:39,729][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:44,731][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:49,732][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:54,733][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:51:59,734][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:52:04,769][ INFO][PID:1216979] Periodic builder liveness probe: dead [2025-07-24 05:53:04,907][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.163 port 22 timed out [2025-07-24 05:54:15,047][ ERROR][PID:1216979] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.163 port 22 timed out [2025-07-24 05:55:21,143][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:55:25,116][ ERROR][PID:1216979] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-07-24 05:55:31,143][WARNING][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:55:41,144][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 2 [2025-07-24 05:55:41,146][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:56:35,188][ ERROR][PID:1216979] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.163 port 22: Connection timed out [2025-07-24 05:56:41,208][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:56:45,188][ ERROR][PID:1216979] Can't ssh to cancel build. [2025-07-24 05:56:51,212][WARNING][PID:1216979] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:57:01,213][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 3 [2025-07-24 05:57:01,214][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:58:01,282][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:58:11,282][WARNING][PID:1216979] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:58:21,283][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 4 [2025-07-24 05:58:21,284][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log [2025-07-24 05:59:21,352][ ERROR][PID:1216979] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:59:31,353][ ERROR][PID:1216979] Giving up for unstable SSH, failures: 1753336531.1438928, 1753336611.2124152, 1753336691.282797, 1753336771.3529515 [2025-07-24 05:59:31,353][ ERROR][PID:1216979] Re-try request for task on 'ResallocHost, ticket_id=4086683, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05778015_20250724_051716, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-24 05:59:31,354][ INFO][PID:1216979] Releasing VM back to pool [2025-07-24 05:59:31,365][ INFO][PID:1216979] Retry #3 (on other host) [2025-07-24 05:59:31,366][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:59:31,367][ INFO][PID:1216979] VM allocation process starts [2025-07-24 05:59:31,378][ INFO][PID:1216979] Trying to allocate VM: ResallocHost, ticket_id=4087101, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:59:34,394][ INFO][PID:1216979] Allocated host ResallocHost, ticket_id=4087101, hostname=2620:52:3:1:dead:beef:cafe:c20d, name=copr_hv_ppc64le_01_prod_05778280_20250724_054909, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:59:34,395][ INFO][PID:1216979] Allocating ssh connection to builder [2025-07-24 05:59:34,395][ INFO][PID:1216979] Checking that builder machine is OK [2025-07-24 05:59:36,405][ INFO][PID:1216979] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 05:59:37,512][ INFO][PID:1216979] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 05:59:37,512][ INFO][PID:1216979] Filling build.info file with builder info [2025-07-24 05:59:37,517][ INFO][PID:1216979] Checking for cancel request [2025-07-24 05:59:37,518][ INFO][PID:1216979] Not re-notifying FE and msg buses for the new host. [2025-07-24 05:59:37,519][ INFO][PID:1216979] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313654-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 05:59:38,912][ INFO][PID:1216979] Downloading the builder-live.log file, attempt 1 [2025-07-24 05:59:38,913][ INFO][PID:1216979] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20d copr-rpmbuild-log [2025-07-24 05:59:48,206][ INFO][PID:1216979] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20d' (ED25519) to the list of known hosts. [2025-07-24 05:59:48,206][ INFO][PID:1216979] Downloading results from builder [2025-07-24 05:59:48,207][ INFO][PID:1216979] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData started [2025-07-24 05:59:48,208][ INFO][PID:1216979] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/build-09313654.rsync.log [2025-07-24 05:59:49,607][ INFO][PID:1216979] rsyncing finished. [2025-07-24 05:59:49,607][ INFO][PID:1216979] Releasing VM back to pool [2025-07-24 05:59:49,615][ INFO][PID:1216979] Searching for 'success' file in resultdir [2025-07-24 05:59:49,616][ ERROR][PID:1216979] Build failed: Backend process error: No success file => build failure [2025-07-24 05:59:49,617][ INFO][PID:1216979] Finished build: id=9313654 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le [2025-07-24 05:59:49,618][ ERROR][PID:1216979] Backend process error: No success file => build failure [2025-07-24 05:59:49,618][ INFO][PID:1216979] Worker failed build, took 12.1003098487854 [2025-07-24 05:59:49,619][ INFO][PID:1216979] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": 1753336789.6189165, "started_on": 1753336777.5186067, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9313654-fedora-42-ppc64le", "build_id": 9313654, "package_name": "R-GenomeInfoDbData", "package_version": "1.2.8-13", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-GenomeInfoDbData", "git_hash": "227a4f47b777b82401a0254bd543c2b44382f410", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09313654-R-GenomeInfoDbData", "built_packages": "", "id": 9313654, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-24 05:59:49,654][ INFO][PID:1216979] Sending fedora-messaging bus message in build.end [2025-07-24 05:59:49,680][ INFO][PID:1216979] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/builder-live.log by gzip [2025-07-24 05:59:49,681][ INFO][PID:1216979] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/builder-live.log' as PID 1733618 [2025-07-24 05:59:49,683][ INFO][PID:1216979] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/builder-live.log) [2025-07-24 05:59:49,683][ INFO][PID:1216979] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/backend.log by gzip [2025-07-24 05:59:49,684][ INFO][PID:1216979] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313654-R-GenomeInfoDbData/backend.log' as PID 1733619