[2025-07-24 10:46:21,229][ INFO][PID:3231893] Marking build as starting [2025-07-24 10:46:21,348][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:21,350][ INFO][PID:3231893] VM allocation process starts [2025-07-24 10:46:21,369][ INFO][PID:3231893] Trying to allocate VM: ResallocHost, ticket_id=4090725, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-24 10:46:26,371][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:31,372][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:36,373][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:41,374][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:46,375][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:51,377][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:46:56,378][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:01,379][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:06,380][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:11,381][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:16,383][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:21,384][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:26,385][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:31,386][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:36,387][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:41,389][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:46,391][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:51,396][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:47:56,398][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:01,399][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:06,400][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:11,402][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:16,403][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:21,404][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:26,405][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:31,406][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:36,410][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:41,411][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:46,412][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:51,413][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:48:56,415][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:01,416][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:06,417][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:11,418][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:16,419][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:21,420][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:26,423][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:31,425][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:36,428][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:41,429][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:46,430][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:51,432][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:49:56,434][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:01,436][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:06,439][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:11,442][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:16,449][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:21,451][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:26,452][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:31,454][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:36,455][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:41,456][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:46,466][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:51,469][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:50:56,470][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:01,472][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:06,473][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:11,474][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:16,475][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:21,476][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:26,478][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:31,479][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:36,480][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:41,481][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:46,482][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:51,483][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:51:56,492][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:01,493][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:06,495][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:11,496][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:16,498][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:21,504][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:26,508][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:31,510][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:36,513][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:39,485][ INFO][PID:3231893] Allocated host ResallocHost, ticket_id=4090725, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05784558_20250724_104842, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-24 10:52:39,486][ INFO][PID:3231893] Allocating ssh connection to builder [2025-07-24 10:52:39,487][ INFO][PID:3231893] Checking that builder machine is OK [2025-07-24 10:52:40,973][ INFO][PID:3231893] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2025-07-24 10:52:42,050][ INFO][PID:3231893] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2025-07-24 10:52:42,050][ INFO][PID:3231893] Filling build.info file with builder info [2025-07-24 10:52:42,051][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:42,054][ INFO][PID:3231893] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "podman-next", "project_dirname": "podman-next", "submitter": "packit", "ended_on": null, "started_on": 1753354362.054354, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9317795-centos-stream-9-ppc64le", "build_id": 9317795, "package_name": "ramalama", "package_version": "0.11.1-1000.1.20250724104548482143.main.18.g61e7360", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/ramalama", "git_hash": "fa4548ee4e314a7134d3522ab027dd89d9254740", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/podman-next--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/", "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch", "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next", "result_dir": "09317795-ramalama", "built_packages": "", "id": 9317795, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "podman-next", "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)" } } ] } [2025-07-24 10:52:42,103][ INFO][PID:3231893] Sending fedora-messaging bus message in build.start [2025-07-24 10:52:43,308][ INFO][PID:3231893] Sending fedora-messaging bus message in chroot.start [2025-07-24 10:52:43,355][ INFO][PID:3231893] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9317795-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2025-07-24 10:52:44,769][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 1 [2025-07-24 10:52:44,773][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 10:52:49,776][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 10:52:49,777][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:54,778][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:52:59,779][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:04,780][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:09,782][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:14,783][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:19,784][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:24,788][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:29,790][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:34,794][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:39,796][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:44,797][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:49,798][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:54,800][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:53:59,802][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:04,805][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:09,807][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:14,810][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:19,814][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:24,818][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:29,825][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:34,830][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:39,835][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:44,839][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:49,843][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:54,847][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:54:59,851][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:04,852][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:09,854][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:14,856][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:19,862][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:24,863][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:29,865][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:34,866][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:39,867][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:44,869][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:49,870][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:54,872][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:55:59,874][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:04,875][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:09,876][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:14,877][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:19,878][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:24,879][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:29,880][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:34,881][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:39,883][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:44,884][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:45,139][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:56:49,885][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:54,887][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:56:55,140][WARNING][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 10:56:59,889][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:04,890][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:05,140][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 2 [2025-07-24 10:57:05,142][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 10:57:09,891][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:14,893][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:19,894][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:24,896][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:29,899][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:34,903][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:39,905][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:44,907][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:49,912][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:54,916][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:57:59,919][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:04,921][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:05,278][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:58:09,922][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:14,924][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:15,281][WARNING][PID:3231893] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 10:58:19,925][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:24,926][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:25,281][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 3 [2025-07-24 10:58:25,283][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 10:58:29,927][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:34,928][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:39,929][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:44,930][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:49,931][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:54,932][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:58:59,933][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:04,935][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:09,936][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:14,937][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:19,938][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:24,939][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:25,426][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:59:29,942][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:34,944][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:35,429][WARNING][PID:3231893] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 10:59:39,945][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:44,947][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:45,429][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 4 [2025-07-24 10:59:45,431][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 10:59:49,948][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:54,950][ INFO][PID:3231893] Checking for cancel request [2025-07-24 10:59:59,951][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:04,952][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:09,953][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:14,954][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:19,956][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:24,957][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:29,958][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:34,960][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:39,962][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:44,963][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:45,568][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 11:00:49,964][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:54,965][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:55,572][ ERROR][PID:3231893] Giving up for unstable SSH, failures: 1753354615.1399436, 1753354695.2809737, 1753354775.4289823, 1753354855.572434 [2025-07-24 11:00:55,573][ ERROR][PID:3231893] Re-try request for task on 'ResallocHost, ticket_id=4090725, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05784558_20250724_104842, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-24 11:00:55,573][ INFO][PID:3231893] Releasing VM back to pool [2025-07-24 11:00:55,618][ INFO][PID:3231893] Retry #1 (on other host) [2025-07-24 11:00:55,618][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:00:55,620][ INFO][PID:3231893] VM allocation process starts [2025-07-24 11:00:55,658][ INFO][PID:3231893] Trying to allocate VM: ResallocHost, ticket_id=4090935, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-24 11:01:00,660][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:05,662][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:10,670][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:15,672][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:20,673][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:25,681][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:30,685][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:35,688][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:40,690][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:45,691][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:50,692][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:01:55,693][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:00,694][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:05,695][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:10,696][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:15,697][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:20,699][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:25,700][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:30,702][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:35,703][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:40,704][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:45,705][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:50,707][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:02:55,708][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:00,709][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:05,710][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:10,712][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:15,715][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:20,718][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:25,719][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:30,720][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:35,721][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:40,722][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:45,733][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:50,734][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:03:55,735][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:00,736][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:05,737][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:10,738][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:15,739][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:20,740][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:25,741][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:30,742][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:35,744][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:40,748][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:45,750][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:50,751][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:04:55,753][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:00,754][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:05,755][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:10,757][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:15,759][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:20,762][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:25,763][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:30,764][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:35,765][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:40,772][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:45,774][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:50,775][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:05:55,783][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:00,784][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:05,786][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:10,787][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:15,788][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:20,789][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:25,796][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:30,797][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:35,799][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:40,800][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:45,801][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:50,812][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:06:55,820][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:00,821][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:05,830][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:10,836][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:15,840][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:20,841][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:25,843][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:30,844][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:35,846][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:40,847][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:45,848][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:50,850][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:07:55,853][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:00,854][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:05,855][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:10,856][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:15,857][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:20,858][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:25,859][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:30,860][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:35,875][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:40,878][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:45,879][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:50,880][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:08:55,886][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:00,898][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:05,899][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:10,900][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:15,904][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:20,910][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:25,915][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:30,916][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:35,922][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:40,925][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:45,928][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:50,936][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:09:55,941][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:00,944][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:05,947][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:10,957][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:15,966][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:20,970][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:25,973][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:30,981][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:35,983][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:40,985][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:45,986][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:50,989][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:10:55,991][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:00,992][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:05,994][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:10,997][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:13,918][ INFO][PID:3231893] Allocated host ResallocHost, ticket_id=4090935, hostname=140.211.168.158, name=copr_osuosl_p09_prod_05786607_20250724_110645, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-24 11:11:13,919][ INFO][PID:3231893] Allocating ssh connection to builder [2025-07-24 11:11:13,920][ INFO][PID:3231893] Checking that builder machine is OK [2025-07-24 11:11:15,470][ INFO][PID:3231893] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2025-07-24 11:11:16,496][ INFO][PID:3231893] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2025-07-24 11:11:16,497][ INFO][PID:3231893] Filling build.info file with builder info [2025-07-24 11:11:16,502][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:16,504][ INFO][PID:3231893] Not re-notifying FE and msg buses for the new host. [2025-07-24 11:11:16,509][ INFO][PID:3231893] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9317795-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2025-07-24 11:11:17,886][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 1 [2025-07-24 11:11:17,891][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.158 copr-rpmbuild-log [2025-07-24 11:11:22,905][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 11:11:22,906][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:27,908][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:32,918][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:37,928][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:42,929][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:47,932][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:52,933][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:11:57,934][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:02,937][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:07,939][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:12,942][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:17,943][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:22,945][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:27,949][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:32,950][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:37,952][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:42,955][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:47,956][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:52,959][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:12:57,962][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:02,963][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:07,968][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:12,969][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:17,971][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:22,972][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:27,974][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:32,976][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:37,979][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:42,980][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:47,988][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:52,998][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:13:58,000][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:03,004][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:08,005][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:13,007][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:18,012][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:23,013][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:28,016][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:33,021][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:38,024][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:43,027][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:48,029][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:53,034][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:14:58,038][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:03,042][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:08,044][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:13,048][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:18,056][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:23,058][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:28,062][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:33,064][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:38,076][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:43,079][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:48,081][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:53,083][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:15:58,084][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:03,086][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:08,089][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:13,093][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:18,094][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:23,096][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:28,098][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:33,099][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:38,100][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:43,102][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:48,103][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:53,104][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:16:58,105][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:03,106][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:08,107][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:13,110][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:18,111][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:23,113][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:28,114][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:33,115][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:38,122][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:43,123][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:48,125][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:53,127][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:17:58,128][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:03,133][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:08,134][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:13,136][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:18,137][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:23,138][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:28,140][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:33,141][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:38,143][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:43,145][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:48,148][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:53,149][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:18:58,151][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:03,154][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:08,157][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:13,158][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:18,159][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:23,160][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:28,161][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:33,162][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:38,164][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:43,165][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:48,166][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:53,167][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:19:58,168][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:03,169][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:08,170][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:13,172][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:18,174][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:23,175][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:28,176][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:33,178][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:38,179][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:43,180][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:48,181][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:53,182][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:20:58,184][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:03,185][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:08,186][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:13,187][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:18,189][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:23,210][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 11:21:23,211][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:28,212][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:33,213][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:38,215][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:43,316][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:48,335][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:53,336][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:21:58,337][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:03,425][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:09,255][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:14,444][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:20,253][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:25,273][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:30,275][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:35,277][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:40,315][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:45,438][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:50,441][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:22:55,447][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:00,451][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:05,453][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:10,454][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:15,456][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:20,458][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:25,459][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:30,461][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:35,462][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:40,463][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:45,465][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:50,467][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:23:55,469][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:00,482][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:05,484][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:10,486][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:15,487][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:20,489][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:25,492][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:30,494][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:35,495][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:40,497][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:45,503][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:50,504][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:24:55,505][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:00,509][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:05,511][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:10,512][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:15,514][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:20,519][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:25,526][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:30,528][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:35,529][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:40,532][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:45,537][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:50,541][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:25:55,545][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:00,549][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:05,550][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:10,568][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:15,583][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:20,587][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:25,588][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:30,591][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:35,593][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:40,596][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:45,597][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:50,606][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:26:55,616][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:00,618][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:05,619][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:10,624][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:15,626][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:20,628][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:25,631][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:30,637][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:35,648][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:40,654][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:45,659][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:50,660][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:27:55,662][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:00,663][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:05,665][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:10,666][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:15,668][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:20,669][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:25,670][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:30,671][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:35,673][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:40,674][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:45,675][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:50,678][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:28:55,680][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:00,683][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:05,685][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:10,686][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:15,702][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:20,708][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:25,709][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:30,713][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:35,714][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:40,715][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:45,717][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:50,720][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:29:55,722][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:00,724][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:05,727][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:10,731][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:15,733][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:20,736][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:25,737][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:30,740][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:35,743][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:40,744][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:45,745][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:50,747][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:30:55,748][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:00,749][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:05,782][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:10,785][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:15,788][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:20,791][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:25,804][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 11:31:25,805][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:30,809][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:35,810][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:40,811][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:45,814][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:50,826][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:31:55,831][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:00,835][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:05,837][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:10,839][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:15,844][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:20,845][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:25,847][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:30,849][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:35,852][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:40,854][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:45,855][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:50,860][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:32:55,868][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:00,874][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:05,876][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:10,883][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:15,887][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:20,888][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:25,890][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:30,893][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:35,895][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:40,898][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:45,902][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:50,912][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:33:55,915][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:00,937][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:05,939][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:10,942][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:15,943][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:20,945][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:25,947][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:30,949][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:35,950][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:40,955][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:45,957][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:51,013][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:34:56,019][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:01,021][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:06,033][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:11,038][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:16,039][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:21,049][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:26,050][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:31,055][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:36,057][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:41,059][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:46,060][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:51,062][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:35:56,063][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:01,064][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:06,066][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:11,067][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:16,068][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:21,069][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:26,071][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:31,072][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:36,073][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:41,075][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:46,083][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:51,086][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:36:56,091][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:01,094][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:06,095][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:11,096][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:16,096][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:21,103][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:26,106][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:31,107][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:36,109][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:41,110][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:46,116][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:51,127][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:37:56,128][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:01,129][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:06,131][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:11,132][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:15,896][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 11:38:16,137][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:21,142][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:25,900][WARNING][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 11:38:26,157][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:31,162][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:35,901][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 2 [2025-07-24 11:38:35,902][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.158 copr-rpmbuild-log [2025-07-24 11:38:36,163][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:41,164][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:46,165][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:51,166][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:38:56,167][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:01,168][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:06,169][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:11,171][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:16,174][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:21,176][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:26,205][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:31,206][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:36,218][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:41,221][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:46,225][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:51,227][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:39:56,239][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:01,243][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:06,244][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:11,246][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:16,249][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:21,253][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:26,257][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:31,259][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:36,262][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:38,637][ ERROR][PID:3231893] Re-try request for task on 'ResallocHost, ticket_id=4090935, hostname=140.211.168.158, name=copr_osuosl_p09_prod_05786607_20250724_110645, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: copr-rpmbuild-log shouldn't exit != 0 [2025-07-24 11:40:38,641][ INFO][PID:3231893] Releasing VM back to pool [2025-07-24 11:40:38,660][ INFO][PID:3231893] Retry #2 (on other host) [2025-07-24 11:40:38,661][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:38,663][ INFO][PID:3231893] VM allocation process starts [2025-07-24 11:40:38,687][ INFO][PID:3231893] Trying to allocate VM: ResallocHost, ticket_id=4091665, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-24 11:40:43,690][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:48,692][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:53,695][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:40:58,702][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:03,709][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:08,710][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:13,713][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:18,714][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:23,715][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:28,717][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:33,718][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:38,720][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:43,721][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:48,723][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:53,724][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:41:58,725][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:03,726][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:06,862][ INFO][PID:3231893] Allocated host ResallocHost, ticket_id=4091665, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05789200_20250724_113825, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-24 11:42:06,863][ INFO][PID:3231893] Allocating ssh connection to builder [2025-07-24 11:42:06,863][ INFO][PID:3231893] Checking that builder machine is OK [2025-07-24 11:42:08,220][ INFO][PID:3231893] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2025-07-24 11:42:09,234][ INFO][PID:3231893] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2025-07-24 11:42:09,235][ INFO][PID:3231893] Filling build.info file with builder info [2025-07-24 11:42:09,238][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:09,241][ INFO][PID:3231893] Not re-notifying FE and msg buses for the new host. [2025-07-24 11:42:09,241][ INFO][PID:3231893] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9317795-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2025-07-24 11:42:10,731][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 1 [2025-07-24 11:42:10,739][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-24 11:42:15,749][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 11:42:15,750][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:20,756][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:25,759][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:30,760][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:35,762][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:40,764][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:45,765][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:50,766][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:42:55,769][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:00,771][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:05,772][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:10,773][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:15,775][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:20,788][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:25,791][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:30,792][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:35,794][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:40,799][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:45,802][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:50,806][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:43:55,808][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:00,809][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:05,814][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:10,815][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:15,817][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:20,818][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:25,819][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:30,820][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:35,821][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:40,822][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:45,824][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:50,825][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:44:55,826][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:00,827][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:05,828][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:10,836][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:15,837][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:20,839][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:25,840][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:30,843][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:35,844][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:40,845][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:45,847][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:50,849][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:45:55,854][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:00,862][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:05,864][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:10,865][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:15,866][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:20,870][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:25,871][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:30,873][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:35,876][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:40,877][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:45,878][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:50,880][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:46:55,881][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:00,884][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:05,885][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:10,886][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:15,888][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:20,890][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:25,892][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:30,893][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:35,894][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:40,896][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:45,897][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:50,902][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:47:55,903][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:00,904][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:05,905][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:10,907][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:15,909][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:20,912][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:25,914][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:30,915][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:35,917][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:40,919][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:45,920][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:50,921][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:48:55,922][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:00,923][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:05,925][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:10,926][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:15,927][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:20,929][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:25,930][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:30,931][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:35,933][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:40,934][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:45,935][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:50,936][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:49:55,938][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:00,943][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:05,945][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:10,946][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:15,947][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:20,950][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:25,951][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:30,952][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:35,953][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:40,954][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:45,955][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:50,956][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:50:55,957][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:00,958][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:05,959][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:10,960][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:15,961][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:20,962][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:25,963][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:30,965][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:35,966][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:40,967][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:45,968][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:50,970][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:51:55,971][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:00,972][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:05,973][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:10,974][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:15,983][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 11:52:15,983][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:20,984][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:25,986][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:30,987][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:35,988][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:40,989][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:45,990][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:50,992][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:52:55,993][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:00,994][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:05,995][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:10,996][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:15,997][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:20,999][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:26,001][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:31,003][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:36,004][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:41,005][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:46,006][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:51,007][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:53:56,008][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:01,009][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:06,010][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:11,011][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:16,012][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:21,013][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:26,014][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:31,015][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:36,016][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:41,018][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:46,019][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:51,020][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:54:56,021][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:01,023][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:06,024][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:11,025][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:16,026][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:21,027][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:26,028][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:31,029][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:36,030][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:41,031][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:46,032][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:51,033][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:55:56,034][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:01,035][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:06,036][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:11,037][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:16,038][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:21,039][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:26,040][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:31,041][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:36,042][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:41,044][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:46,045][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:51,046][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:56:56,047][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:01,048][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:06,049][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:11,050][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:16,051][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:21,053][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:26,054][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:31,057][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:36,059][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:41,060][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:46,061][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:51,062][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:57:56,063][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:01,064][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:06,065][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:11,067][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:16,069][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:21,071][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:26,072][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:31,073][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:36,074][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:41,075][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:46,076][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:51,077][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:58:56,079][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:01,080][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:06,081][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:11,082][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:16,084][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:21,085][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:26,086][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:31,087][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:36,088][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:41,089][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:46,090][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:51,091][ INFO][PID:3231893] Checking for cancel request [2025-07-24 11:59:56,092][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:01,093][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:06,095][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:11,096][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:16,097][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:21,098][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:26,100][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:31,105][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:36,106][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:41,107][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:46,109][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:51,110][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:00:56,112][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:01,113][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:06,114][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:11,115][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:16,118][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:21,120][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:26,121][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:31,123][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:36,124][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:41,125][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:46,126][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:51,128][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:01:56,130][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:01,134][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:06,135][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:11,136][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:16,164][ INFO][PID:3231893] Periodic builder liveness probe: alive [2025-07-24 12:02:16,166][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:21,168][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:26,177][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:31,180][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:36,182][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:41,186][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:46,187][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:51,188][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:02:56,190][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:01,191][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:06,192][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:11,194][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:16,195][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:21,196][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:26,197][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:31,199][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:36,200][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:41,201][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:46,203][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:51,214][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:03:56,215][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:01,216][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:06,218][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:11,221][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:16,223][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:21,225][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:26,226][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:31,227][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:36,228][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:41,230][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:46,231][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:51,234][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:04:56,236][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:01,240][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:06,243][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:11,245][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:16,247][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:21,258][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:26,259][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:31,260][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:36,261][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:41,264][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:46,266][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:51,268][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:05:56,286][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:01,288][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:06,298][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:11,301][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:16,302][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:21,304][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:26,307][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:31,309][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:36,311][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:41,313][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:46,314][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:51,315][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:06:56,316][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:01,317][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:06,319][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:11,321][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:16,322][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:21,325][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:26,328][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:31,329][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:36,331][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:41,332][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:46,334][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:51,335][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:07:56,336][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:01,337][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:06,340][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:11,344][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:16,352][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:21,355][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:26,359][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:31,365][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:36,369][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:41,380][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:46,381][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:51,390][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:08:56,395][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:01,396][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:06,401][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:11,403][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:16,414][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:21,418][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:26,431][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:31,434][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:36,435][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:41,445][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:46,446][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:51,451][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:09:56,456][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:01,457][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:06,459][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:11,461][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:16,464][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:21,465][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:26,467][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:31,468][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:36,481][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:41,482][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:46,485][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:51,487][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:10:56,490][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:01,493][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:06,495][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:11,498][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:16,501][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:21,505][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:26,508][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:31,510][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:34,148][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 12:11:36,514][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:41,515][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:44,150][WARNING][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 12:11:46,519][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:51,523][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:11:54,156][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 2 [2025-07-24 12:11:54,162][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-24 12:11:56,524][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:12:01,525][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:12:06,530][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:12:11,539][ INFO][PID:3231893] Checking for cancel request [2025-07-24 12:12:16,592][ INFO][PID:3231893] Periodic builder liveness probe: dead [2025-07-24 12:12:54,261][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 12:13:04,281][WARNING][PID:3231893] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 12:13:14,285][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 3 [2025-07-24 12:13:14,297][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-24 12:13:16,724][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.35 port 22: Connection timed out [2025-07-24 12:14:04,636][ INFO][PID:3231893] Cancel request succeeded out: err: Warning: Permanently added '140.211.168.35' (ED25519) to the list of known hosts. Unexpected exception Traceback (most recent call last): File "/usr/bin/copr-rpmbuild-cancel", line 86, in _main() ~~~~~^^ File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main with open(pidfile, "r") as pidfd: ~~~~^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid' [2025-07-24 12:14:14,396][ ERROR][PID:3231893] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 12:14:24,403][WARNING][PID:3231893] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 12:14:34,406][ INFO][PID:3231893] Downloading the builder-live.log file, attempt 4 [2025-07-24 12:14:34,408][ INFO][PID:3231893] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log [2025-07-24 12:16:36,449][ ERROR][PID:3231893] Re-try request for task on 'ResallocHost, ticket_id=4091665, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05789200_20250724_113825, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-24 12:16:36,450][ INFO][PID:3231893] Releasing VM back to pool [2025-07-24 12:16:36,464][ ERROR][PID:3231893] Backend process error: Three host tried without success: {'140.211.168.35', '140.211.168.89', '140.211.168.158'} [2025-07-24 12:16:36,465][WARNING][PID:3231893] Switching not-finished job state to 'failed' [2025-07-24 12:16:36,465][ INFO][PID:3231893] Worker failed build, took 2067.223995923996 [2025-07-24 12:16:36,466][ INFO][PID:3231893] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "podman-next", "project_dirname": "podman-next", "submitter": "packit", "ended_on": 1753359396.465155, "started_on": 1753357329.241159, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9317795-centos-stream-9-ppc64le", "build_id": 9317795, "package_name": "ramalama", "package_version": "0.11.1-1000.1.20250724104548482143.main.18.g61e7360", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/ramalama", "git_hash": "fa4548ee4e314a7134d3522ab027dd89d9254740", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/podman-next--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://dl.fedoraproject.org/pub/epel/9/Everything/$basearch/", "id": "https_dl_fedoraproject_org_pub_epel_9_Everything_basearch", "name": "Additional repo https_dl_fedoraproject_org_pub_epel_9_Everything_basearch" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next", "result_dir": "09317795-ramalama", "built_packages": "", "id": 9317795, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "podman-next", "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)" } } ] } [2025-07-24 12:16:36,518][ INFO][PID:3231893] Sending fedora-messaging bus message in build.end [2025-07-24 12:16:36,545][ INFO][PID:3231893] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09317795-ramalama/builder-live.log by gzip [2025-07-24 12:16:36,546][ INFO][PID:3231893] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09317795-ramalama/builder-live.log' as PID 3928513 [2025-07-24 12:16:36,549][ INFO][PID:3231893] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09317795-ramalama/builder-live.log) [2025-07-24 12:16:36,550][ INFO][PID:3231893] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09317795-ramalama/backend.log by gzip [2025-07-24 12:16:36,551][ INFO][PID:3231893] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-9-ppc64le/09317795-ramalama/backend.log' as PID 3928515