[2025-06-25 18:52:14,246][ INFO][PID:1406870] Marking build as starting [2025-06-25 18:52:14,310][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:14,311][ INFO][PID:1406870] VM allocation process starts [2025-06-25 18:52:14,328][ INFO][PID:1406870] Trying to allocate VM: ResallocHost, ticket_id=3667297, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-06-25 18:52:19,330][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:24,331][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:29,335][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:34,336][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:39,338][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:44,341][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:49,348][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:54,349][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:52:59,354][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:04,360][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:09,366][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:14,371][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:19,372][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:24,378][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:29,386][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:34,391][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:39,394][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:44,401][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:49,409][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:54,412][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:53:59,415][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:04,422][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:09,423][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:14,425][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:19,436][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:24,437][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:29,443][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:34,444][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:39,446][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:44,448][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:49,449][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:54,451][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:54:59,458][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:04,462][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:09,463][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:14,465][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:19,471][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:24,472][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:29,473][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:34,477][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:39,481][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:44,489][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:49,490][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:54,491][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:55:59,498][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:04,501][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:09,503][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:14,514][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:19,519][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:24,520][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:29,522][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:34,527][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:39,530][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:44,535][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:49,543][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:54,546][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:56:59,550][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:04,555][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:09,559][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:14,562][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:19,567][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:24,570][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:29,572][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:34,578][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:39,584][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:44,587][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:49,590][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:54,596][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:57:59,601][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:04,606][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:09,609][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:14,614][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:19,622][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:24,624][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:29,625][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:34,636][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:39,638][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:44,641][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:49,657][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:54,659][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:58:59,670][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:04,674][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:09,678][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:14,681][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:19,685][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:24,688][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:29,695][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:32,626][ INFO][PID:1406870] Allocated host ResallocHost, ticket_id=3667297, hostname=140.211.168.190, name=copr_osuosl_p09_prod_05002623_20250625_185539, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-06-25 18:59:32,627][ INFO][PID:1406870] Allocating ssh connection to builder [2025-06-25 18:59:32,629][ INFO][PID:1406870] Checking that builder machine is OK [2025-06-25 18:59:34,235][ INFO][PID:1406870] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-06-25 18:59:35,305][ INFO][PID:1406870] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2025-06-25 18:59:35,306][ INFO][PID:1406870] Filling build.info file with builder info [2025-06-25 18:59:35,307][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:35,310][ INFO][PID:1406870] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "packit", "project_name": "osbuild-osbuild-composer-4758", "project_dirname": "osbuild-osbuild-composer-4758", "submitter": "packit", "ended_on": null, "started_on": 1750877975.3094592, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9211116-centos-stream-10-ppc64le", "build_id": 9211116, "package_name": "osbuild-composer", "package_version": "144-1.20250625184928476629.pr4758.2.gcf8264eaa", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-osbuild-composer-4758/osbuild-composer", "git_hash": "21267734390575eaf3249aa62e1fab437098c0a6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "packit/osbuild-osbuild-composer-4758--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4758", "result_dir": "09211116-osbuild-composer", "built_packages": "", "id": 9211116, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "osbuild-osbuild-composer-4758", "vendor": "Fedora Project COPR (packit/osbuild-osbuild-composer-4758)" } } ] } [2025-06-25 18:59:35,385][ INFO][PID:1406870] Sending fedora-messaging bus message in build.start [2025-06-25 18:59:36,449][ INFO][PID:1406870] Sending fedora-messaging bus message in chroot.start [2025-06-25 18:59:36,470][ INFO][PID:1406870] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9211116-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2025-06-25 18:59:37,798][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 1 [2025-06-25 18:59:37,809][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.190 copr-rpmbuild-log [2025-06-25 18:59:42,823][ INFO][PID:1406870] Periodic builder liveness probe: alive [2025-06-25 18:59:42,825][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:47,828][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:52,840][ INFO][PID:1406870] Checking for cancel request [2025-06-25 18:59:57,846][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:02,847][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:07,849][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:12,858][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:17,870][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:22,875][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:27,882][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:32,886][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:37,888][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:42,893][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:47,899][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:52,901][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:00:57,905][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:02,908][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:07,915][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:12,916][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:17,921][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:22,922][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:27,931][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:32,937][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:37,939][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:42,947][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:47,949][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:52,952][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:01:57,954][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:02,959][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:07,963][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:12,964][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:17,967][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:22,971][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:27,979][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:32,980][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:37,982][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:42,985][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:47,988][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:52,990][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:02:57,993][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:02,997][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:08,005][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:13,013][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:18,035][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:23,036][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:23,139][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:03:28,041][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:33,043][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:33,141][WARNING][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:03:38,046][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:43,048][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:43,146][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 2 [2025-06-25 19:03:43,148][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.190 copr-rpmbuild-log [2025-06-25 19:03:48,058][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:53,062][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:03:58,065][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:03,073][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:08,074][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:13,076][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:18,078][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:23,084][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:28,085][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:33,087][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:38,090][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:43,092][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:43,294][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:04:48,093][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:53,094][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:04:53,296][WARNING][PID:1406870] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:04:58,097][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:03,104][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:03,297][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 3 [2025-06-25 19:05:03,300][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.190 copr-rpmbuild-log [2025-06-25 19:05:08,107][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:13,112][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:18,116][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:23,120][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:28,122][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:33,126][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:38,127][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:43,131][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:48,132][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:53,135][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:05:58,137][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:03,142][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:03,441][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:06:08,143][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:13,145][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:13,444][WARNING][PID:1406870] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:06:18,151][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:23,155][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:23,448][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 4 [2025-06-25 19:06:23,453][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.190 copr-rpmbuild-log [2025-06-25 19:06:28,161][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:33,162][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:38,167][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:43,169][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:48,175][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:53,176][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:06:58,178][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:03,180][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:08,182][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:13,183][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:18,185][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:23,188][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:23,606][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:07:28,193][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:33,194][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:33,644][ ERROR][PID:1406870] Giving up for unstable SSH, failures: 1750878213.14115, 1750878293.2962854, 1750878373.4442956, 1750878453.6445758 [2025-06-25 19:07:33,645][ ERROR][PID:1406870] Re-try request for task on 'ResallocHost, ticket_id=3667297, hostname=140.211.168.190, name=copr_osuosl_p09_prod_05002623_20250625_185539, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-06-25 19:07:33,646][ INFO][PID:1406870] Releasing VM back to pool [2025-06-25 19:07:33,656][ INFO][PID:1406870] Retry #1 (on other host) [2025-06-25 19:07:33,657][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:33,657][ INFO][PID:1406870] VM allocation process starts [2025-06-25 19:07:33,669][ INFO][PID:1406870] Trying to allocate VM: ResallocHost, ticket_id=3667690, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-06-25 19:07:38,671][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:43,673][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:48,675][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:53,678][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:07:58,679][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:03,680][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:08,682][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:13,686][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:18,689][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:23,691][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:28,693][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:33,695][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:38,700][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:43,702][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:48,711][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:53,713][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:08:58,717][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:03,718][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:08,719][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:13,722][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:18,725][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:23,729][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:28,733][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:33,734][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:38,735][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:43,739][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:48,743][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:53,746][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:09:58,750][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:03,753][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:08,761][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:13,768][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:18,771][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:23,772][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:28,777][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:33,778][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:38,780][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:43,787][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:48,788][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:53,790][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:10:58,791][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:03,792][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:08,793][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:13,795][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:18,796][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:23,800][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:28,801][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:33,802][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:38,808][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:43,810][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:48,816][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:53,817][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:11:58,825][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:03,835][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:08,838][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:13,840][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:18,844][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:23,855][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:28,872][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:33,875][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:38,876][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:43,879][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:48,885][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:51,900][ INFO][PID:1406870] Allocated host ResallocHost, ticket_id=3667690, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_05003263_20250625_191105, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-06-25 19:12:51,901][ INFO][PID:1406870] Allocating ssh connection to builder [2025-06-25 19:12:51,903][ INFO][PID:1406870] Checking that builder machine is OK [2025-06-25 19:12:52,790][ INFO][PID:1406870] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-06-25 19:12:53,247][ INFO][PID:1406870] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2025-06-25 19:12:53,248][ INFO][PID:1406870] Filling build.info file with builder info [2025-06-25 19:12:53,258][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:12:53,260][ INFO][PID:1406870] Not re-notifying FE and msg buses for the new host. [2025-06-25 19:12:53,262][ INFO][PID:1406870] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9211116-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2025-06-25 19:12:53,968][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 1 [2025-06-25 19:12:53,969][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-06-25 19:12:59,002][ INFO][PID:1406870] Periodic builder liveness probe: alive [2025-06-25 19:12:59,005][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:04,012][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:09,020][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:14,032][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:19,035][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:24,040][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:29,042][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:34,043][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:39,045][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:44,048][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:49,051][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:54,053][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:13:59,057][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:04,058][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:09,061][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:14,064][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:19,074][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:24,075][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:29,077][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:34,085][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:39,101][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:44,115][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:49,117][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:54,123][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:14:59,126][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:04,128][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:09,136][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:14,142][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:19,149][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:24,154][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:29,155][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:34,158][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:39,160][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:44,162][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:49,167][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:54,171][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:15:59,172][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:04,173][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:09,174][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:14,178][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:19,180][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:24,184][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:29,187][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:34,189][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:39,196][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:44,199][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:49,202][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:54,203][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:16:59,208][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:04,211][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:09,213][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:14,218][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:19,220][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:24,222][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:29,225][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:34,230][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:39,236][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:44,241][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:49,243][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:54,246][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:17:59,253][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:04,254][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:09,257][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:14,259][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:19,264][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:24,266][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:29,270][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:34,275][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:39,281][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:44,284][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:49,288][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:54,290][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:18:59,294][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:04,299][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:09,303][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:14,309][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:19,313][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:24,317][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:29,323][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:34,325][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:39,326][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:44,329][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:49,334][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:54,336][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:19:59,338][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:04,342][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:09,343][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:14,346][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:19,348][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:24,349][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:29,351][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:34,352][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:39,354][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:44,357][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:49,363][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:54,365][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:20:59,368][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:04,373][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:09,374][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:14,377][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:19,382][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:24,384][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:29,387][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:34,388][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:39,389][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:44,393][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:49,399][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:54,401][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:21:59,403][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:04,404][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:09,407][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:14,409][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:19,411][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:24,415][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:29,420][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:34,422][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:39,424][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:44,429][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:49,432][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:54,434][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:22:59,485][ INFO][PID:1406870] Periodic builder liveness probe: alive [2025-06-25 19:22:59,488][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:04,499][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:09,505][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:14,507][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:19,509][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:24,517][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:29,527][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:34,536][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:39,541][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:44,542][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:49,544][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:54,552][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:23:59,565][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:04,576][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:09,139][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:24:09,581][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:14,583][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:19,141][WARNING][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:24:19,586][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:24,589][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:29,142][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 2 [2025-06-25 19:24:29,153][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-06-25 19:24:29,595][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:34,597][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:39,599][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:44,609][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:49,610][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:54,614][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:24:59,617][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:04,619][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:09,622][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:14,625][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:19,626][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:24,630][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:29,226][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:25:29,638][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:34,642][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:39,230][WARNING][PID:1406870] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:25:39,643][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:44,646][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:49,233][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 3 [2025-06-25 19:25:49,234][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-06-25 19:25:49,648][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:54,650][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:25:59,652][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:04,654][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:09,656][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:14,660][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:19,666][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:24,669][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:29,672][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:34,675][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:39,676][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:44,689][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:49,319][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:26:49,691][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:54,698][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:26:59,319][WARNING][PID:1406870] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:26:59,702][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:04,703][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:09,323][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 4 [2025-06-25 19:27:09,325][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log [2025-06-25 19:27:09,706][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:14,708][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:19,711][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:24,713][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:29,715][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:34,717][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:39,721][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:44,724][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:49,729][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:54,734][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:27:59,735][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:04,736][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:09,402][ ERROR][PID:1406870] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:28:09,737][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:14,738][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:19,404][ ERROR][PID:1406870] Giving up for unstable SSH, failures: 1750879459.1411161, 1750879539.230321, 1750879619.319893, 1750879699.403973 [2025-06-25 19:28:19,405][ ERROR][PID:1406870] Re-try request for task on 'ResallocHost, ticket_id=3667690, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_05003263_20250625_191105, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-06-25 19:28:19,409][ INFO][PID:1406870] Releasing VM back to pool [2025-06-25 19:28:19,431][ INFO][PID:1406870] Retry #2 (on other host) [2025-06-25 19:28:19,433][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:19,434][ INFO][PID:1406870] VM allocation process starts [2025-06-25 19:28:19,465][ INFO][PID:1406870] Trying to allocate VM: ResallocHost, ticket_id=3668372, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-06-25 19:28:24,469][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:29,471][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:34,473][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:39,481][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:44,483][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:49,487][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:54,489][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:28:59,490][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:04,491][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:09,493][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:14,495][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:19,498][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:24,500][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:29,502][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:34,505][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:39,508][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:44,509][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:49,510][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:54,514][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:29:59,515][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:04,523][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:09,524][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:14,526][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:19,528][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:24,529][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:29,531][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:34,534][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:39,535][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:44,537][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:49,539][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:54,544][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:30:59,545][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:04,550][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:09,551][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:14,552][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:19,554][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:24,560][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:29,562][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:34,567][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:39,570][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:44,573][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:49,575][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:54,576][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:31:59,578][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:04,579][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:09,580][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:14,581][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:19,582][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:24,583][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:29,585][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:34,586][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:39,588][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:44,590][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:49,592][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:54,595][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:32:59,598][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:04,602][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:09,606][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:14,608][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:19,610][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:24,614][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:29,617][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:34,623][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:37,682][ INFO][PID:1406870] Allocated host ResallocHost, ticket_id=3668372, hostname=2620:52:3:1:dead:beef:cafe:c292, name=copr_p09_01_prod_05004054_20250625_193152, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-06-25 19:33:37,682][ INFO][PID:1406870] Allocating ssh connection to builder [2025-06-25 19:33:37,684][ INFO][PID:1406870] Checking that builder machine is OK [2025-06-25 19:33:38,548][ INFO][PID:1406870] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-06-25 19:33:39,006][ INFO][PID:1406870] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2025-06-25 19:33:39,006][ INFO][PID:1406870] Filling build.info file with builder info [2025-06-25 19:33:39,010][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:39,011][ INFO][PID:1406870] Not re-notifying FE and msg buses for the new host. [2025-06-25 19:33:39,012][ INFO][PID:1406870] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9211116-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2025-06-25 19:33:39,870][ INFO][PID:1406870] Downloading the builder-live.log file, attempt 1 [2025-06-25 19:33:39,874][ INFO][PID:1406870] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c292 copr-rpmbuild-log [2025-06-25 19:33:44,884][ INFO][PID:1406870] Periodic builder liveness probe: alive [2025-06-25 19:33:44,887][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:49,890][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:54,893][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:33:59,894][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:04,896][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:09,902][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:14,903][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:19,906][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:24,909][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:29,910][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:34,913][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:39,919][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:44,923][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:49,926][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:54,928][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:34:59,931][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:04,932][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:09,933][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:14,935][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:19,938][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:24,939][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:29,940][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:34,943][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:39,950][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:44,954][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:49,955][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:54,957][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:35:59,958][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:04,961][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:09,962][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:14,966][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:19,967][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:24,969][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:29,971][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:34,974][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:39,976][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:44,977][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:49,987][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:54,992][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:36:59,994][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:04,997][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:10,000][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:15,002][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:20,004][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:25,006][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:30,007][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:35,008][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:40,013][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:45,015][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:50,018][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:37:55,022][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:00,024][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:05,025][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:10,027][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:15,029][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:20,031][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:25,042][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:30,045][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:35,046][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:40,047][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:45,048][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:50,050][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:38:55,053][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:00,054][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:05,055][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:10,063][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:15,065][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:20,067][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:25,068][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:30,071][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:35,072][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:40,073][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:45,075][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:50,076][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:39:55,077][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:00,079][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:05,080][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:10,081][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:15,082][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:20,083][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:25,085][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:30,086][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:35,087][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:40,091][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:45,094][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:50,099][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:40:55,103][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:00,105][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:05,107][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:10,108][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:15,116][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:20,118][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:25,121][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:30,127][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:35,128][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:40,131][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:45,134][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:50,138][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:41:55,141][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:00,143][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:05,145][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:10,154][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:15,158][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:20,159][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:25,161][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:30,165][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:35,167][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:40,173][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:45,174][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:50,176][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:42:55,180][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:00,185][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:05,187][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:10,188][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:15,189][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:20,192][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:25,194][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:30,197][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:35,203][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:40,206][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:45,223][ INFO][PID:1406870] Periodic builder liveness probe: alive [2025-06-25 19:43:45,228][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:50,230][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:43:55,232][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:00,235][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:05,237][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:10,239][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:15,241][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:20,243][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:25,250][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:30,252][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:35,253][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:40,256][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:45,257][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:50,259][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:44:55,261][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:00,266][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:05,272][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:10,275][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:15,280][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:20,287][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:25,289][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:30,300][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:35,305][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:40,312][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:45,314][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:50,315][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:45:55,322][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:00,324][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:05,326][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:10,331][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:15,336][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:20,337][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:25,339][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:30,340][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:35,341][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:40,343][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:45,346][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:50,351][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:46:55,357][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:00,360][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:05,365][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:10,367][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:15,371][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:20,372][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:25,376][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:30,380][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:35,381][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:40,383][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:45,384][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:50,385][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:47:55,387][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:00,389][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:05,392][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:10,393][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:15,396][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:20,398][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:25,399][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:30,400][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:35,402][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:40,404][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:45,407][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:50,408][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:48:55,410][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:00,411][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:05,412][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:10,414][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:15,415][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:20,416][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:25,418][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:30,419][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:35,420][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:40,421][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:45,423][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:50,424][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:49:55,425][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:00,426][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:05,430][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:10,432][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:15,433][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:20,434][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:25,437][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:30,440][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:35,441][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:40,444][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:45,450][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:50,451][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:50:55,452][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:00,453][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:05,455][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:10,456][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:15,462][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:20,464][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:25,465][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:30,466][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:35,467][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:40,474][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:45,478][ INFO][PID:1406870] Checking for cancel request [2025-06-25 19:51:50,138][ INFO][PID:1406870] Downloading results from builder [2025-06-25 19:51:50,141][ INFO][PID:1406870] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c292]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer started [2025-06-25 19:51:50,142][ INFO][PID:1406870] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c292]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/ &> /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/build-09211116.rsync.log [2025-06-25 19:51:55,107][ INFO][PID:1406870] rsyncing finished. [2025-06-25 19:51:55,108][ INFO][PID:1406870] Releasing VM back to pool [2025-06-25 19:51:55,126][ INFO][PID:1406870] Searching for 'success' file in resultdir [2025-06-25 19:51:55,127][ INFO][PID:1406870] Going to sign pkgs from source: 9211116-centos-stream-10-ppc64le in chroot: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le [2025-06-25 19:51:55,128][ INFO][PID:1406870] Calling '/bin/sign -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -p' (attempt #1) [2025-06-25 19:51:55,344][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-core-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:51:56,755][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-core-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:51:56,764][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-worker-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:51:58,532][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-worker-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:51:58,532][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-tests-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:52:01,361][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-tests-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:52:01,362][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-debugsource-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:52:02,623][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-debugsource-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:52:02,624][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.src.rpm' (attempt #1) [2025-06-25 19:52:05,025][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.src.rpm [2025-06-25 19:52:05,028][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-tests-debuginfo-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:52:09,011][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-tests-debuginfo-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:52:09,013][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-worker-debuginfo-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:52:10,783][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-worker-debuginfo-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:52:10,784][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:52:11,617][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:52:11,618][ INFO][PID:1406870] Calling '/bin/sign -4 -h sha256 -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-core-debuginfo-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm' (attempt #1) [2025-06-25 19:52:12,742][ INFO][PID:1406870] signed rpm: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/osbuild-composer-core-debuginfo-144-1.20250625184928476629.pr4758.2.gcf8264eaa.el10.ppc64le.rpm [2025-06-25 19:52:12,743][ INFO][PID:1406870] Sign done [2025-06-25 19:52:12,744][ INFO][PID:1406870] Incremental createrepo run, adding 09211116-osbuild-composer into https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le, (auto-create-repo=True) [2025-06-25 19:52:12,745][ INFO][PID:1406870] Running command 'copr-repo --batched /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le --add 09211116-osbuild-composer --no-appstream-metadata' as PID 2082240 [2025-06-25 19:52:14,157][ INFO][PID:1406870] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le --add 09211116-osbuild-composer --no-appstream-metadata) [2025-06-25 19:52:14,159][ INFO][PID:1406870] Getting build details [2025-06-25 19:52:14,160][ INFO][PID:1406870] Listing built binary packages in /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer [2025-06-25 19:52:14,161][ INFO][PID:1406870] Built packages: ['osbuild-composer-tests 144', 'osbuild-composer-debugsource 144', 'osbuild-composer-tests-debuginfo 144', 'osbuild-composer 144', 'osbuild-composer-core-debuginfo 144', 'osbuild-composer-worker-debuginfo 144', 'osbuild-composer-worker 144', 'osbuild-composer-core 144'] [2025-06-25 19:52:14,162][ INFO][PID:1406870] build details: {'built_packages': 'osbuild-composer-tests 144\nosbuild-composer-debugsource 144\nosbuild-composer-tests-debuginfo 144\nosbuild-composer 144\nosbuild-composer-core-debuginfo 144\nosbuild-composer-worker-debuginfo 144\nosbuild-composer-worker 144\nosbuild-composer-core 144'} [2025-06-25 19:52:14,163][ INFO][PID:1406870] Retrieving pubkey [2025-06-25 19:52:14,164][ INFO][PID:1406870] Calling '/bin/sign -u packit#osbuild-osbuild-composer-4758@copr.fedorahosted.org -p' (attempt #1) [2025-06-25 19:52:14,495][ INFO][PID:1406870] Added pubkey for user packit project osbuild-osbuild-composer-4758 into: /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/pubkey.gpg [2025-06-25 19:52:14,495][ INFO][PID:1406870] Finished build: id=9211116 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758 chroot=centos-stream-10-ppc64le [2025-06-25 19:52:14,500][ INFO][PID:1406870] Worker succeeded build, took 1115.488442182541 [2025-06-25 19:52:14,500][ INFO][PID:1406870] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "packit", "project_name": "osbuild-osbuild-composer-4758", "project_dirname": "osbuild-osbuild-composer-4758", "submitter": "packit", "ended_on": 1750881134.5000224, "started_on": 1750880019.0115802, "submitted_on": null, "status": 1, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9211116-centos-stream-10-ppc64le", "build_id": 9211116, "package_name": "osbuild-composer", "package_version": "144-1.20250625184928476629.pr4758.2.gcf8264eaa", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-osbuild-composer-4758/osbuild-composer", "git_hash": "21267734390575eaf3249aa62e1fab437098c0a6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "packit/osbuild-osbuild-composer-4758--packit", "results": { "packages": [ { "name": "osbuild-composer-tests", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "src" }, { "name": "osbuild-composer-debugsource", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer-tests-debuginfo", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer-core-debuginfo", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer-worker-debuginfo", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer-worker", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" }, { "name": "osbuild-composer-core", "epoch": null, "version": "144", "release": "1.20250625184928476629.pr4758.2.gcf8264eaa.el10", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-osbuild-composer-4758", "result_dir": "09211116-osbuild-composer", "built_packages": "osbuild-composer-tests 144\nosbuild-composer-debugsource 144\nosbuild-composer-tests-debuginfo 144\nosbuild-composer 144\nosbuild-composer-core-debuginfo 144\nosbuild-composer-worker-debuginfo 144\nosbuild-composer-worker 144\nosbuild-composer-core 144", "id": 9211116, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "osbuild-osbuild-composer-4758", "vendor": "Fedora Project COPR (packit/osbuild-osbuild-composer-4758)" } } ] } [2025-06-25 19:52:14,559][ INFO][PID:1406870] Sending fedora-messaging bus message in build.end [2025-06-25 19:52:14,580][ INFO][PID:1406870] Compressing /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/builder-live.log by gzip [2025-06-25 19:52:14,583][ INFO][PID:1406870] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/builder-live.log' as PID 2082598 [2025-06-25 19:52:14,732][ INFO][PID:1406870] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/builder-live.log) [2025-06-25 19:52:14,734][ INFO][PID:1406870] Compressing /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/backend.log by gzip [2025-06-25 19:52:14,735][ INFO][PID:1406870] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-osbuild-composer-4758/centos-stream-10-ppc64le/09211116-osbuild-composer/backend.log' as PID 2082635