[2025-07-23 14:56:28,920][  INFO][PID:3629014] Marking build as starting
[2025-07-23 14:56:29,023][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:56:29,038][  INFO][PID:3629014] VM allocation process starts
[2025-07-23 14:56:29,067][  INFO][PID:3629014] Trying to allocate VM: ResallocHost, ticket_id=4067841, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 14:56:32,113][  INFO][PID:3629014] Allocated host ResallocHost, ticket_id=4067841, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05761473_20250723_143603, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 14:56:32,113][  INFO][PID:3629014] Allocating ssh connection to builder
[2025-07-23 14:56:32,114][  INFO][PID:3629014] Checking that builder machine is OK
[2025-07-23 14:56:33,482][  INFO][PID:3629014] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-07-23 14:56:34,470][  INFO][PID:3629014] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-07-23 14:56:34,471][  INFO][PID:3629014] Filling build.info file with builder info
[2025-07-23 14:56:34,472][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:56:34,474][  INFO][PID:3629014] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1753282594.4740496,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9312726-centos-stream-9-ppc64le",
            "build_id": 9312726,
            "package_name": "bootc",
            "package_version": "202507231449.g6607f10ed6-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "50375483f9bfed1b8117135148b4121490b2786f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09312726-bootc",
            "built_packages": "",
            "id": 9312726,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-07-23 14:56:34,544][  INFO][PID:3629014] Sending fedora-messaging bus message in build.start
[2025-07-23 14:56:35,508][  INFO][PID:3629014] Sending fedora-messaging bus message in chroot.start
[2025-07-23 14:56:35,538][  INFO][PID:3629014] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9312726-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-07-23 14:56:36,835][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 1
[2025-07-23 14:56:36,844][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log
[2025-07-23 14:56:41,851][  INFO][PID:3629014] Periodic builder liveness probe: alive
[2025-07-23 14:56:41,853][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:56:46,856][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:56:51,857][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:56:56,859][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:01,862][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:06,864][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:11,866][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:16,867][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:21,869][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:26,870][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:31,872][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:36,879][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:41,881][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:46,883][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:51,884][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:57:56,885][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:01,891][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:06,892][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:11,893][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:16,898][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:21,916][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:26,918][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:31,919][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:36,920][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:41,922][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:46,923][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:51,924][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:58:56,925][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:01,926][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:06,929][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:11,931][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:16,932][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:21,933][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:26,935][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:31,939][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:36,940][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:41,941][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:46,942][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:51,943][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 14:59:56,944][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:01,946][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:06,947][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:11,950][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:16,951][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:20,139][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:00:21,952][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:26,954][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:30,144][WARNING][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:00:31,959][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:36,965][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:40,148][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 2
[2025-07-23 15:00:40,150][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log
[2025-07-23 15:00:41,966][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:46,968][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:51,969][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:00:56,970][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:01,971][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:06,974][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:11,975][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:16,976][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:21,977][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:26,980][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:31,982][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:36,983][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:40,291][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:01:41,984][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:46,986][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:50,294][WARNING][PID:3629014] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:01:51,987][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:01:56,992][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:00,305][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 3
[2025-07-23 15:02:00,309][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log
[2025-07-23 15:02:01,994][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:06,997][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:11,998][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:17,002][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:22,003][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:27,004][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:32,006][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:37,008][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:42,012][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:47,016][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:52,018][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:02:57,019][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:00,458][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:03:02,021][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:07,022][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:10,463][WARNING][PID:3629014] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:03:12,024][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:17,025][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:20,464][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 4
[2025-07-23 15:03:20,465][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log
[2025-07-23 15:03:22,026][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:27,028][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:32,033][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:37,034][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:42,038][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:47,041][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:52,042][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:03:57,043][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:02,044][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:07,046][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:12,047][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:17,048][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:20,602][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:04:22,049][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:27,050][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:30,603][ ERROR][PID:3629014] Giving up for unstable SSH, failures: 1753282830.144134, 1753282910.2941813, 1753282990.4632623, 1753283070.6036694
[2025-07-23 15:04:30,604][ ERROR][PID:3629014] Re-try request for task on 'ResallocHost, ticket_id=4067841, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05761473_20250723_143603, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-23 15:04:30,605][  INFO][PID:3629014] Releasing VM back to pool
[2025-07-23 15:04:30,616][  INFO][PID:3629014] Retry #1 (on other host)
[2025-07-23 15:04:30,616][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:30,617][  INFO][PID:3629014] VM allocation process starts
[2025-07-23 15:04:30,628][  INFO][PID:3629014] Trying to allocate VM: ResallocHost, ticket_id=4068105, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 15:04:33,659][  INFO][PID:3629014] Allocated host ResallocHost, ticket_id=4068105, hostname=140.211.168.35, name=copr_osuosl_p09_prod_05761763_20250723_145447, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 15:04:33,662][  INFO][PID:3629014] Allocating ssh connection to builder
[2025-07-23 15:04:33,663][  INFO][PID:3629014] Checking that builder machine is OK
[2025-07-23 15:04:35,208][  INFO][PID:3629014] Running remote command: copr-builder-ready centos-stream-9-ppc64le
[2025-07-23 15:04:36,271][  INFO][PID:3629014] Red Hat subscription not needed for centos-stream-9-ppc64le
Builder is ready to be used

[2025-07-23 15:04:36,272][  INFO][PID:3629014] Filling build.info file with builder info
[2025-07-23 15:04:36,278][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:36,280][  INFO][PID:3629014] Not re-notifying FE and msg buses for the new host.
[2025-07-23 15:04:36,280][  INFO][PID:3629014] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9312726-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached
[2025-07-23 15:04:37,782][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 1
[2025-07-23 15:04:37,784][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-23 15:04:42,782][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:47,784][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:52,785][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:04:57,787][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:02,788][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:07,789][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:12,790][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:17,793][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:22,799][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:27,803][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:32,809][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:37,832][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:42,838][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:47,855][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:52,862][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:05:57,866][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:02,870][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:07,880][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:12,882][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:17,888][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:22,890][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:27,891][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:32,893][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:37,895][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:42,922][  INFO][PID:3629014] Periodic builder liveness probe: alive
[2025-07-23 15:06:42,925][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:47,932][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:52,936][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:06:57,940][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:02,954][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:07,955][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:12,962][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:17,965][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:22,969][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:27,972][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:32,974][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:37,976][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:42,980][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:47,982][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:52,987][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:07:57,990][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:02,993][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:07,999][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:13,004][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:18,009][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:23,015][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:28,019][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:33,022][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:38,025][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:43,029][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:48,030][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:53,045][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:08:58,047][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:03,053][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:08,060][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:13,072][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:18,073][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:23,084][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:28,091][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:33,092][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:38,097][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:43,101][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:09:48,109][  INFO][PID:3629014] Checking for cancel request
[2025-07-23 15:10:48,293][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.35 port 22 timed out

[2025-07-23 15:11:58,471][ ERROR][PID:3629014] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.35 port 22 timed out

[2025-07-23 15:13:08,706][ ERROR][PID:3629014] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.35 port 22 timed out

[2025-07-23 15:14:18,909][ ERROR][PID:3629014] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.35 port 22 timed out

[2025-07-23 15:14:28,928][ ERROR][PID:3629014] Can't ssh to cancel build.
[2025-07-23 15:30:13,145][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:30:23,159][WARNING][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:30:33,163][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 2
[2025-07-23 15:30:33,183][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-23 15:31:33,280][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:31:43,286][WARNING][PID:3629014] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:31:53,287][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 3
[2025-07-23 15:31:53,292][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-23 15:32:53,419][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:33:03,423][WARNING][PID:3629014] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 15:33:13,426][  INFO][PID:3629014] Downloading the builder-live.log file, attempt 4
[2025-07-23 15:33:13,440][  INFO][PID:3629014] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.35 copr-rpmbuild-log
[2025-07-23 15:34:13,566][ ERROR][PID:3629014] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 15:34:23,570][ ERROR][PID:3629014] Giving up for unstable SSH, failures: 1753284623.1596768, 1753284703.2867262, 1753284783.4235818, 1753284863.5698826
[2025-07-23 15:34:23,575][ ERROR][PID:3629014] Build was canceled
[2025-07-23 15:34:23,575][  INFO][PID:3629014] Releasing VM back to pool
[2025-07-23 15:34:23,602][WARNING][PID:3629014] Switching not-finished job state to 'failed'
[2025-07-23 15:34:23,609][  INFO][PID:3629014] Worker failed build, took 1787.3223989009857
[2025-07-23 15:34:23,612][  INFO][PID:3629014] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "rhcontainerbot",
            "project_name": "bootc",
            "project_dirname": "bootc",
            "submitter": "packit",
            "ended_on": 1753284863.6025596,
            "started_on": 1753283076.2801607,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9312726-centos-stream-9-ppc64le",
            "build_id": 9312726,
            "package_name": "bootc",
            "package_version": "202507231449.g6607f10ed6-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc",
            "git_hash": "50375483f9bfed1b8117135148b4121490b2786f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rhcontainerbot/bootc--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc",
            "result_dir": "09312726-bootc",
            "built_packages": "",
            "id": 9312726,
            "mockchain_macros": {
                "copr_username": "rhcontainerbot",
                "copr_projectname": "bootc",
                "vendor": "Fedora Project COPR (rhcontainerbot/bootc)"
            }
        }
    ]
}
[2025-07-23 15:34:23,679][  INFO][PID:3629014] Sending fedora-messaging bus message in build.end
[2025-07-23 15:34:23,743][  INFO][PID:3629014] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/09312726-bootc/builder-live.log by gzip
[2025-07-23 15:34:23,751][  INFO][PID:3629014] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/09312726-bootc/builder-live.log' as PID 4002337
[2025-07-23 15:34:23,752][  INFO][PID:3629014] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/09312726-bootc/builder-live.log)
[2025-07-23 15:34:23,754][  INFO][PID:3629014] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/09312726-bootc/backend.log by gzip
[2025-07-23 15:34:23,762][  INFO][PID:3629014] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/centos-stream-9-ppc64le/09312726-bootc/backend.log' as PID 4002338