[2025-06-18 15:01:04,655][  INFO][PID:1323676] Marking build as starting
[2025-06-18 15:01:05,495][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:05,530][  INFO][PID:1323676] VM allocation process starts
[2025-06-18 15:01:05,662][  INFO][PID:1323676] Trying to allocate VM: ResallocHost, ticket_id=3557590, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-06-18 15:01:10,667][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:15,676][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:20,692][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:23,923][  INFO][PID:1323676] Allocated host ResallocHost, ticket_id=3557590, hostname=2620:52:3:1:dead:beef:cafe:c28f, name=copr_p09_01_prod_04885002_20250618_145836, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-06-18 15:01:23,926][  INFO][PID:1323676] Allocating ssh connection to builder
[2025-06-18 15:01:23,931][  INFO][PID:1323676] Checking that builder machine is OK
[2025-06-18 15:01:25,017][  INFO][PID:1323676] Running remote command: copr-builder-ready centos-stream-10-ppc64le
[2025-06-18 15:01:26,387][  INFO][PID:1323676] Red Hat subscription not needed for centos-stream-10-ppc64le
Builder is ready to be used

[2025-06-18 15:01:26,393][  INFO][PID:1323676] Filling build.info file with builder info
[2025-06-18 15:01:26,396][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:26,403][  INFO][PID:1323676] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "packit",
            "project_name": "bootc-dev-bootc-1378",
            "project_dirname": "bootc-dev-bootc-1378",
            "submitter": "packit",
            "ended_on": null,
            "started_on": 1750258886.4028459,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9180818-centos-stream-10-ppc64le",
            "build_id": 9180818,
            "package_name": "bootc",
            "package_version": "202506181453.gb1c0f7afde-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/bootc-dev-bootc-1378/bootc",
            "git_hash": "8a98fda4f6ecc13ce8f4d7f6aada37003b5ebf74",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "packit/bootc-dev-bootc-1378--packit",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/bootc-dev-bootc-1378",
            "result_dir": "09180818-bootc",
            "built_packages": "",
            "id": 9180818,
            "mockchain_macros": {
                "copr_username": "packit",
                "copr_projectname": "bootc-dev-bootc-1378",
                "vendor": "Fedora Project COPR (packit/bootc-dev-bootc-1378)"
            }
        }
    ]
}
[2025-06-18 15:01:26,453][  INFO][PID:1323676] Sending fedora-messaging bus message in build.start
[2025-06-18 15:01:28,146][  INFO][PID:1323676] Sending fedora-messaging bus message in chroot.start
[2025-06-18 15:01:28,213][  INFO][PID:1323676] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9180818-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached
[2025-06-18 15:01:31,102][  INFO][PID:1323676] Downloading the builder-live.log file, attempt 1
[2025-06-18 15:01:31,123][  INFO][PID:1323676] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28f copr-rpmbuild-log
[2025-06-18 15:01:36,190][  INFO][PID:1323676] Periodic builder liveness probe: alive
[2025-06-18 15:01:36,206][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:41,227][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:46,244][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:51,255][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:01:56,275][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:01,281][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:06,290][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:11,382][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:16,389][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:21,424][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:26,433][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:31,439][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:36,486][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:41,499][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:46,511][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:51,530][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:02:56,598][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:01,610][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:06,631][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:11,651][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:16,663][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:21,685][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:26,690][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:31,718][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:36,753][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:41,768][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:46,779][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:51,813][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:03:56,871][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:01,914][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:06,950][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:11,969][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:16,975][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:22,067][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:27,078][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:32,085][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:37,108][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:42,120][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:47,127][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:52,136][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:04:57,147][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:02,166][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:07,174][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:12,272][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:17,451][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:22,469][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:27,518][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:30,139][ ERROR][PID:1323676] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-06-18 15:05:32,571][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:37,596][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:40,141][WARNING][PID:1323676] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-06-18 15:05:42,617][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:47,635][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:50,151][  INFO][PID:1323676] Downloading the builder-live.log file, attempt 2
[2025-06-18 15:05:50,167][  INFO][PID:1323676] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28f copr-rpmbuild-log
[2025-06-18 15:05:52,649][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:05:57,661][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:02,674][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:07,680][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:12,697][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:17,718][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:22,731][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:27,744][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:32,765][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:37,783][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:42,795][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:47,808][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:50,277][ ERROR][PID:1323676] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-06-18 15:06:52,823][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:06:57,847][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:00,300][WARNING][PID:1323676] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-06-18 15:07:02,852][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:07,861][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:10,302][  INFO][PID:1323676] Downloading the builder-live.log file, attempt 3
[2025-06-18 15:07:10,310][  INFO][PID:1323676] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28f copr-rpmbuild-log
[2025-06-18 15:07:12,873][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:17,880][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:22,889][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:27,911][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:32,948][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:37,961][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:42,978][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:48,011][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:53,028][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:07:58,033][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:03,037][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:08,074][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:10,427][ ERROR][PID:1323676] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-06-18 15:08:13,081][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:18,100][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:20,588][WARNING][PID:1323676] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-06-18 15:08:23,124][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:28,148][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:30,594][  INFO][PID:1323676] Downloading the builder-live.log file, attempt 4
[2025-06-18 15:08:30,608][  INFO][PID:1323676] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28f copr-rpmbuild-log
[2025-06-18 15:08:33,169][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:38,190][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:43,194][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:48,203][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:53,212][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:08:58,229][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:03,240][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:08,256][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:13,270][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:18,280][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:23,312][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:28,331][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:30,739][ ERROR][PID:1323676] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-06-18 15:09:33,352][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:38,363][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:40,809][ ERROR][PID:1323676] Giving up for unstable SSH, failures: 1750259140.1417732, 1750259220.3003514, 1750259300.5886443, 1750259380.8093603
[2025-06-18 15:09:40,819][ ERROR][PID:1323676] Re-try request for task on 'ResallocHost, ticket_id=3557590, hostname=2620:52:3:1:dead:beef:cafe:c28f, name=copr_p09_01_prod_04885002_20250618_145836, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-06-18 15:09:40,821][  INFO][PID:1323676] Releasing VM back to pool
[2025-06-18 15:09:40,947][  INFO][PID:1323676] Retry #1 (on other host)
[2025-06-18 15:09:40,951][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:40,960][  INFO][PID:1323676] VM allocation process starts
[2025-06-18 15:09:41,071][  INFO][PID:1323676] Trying to allocate VM: ResallocHost, ticket_id=3557901, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-06-18 15:09:46,087][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:51,103][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:09:56,117][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:01,133][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:06,144][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:09,433][  INFO][PID:1323676] Allocated host ResallocHost, ticket_id=3557901, hostname=2620:52:3:1:dead:beef:cafe:c288, name=copr_p09_01_prod_04885178_20250618_150357, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-06-18 15:10:09,439][  INFO][PID:1323676] Allocating ssh connection to builder
[2025-06-18 15:10:09,440][  INFO][PID:1323676] Checking that builder machine is OK
[2025-06-18 15:10:10,307][  INFO][PID:1323676] Running remote command: copr-builder-ready centos-stream-10-ppc64le
[2025-06-18 15:10:10,807][  INFO][PID:1323676] Red Hat subscription not needed for centos-stream-10-ppc64le
Builder is ready to be used

[2025-06-18 15:10:10,809][  INFO][PID:1323676] Filling build.info file with builder info
[2025-06-18 15:10:10,813][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:10,818][  INFO][PID:1323676] Not re-notifying FE and msg buses for the new host.
[2025-06-18 15:10:10,820][  INFO][PID:1323676] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9180818-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached
[2025-06-18 15:10:11,563][  INFO][PID:1323676] Downloading the builder-live.log file, attempt 1
[2025-06-18 15:10:11,579][  INFO][PID:1323676] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c288 copr-rpmbuild-log
[2025-06-18 15:10:16,572][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:21,587][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:26,593][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:31,601][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:36,616][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:41,634][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:46,651][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:51,662][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:10:56,677][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:01,693][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:06,705][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:11,715][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:16,719][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:21,725][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:26,732][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:31,745][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:36,819][  INFO][PID:1323676] Periodic builder liveness probe: alive
[2025-06-18 15:11:36,825][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:41,834][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:46,850][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:51,863][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:11:56,867][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:01,872][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:06,883][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:11,904][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:16,926][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:21,931][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:26,940][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:31,963][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:36,969][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:41,994][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:47,000][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:52,007][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:12:57,018][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:02,025][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:07,034][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:12,060][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:17,063][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:22,078][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:27,089][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:32,097][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:37,105][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:42,138][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:47,148][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:52,162][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:13:57,171][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:02,179][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:07,185][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:12,200][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:17,207][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:22,222][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:27,228][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:32,431][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:37,858][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:43,396][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:48,473][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:53,485][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:14:58,579][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:03,620][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:08,646][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:13,654][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:19,081][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:24,368][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:29,472][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:34,488][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:39,526][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:44,539][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:49,547][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:54,559][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:15:59,571][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:04,592][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:09,624][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:14,628][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:19,648][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:24,661][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:29,674][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:34,679][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:39,683][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:44,686][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:49,694][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:54,722][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:16:59,727][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:04,739][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:09,746][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:14,752][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:19,759][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:24,767][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:29,773][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:34,777][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:39,783][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:44,787][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:49,795][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:54,941][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:17:59,958][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:04,974][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:09,999][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:15,011][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:20,016][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:25,022][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:30,034][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:35,053][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:40,064][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:45,071][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:50,081][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:18:55,093][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:00,097][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:05,102][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:10,105][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:15,114][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:20,123][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:25,131][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:30,152][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:35,176][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:40,193][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:45,197][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:50,205][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:19:55,218][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:00,224][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:05,239][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:10,249][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:15,259][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:20,279][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:25,287][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:30,320][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:35,332][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:40,340][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:45,351][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:50,368][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:20:55,382][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:00,390][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:05,404][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:10,409][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:15,423][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:20,431][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:25,436][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:30,444][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:35,455][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:40,508][  INFO][PID:1323676] Periodic builder liveness probe: alive
[2025-06-18 15:21:40,515][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:45,527][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:50,531][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:21:55,537][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:00,540][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:05,554][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:10,559][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:15,565][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:20,568][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:25,584][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:30,592][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:35,601][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:40,607][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:45,615][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:50,620][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:22:55,627][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:00,642][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:05,647][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:10,652][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:15,669][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:20,678][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:25,687][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:30,691][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:35,695][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:40,700][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:45,707][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:50,716][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:55,723][  INFO][PID:1323676] Checking for cancel request
[2025-06-18 15:23:55,831][  INFO][PID:1323676] Downloading results from builder
[2025-06-18 15:23:55,835][  INFO][PID:1323676] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c288]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc started
[2025-06-18 15:23:55,841][  INFO][PID:1323676] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c288]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/ &> /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/build-09180818.rsync.log
[2025-06-18 15:24:06,890][  INFO][PID:1323676] rsyncing finished.
[2025-06-18 15:24:06,897][  INFO][PID:1323676] Releasing VM back to pool
[2025-06-18 15:24:07,004][  INFO][PID:1323676] Searching for 'success' file in resultdir
[2025-06-18 15:24:07,013][  INFO][PID:1323676] Going to sign pkgs from source: 9180818-centos-stream-10-ppc64le in chroot: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le
[2025-06-18 15:24:07,025][  INFO][PID:1323676] Calling '/bin/sign -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -p' (attempt #1)
[2025-06-18 15:24:07,209][  INFO][PID:1323676] Calling '/bin/sign -4 -h sha256 -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/system-reinstall-bootc-debuginfo-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm' (attempt #1)
[2025-06-18 15:24:08,215][  INFO][PID:1323676] signed rpm: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/system-reinstall-bootc-debuginfo-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm
[2025-06-18 15:24:08,217][  INFO][PID:1323676] Calling '/bin/sign -4 -h sha256 -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-debugsource-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm' (attempt #1)
[2025-06-18 15:24:08,990][  INFO][PID:1323676] signed rpm: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-debugsource-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm
[2025-06-18 15:24:08,992][  INFO][PID:1323676] Calling '/bin/sign -4 -h sha256 -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-202506181453.gb1c0f7afde-1.el10.src.rpm' (attempt #1)
[2025-06-18 15:24:11,153][  INFO][PID:1323676] signed rpm: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-202506181453.gb1c0f7afde-1.el10.src.rpm
[2025-06-18 15:24:11,157][  INFO][PID:1323676] Calling '/bin/sign -4 -h sha256 -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm' (attempt #1)
[2025-06-18 15:24:12,360][  INFO][PID:1323676] signed rpm: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm
[2025-06-18 15:24:12,364][  INFO][PID:1323676] Calling '/bin/sign -4 -h sha256 -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-debuginfo-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm' (attempt #1)
[2025-06-18 15:24:13,917][  INFO][PID:1323676] signed rpm: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/bootc-debuginfo-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm
[2025-06-18 15:24:13,930][  INFO][PID:1323676] Calling '/bin/sign -4 -h sha256 -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -r /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/system-reinstall-bootc-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm' (attempt #1)
[2025-06-18 15:24:15,075][  INFO][PID:1323676] signed rpm: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/system-reinstall-bootc-202506181453.gb1c0f7afde-1.el10.ppc64le.rpm
[2025-06-18 15:24:15,078][  INFO][PID:1323676] Sign done
[2025-06-18 15:24:15,084][  INFO][PID:1323676] Incremental createrepo run, adding 09180818-bootc into https://download.copr.fedorainfracloud.org/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le, (auto-create-repo=True)
[2025-06-18 15:24:15,090][  INFO][PID:1323676] Running command 'copr-repo --batched /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le --add 09180818-bootc --no-appstream-metadata' as PID 1525588
[2025-06-18 15:24:17,566][  INFO][PID:1323676] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le --add 09180818-bootc --no-appstream-metadata)
[2025-06-18 15:24:17,571][  INFO][PID:1323676] Getting build details
[2025-06-18 15:24:17,573][  INFO][PID:1323676] Listing built binary packages in /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc
[2025-06-18 15:24:17,575][  INFO][PID:1323676] Built packages:
['system-reinstall-bootc 202506181453.gb1c0f7afde', 'bootc-debuginfo 202506181453.gb1c0f7afde', 'bootc-debugsource 202506181453.gb1c0f7afde', 'system-reinstall-bootc-debuginfo 202506181453.gb1c0f7afde', 'bootc 202506181453.gb1c0f7afde']
[2025-06-18 15:24:17,578][  INFO][PID:1323676] build details: {'built_packages': 'system-reinstall-bootc 202506181453.gb1c0f7afde\nbootc-debuginfo 202506181453.gb1c0f7afde\nbootc-debugsource 202506181453.gb1c0f7afde\nsystem-reinstall-bootc-debuginfo 202506181453.gb1c0f7afde\nbootc 202506181453.gb1c0f7afde'}
[2025-06-18 15:24:17,581][  INFO][PID:1323676] Retrieving pubkey
[2025-06-18 15:24:17,584][  INFO][PID:1323676] Calling '/bin/sign -u packit#bootc-dev-bootc-1378@copr.fedorahosted.org -p' (attempt #1)
[2025-06-18 15:24:17,791][  INFO][PID:1323676] Added pubkey for user packit project bootc-dev-bootc-1378 into: /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/pubkey.gpg
[2025-06-18 15:24:17,793][  INFO][PID:1323676] Finished build: id=9180818 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378 chroot=centos-stream-10-ppc64le 
[2025-06-18 15:24:17,838][  INFO][PID:1323676] Worker succeeded build, took 847.0197193622589
[2025-06-18 15:24:17,847][  INFO][PID:1323676] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "packit",
            "project_name": "bootc-dev-bootc-1378",
            "project_dirname": "bootc-dev-bootc-1378",
            "submitter": "packit",
            "ended_on": 1750260257.838343,
            "started_on": 1750259410.8186235,
            "submitted_on": null,
            "status": 1,
            "chroot": "centos-stream-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9180818-centos-stream-10-ppc64le",
            "build_id": 9180818,
            "package_name": "bootc",
            "package_version": "202506181453.gb1c0f7afde-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/bootc-dev-bootc-1378/bootc",
            "git_hash": "8a98fda4f6ecc13ce8f4d7f6aada37003b5ebf74",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "packit/bootc-dev-bootc-1378--packit",
            "results": {
                "packages": [
                    {
                        "name": "system-reinstall-bootc",
                        "epoch": null,
                        "version": "202506181453.gb1c0f7afde",
                        "release": "1.el10",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "bootc",
                        "epoch": null,
                        "version": "202506181453.gb1c0f7afde",
                        "release": "1.el10",
                        "arch": "src"
                    },
                    {
                        "name": "bootc-debuginfo",
                        "epoch": null,
                        "version": "202506181453.gb1c0f7afde",
                        "release": "1.el10",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "bootc-debugsource",
                        "epoch": null,
                        "version": "202506181453.gb1c0f7afde",
                        "release": "1.el10",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "system-reinstall-bootc-debuginfo",
                        "epoch": null,
                        "version": "202506181453.gb1c0f7afde",
                        "release": "1.el10",
                        "arch": "ppc64le"
                    },
                    {
                        "name": "bootc",
                        "epoch": null,
                        "version": "202506181453.gb1c0f7afde",
                        "release": "1.el10",
                        "arch": "ppc64le"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/bootc-dev-bootc-1378",
            "result_dir": "09180818-bootc",
            "built_packages": "system-reinstall-bootc 202506181453.gb1c0f7afde\nbootc-debuginfo 202506181453.gb1c0f7afde\nbootc-debugsource 202506181453.gb1c0f7afde\nsystem-reinstall-bootc-debuginfo 202506181453.gb1c0f7afde\nbootc 202506181453.gb1c0f7afde",
            "id": 9180818,
            "mockchain_macros": {
                "copr_username": "packit",
                "copr_projectname": "bootc-dev-bootc-1378",
                "vendor": "Fedora Project COPR (packit/bootc-dev-bootc-1378)"
            }
        }
    ]
}
[2025-06-18 15:24:18,196][  INFO][PID:1323676] Sending fedora-messaging bus message in build.end
[2025-06-18 15:24:18,321][  INFO][PID:1323676] Compressing /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/builder-live.log by gzip
[2025-06-18 15:24:18,325][  INFO][PID:1323676] Running command 'gzip /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/builder-live.log' as PID 1526070
[2025-06-18 15:24:18,436][  INFO][PID:1323676] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/builder-live.log)
[2025-06-18 15:24:18,441][  INFO][PID:1323676] Compressing /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/backend.log by gzip
[2025-06-18 15:24:18,447][  INFO][PID:1323676] Running command 'gzip /var/lib/copr/public_html/results/packit/bootc-dev-bootc-1378/centos-stream-10-ppc64le/09180818-bootc/backend.log' as PID 1526075