[2026-01-05 11:18:49,322][  INFO][PID:282513] Marking build as starting
[2026-01-05 11:18:49,522][  INFO][PID:282513] Checking that /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-01-05 11:18:49,533][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:18:49,534][  INFO][PID:282513] VM allocation process starts
[2026-01-05 11:18:49,548][  INFO][PID:282513] Trying to allocate VM: ResallocHost, ticket_id=658839, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:18:52,563][  INFO][PID:282513] Allocated host ResallocHost, ticket_id=658839, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_00920871_20260105_104851, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:18:52,564][  INFO][PID:282513] Allocating ssh connection to builder
[2026-01-05 11:18:52,564][  INFO][PID:282513] Checking that builder machine is OK
[2026-01-05 11:18:53,506][  INFO][PID:282513] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-01-05 11:18:53,985][  INFO][PID:282513] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-01-05 11:18:53,986][  INFO][PID:282513] Filling build.info file with builder info
[2026-01-05 11:18:53,990][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:18:53,991][  INFO][PID:282513] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ryanabx",
            "project_name": "cosmic-epoch-tagged",
            "project_dirname": "cosmic-epoch-tagged",
            "submitter": "ryanabx",
            "ended_on": null,
            "started_on": 1767611933.991393,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9975441-fedora-rawhide-ppc64le",
            "build_id": 9975441,
            "package_name": "cosmic-settings",
            "package_version": "1.0.1-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ryanabx/cosmic-epoch-tagged/cosmic-settings",
            "git_hash": "b22e1a5369e3d3d6801ed00b4c0a284e1dbae6ec",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ryanabx/cosmic-epoch-tagged--ryanabx",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged",
            "result_dir": "09975441-cosmic-settings",
            "built_packages": "",
            "id": 9975441,
            "mockchain_macros": {
                "copr_username": "ryanabx",
                "copr_projectname": "cosmic-epoch-tagged",
                "vendor": "Fedora Project COPR (ryanabx/cosmic-epoch-tagged)"
            }
        }
    ]
}
[2026-01-05 11:18:54,056][  INFO][PID:282513] Sending fedora-messaging bus message in build.start
[2026-01-05 11:18:54,805][  INFO][PID:282513] Sending fedora-messaging bus message in chroot.start
[2026-01-05 11:18:54,835][  INFO][PID:282513] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9975441-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-01-05 11:19:54,907][ ERROR][PID:282513] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c189 port 22: Connection timed out

[2026-01-05 11:20:04,908][ ERROR][PID:282513] Re-try request for task on 'ResallocHost, ticket_id=658839, hostname=2620:52:6:1161:dead:beef:cafe:c189, name=vmhost_p09_04_prod_00920871_20260105_104851, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2026-01-05 11:20:04,908][  INFO][PID:282513] Releasing VM back to pool
[2026-01-05 11:20:04,916][  INFO][PID:282513] Retry #1 (on other host)
[2026-01-05 11:20:04,917][  INFO][PID:282513] Checking that /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-01-05 11:20:04,918][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:04,918][  INFO][PID:282513] VM allocation process starts
[2026-01-05 11:20:04,978][  INFO][PID:282513] Trying to allocate VM: ResallocHost, ticket_id=658913, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:20:08,020][  INFO][PID:282513] Allocated host ResallocHost, ticket_id=658913, hostname=2620:52:6:1161:dead:beef:cafe:c153, name=vmhost_p09_03_prod_00920997_20260105_110459, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-05 11:20:08,021][  INFO][PID:282513] Allocating ssh connection to builder
[2026-01-05 11:20:08,021][  INFO][PID:282513] Checking that builder machine is OK
[2026-01-05 11:20:08,912][  INFO][PID:282513] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-01-05 11:20:09,403][  INFO][PID:282513] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-01-05 11:20:09,403][  INFO][PID:282513] Filling build.info file with builder info
[2026-01-05 11:20:09,409][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:09,410][  INFO][PID:282513] Not re-notifying FE and msg buses for the new host.
[2026-01-05 11:20:09,411][  INFO][PID:282513] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9975441-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-01-05 11:20:10,415][  INFO][PID:282513] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c153' (ED25519) to the list of known hosts.


[2026-01-05 11:20:10,415][  INFO][PID:282513] Downloading the builder-live.log file, attempt 1
[2026-01-05 11:20:10,417][  INFO][PID:282513] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c153 copr-rpmbuild-log
[2026-01-05 11:20:15,421][  INFO][PID:282513] Periodic builder liveness probe: alive
[2026-01-05 11:20:15,421][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:20,422][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:25,423][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:30,424][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:35,425][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:40,426][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:45,427][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:50,428][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:20:55,429][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:00,430][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:05,432][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:10,433][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:15,435][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:20,436][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:25,437][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:30,438][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:35,439][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:40,440][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:45,441][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:50,442][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:21:55,443][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:00,444][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:05,445][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:10,447][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:15,447][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:20,449][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:25,450][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:30,451][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:35,452][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:40,453][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:45,454][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:50,455][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:22:55,456][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:00,457][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:05,458][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:10,459][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:15,460][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:20,461][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:25,463][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:30,464][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:35,465][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:40,466][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:45,468][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:50,471][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:23:55,478][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:00,481][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:05,484][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:10,486][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:15,489][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:20,498][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:25,504][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:30,506][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:35,508][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:40,510][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:45,513][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:50,516][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:24:55,518][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:00,523][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:05,525][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:10,527][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:15,528][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:20,530][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:25,532][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:30,534][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:35,535][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:40,536][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:45,537][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:50,538][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:25:55,539][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:00,540][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:05,542][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:10,543][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:15,544][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:20,545][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:25,546][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:30,548][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:35,548][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:40,549][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:45,551][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:50,552][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:26:55,553][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:00,554][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:05,555][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:10,556][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:15,557][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:20,558][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:25,559][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:30,561][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:35,562][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:40,563][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:45,565][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:50,566][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:27:55,567][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:00,568][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:05,569][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:10,571][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:15,575][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:20,576][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:25,577][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:30,578][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:35,579][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:40,581][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:45,582][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:50,583][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:28:55,583][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:00,584][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:05,585][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:10,586][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:15,587][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:20,588][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:25,593][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:30,594][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:35,595][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:40,596][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:45,597][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:50,598][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:29:55,599][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:00,600][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:05,601][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:10,602][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:15,610][  INFO][PID:282513] Periodic builder liveness probe: alive
[2026-01-05 11:30:15,611][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:20,611][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:25,613][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:30,613][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:35,614][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:40,616][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:45,617][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:50,618][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:30:55,619][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:00,620][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:05,621][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:10,622][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:15,624][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:20,625][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:25,626][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:30,627][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:35,628][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:40,629][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:45,630][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:50,631][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:31:55,632][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:00,633][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:05,634][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:10,635][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:15,636][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:20,637][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:25,639][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:30,640][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:35,641][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:40,642][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:45,643][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:50,644][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:32:55,650][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:00,652][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:05,654][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:10,654][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:15,656][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:20,657][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:25,659][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:30,660][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:35,665][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:40,667][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:45,668][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:50,669][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:33:55,675][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:00,676][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:05,677][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:10,679][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:15,680][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:20,681][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:25,682][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:30,683][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:35,685][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:40,686][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:45,687][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:50,688][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:34:55,689][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:00,690][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:05,694][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:10,695][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:15,695][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:20,696][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:25,697][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:30,698][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:35,699][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:40,700][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:45,701][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:50,702][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:35:55,704][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:00,705][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:05,706][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:10,707][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:15,709][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:20,710][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:25,711][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:30,712][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:35,713][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:40,714][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:45,715][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:50,716][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:36:55,717][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:00,718][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:05,719][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:10,721][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:15,722][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:20,723][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:25,724][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:30,725][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:35,727][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:40,729][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:45,730][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:50,731][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:37:55,732][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:00,734][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:05,735][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:10,736][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:15,737][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:20,739][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:25,740][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:30,741][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:35,742][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:40,743][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:45,744][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:50,745][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:38:55,746][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:00,747][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:05,748][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:10,749][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:15,750][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:20,751][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:25,752][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:30,752][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:35,753][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:40,754][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:45,755][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:50,756][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:39:55,757][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:00,758][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:05,759][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:10,760][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:15,769][  INFO][PID:282513] Periodic builder liveness probe: alive
[2026-01-05 11:40:15,769][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:20,770][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:25,771][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:30,772][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:35,774][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:40,775][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:45,776][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:50,777][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:40:55,778][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:00,778][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:05,779][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:10,780][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:15,805][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:20,833][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:25,834][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:30,835][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:35,836][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:40,837][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:45,838][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:50,839][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:41:55,840][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:42:00,841][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:42:05,841][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:42:11,460][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:42:16,507][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:42:21,510][  INFO][PID:282513] Checking for cancel request
[2026-01-05 11:42:23,173][  INFO][PID:282513] Downloading results from builder
[2026-01-05 11:42:23,173][  INFO][PID:282513] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings started
[2026-01-05 11:42:23,174][  INFO][PID:282513] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/ &> /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/build-09975441.rsync.log
[2026-01-05 11:42:23,304][  INFO][PID:282513] rsyncing finished.
[2026-01-05 11:42:23,305][ ERROR][PID:282513] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-05 11:42:23,305][ ERROR][PID:282513] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-05 11:42:33,306][  INFO][PID:282513] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings started
[2026-01-05 11:42:33,345][  INFO][PID:282513] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/ &> /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/build-09975441.rsync.log
[2026-01-05 11:42:33,392][  INFO][PID:282513] rsyncing finished.
[2026-01-05 11:42:33,392][ ERROR][PID:282513] Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-05 11:42:33,393][ ERROR][PID:282513] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details.
[2026-01-05 11:42:43,393][  INFO][PID:282513] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings started
[2026-01-05 11:42:43,394][  INFO][PID:282513] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c153]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/ &> /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/build-09975441.rsync.log
[2026-01-05 11:42:46,060][  INFO][PID:282513] rsyncing finished.
[2026-01-05 11:42:46,061][  INFO][PID:282513] Releasing VM back to pool
[2026-01-05 11:42:46,071][  INFO][PID:282513] Searching for 'success' file in resultdir
[2026-01-05 11:42:46,072][ ERROR][PID:282513] Build failed: Backend process error: No success file => build failure
[2026-01-05 11:42:46,072][  INFO][PID:282513] Finished build: id=9975441 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged chroot=fedora-rawhide-ppc64le 
[2026-01-05 11:42:46,074][ ERROR][PID:282513] Backend process error: No success file => build failure
[2026-01-05 11:42:46,074][  INFO][PID:282513] Worker failed build, took 1356.6640229225159
[2026-01-05 11:42:46,075][  INFO][PID:282513] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "ryanabx",
            "project_name": "cosmic-epoch-tagged",
            "project_dirname": "cosmic-epoch-tagged",
            "submitter": "ryanabx",
            "ended_on": 1767613366.074686,
            "started_on": 1767612009.4106631,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9975441-fedora-rawhide-ppc64le",
            "build_id": 9975441,
            "package_name": "cosmic-settings",
            "package_version": "1.0.1-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ryanabx/cosmic-epoch-tagged/cosmic-settings",
            "git_hash": "b22e1a5369e3d3d6801ed00b4c0a284e1dbae6ec",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "ryanabx/cosmic-epoch-tagged--ryanabx",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged",
            "result_dir": "09975441-cosmic-settings",
            "built_packages": "",
            "id": 9975441,
            "mockchain_macros": {
                "copr_username": "ryanabx",
                "copr_projectname": "cosmic-epoch-tagged",
                "vendor": "Fedora Project COPR (ryanabx/cosmic-epoch-tagged)"
            }
        }
    ]
}
[2026-01-05 11:42:46,118][  INFO][PID:282513] Sending fedora-messaging bus message in build.end
[2026-01-05 11:42:46,144][  INFO][PID:282513] Compressing /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/builder-live.log by gzip
[2026-01-05 11:42:46,145][  INFO][PID:282513] Running command 'gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/builder-live.log' as PID 453801
[2026-01-05 11:42:46,299][  INFO][PID:282513] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/builder-live.log)
[2026-01-05 11:42:46,300][  INFO][PID:282513] Compressing /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/backend.log by gzip
[2026-01-05 11:42:46,301][  INFO][PID:282513] Running command 'gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/09975441-cosmic-settings/backend.log' as PID 453806