[2026-01-12 22:46:38,821][  INFO][PID:3398039] Marking build as starting
[2026-01-12 22:46:38,869][  INFO][PID:3398039] Checking that /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-01-12 22:46:38,871][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:46:38,871][  INFO][PID:3398039] VM allocation process starts
[2026-01-12 22:46:38,886][  INFO][PID:3398039] Trying to allocate VM: ResallocHost, ticket_id=784808, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-12 22:46:41,909][  INFO][PID:3398039] Allocated host ResallocHost, ticket_id=784808, hostname=2620:52:6:1161:dead:beef:cafe:c151, name=vmhost_p09_03_prod_01168660_20260112_221652, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-12 22:46:41,910][  INFO][PID:3398039] Allocating ssh connection to builder
[2026-01-12 22:46:41,910][  INFO][PID:3398039] Checking that builder machine is OK
[2026-01-12 22:46:43,022][  INFO][PID:3398039] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-01-12 22:46:43,495][  INFO][PID:3398039] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-01-12 22:46:43,496][  INFO][PID:3398039] Filling build.info file with builder info
[2026-01-12 22:46:43,497][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:46:43,497][  INFO][PID:3398039] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 172800,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "music",
            "project_name": "abseil-cpp",
            "project_dirname": "abseil-cpp",
            "submitter": "music",
            "ended_on": null,
            "started_on": 1768258003.4976976,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10002246-fedora-rawhide-ppc64le",
            "build_id": 10002246,
            "package_name": "boost",
            "package_version": "1.90.0-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/music/abseil-cpp/boost",
            "git_hash": "5cb721c40ef3a7da744069de207f717b7749f95f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "music/abseil-cpp--music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/music/abseil-cpp/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/music/abseil-cpp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/music/abseil-cpp",
            "result_dir": "10002246-boost",
            "built_packages": "",
            "id": 10002246,
            "mockchain_macros": {
                "copr_username": "music",
                "copr_projectname": "abseil-cpp",
                "vendor": "Fedora Project COPR (music/abseil-cpp)"
            }
        }
    ]
}
[2026-01-12 22:46:43,538][  INFO][PID:3398039] Sending fedora-messaging bus message in build.start
[2026-01-12 22:46:44,088][  INFO][PID:3398039] Sending fedora-messaging bus message in chroot.start
[2026-01-12 22:46:44,116][  INFO][PID:3398039] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10002246-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-01-12 22:46:45,086][  INFO][PID:3398039] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c151' (ED25519) to the list of known hosts.


[2026-01-12 22:46:45,087][  INFO][PID:3398039] Downloading the builder-live.log file, attempt 1
[2026-01-12 22:46:45,088][  INFO][PID:3398039] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c151 copr-rpmbuild-log
[2026-01-12 22:46:50,092][  INFO][PID:3398039] Periodic builder liveness probe: alive
[2026-01-12 22:46:50,093][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:46:55,094][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:00,095][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:05,096][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:10,097][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:15,098][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:20,099][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:25,100][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:30,101][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:35,102][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:40,103][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:45,103][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:45,155][ ERROR][PID:3398039] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-12 22:47:50,104][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:55,105][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:47:55,156][WARNING][PID:3398039] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-12 22:48:00,106][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:05,107][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:05,157][  INFO][PID:3398039] Downloading the builder-live.log file, attempt 2
[2026-01-12 22:48:05,158][  INFO][PID:3398039] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c151 copr-rpmbuild-log
[2026-01-12 22:48:10,108][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:15,109][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:20,110][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:25,111][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:30,112][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:35,113][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:40,114][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:45,115][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:50,116][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:48:55,117][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:00,118][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:05,119][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:10,120][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:15,121][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:20,121][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:25,122][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:30,123][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:35,124][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:40,125][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:45,126][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:50,127][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:49:55,128][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:00,128][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:05,129][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:10,130][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:15,131][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:20,132][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:25,133][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:30,134][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:35,135][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:40,136][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:45,137][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:50,137][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:50:55,138][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:00,139][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:05,140][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:10,141][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:15,142][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:20,143][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:25,144][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:30,145][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:35,146][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:40,147][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:45,148][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:50,149][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:51:55,150][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:00,151][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:05,152][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:10,153][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:15,154][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:20,155][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:25,156][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:30,156][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:35,157][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:40,158][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:45,159][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:50,160][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:52:55,162][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:00,163][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:05,164][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:10,165][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:15,166][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:20,167][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:25,168][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:30,171][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:35,172][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:40,173][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:45,174][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:50,175][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:53:55,176][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:00,177][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:05,178][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:10,179][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:15,180][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:20,181][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:25,182][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:30,183][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:35,184][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:40,186][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:45,187][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:50,188][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:54:55,189][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:00,190][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:05,190][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:10,191][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:15,193][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:20,194][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:25,195][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:30,196][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:35,197][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:40,198][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:45,198][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:50,199][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:55:55,200][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:00,201][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:05,202][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:10,203][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:15,204][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:20,205][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:25,206][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:30,207][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:35,208][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:40,209][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:45,209][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:50,215][  INFO][PID:3398039] Periodic builder liveness probe: alive
[2026-01-12 22:56:50,216][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:56:55,216][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:00,217][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:05,218][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:10,219][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:15,220][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:20,221][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:25,222][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:30,223][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:35,224][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:40,225][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:45,226][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:50,227][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:57:55,228][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:00,229][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:05,229][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:10,230][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:15,231][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:20,232][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:25,233][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:30,234][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:35,235][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:40,236][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:45,237][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:50,238][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:58:55,239][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:00,240][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:05,241][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:10,242][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:15,243][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:20,243][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:25,244][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:30,245][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:35,246][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:40,247][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:45,249][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:50,249][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 22:59:55,250][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:00,251][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:05,252][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:10,253][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:15,254][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:20,255][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:25,256][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:30,257][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:35,258][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:40,259][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:45,260][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:50,261][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:00:55,262][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:00,263][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:05,264][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:10,265][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:15,266][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:20,267][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:25,268][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:30,269][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:35,270][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:40,271][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:45,272][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:50,272][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:01:55,273][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:00,274][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:05,275][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:10,276][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:15,277][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:20,278][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:25,279][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:30,280][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:35,281][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:40,282][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:45,283][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:50,284][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:02:55,285][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:00,286][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:05,287][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:10,288][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:15,289][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:20,289][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:25,290][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:30,291][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:35,292][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:40,293][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:45,294][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:50,295][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:03:55,296][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:00,297][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:05,298][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:10,299][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:15,300][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:20,301][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:25,302][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:30,303][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:35,304][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:40,305][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:45,306][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:50,307][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:04:55,308][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:00,309][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:05,318][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:10,322][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:15,324][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:20,331][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:25,335][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:30,337][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:35,338][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:40,339][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:45,340][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:50,341][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:05:55,342][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:00,343][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:05,344][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:10,345][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:15,346][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:20,347][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:25,348][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:30,349][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:35,350][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:40,351][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:41,036][ ERROR][PID:3398039] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-12 23:06:45,352][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:06:50,367][  INFO][PID:3398039] Periodic builder liveness probe: dead
[2026-01-12 23:06:50,368][  INFO][PID:3398039] calling cancel callback, and waiting
[2026-01-12 23:06:51,037][WARNING][PID:3398039] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-12 23:06:51,673][WARNING][PID:3398039] Can't cancel build
out:

err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c151' (ED25519) to the list of known hosts.
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 85, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2026-01-12 23:07:01,038][  INFO][PID:3398039] Downloading the builder-live.log file, attempt 3
[2026-01-12 23:07:01,077][  INFO][PID:3398039] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c151 copr-rpmbuild-log
[2026-01-12 23:09:01,815][ ERROR][PID:3398039] Re-try request for task on 'ResallocHost, ticket_id=784808, hostname=2620:52:6:1161:dead:beef:cafe:c151, name=vmhost_p09_03_prod_01168660_20260112_221652, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2026-01-12 23:09:01,824][  INFO][PID:3398039] Releasing VM back to pool
[2026-01-12 23:09:01,835][  INFO][PID:3398039] Retry #1 (on other host)
[2026-01-12 23:09:01,836][  INFO][PID:3398039] Checking that /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2026-01-12 23:09:01,837][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:09:01,837][  INFO][PID:3398039] VM allocation process starts
[2026-01-12 23:09:01,850][  INFO][PID:3398039] Trying to allocate VM: ResallocHost, ticket_id=785015, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-12 23:09:04,867][  INFO][PID:3398039] Allocated host ResallocHost, ticket_id=785015, hostname=2620:52:6:1161:dead:beef:cafe:c196, name=vmhost_p09_04_prod_01169111_20260112_223715, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-12 23:09:04,868][  INFO][PID:3398039] Allocating ssh connection to builder
[2026-01-12 23:09:04,868][  INFO][PID:3398039] Checking that builder machine is OK
[2026-01-12 23:09:05,885][  INFO][PID:3398039] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2026-01-12 23:09:06,438][  INFO][PID:3398039] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2026-01-12 23:09:06,439][  INFO][PID:3398039] Filling build.info file with builder info
[2026-01-12 23:09:06,460][  INFO][PID:3398039] Checking for cancel request
[2026-01-12 23:09:06,462][  INFO][PID:3398039] Not re-notifying FE and msg buses for the new host.
[2026-01-12 23:09:06,463][  INFO][PID:3398039] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10002246-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2026-01-12 23:09:07,491][  INFO][PID:3398039] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts.


[2026-01-12 23:09:07,493][  INFO][PID:3398039] Downloading the builder-live.log file, attempt 1
[2026-01-12 23:09:07,496][  INFO][PID:3398039] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c196 copr-rpmbuild-log
[2026-01-12 23:09:12,493][  INFO][PID:3398039] calling cancel callback, and waiting
[2026-01-12 23:09:16,207][  INFO][PID:3398039] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts.

[2026-01-12 23:09:16,207][  INFO][PID:3398039] Downloading results from builder
[2026-01-12 23:09:16,208][  INFO][PID:3398039] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost started
[2026-01-12 23:09:16,208][  INFO][PID:3398039] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/ &> /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/build-10002246.rsync.log
[2026-01-12 23:09:17,088][  INFO][PID:3398039] rsyncing finished.
[2026-01-12 23:09:17,089][  INFO][PID:3398039] Releasing VM back to pool
[2026-01-12 23:09:17,155][  INFO][PID:3398039] Searching for 'success' file in resultdir
[2026-01-12 23:09:17,156][ ERROR][PID:3398039] Build failed: Backend process error: No success file => build failure
[2026-01-12 23:09:17,157][  INFO][PID:3398039] Finished build: id=10002246 failed=True timeout=172800 destdir=/var/lib/copr/public_html/results/music/abseil-cpp chroot=fedora-rawhide-ppc64le 
[2026-01-12 23:09:17,159][ ERROR][PID:3398039] Backend process error: No success file => build failure
[2026-01-12 23:09:17,160][  INFO][PID:3398039] Worker failed build, took 10.698414325714111
[2026-01-12 23:09:17,161][  INFO][PID:3398039] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 172800,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "music",
            "project_name": "abseil-cpp",
            "project_dirname": "abseil-cpp",
            "submitter": "music",
            "ended_on": 1768259357.1603982,
            "started_on": 1768259346.461984,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10002246-fedora-rawhide-ppc64le",
            "build_id": 10002246,
            "package_name": "boost",
            "package_version": "1.90.0-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/music/abseil-cpp/boost",
            "git_hash": "5cb721c40ef3a7da744069de207f717b7749f95f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "music/abseil-cpp--music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/music/abseil-cpp/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/music/abseil-cpp",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/music/abseil-cpp",
            "result_dir": "10002246-boost",
            "built_packages": "",
            "id": 10002246,
            "mockchain_macros": {
                "copr_username": "music",
                "copr_projectname": "abseil-cpp",
                "vendor": "Fedora Project COPR (music/abseil-cpp)"
            }
        }
    ]
}
[2026-01-12 23:09:17,210][  INFO][PID:3398039] Sending fedora-messaging bus message in build.end
[2026-01-12 23:09:17,243][  INFO][PID:3398039] Compressing /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/builder-live.log by gzip
[2026-01-12 23:09:17,245][  INFO][PID:3398039] Running command 'gzip /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/builder-live.log' as PID 3497043
[2026-01-12 23:09:17,246][  INFO][PID:3398039] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/builder-live.log)
[2026-01-12 23:09:17,247][  INFO][PID:3398039] Compressing /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/backend.log by gzip
[2026-01-12 23:09:17,249][  INFO][PID:3398039] Running command 'gzip /var/lib/copr/public_html/results/music/abseil-cpp/fedora-rawhide-ppc64le/10002246-boost/backend.log' as PID 3497045