[2026-01-14 01:16:29,023][ INFO][PID:2787494] Marking build as starting [2026-01-14 01:16:29,069][ INFO][PID:2787494] Checking that /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-14 01:16:29,070][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:16:29,071][ INFO][PID:2787494] VM allocation process starts [2026-01-14 01:16:29,081][ INFO][PID:2787494] Trying to allocate VM: ResallocHost, ticket_id=802104, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-14 01:16:32,124][ INFO][PID:2787494] Allocated host ResallocHost, ticket_id=802104, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_01215703_20260114_005756, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-14 01:16:32,124][ INFO][PID:2787494] Allocating ssh connection to builder [2026-01-14 01:16:32,125][ INFO][PID:2787494] Checking that builder machine is OK [2026-01-14 01:16:33,077][ INFO][PID:2787494] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-14 01:16:33,634][ INFO][PID:2787494] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-14 01:16:33,634][ INFO][PID:2787494] Filling build.info file with builder info [2026-01-14 01:16:33,635][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:16:33,636][ INFO][PID:2787494] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ryanabx", "project_name": "cosmic-epoch-tagged", "project_dirname": "cosmic-epoch-tagged", "submitter": "ryanabx", "ended_on": null, "started_on": 1768353393.6358638, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10005420-fedora-rawhide-ppc64le", "build_id": 10005420, "package_name": "cosmic-initial-setup", "package_version": "1.0.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ryanabx/cosmic-epoch-tagged/cosmic-initial-setup", "git_hash": "c68a11711332d6aa771a0e0d04f7734762cca995", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ryanabx/cosmic-epoch-tagged--ryanabx", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged", "result_dir": "10005420-cosmic-initial-setup", "built_packages": "", "id": 10005420, "mockchain_macros": { "copr_username": "ryanabx", "copr_projectname": "cosmic-epoch-tagged", "vendor": "Fedora Project COPR (ryanabx/cosmic-epoch-tagged)" } } ] } [2026-01-14 01:16:33,677][ INFO][PID:2787494] Sending fedora-messaging bus message in build.start [2026-01-14 01:16:34,181][ INFO][PID:2787494] Sending fedora-messaging bus message in chroot.start [2026-01-14 01:16:34,207][ INFO][PID:2787494] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10005420-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-14 01:16:35,149][ INFO][PID:2787494] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c190' (ED25519) to the list of known hosts. [2026-01-14 01:16:35,150][ INFO][PID:2787494] Downloading the builder-live.log file, attempt 1 [2026-01-14 01:16:35,152][ INFO][PID:2787494] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log [2026-01-14 01:16:40,156][ INFO][PID:2787494] Periodic builder liveness probe: alive [2026-01-14 01:16:40,156][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:16:45,157][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:16:50,158][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:16:55,159][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:00,160][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:05,161][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:10,162][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:15,163][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:20,164][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:25,165][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:30,166][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:35,167][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:40,168][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:45,168][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:50,170][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:17:55,171][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:00,172][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:05,173][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:10,174][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:15,175][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:20,176][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:25,176][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:30,177][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:35,178][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:40,179][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:45,190][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:50,191][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:18:55,192][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:00,193][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:05,194][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:10,195][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:15,195][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:20,197][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:25,197][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:30,198][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:35,199][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:40,200][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:45,201][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:50,202][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:19:55,203][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:00,204][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:05,205][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:10,206][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:15,207][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:20,212][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:25,213][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:30,214][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:35,215][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:40,216][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:45,217][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:50,218][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:20:55,219][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:00,220][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:05,221][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:10,222][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:15,249][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:20,251][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:25,252][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:30,332][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:35,333][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:40,334][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:45,335][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:50,335][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:21:55,336][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:00,353][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:05,354][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:10,536][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:15,537][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:20,914][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:25,915][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:30,916][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:35,917][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:40,918][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:45,920][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:50,921][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:22:56,238][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:01,240][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:06,242][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:11,243][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:16,346][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:21,348][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:26,356][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:31,360][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:36,360][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:41,361][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:46,362][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:51,363][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:23:56,364][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:01,365][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:06,366][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:11,367][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:16,368][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:21,371][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:26,372][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:31,373][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:36,377][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:41,381][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:46,383][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:51,386][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:24:56,387][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:01,388][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:06,584][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:11,586][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:16,587][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:21,589][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:26,591][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:31,594][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:36,595][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:41,597][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:46,599][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:51,600][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:25:56,601][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:01,602][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:06,603][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:11,604][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:16,605][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:21,607][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:26,610][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:31,611][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:36,613][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:41,798][ INFO][PID:2787494] Periodic builder liveness probe: alive [2026-01-14 01:26:41,798][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:46,799][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:51,821][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:26:56,823][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:01,826][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:06,853][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:11,860][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:16,880][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:21,882][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:26,883][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:31,889][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:36,891][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:41,892][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:46,894][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:51,896][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:27:56,900][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:01,901][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:06,903][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:11,905][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:16,909][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:21,910][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:26,911][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:31,913][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:36,921][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:41,922][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:46,923][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:51,938][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:28:56,942][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:01,947][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:06,948][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:11,950][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:16,951][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:21,952][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:26,953][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:31,954][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:36,956][ INFO][PID:2787494] Checking for cancel request [2026-01-14 01:29:41,929][ INFO][PID:2787494] Downloading results from builder [2026-01-14 01:29:41,930][ INFO][PID:2787494] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup started [2026-01-14 01:29:41,931][ INFO][PID:2787494] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c190]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/ &> /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/build-10005420.rsync.log [2026-01-14 01:29:45,234][ INFO][PID:2787494] rsyncing finished. [2026-01-14 01:29:45,234][ INFO][PID:2787494] Releasing VM back to pool [2026-01-14 01:29:45,271][ INFO][PID:2787494] Searching for 'success' file in resultdir [2026-01-14 01:29:45,271][ ERROR][PID:2787494] Build failed: Backend process error: No success file => build failure [2026-01-14 01:29:45,272][ INFO][PID:2787494] Finished build: id=10005420 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged chroot=fedora-rawhide-ppc64le [2026-01-14 01:29:45,274][ ERROR][PID:2787494] Backend process error: No success file => build failure [2026-01-14 01:29:45,274][ INFO][PID:2787494] Worker failed build, took 791.6386022567749 [2026-01-14 01:29:45,274][ INFO][PID:2787494] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ryanabx", "project_name": "cosmic-epoch-tagged", "project_dirname": "cosmic-epoch-tagged", "submitter": "ryanabx", "ended_on": 1768354185.274466, "started_on": 1768353393.6358638, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10005420-fedora-rawhide-ppc64le", "build_id": 10005420, "package_name": "cosmic-initial-setup", "package_version": "1.0.2-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ryanabx/cosmic-epoch-tagged/cosmic-initial-setup", "git_hash": "c68a11711332d6aa771a0e0d04f7734762cca995", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ryanabx/cosmic-epoch-tagged--ryanabx", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch-tagged", "result_dir": "10005420-cosmic-initial-setup", "built_packages": "", "id": 10005420, "mockchain_macros": { "copr_username": "ryanabx", "copr_projectname": "cosmic-epoch-tagged", "vendor": "Fedora Project COPR (ryanabx/cosmic-epoch-tagged)" } } ] } [2026-01-14 01:29:45,334][ INFO][PID:2787494] Sending fedora-messaging bus message in build.end [2026-01-14 01:29:45,360][ INFO][PID:2787494] Compressing /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/builder-live.log by gzip [2026-01-14 01:29:45,361][ INFO][PID:2787494] Running command 'gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/builder-live.log' as PID 2864658 [2026-01-14 01:29:45,475][ INFO][PID:2787494] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/builder-live.log) [2026-01-14 01:29:45,476][ INFO][PID:2787494] Compressing /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/backend.log by gzip [2026-01-14 01:29:45,476][ INFO][PID:2787494] Running command 'gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch-tagged/fedora-rawhide-ppc64le/10005420-cosmic-initial-setup/backend.log' as PID 2864679