[2026-01-14 03:05:48,783][ INFO][PID:3408820] Marking build as starting [2026-01-14 03:05:48,852][ INFO][PID:3408820] Checking that /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-01-14 03:05:48,853][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:05:48,854][ INFO][PID:3408820] VM allocation process starts [2026-01-14 03:05:48,863][ INFO][PID:3408820] Trying to allocate VM: ResallocHost, ticket_id=803969, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-14 03:05:51,944][ INFO][PID:3408820] Allocated host ResallocHost, ticket_id=803969, hostname=44.203.207.11, name=aws_x86_64_spot_prod_01216989_20260114_025732, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-14 03:05:51,944][ INFO][PID:3408820] Allocating ssh connection to builder [2026-01-14 03:05:51,945][ INFO][PID:3408820] Checking that builder machine is OK [2026-01-14 03:05:52,280][ INFO][PID:3408820] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-01-14 03:05:52,467][ INFO][PID:3408820] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-01-14 03:05:52,467][ INFO][PID:3408820] Filling build.info file with builder info [2026-01-14 03:05:52,468][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:05:52,469][ INFO][PID:3408820] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ryanabx", "project_name": "cosmic-epoch", "project_dirname": "cosmic-epoch", "submitter": "ryanabx", "ended_on": null, "started_on": 1768359952.4690475, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10005597-fedora-rawhide-x86_64", "build_id": 10005597, "package_name": "cosmic-idle", "package_version": "1.0.2^git20251113.983d34a-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ryanabx/cosmic-epoch/cosmic-idle", "git_hash": "2e1c4d4ff6f4f49c85d8be444ad5504108e77347", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ryanabx/cosmic-epoch--ryanabx", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ryanabx/cosmic-epoch", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch", "result_dir": "10005597-cosmic-idle", "built_packages": "", "id": 10005597, "mockchain_macros": { "copr_username": "ryanabx", "copr_projectname": "cosmic-epoch", "vendor": "Fedora Project COPR (ryanabx/cosmic-epoch)" } } ] } [2026-01-14 03:05:52,552][ INFO][PID:3408820] Sending fedora-messaging bus message in build.start [2026-01-14 03:05:53,061][ INFO][PID:3408820] Sending fedora-messaging bus message in chroot.start [2026-01-14 03:05:53,087][ INFO][PID:3408820] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10005597-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-01-14 03:05:53,396][ INFO][PID:3408820] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '44.203.207.11' (ED25519) to the list of known hosts. [2026-01-14 03:05:53,396][ INFO][PID:3408820] Downloading the builder-live.log file, attempt 1 [2026-01-14 03:05:53,398][ INFO][PID:3408820] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.203.207.11 copr-rpmbuild-log [2026-01-14 03:05:58,402][ INFO][PID:3408820] Periodic builder liveness probe: alive [2026-01-14 03:05:58,402][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:03,403][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:08,404][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:13,405][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:18,406][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:23,407][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:28,408][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:33,409][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:38,409][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:43,411][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:48,412][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:53,413][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:06:58,414][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:03,415][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:08,416][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:13,417][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:18,418][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:23,420][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:28,421][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:33,422][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:38,423][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:43,425][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:48,426][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:53,427][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:07:58,430][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:03,432][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:08,433][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:13,436][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:18,439][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:23,440][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:28,441][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:33,442][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:38,443][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:43,445][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:48,445][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:53,446][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:08:58,447][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:03,448][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:08,449][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:13,450][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:18,451][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:23,452][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:28,453][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:33,454][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:38,456][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:43,457][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:48,458][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:53,459][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:09:58,460][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:03,461][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:08,462][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:13,463][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:18,465][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:23,466][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:28,467][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:33,469][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:34,656][ ERROR][PID:3408820] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-14 03:10:38,470][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:43,471][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:44,657][WARNING][PID:3408820] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-14 03:10:48,472][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:53,473][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:10:54,658][ INFO][PID:3408820] Downloading the builder-live.log file, attempt 2 [2026-01-14 03:10:54,659][ INFO][PID:3408820] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.203.207.11 copr-rpmbuild-log [2026-01-14 03:10:58,474][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:03,475][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:08,476][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:13,488][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:18,489][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:23,490][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:28,491][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:33,492][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:38,493][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:43,494][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:48,495][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:53,496][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:11:54,727][ ERROR][PID:3408820] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-14 03:11:58,497][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:03,498][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:04,731][WARNING][PID:3408820] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-14 03:12:08,499][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:13,500][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:14,731][ INFO][PID:3408820] Downloading the builder-live.log file, attempt 3 [2026-01-14 03:12:14,733][ INFO][PID:3408820] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.203.207.11 copr-rpmbuild-log [2026-01-14 03:12:18,501][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:23,502][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:28,503][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:33,504][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:38,505][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:43,506][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:48,507][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:53,509][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:12:58,510][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:03,511][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:08,512][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:13,513][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:14,801][ ERROR][PID:3408820] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-14 03:13:18,514][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:23,515][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:24,805][WARNING][PID:3408820] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-14 03:13:28,516][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:33,517][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:34,806][ INFO][PID:3408820] Downloading the builder-live.log file, attempt 4 [2026-01-14 03:13:34,811][ INFO][PID:3408820] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.203.207.11 copr-rpmbuild-log [2026-01-14 03:13:38,518][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:43,519][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:48,520][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:53,522][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:13:58,522][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:03,524][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:08,525][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:13,526][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:18,527][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:23,528][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:28,529][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:33,530][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:34,880][ ERROR][PID:3408820] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-14 03:14:38,530][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:43,531][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:44,884][ ERROR][PID:3408820] Giving up for unstable SSH, failures: 1768360244.6576877, 1768360324.7311246, 1768360404.8058605, 1768360484.8840864 [2026-01-14 03:14:44,885][ ERROR][PID:3408820] Re-try request for task on 'ResallocHost, ticket_id=803969, hostname=44.203.207.11, name=aws_x86_64_spot_prod_01216989_20260114_025732, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2026-01-14 03:14:44,885][ INFO][PID:3408820] Releasing VM back to pool [2026-01-14 03:14:44,901][ INFO][PID:3408820] Retry #1 (on other host) [2026-01-14 03:14:44,902][ INFO][PID:3408820] Checking that /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/repodata/repomd.xml exists [2026-01-14 03:14:44,902][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:44,903][ INFO][PID:3408820] VM allocation process starts [2026-01-14 03:14:44,922][ INFO][PID:3408820] Trying to allocate VM: ResallocHost, ticket_id=804078, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-14 03:14:47,939][ INFO][PID:3408820] Allocated host ResallocHost, ticket_id=804078, hostname=3.81.21.48, name=aws_x86_64_normalreserved_prod_01217197_20260114_031115, requested_tags=['copr_builder', 'arch_x86_64'] [2026-01-14 03:14:47,939][ INFO][PID:3408820] Allocating ssh connection to builder [2026-01-14 03:14:47,940][ INFO][PID:3408820] Checking that builder machine is OK [2026-01-14 03:14:48,270][ INFO][PID:3408820] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-01-14 03:14:48,465][ INFO][PID:3408820] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-01-14 03:14:48,465][ INFO][PID:3408820] Filling build.info file with builder info [2026-01-14 03:14:48,481][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:48,482][ INFO][PID:3408820] Not re-notifying FE and msg buses for the new host. [2026-01-14 03:14:48,482][ INFO][PID:3408820] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10005597-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-01-14 03:14:48,796][ INFO][PID:3408820] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.81.21.48' (ED25519) to the list of known hosts. [2026-01-14 03:14:48,797][ INFO][PID:3408820] Downloading the builder-live.log file, attempt 1 [2026-01-14 03:14:48,798][ INFO][PID:3408820] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.81.21.48 copr-rpmbuild-log [2026-01-14 03:14:53,797][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:14:58,798][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:03,799][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:08,800][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:13,801][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:18,802][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:23,803][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:28,804][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:33,805][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:38,806][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:43,807][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:48,808][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:53,809][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:15:58,818][ INFO][PID:3408820] Periodic builder liveness probe: alive [2026-01-14 03:15:58,819][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:03,819][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:08,820][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:13,821][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:18,822][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:23,823][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:28,824][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:33,825][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:38,825][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:43,826][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:48,827][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:54,120][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:16:59,121][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:04,122][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:09,123][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:14,124][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:19,125][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:24,126][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:29,127][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:34,128][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:39,129][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:44,130][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:49,131][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:54,132][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:17:59,557][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:04,558][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:09,559][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:14,561][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:19,712][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:24,714][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:29,715][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:34,717][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:39,718][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:44,719][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:49,720][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:54,721][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:18:59,722][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:04,723][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:09,724][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:14,725][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:19,726][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:24,727][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:29,728][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:34,729][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:39,731][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:44,733][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:49,734][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:54,735][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:19:59,736][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:04,737][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:09,737][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:14,738][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:19,739][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:24,740][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:29,741][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:34,742][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:39,743][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:44,744][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:49,745][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:54,746][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:20:59,747][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:04,748][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:09,749][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:14,750][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:19,751][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:24,752][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:29,753][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:34,754][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:39,755][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:44,756][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:49,757][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:54,758][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:21:59,759][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:04,760][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:09,768][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:14,769][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:19,770][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:24,771][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:29,772][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:34,773][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:39,774][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:44,775][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:49,776][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:22:55,068][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:00,070][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:05,072][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:10,073][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:15,075][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:20,076][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:25,078][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:30,079][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:35,080][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:40,139][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:45,140][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:50,143][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:23:55,146][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:00,147][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:05,149][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:10,151][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:15,152][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:20,170][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:25,171][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:30,173][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:35,174][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:40,176][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:45,178][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:50,179][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:24:55,181][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:00,183][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:05,184][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:10,185][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:15,185][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:20,230][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:25,232][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:30,233][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:35,364][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:40,738][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:45,741][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:50,748][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:25:55,750][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:00,755][ INFO][PID:3408820] Periodic builder liveness probe: alive [2026-01-14 03:26:00,756][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:05,757][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:10,758][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:15,759][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:20,759][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:25,760][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:30,761][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:35,762][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:40,822][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:45,823][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:50,824][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:26:55,825][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:00,826][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:05,826][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:10,827][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:15,828][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:20,829][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:25,848][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:31,046][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:36,047][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:41,048][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:46,049][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:51,050][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:27:56,051][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:01,052][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:06,053][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:11,053][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:16,666][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:21,667][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:26,668][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:31,669][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:36,670][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:41,671][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:46,672][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:51,673][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:28:56,674][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:01,675][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:06,676][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:11,677][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:16,678][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:21,679][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:26,680][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:31,681][ INFO][PID:3408820] Checking for cancel request [2026-01-14 03:29:33,183][ INFO][PID:3408820] Downloading results from builder [2026-01-14 03:29:33,184][ INFO][PID:3408820] rsyncing of mockbuilder@3.81.21.48:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle started [2026-01-14 03:29:33,184][ INFO][PID:3408820] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.81.21.48:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/ &> /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/build-10005597.rsync.log [2026-01-14 03:29:33,893][ INFO][PID:3408820] rsyncing finished. [2026-01-14 03:29:33,894][ INFO][PID:3408820] Releasing VM back to pool [2026-01-14 03:29:33,903][ INFO][PID:3408820] Searching for 'success' file in resultdir [2026-01-14 03:29:33,904][ INFO][PID:3408820] Going to sign pkgs from source: 10005597-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64 [2026-01-14 03:29:33,904][ INFO][PID:3408820] Calling '/bin/sign -u ryanabx#cosmic-epoch@copr.fedorahosted.org -p' (attempt #1) [2026-01-14 03:29:34,180][ INFO][PID:3408820] Calling '/bin/sign -4 -h sha256 -u ryanabx#cosmic-epoch@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-debugsource-1.0.2^git20251113.983d34a-1.fc44.x86_64.rpm' (attempt #1) [2026-01-14 03:29:34,857][ INFO][PID:3408820] signed rpm: /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-debugsource-1.0.2^git20251113.983d34a-1.fc44.x86_64.rpm [2026-01-14 03:29:34,857][ INFO][PID:3408820] Calling '/bin/sign -4 -h sha256 -u ryanabx#cosmic-epoch@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-1.0.2^git20251113.983d34a-1.fc44.x86_64.rpm' (attempt #1) [2026-01-14 03:29:35,719][ INFO][PID:3408820] signed rpm: /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-1.0.2^git20251113.983d34a-1.fc44.x86_64.rpm [2026-01-14 03:29:35,719][ INFO][PID:3408820] Calling '/bin/sign -4 -h sha256 -u ryanabx#cosmic-epoch@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-1.0.2^git20251113.983d34a-1.fc44.src.rpm' (attempt #1) [2026-01-14 03:29:38,038][ INFO][PID:3408820] signed rpm: /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-1.0.2^git20251113.983d34a-1.fc44.src.rpm [2026-01-14 03:29:38,039][ INFO][PID:3408820] Calling '/bin/sign -4 -h sha256 -u ryanabx#cosmic-epoch@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-debuginfo-1.0.2^git20251113.983d34a-1.fc44.x86_64.rpm' (attempt #1) [2026-01-14 03:29:39,199][ INFO][PID:3408820] signed rpm: /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/cosmic-idle-debuginfo-1.0.2^git20251113.983d34a-1.fc44.x86_64.rpm [2026-01-14 03:29:39,200][ INFO][PID:3408820] Sign done [2026-01-14 03:29:39,200][ INFO][PID:3408820] Incremental createrepo run, adding 10005597-cosmic-idle into https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64, (auto-create-repo=True) [2026-01-14 03:29:39,201][ INFO][PID:3408820] Running command 'copr-repo --batched /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64 --add 10005597-cosmic-idle --no-appstream-metadata' as PID 3504291 [2026-01-14 03:29:41,854][ INFO][PID:3408820] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64 --add 10005597-cosmic-idle --no-appstream-metadata) [2026-01-14 03:29:41,855][ INFO][PID:3408820] Getting build details [2026-01-14 03:29:41,856][ INFO][PID:3408820] Listing built binary packages in /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle [2026-01-14 03:29:41,856][ INFO][PID:3408820] Built packages: ['cosmic-idle-debugsource 1.0.2^git20251113.983d34a', 'cosmic-idle 1.0.2^git20251113.983d34a', 'cosmic-idle-debuginfo 1.0.2^git20251113.983d34a'] [2026-01-14 03:29:41,857][ INFO][PID:3408820] build details: {'built_packages': 'cosmic-idle-debugsource 1.0.2^git20251113.983d34a\ncosmic-idle 1.0.2^git20251113.983d34a\ncosmic-idle-debuginfo 1.0.2^git20251113.983d34a'} [2026-01-14 03:29:41,857][ INFO][PID:3408820] Retrieving pubkey [2026-01-14 03:29:41,858][ INFO][PID:3408820] Calling '/bin/sign -u ryanabx#cosmic-epoch@copr.fedorahosted.org -p' (attempt #1) [2026-01-14 03:29:42,181][ INFO][PID:3408820] Added pubkey for user ryanabx project cosmic-epoch into: /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/pubkey.gpg [2026-01-14 03:29:42,182][ INFO][PID:3408820] Finished build: id=10005597 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/ryanabx/cosmic-epoch chroot=fedora-rawhide-x86_64 [2026-01-14 03:29:42,185][ INFO][PID:3408820] Worker succeeded build, took 893.7029232978821 [2026-01-14 03:29:42,186][ INFO][PID:3408820] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "ryanabx", "project_name": "cosmic-epoch", "project_dirname": "cosmic-epoch", "submitter": "ryanabx", "ended_on": 1768361382.1851037, "started_on": 1768360488.4821804, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10005597-fedora-rawhide-x86_64", "build_id": 10005597, "package_name": "cosmic-idle", "package_version": "1.0.2^git20251113.983d34a-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ryanabx/cosmic-epoch/cosmic-idle", "git_hash": "2e1c4d4ff6f4f49c85d8be444ad5504108e77347", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "ryanabx/cosmic-epoch--ryanabx", "results": { "packages": [ { "name": "cosmic-idle-debugsource", "epoch": null, "version": "1.0.2^git20251113.983d34a", "release": "1.fc44", "arch": "x86_64" }, { "name": "cosmic-idle", "epoch": null, "version": "1.0.2^git20251113.983d34a", "release": "1.fc44", "arch": "x86_64" }, { "name": "cosmic-idle-debuginfo", "epoch": null, "version": "1.0.2^git20251113.983d34a", "release": "1.fc44", "arch": "x86_64" }, { "name": "cosmic-idle", "epoch": null, "version": "1.0.2^git20251113.983d34a", "release": "1.fc44", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": true, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/ryanabx/cosmic-epoch", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/ryanabx/cosmic-epoch", "result_dir": "10005597-cosmic-idle", "built_packages": "cosmic-idle-debugsource 1.0.2^git20251113.983d34a\ncosmic-idle 1.0.2^git20251113.983d34a\ncosmic-idle-debuginfo 1.0.2^git20251113.983d34a", "id": 10005597, "mockchain_macros": { "copr_username": "ryanabx", "copr_projectname": "cosmic-epoch", "vendor": "Fedora Project COPR (ryanabx/cosmic-epoch)" } } ] } [2026-01-14 03:29:42,259][ INFO][PID:3408820] Sending fedora-messaging bus message in build.end [2026-01-14 03:29:42,287][ INFO][PID:3408820] Compressing /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/builder-live.log by gzip [2026-01-14 03:29:42,290][ INFO][PID:3408820] Running command 'gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/builder-live.log' as PID 3504454 [2026-01-14 03:29:42,434][ INFO][PID:3408820] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/builder-live.log) [2026-01-14 03:29:42,435][ INFO][PID:3408820] Compressing /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/backend.log by gzip [2026-01-14 03:29:42,436][ INFO][PID:3408820] Running command 'gzip /var/lib/copr/public_html/results/ryanabx/cosmic-epoch/fedora-rawhide-x86_64/10005597-cosmic-idle/backend.log' as PID 3504457