[2025-12-14 22:36:34,124][ INFO][PID:3123874] Marking build as starting [2025-12-14 22:36:34,295][ INFO][PID:3123874] Checking that /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-14 22:36:34,413][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:36:34,415][ INFO][PID:3123874] VM allocation process starts [2025-12-14 22:36:34,428][ INFO][PID:3123874] Trying to allocate VM: ResallocHost, ticket_id=336666, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-14 22:36:37,445][ INFO][PID:3123874] Allocated host ResallocHost, ticket_id=336666, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00546170_20251214_222910, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-14 22:36:37,446][ INFO][PID:3123874] Allocating ssh connection to builder [2025-12-14 22:36:37,446][ INFO][PID:3123874] Checking that builder machine is OK [2025-12-14 22:36:38,585][ INFO][PID:3123874] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-14 22:36:39,117][ INFO][PID:3123874] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-14 22:36:39,118][ INFO][PID:3123874] Filling build.info file with builder info [2025-12-14 22:36:39,118][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:36:39,119][ INFO][PID:3123874] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "minfrin", "project_name": "sequence", "project_dirname": "sequence", "submitter": "minfrin", "ended_on": null, "started_on": 1765751799.119519, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9908906-fedora-41-ppc64le", "build_id": 9908906, "package_name": "sequence", "package_version": "1.2.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/minfrin/sequence/sequence", "git_hash": "722e87626d16c7ff51fa494c50373b0c6b7aa806", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "minfrin/sequence--minfrin", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/minfrin/sequence/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/minfrin/sequence", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/minfrin/sequence", "result_dir": "09908906-sequence", "built_packages": "", "id": 9908906, "mockchain_macros": { "copr_username": "minfrin", "copr_projectname": "sequence", "vendor": "Fedora Project COPR (minfrin/sequence)" } } ] } [2025-12-14 22:36:39,316][ INFO][PID:3123874] Sending fedora-messaging bus message in build.start [2025-12-14 22:36:39,833][ INFO][PID:3123874] Sending fedora-messaging bus message in chroot.start [2025-12-14 22:36:39,859][ INFO][PID:3123874] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9908906-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-14 22:36:40,843][ INFO][PID:3123874] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c10e' (ED25519) to the list of known hosts. [2025-12-14 22:36:41,129][ INFO][PID:3123874] Downloading the builder-live.log file, attempt 1 [2025-12-14 22:36:41,346][ INFO][PID:3123874] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10e copr-rpmbuild-log [2025-12-14 22:36:46,135][ INFO][PID:3123874] Periodic builder liveness probe: alive [2025-12-14 22:36:46,136][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:36:51,136][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:36:56,138][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:01,138][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:06,140][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:11,140][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:16,604][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:21,605][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:26,607][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:31,609][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:36,611][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:41,612][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:46,613][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:51,614][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:37:56,615][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:01,830][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:06,831][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:11,832][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:16,833][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:21,834][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:26,835][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:31,836][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:36,837][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:41,838][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:46,839][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:51,840][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:38:56,842][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:01,847][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:06,848][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:11,850][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:16,850][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:21,852][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:26,853][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:31,854][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:36,855][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:41,856][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:46,857][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:51,858][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:39:56,859][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:01,860][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:06,862][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:11,863][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:16,864][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:21,865][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:26,866][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:31,910][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:36,911][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:41,912][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:46,914][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:48,370][ ERROR][PID:3123874] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-14 22:40:51,916][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:56,917][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:40:58,370][WARNING][PID:3123874] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-14 22:41:01,918][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:06,919][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:08,371][ INFO][PID:3123874] Downloading the builder-live.log file, attempt 2 [2025-12-14 22:41:08,372][ INFO][PID:3123874] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10e copr-rpmbuild-log [2025-12-14 22:41:11,920][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:16,921][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:21,922][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:26,923][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:31,924][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:36,942][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:41,944][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:46,945][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:51,946][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:41:56,946][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:01,947][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:06,948][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:08,440][ ERROR][PID:3123874] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-14 22:42:11,949][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:16,950][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:18,455][WARNING][PID:3123874] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-14 22:42:22,257][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:27,261][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:28,456][ INFO][PID:3123874] Downloading the builder-live.log file, attempt 3 [2025-12-14 22:42:28,457][ INFO][PID:3123874] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10e copr-rpmbuild-log [2025-12-14 22:42:32,266][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:37,268][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:42,509][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:47,510][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:52,511][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:42:57,512][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:02,513][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:07,515][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:12,515][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:17,516][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:22,517][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:27,518][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:28,525][ ERROR][PID:3123874] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-14 22:43:32,519][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:37,520][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:38,541][WARNING][PID:3123874] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-14 22:43:42,521][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:47,522][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:48,542][ INFO][PID:3123874] Downloading the builder-live.log file, attempt 4 [2025-12-14 22:43:48,544][ INFO][PID:3123874] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c10e copr-rpmbuild-log [2025-12-14 22:43:52,523][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:43:57,524][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:02,525][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:07,526][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:12,527][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:17,528][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:22,529][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:27,530][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:32,531][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:37,532][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:42,533][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:47,534][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:48,612][ ERROR][PID:3123874] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-14 22:44:52,535][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:57,536][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:58,627][ ERROR][PID:3123874] Giving up for unstable SSH, failures: 1765752058.370871, 1765752138.4555771, 1765752218.5418997, 1765752298.6273248 [2025-12-14 22:44:58,628][ ERROR][PID:3123874] Re-try request for task on 'ResallocHost, ticket_id=336666, hostname=2620:52:6:1161:dead:beef:cafe:c10e, name=vmhost_p09_02_prod_00546170_20251214_222910, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-14 22:44:58,628][ INFO][PID:3123874] Releasing VM back to pool [2025-12-14 22:44:58,638][ INFO][PID:3123874] Retry #1 (on other host) [2025-12-14 22:44:58,639][ INFO][PID:3123874] Checking that /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/repodata/repomd.xml exists [2025-12-14 22:44:58,639][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:44:58,640][ INFO][PID:3123874] VM allocation process starts [2025-12-14 22:44:58,649][ INFO][PID:3123874] Trying to allocate VM: ResallocHost, ticket_id=336721, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-14 22:45:01,663][ INFO][PID:3123874] Allocated host ResallocHost, ticket_id=336721, hostname=2620:52:6:1161:dead:beef:cafe:c110, name=vmhost_p09_02_prod_00546273_20251214_223647, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-14 22:45:01,663][ INFO][PID:3123874] Allocating ssh connection to builder [2025-12-14 22:45:01,664][ INFO][PID:3123874] Checking that builder machine is OK [2025-12-14 22:45:02,556][ INFO][PID:3123874] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-14 22:45:03,045][ INFO][PID:3123874] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-14 22:45:03,045][ INFO][PID:3123874] Filling build.info file with builder info [2025-12-14 22:45:03,053][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:03,053][ INFO][PID:3123874] Not re-notifying FE and msg buses for the new host. [2025-12-14 22:45:03,054][ INFO][PID:3123874] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9908906-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-14 22:45:03,993][ INFO][PID:3123874] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c110' (ED25519) to the list of known hosts. [2025-12-14 22:45:03,994][ INFO][PID:3123874] Downloading the builder-live.log file, attempt 1 [2025-12-14 22:45:03,995][ INFO][PID:3123874] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c110 copr-rpmbuild-log [2025-12-14 22:45:08,994][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:13,995][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:18,996][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:23,997][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:28,998][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:33,999][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:39,000][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:44,001][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:49,002][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:54,004][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:45:59,004][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:04,005][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:09,006][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:14,007][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:19,008][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:24,009][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:29,010][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:34,011][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:39,012][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:44,013][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:49,021][ INFO][PID:3123874] Periodic builder liveness probe: alive [2025-12-14 22:46:49,022][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:54,023][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:46:59,024][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:04,025][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:09,026][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:14,027][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:19,028][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:24,029][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:29,030][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:34,031][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:39,031][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:44,032][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:49,033][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:54,034][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:47:59,035][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:04,036][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:09,037][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:14,038][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:19,039][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:24,039][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:29,040][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:34,041][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:39,042][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:44,043][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:49,044][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:54,045][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:48:59,046][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:04,047][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:09,048][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:14,049][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:19,050][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:24,051][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:29,052][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:34,053][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:39,054][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:44,055][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:49,056][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:54,057][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:49:59,058][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:04,059][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:09,059][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:14,060][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:19,061][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:24,062][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:29,064][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:34,065][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:39,066][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:44,066][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:49,067][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:54,068][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:50:59,069][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:51:04,071][ INFO][PID:3123874] Checking for cancel request [2025-12-14 22:51:08,466][ INFO][PID:3123874] Downloading results from builder [2025-12-14 22:51:08,470][ INFO][PID:3123874] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c110]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence started [2025-12-14 22:51:08,471][ INFO][PID:3123874] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c110]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/ &> /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/build-09908906.rsync.log [2025-12-14 22:51:09,164][ INFO][PID:3123874] rsyncing finished. [2025-12-14 22:51:09,166][ INFO][PID:3123874] Releasing VM back to pool [2025-12-14 22:51:09,189][ INFO][PID:3123874] Searching for 'success' file in resultdir [2025-12-14 22:51:09,194][ INFO][PID:3123874] Going to sign pkgs from source: 9908906-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le [2025-12-14 22:51:09,195][ INFO][PID:3123874] Calling '/bin/sign -u minfrin#sequence@copr.fedorahosted.org -p' (attempt #1) [2025-12-14 22:51:09,469][ INFO][PID:3123874] Calling '/bin/sign -4 -h sha256 -u minfrin#sequence@copr.fedorahosted.org -r /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-debuginfo-1.2.0-1.fc41.ppc64le.rpm' (attempt #1) [2025-12-14 22:51:10,272][ INFO][PID:3123874] signed rpm: /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-debuginfo-1.2.0-1.fc41.ppc64le.rpm [2025-12-14 22:51:10,273][ INFO][PID:3123874] Calling '/bin/sign -4 -h sha256 -u minfrin#sequence@copr.fedorahosted.org -r /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-1.2.0-1.fc41.src.rpm' (attempt #1) [2025-12-14 22:51:11,059][ INFO][PID:3123874] signed rpm: /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-1.2.0-1.fc41.src.rpm [2025-12-14 22:51:11,060][ INFO][PID:3123874] Calling '/bin/sign -4 -h sha256 -u minfrin#sequence@copr.fedorahosted.org -r /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-1.2.0-1.fc41.ppc64le.rpm' (attempt #1) [2025-12-14 22:51:11,843][ INFO][PID:3123874] signed rpm: /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-1.2.0-1.fc41.ppc64le.rpm [2025-12-14 22:51:11,843][ INFO][PID:3123874] Calling '/bin/sign -4 -h sha256 -u minfrin#sequence@copr.fedorahosted.org -r /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-debugsource-1.2.0-1.fc41.ppc64le.rpm' (attempt #1) [2025-12-14 22:51:12,628][ INFO][PID:3123874] signed rpm: /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/sequence-debugsource-1.2.0-1.fc41.ppc64le.rpm [2025-12-14 22:51:12,629][ INFO][PID:3123874] Sign done [2025-12-14 22:51:12,630][ INFO][PID:3123874] Incremental createrepo run, adding 09908906-sequence into https://download.copr.fedorainfracloud.org/results/minfrin/sequence/fedora-41-ppc64le, (auto-create-repo=True) [2025-12-14 22:51:12,631][ INFO][PID:3123874] Running command 'copr-repo --batched /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le --add 09908906-sequence --no-appstream-metadata' as PID 3188808 [2025-12-14 22:51:14,247][ INFO][PID:3123874] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le --add 09908906-sequence --no-appstream-metadata) [2025-12-14 22:51:14,248][ INFO][PID:3123874] Getting build details [2025-12-14 22:51:14,248][ INFO][PID:3123874] Listing built binary packages in /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence [2025-12-14 22:51:14,248][ INFO][PID:3123874] Built packages: ['sequence 1.2.0', 'sequence-debuginfo 1.2.0', 'sequence-debugsource 1.2.0'] [2025-12-14 22:51:14,249][ INFO][PID:3123874] build details: {'built_packages': 'sequence 1.2.0\nsequence-debuginfo 1.2.0\nsequence-debugsource 1.2.0'} [2025-12-14 22:51:14,250][ INFO][PID:3123874] Retrieving pubkey [2025-12-14 22:51:14,250][ INFO][PID:3123874] Calling '/bin/sign -u minfrin#sequence@copr.fedorahosted.org -p' (attempt #1) [2025-12-14 22:51:14,523][ INFO][PID:3123874] Added pubkey for user minfrin project sequence into: /var/lib/copr/public_html/results/minfrin/sequence/pubkey.gpg [2025-12-14 22:51:14,524][ INFO][PID:3123874] Finished build: id=9908906 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/minfrin/sequence chroot=fedora-41-ppc64le [2025-12-14 22:51:14,525][ INFO][PID:3123874] Worker succeeded build, took 371.4718770980835 [2025-12-14 22:51:14,526][ INFO][PID:3123874] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "minfrin", "project_name": "sequence", "project_dirname": "sequence", "submitter": "minfrin", "ended_on": 1765752674.5257254, "started_on": 1765752303.0538483, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9908906-fedora-41-ppc64le", "build_id": 9908906, "package_name": "sequence", "package_version": "1.2.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/minfrin/sequence/sequence", "git_hash": "722e87626d16c7ff51fa494c50373b0c6b7aa806", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "minfrin/sequence--minfrin", "results": { "packages": [ { "name": "sequence", "epoch": null, "version": "1.2.0", "release": "1.fc41", "arch": "ppc64le" }, { "name": "sequence", "epoch": null, "version": "1.2.0", "release": "1.fc41", "arch": "src" }, { "name": "sequence-debuginfo", "epoch": null, "version": "1.2.0", "release": "1.fc41", "arch": "ppc64le" }, { "name": "sequence-debugsource", "epoch": null, "version": "1.2.0", "release": "1.fc41", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/minfrin/sequence/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/minfrin/sequence", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/minfrin/sequence", "result_dir": "09908906-sequence", "built_packages": "sequence 1.2.0\nsequence-debuginfo 1.2.0\nsequence-debugsource 1.2.0", "id": 9908906, "mockchain_macros": { "copr_username": "minfrin", "copr_projectname": "sequence", "vendor": "Fedora Project COPR (minfrin/sequence)" } } ] } [2025-12-14 22:51:14,659][ INFO][PID:3123874] Sending fedora-messaging bus message in build.end [2025-12-14 22:51:14,687][ INFO][PID:3123874] Compressing /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/builder-live.log by gzip [2025-12-14 22:51:14,688][ INFO][PID:3123874] Running command 'gzip /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/builder-live.log' as PID 3188994 [2025-12-14 22:51:14,694][ INFO][PID:3123874] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/builder-live.log) [2025-12-14 22:51:14,695][ INFO][PID:3123874] Compressing /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/backend.log by gzip [2025-12-14 22:51:14,696][ INFO][PID:3123874] Running command 'gzip /var/lib/copr/public_html/results/minfrin/sequence/fedora-41-ppc64le/09908906-sequence/backend.log' as PID 3188998