[2026-01-04 02:54:46,634][ INFO][PID:1349943] Marking build as starting [2026-01-04 02:54:46,712][ INFO][PID:1349943] Checking that /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/repodata/repomd.xml exists [2026-01-04 02:54:46,713][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:54:46,714][ INFO][PID:1349943] VM allocation process starts [2026-01-04 02:54:46,727][ INFO][PID:1349943] Trying to allocate VM: ResallocHost, ticket_id=647421, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-04 02:54:51,728][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:54:56,729][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:01,730][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:06,732][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:11,733][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:16,734][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:21,735][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:26,736][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:31,737][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:36,738][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:41,739][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:46,740][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:51,742][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:55:56,743][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:01,744][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:06,745][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:11,746][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:16,747][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:21,748][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:26,749][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:31,750][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:36,751][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:41,752][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:46,777][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:51,780][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:56:56,781][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:01,781][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:04,914][ INFO][PID:1349943] Allocated host ResallocHost, ticket_id=647421, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_00909349_20260104_025209, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-04 02:57:04,915][ INFO][PID:1349943] Allocating ssh connection to builder [2026-01-04 02:57:04,915][ INFO][PID:1349943] Checking that builder machine is OK [2026-01-04 02:57:05,757][ INFO][PID:1349943] Running remote command: copr-builder-ready fedora-42-ppc64le [2026-01-04 02:57:06,283][ INFO][PID:1349943] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2026-01-04 02:57:06,284][ INFO][PID:1349943] Filling build.info file with builder info [2026-01-04 02:57:06,285][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:06,286][ INFO][PID:1349943] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "amatej", "project_name": "dnf-nightly-sanitizers", "project_dirname": "dnf-nightly-sanitizers", "submitter": "amatej", "ended_on": null, "started_on": 1767495426.2862723, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9973364-fedora-42-ppc64le", "build_id": 9973364, "package_name": "dnf-plugins-extras", "package_version": "4.1.2-1.20260104024143388691.master.6.gb381ca4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly-sanitizers/dnf-plugins-extras", "git_hash": "c49b16af2cac5b9505cf3478daed02c08a89a4ac", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "amatej/dnf-nightly-sanitizers--amatej", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers", "result_dir": "09973364-dnf-plugins-extras", "built_packages": "", "id": 9973364, "mockchain_macros": { "copr_username": "amatej", "copr_projectname": "dnf-nightly-sanitizers", "vendor": "Fedora Project COPR (amatej/dnf-nightly-sanitizers)" } } ] } [2026-01-04 02:57:06,391][ INFO][PID:1349943] Sending fedora-messaging bus message in build.start [2026-01-04 02:57:06,973][ INFO][PID:1349943] Sending fedora-messaging bus message in chroot.start [2026-01-04 02:57:07,007][ INFO][PID:1349943] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9973364-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2026-01-04 02:57:08,006][ INFO][PID:1349943] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c195' (ED25519) to the list of known hosts. [2026-01-04 02:57:08,007][ INFO][PID:1349943] Downloading the builder-live.log file, attempt 1 [2026-01-04 02:57:08,008][ INFO][PID:1349943] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c195 copr-rpmbuild-log [2026-01-04 02:57:13,014][ INFO][PID:1349943] Periodic builder liveness probe: alive [2026-01-04 02:57:13,014][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:18,015][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:23,016][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:28,017][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:33,018][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:38,019][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:43,020][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:48,021][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:53,022][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:57:58,024][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:03,025][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:08,026][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:13,027][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:18,028][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:23,029][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:28,030][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:33,031][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:38,032][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:43,033][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:48,034][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:53,035][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:58:58,036][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:03,037][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:08,038][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:13,039][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:18,040][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:23,041][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:28,042][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:33,043][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:38,044][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:43,045][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:48,046][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:53,047][ INFO][PID:1349943] Checking for cancel request [2026-01-04 02:59:58,048][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:03,049][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:08,050][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:13,051][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:18,052][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:23,053][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:28,054][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:33,055][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:38,056][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:43,057][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:48,058][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:53,059][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:00:58,060][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:03,061][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:08,062][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:13,063][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:18,064][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:23,065][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:28,067][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:33,068][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:38,069][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:43,070][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:48,071][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:53,072][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:01:58,073][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:03,074][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:08,075][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:13,076][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:18,181][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:23,182][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:28,182][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:33,183][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:37,365][ ERROR][PID:1349943] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2026-01-04 03:02:38,184][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:43,185][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:47,366][WARNING][PID:1349943] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2026-01-04 03:02:48,193][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:53,194][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:02:57,368][ INFO][PID:1349943] Downloading the builder-live.log file, attempt 2 [2026-01-04 03:02:58,084][ INFO][PID:1349943] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c195 copr-rpmbuild-log [2026-01-04 03:02:58,195][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:03,196][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:08,197][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:13,199][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:18,199][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:23,200][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:28,202][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:33,203][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:38,204][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:43,205][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:48,206][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:53,207][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:03:58,208][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:03,210][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:08,211][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:13,212][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:18,213][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:23,216][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:28,217][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:33,223][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:38,225][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:43,235][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:48,240][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:53,241][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:04:58,242][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:03,243][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:08,245][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:13,248][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:18,249][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:23,251][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:28,252][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:33,253][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:38,255][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:43,256][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:48,257][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:05:49,616][ INFO][PID:1349943] Downloading results from builder [2026-01-04 03:05:49,617][ INFO][PID:1349943] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras started [2026-01-04 03:05:49,617][ INFO][PID:1349943] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/build-09973364.rsync.log [2026-01-04 03:06:49,694][ INFO][PID:1349943] rsyncing finished. [2026-01-04 03:06:49,694][ ERROR][PID:1349943] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-04 03:06:49,695][ ERROR][PID:1349943] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-04 03:06:59,695][ INFO][PID:1349943] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras started [2026-01-04 03:06:59,696][ INFO][PID:1349943] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/build-09973364.rsync.log [2026-01-04 03:07:59,776][ INFO][PID:1349943] rsyncing finished. [2026-01-04 03:07:59,791][ ERROR][PID:1349943] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-04 03:07:59,792][ ERROR][PID:1349943] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-04 03:08:09,792][ INFO][PID:1349943] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras started [2026-01-04 03:08:09,793][ INFO][PID:1349943] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c195]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/build-09973364.rsync.log [2026-01-04 03:09:09,885][ INFO][PID:1349943] rsyncing finished. [2026-01-04 03:09:09,890][ ERROR][PID:1349943] Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-04 03:09:09,890][ ERROR][PID:1349943] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2026-01-04 03:09:19,891][ ERROR][PID:1349943] Re-try request for task on 'ResallocHost, ticket_id=647421, hostname=2620:52:6:1161:dead:beef:cafe:c195, name=vmhost_p09_04_prod_00909349_20260104_025209, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts [2026-01-04 03:09:19,894][ INFO][PID:1349943] Releasing VM back to pool [2026-01-04 03:09:19,910][ INFO][PID:1349943] Retry #1 (on other host) [2026-01-04 03:09:19,916][ INFO][PID:1349943] Checking that /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/repodata/repomd.xml exists [2026-01-04 03:09:19,920][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:19,923][ INFO][PID:1349943] VM allocation process starts [2026-01-04 03:09:19,963][ INFO][PID:1349943] Trying to allocate VM: ResallocHost, ticket_id=647585, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-04 03:09:23,001][ INFO][PID:1349943] Allocated host ResallocHost, ticket_id=647585, hostname=2620:52:6:1161:dead:beef:cafe:c14b, name=vmhost_p09_03_prod_00909421_20260104_025906, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-04 03:09:23,371][ INFO][PID:1349943] Allocating ssh connection to builder [2026-01-04 03:09:23,374][ INFO][PID:1349943] Checking that builder machine is OK [2026-01-04 03:09:24,534][ INFO][PID:1349943] Running remote command: copr-builder-ready fedora-42-ppc64le [2026-01-04 03:09:25,111][ INFO][PID:1349943] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2026-01-04 03:09:25,112][ INFO][PID:1349943] Filling build.info file with builder info [2026-01-04 03:09:25,144][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:25,146][ INFO][PID:1349943] Not re-notifying FE and msg buses for the new host. [2026-01-04 03:09:25,151][ INFO][PID:1349943] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9973364-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2026-01-04 03:09:26,163][ INFO][PID:1349943] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14b' (ED25519) to the list of known hosts. [2026-01-04 03:09:26,165][ INFO][PID:1349943] Downloading the builder-live.log file, attempt 1 [2026-01-04 03:09:26,167][ INFO][PID:1349943] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14b copr-rpmbuild-log [2026-01-04 03:09:31,171][ INFO][PID:1349943] Periodic builder liveness probe: alive [2026-01-04 03:09:31,172][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:36,173][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:41,174][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:46,175][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:51,176][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:09:56,177][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:01,344][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:06,437][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:11,438][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:16,438][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:21,440][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:26,441][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:31,442][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:36,443][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:41,444][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:46,445][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:51,446][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:10:56,447][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:01,448][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:06,449][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:11,450][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:16,451][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:21,453][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:26,520][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:32,079][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:37,080][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:42,081][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:47,082][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:52,083][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:11:57,084][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:02,085][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:07,088][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:12,089][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:17,090][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:22,091][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:27,092][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:32,092][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:37,093][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:42,094][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:47,095][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:52,096][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:12:57,097][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:02,098][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:07,098][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:12,099][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:17,100][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:22,101][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:27,102][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:32,103][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:37,104][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:42,105][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:47,106][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:52,107][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:13:57,107][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:02,108][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:07,109][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:12,110][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:17,111][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:22,112][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:27,113][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:32,114][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:37,115][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:42,115][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:47,116][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:52,117][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:14:57,118][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:02,119][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:07,617][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:12,906][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:17,907][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:22,908][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:27,909][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:32,909][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:37,910][ INFO][PID:1349943] Checking for cancel request [2026-01-04 03:15:39,580][ INFO][PID:1349943] Downloading results from builder [2026-01-04 03:15:39,581][ INFO][PID:1349943] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras started [2026-01-04 03:15:39,581][ INFO][PID:1349943] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/build-09973364.rsync.log [2026-01-04 03:15:40,244][ INFO][PID:1349943] rsyncing finished. [2026-01-04 03:15:40,244][ INFO][PID:1349943] Releasing VM back to pool [2026-01-04 03:15:40,253][ INFO][PID:1349943] Searching for 'success' file in resultdir [2026-01-04 03:15:40,253][ INFO][PID:1349943] Going to sign pkgs from source: 9973364-fedora-42-ppc64le in chroot: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le [2026-01-04 03:15:40,254][ INFO][PID:1349943] Calling '/bin/sign -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -p' (attempt #1) [2026-01-04 03:15:40,518][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-showvars-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:41,320][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-showvars-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:41,320][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-tracer-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:42,819][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-tracer-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:42,820][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-torproxy-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:43,612][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-torproxy-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:43,613][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/dnf-plugins-extras-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.src.rpm' (attempt #1) [2026-01-04 03:15:44,414][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/dnf-plugins-extras-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.src.rpm [2026-01-04 03:15:44,414][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugins-extras-common-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:45,210][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugins-extras-common-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:45,210][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-snapper-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:46,019][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-snapper-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:46,020][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-kickstart-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:46,952][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-kickstart-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:46,953][ INFO][PID:1349943] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-rpmconf-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm' (attempt #1) [2026-01-04 03:15:47,762][ INFO][PID:1349943] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/python3-dnf-plugin-rpmconf-4.1.2-1.20260104024143388691.master.6.gb381ca4.fc42.noarch.rpm [2026-01-04 03:15:47,763][ INFO][PID:1349943] Sign done [2026-01-04 03:15:47,763][ INFO][PID:1349943] Incremental createrepo run, adding 09973364-dnf-plugins-extras into https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le, (auto-create-repo=True) [2026-01-04 03:15:47,764][ INFO][PID:1349943] Running command 'copr-repo --batched /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le --add 09973364-dnf-plugins-extras --no-appstream-metadata' as PID 1457401 [2026-01-04 03:15:50,421][ INFO][PID:1349943] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le --add 09973364-dnf-plugins-extras --no-appstream-metadata) [2026-01-04 03:15:50,422][ INFO][PID:1349943] Getting build details [2026-01-04 03:15:50,423][ INFO][PID:1349943] Listing built binary packages in /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras [2026-01-04 03:15:50,423][ INFO][PID:1349943] Built packages: ['python3-dnf-plugin-tracer 4.1.2', 'python3-dnf-plugin-snapper 4.1.2', 'python3-dnf-plugin-rpmconf 4.1.2', 'python3-dnf-plugin-showvars 4.1.2', 'python3-dnf-plugins-extras-common 4.1.2', 'python3-dnf-plugin-torproxy 4.1.2', 'python3-dnf-plugin-kickstart 4.1.2'] [2026-01-04 03:15:50,423][ INFO][PID:1349943] build details: {'built_packages': 'python3-dnf-plugin-tracer 4.1.2\npython3-dnf-plugin-snapper 4.1.2\npython3-dnf-plugin-rpmconf 4.1.2\npython3-dnf-plugin-showvars 4.1.2\npython3-dnf-plugins-extras-common 4.1.2\npython3-dnf-plugin-torproxy 4.1.2\npython3-dnf-plugin-kickstart 4.1.2'} [2026-01-04 03:15:50,424][ INFO][PID:1349943] Retrieving pubkey [2026-01-04 03:15:50,424][ INFO][PID:1349943] Calling '/bin/sign -u amatej#dnf-nightly-sanitizers@copr.fedorahosted.org -p' (attempt #1) [2026-01-04 03:15:50,706][ INFO][PID:1349943] Added pubkey for user amatej project dnf-nightly-sanitizers into: /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/pubkey.gpg [2026-01-04 03:15:50,707][ INFO][PID:1349943] Finished build: id=9973364 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers chroot=fedora-42-ppc64le [2026-01-04 03:15:50,708][ INFO][PID:1349943] Worker succeeded build, took 385.56223702430725 [2026-01-04 03:15:50,709][ INFO][PID:1349943] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "amatej", "project_name": "dnf-nightly-sanitizers", "project_dirname": "dnf-nightly-sanitizers", "submitter": "amatej", "ended_on": 1767496550.7087257, "started_on": 1767496165.1464887, "submitted_on": null, "status": 1, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9973364-fedora-42-ppc64le", "build_id": 9973364, "package_name": "dnf-plugins-extras", "package_version": "4.1.2-1.20260104024143388691.master.6.gb381ca4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly-sanitizers/dnf-plugins-extras", "git_hash": "c49b16af2cac5b9505cf3478daed02c08a89a4ac", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "amatej/dnf-nightly-sanitizers--amatej", "results": { "packages": [ { "name": "python3-dnf-plugin-tracer", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" }, { "name": "python3-dnf-plugin-snapper", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" }, { "name": "python3-dnf-plugin-rpmconf", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" }, { "name": "dnf-plugins-extras", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "src" }, { "name": "python3-dnf-plugin-showvars", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" }, { "name": "python3-dnf-plugins-extras-common", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" }, { "name": "python3-dnf-plugin-torproxy", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" }, { "name": "python3-dnf-plugin-kickstart", "epoch": null, "version": "4.1.2", "release": "1.20260104024143388691.master.6.gb381ca4.fc42", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers", "result_dir": "09973364-dnf-plugins-extras", "built_packages": "python3-dnf-plugin-tracer 4.1.2\npython3-dnf-plugin-snapper 4.1.2\npython3-dnf-plugin-rpmconf 4.1.2\npython3-dnf-plugin-showvars 4.1.2\npython3-dnf-plugins-extras-common 4.1.2\npython3-dnf-plugin-torproxy 4.1.2\npython3-dnf-plugin-kickstart 4.1.2", "id": 9973364, "mockchain_macros": { "copr_username": "amatej", "copr_projectname": "dnf-nightly-sanitizers", "vendor": "Fedora Project COPR (amatej/dnf-nightly-sanitizers)" } } ] } [2026-01-04 03:15:50,844][ INFO][PID:1349943] Sending fedora-messaging bus message in build.end [2026-01-04 03:15:50,870][ INFO][PID:1349943] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/builder-live.log by gzip [2026-01-04 03:15:50,871][ INFO][PID:1349943] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/builder-live.log' as PID 1457452 [2026-01-04 03:15:50,877][ INFO][PID:1349943] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/builder-live.log) [2026-01-04 03:15:50,878][ INFO][PID:1349943] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/backend.log by gzip [2026-01-04 03:15:50,878][ INFO][PID:1349943] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/09973364-dnf-plugins-extras/backend.log' as PID 1457453