[2025-12-16 06:23:08,673][ INFO][PID:2405263] Marking build as starting [2025-12-16 06:23:08,864][ INFO][PID:2405263] Checking that /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-16 06:23:09,105][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:09,113][ INFO][PID:2405263] VM allocation process starts [2025-12-16 06:23:09,131][ INFO][PID:2405263] Trying to allocate VM: ResallocHost, ticket_id=366351, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-16 06:23:14,137][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:19,139][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:21,185][ INFO][PID:2405263] Allocated host ResallocHost, ticket_id=366351, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_00591521_20251216_054408, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-16 06:23:21,186][ INFO][PID:2405263] Allocating ssh connection to builder [2025-12-16 06:23:21,191][ INFO][PID:2405263] Checking that builder machine is OK [2025-12-16 06:23:22,252][ INFO][PID:2405263] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-16 06:23:22,832][ INFO][PID:2405263] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-16 06:23:22,845][ INFO][PID:2405263] Filling build.info file with builder info [2025-12-16 06:23:22,848][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:22,850][ INFO][PID:2405263] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.10.0", "project_dirname": "scipy-1.10.0", "submitter": "https://src.fedoraproject.org/user/qulogic", "ended_on": null, "started_on": 1765866202.8499093, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9914407-fedora-rawhide-ppc64le", "build_id": 9914407, "package_name": "python-xarray", "package_version": "2025.12.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.10.0/python-xarray", "git_hash": "87adcc8c2bd25a8c489c0a7f2ab9b92d98eb1a9a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.10.0--https://src.fedoraproject.org/user/qulogic", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.10.0", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0", "result_dir": "09914407-python-xarray", "built_packages": "", "id": 9914407, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.10.0", "vendor": "Fedora Project COPR (psimovec/scipy-1.10.0)" } } ] } [2025-12-16 06:23:22,999][ INFO][PID:2405263] Sending fedora-messaging bus message in build.start [2025-12-16 06:23:25,492][ INFO][PID:2405263] Sending fedora-messaging bus message in chroot.start [2025-12-16 06:23:25,530][ INFO][PID:2405263] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9914407-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-16 06:23:26,533][ INFO][PID:2405263] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18f' (ED25519) to the list of known hosts. [2025-12-16 06:23:26,534][ INFO][PID:2405263] Downloading the builder-live.log file, attempt 1 [2025-12-16 06:23:26,543][ INFO][PID:2405263] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18f copr-rpmbuild-log [2025-12-16 06:23:31,542][ INFO][PID:2405263] Periodic builder liveness probe: alive [2025-12-16 06:23:31,543][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:36,544][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:41,545][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:46,874][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:51,881][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:23:56,885][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:01,887][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:06,889][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:11,891][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:16,893][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:21,895][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:26,899][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:31,900][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:36,902][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:41,903][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:46,904][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:51,905][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:24:56,907][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:01,908][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:06,909][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:11,910][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:16,911][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:21,912][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:26,913][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:31,917][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:36,918][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:41,934][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:46,936][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:52,249][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:25:57,291][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:02,297][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:07,299][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:12,300][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:17,301][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:22,302][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:27,303][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:32,304][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:37,305][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:42,307][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:47,307][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:52,309][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:26:57,311][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:02,312][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:07,314][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:12,315][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:17,329][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:22,330][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:27,331][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:32,332][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:37,333][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:42,334][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:47,339][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:52,381][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:27:57,383][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:02,384][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:07,386][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:12,566][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:17,568][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:22,660][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:27,703][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:32,705][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:37,707][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:42,708][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:47,709][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:52,710][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:28:57,722][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:02,734][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:07,737][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:12,738][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:17,739][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:22,740][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:27,741][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:32,742][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:37,746][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:42,754][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:47,756][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:52,757][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:29:57,758][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:02,759][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:07,760][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:12,764][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:17,766][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:22,770][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:27,785][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:32,921][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:37,922][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:42,962][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:47,963][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:53,072][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:30:58,073][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:03,074][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:08,075][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:13,076][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:18,077][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:23,078][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:28,080][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:33,104][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:38,283][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:43,285][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:48,286][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:53,288][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:31:58,289][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:03,378][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:08,379][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:13,381][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:18,383][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:23,385][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:28,472][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:33,473][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:38,474][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:43,475][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:48,476][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:53,477][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:32:58,478][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:03,479][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:08,848][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:13,849][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:18,850][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:23,851][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:28,852][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:33,905][ INFO][PID:2405263] Periodic builder liveness probe: alive [2025-12-16 06:33:33,912][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:38,913][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:43,915][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:48,915][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:53,916][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:33:58,917][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:34:03,918][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:34:07,815][ INFO][PID:2405263] Downloading results from builder [2025-12-16 06:34:07,819][ INFO][PID:2405263] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray started [2025-12-16 06:34:07,829][ INFO][PID:2405263] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/build-09914407.rsync.log [2025-12-16 06:35:07,893][ INFO][PID:2405263] rsyncing finished. [2025-12-16 06:35:07,896][ ERROR][PID:2405263] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-16 06:35:07,897][ ERROR][PID:2405263] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-16 06:35:17,898][ INFO][PID:2405263] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray started [2025-12-16 06:35:17,899][ INFO][PID:2405263] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/build-09914407.rsync.log [2025-12-16 06:36:17,966][ INFO][PID:2405263] rsyncing finished. [2025-12-16 06:36:17,967][ ERROR][PID:2405263] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-16 06:36:17,967][ ERROR][PID:2405263] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-16 06:36:27,968][ INFO][PID:2405263] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray started [2025-12-16 06:36:27,969][ INFO][PID:2405263] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/build-09914407.rsync.log [2025-12-16 06:37:28,060][ INFO][PID:2405263] rsyncing finished. [2025-12-16 06:37:28,061][ ERROR][PID:2405263] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-16 06:37:28,062][ ERROR][PID:2405263] SSH connection lost on #3 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-12-16 06:37:38,064][ ERROR][PID:2405263] Re-try request for task on 'ResallocHost, ticket_id=366351, hostname=2620:52:6:1161:dead:beef:cafe:c18f, name=vmhost_p09_04_prod_00591521_20251216_054408, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 3 SSH attempts [2025-12-16 06:37:38,064][ INFO][PID:2405263] Releasing VM back to pool [2025-12-16 06:37:38,076][ INFO][PID:2405263] Retry #1 (on other host) [2025-12-16 06:37:38,079][ INFO][PID:2405263] Checking that /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-16 06:37:38,081][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:37:38,082][ INFO][PID:2405263] VM allocation process starts [2025-12-16 06:37:38,130][ INFO][PID:2405263] Trying to allocate VM: ResallocHost, ticket_id=366471, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-16 06:37:41,204][ INFO][PID:2405263] Allocated host ResallocHost, ticket_id=366471, hostname=2620:52:6:1161:dead:beef:cafe:c14f, name=vmhost_p09_03_prod_00591827_20251216_060004, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-16 06:37:41,205][ INFO][PID:2405263] Allocating ssh connection to builder [2025-12-16 06:37:41,206][ INFO][PID:2405263] Checking that builder machine is OK [2025-12-16 06:37:42,134][ INFO][PID:2405263] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-16 06:37:42,646][ INFO][PID:2405263] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-16 06:37:42,647][ INFO][PID:2405263] Filling build.info file with builder info [2025-12-16 06:37:42,661][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:37:42,664][ INFO][PID:2405263] Not re-notifying FE and msg buses for the new host. [2025-12-16 06:37:42,667][ INFO][PID:2405263] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9914407-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-16 06:37:43,468][ INFO][PID:2405263] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14f' (ED25519) to the list of known hosts. [2025-12-16 06:37:43,469][ INFO][PID:2405263] Downloading the builder-live.log file, attempt 1 [2025-12-16 06:37:43,490][ INFO][PID:2405263] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14f copr-rpmbuild-log [2025-12-16 06:37:48,469][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:37:53,470][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:37:58,471][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:03,472][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:08,473][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:13,474][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:18,475][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:23,477][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:28,478][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:33,479][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:38,480][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:43,481][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:48,482][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:53,483][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:38:58,484][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:03,485][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:08,486][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:13,487][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:18,488][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:23,489][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:28,490][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:33,491][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:38,492][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:43,493][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:48,494][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:53,495][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:39:58,496][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:03,497][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:08,498][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:13,499][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:18,500][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:23,501][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:28,502][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:33,503][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:38,504][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:43,505][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:48,506][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:53,507][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:40:58,508][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:03,509][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:08,510][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:13,511][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:18,512][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:23,513][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:28,513][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:33,514][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:38,515][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:43,516][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:48,517][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:53,518][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:41:58,519][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:03,520][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:08,521][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:13,522][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:18,523][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:23,524][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:28,525][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:33,526][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:38,526][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:43,527][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:48,528][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:53,529][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:42:58,530][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:03,531][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:08,532][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:13,533][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:18,534][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:23,534][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:28,535][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:33,536][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:38,593][ INFO][PID:2405263] Periodic builder liveness probe: alive [2025-12-16 06:43:38,594][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:43,595][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:48,596][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:53,597][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:43:58,598][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:03,598][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:08,599][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:13,600][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:18,601][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:23,602][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:28,603][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:33,604][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:38,605][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:43,606][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:48,607][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:53,608][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:44:58,609][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:03,610][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:08,611][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:13,611][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:18,612][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:23,613][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:28,614][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:33,615][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:38,616][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:43,617][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:48,618][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:53,619][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:45:58,620][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:03,621][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:08,621][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:13,622][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:18,623][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:23,624][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:28,625][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:33,627][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:38,628][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:43,629][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:48,630][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:53,631][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:46:58,632][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:47:03,633][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:47:08,634][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:47:13,635][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:47:18,636][ INFO][PID:2405263] Checking for cancel request [2025-12-16 06:47:19,209][ INFO][PID:2405263] Downloading results from builder [2025-12-16 06:47:19,210][ INFO][PID:2405263] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray started [2025-12-16 06:47:19,211][ INFO][PID:2405263] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/build-09914407.rsync.log [2025-12-16 06:47:19,906][ INFO][PID:2405263] rsyncing finished. [2025-12-16 06:47:19,906][ INFO][PID:2405263] Releasing VM back to pool [2025-12-16 06:47:19,917][ INFO][PID:2405263] Searching for 'success' file in resultdir [2025-12-16 06:47:19,917][ INFO][PID:2405263] Going to sign pkgs from source: 9914407-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le [2025-12-16 06:47:19,921][ INFO][PID:2405263] Calling '/bin/sign -u psimovec#scipy-1.10.0@copr.fedorahosted.org -p' (attempt #1) [2025-12-16 06:47:20,189][ INFO][PID:2405263] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.10.0@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/python3-xarray+io-2025.12.0-1.fc44.noarch.rpm' (attempt #1) [2025-12-16 06:47:20,906][ INFO][PID:2405263] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/python3-xarray+io-2025.12.0-1.fc44.noarch.rpm [2025-12-16 06:47:20,907][ INFO][PID:2405263] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.10.0@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/python-xarray-2025.12.0-1.fc44.src.rpm' (attempt #1) [2025-12-16 06:47:22,291][ INFO][PID:2405263] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/python-xarray-2025.12.0-1.fc44.src.rpm [2025-12-16 06:47:22,292][ INFO][PID:2405263] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.10.0@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/python3-xarray-2025.12.0-1.fc44.noarch.rpm' (attempt #1) [2025-12-16 06:47:23,087][ INFO][PID:2405263] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/python3-xarray-2025.12.0-1.fc44.noarch.rpm [2025-12-16 06:47:23,087][ INFO][PID:2405263] Sign done [2025-12-16 06:47:23,089][ INFO][PID:2405263] Incremental createrepo run, adding 09914407-python-xarray into https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le, (auto-create-repo=True) [2025-12-16 06:47:23,090][ INFO][PID:2405263] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le --add 09914407-python-xarray --no-appstream-metadata' as PID 2522451 [2025-12-16 06:47:25,615][ INFO][PID:2405263] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le --add 09914407-python-xarray --no-appstream-metadata) [2025-12-16 06:47:25,617][ INFO][PID:2405263] Getting build details [2025-12-16 06:47:25,618][ INFO][PID:2405263] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray [2025-12-16 06:47:25,618][ INFO][PID:2405263] Built packages: ['python3-xarray+io 2025.12.0', 'python3-xarray 2025.12.0'] [2025-12-16 06:47:25,630][ INFO][PID:2405263] build details: {'built_packages': 'python3-xarray+io 2025.12.0\npython3-xarray 2025.12.0'} [2025-12-16 06:47:25,631][ INFO][PID:2405263] Retrieving pubkey [2025-12-16 06:47:25,632][ INFO][PID:2405263] Calling '/bin/sign -u psimovec#scipy-1.10.0@copr.fedorahosted.org -p' (attempt #1) [2025-12-16 06:47:25,904][ INFO][PID:2405263] Added pubkey for user psimovec project scipy-1.10.0 into: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/pubkey.gpg [2025-12-16 06:47:25,905][ INFO][PID:2405263] Finished build: id=9914407 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/scipy-1.10.0 chroot=fedora-rawhide-ppc64le [2025-12-16 06:47:25,922][ INFO][PID:2405263] Worker succeeded build, took 583.259646654129 [2025-12-16 06:47:25,925][ INFO][PID:2405263] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.10.0", "project_dirname": "scipy-1.10.0", "submitter": "https://src.fedoraproject.org/user/qulogic", "ended_on": 1765867645.9220533, "started_on": 1765867062.6624067, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9914407-fedora-rawhide-ppc64le", "build_id": 9914407, "package_name": "python-xarray", "package_version": "2025.12.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.10.0/python-xarray", "git_hash": "87adcc8c2bd25a8c489c0a7f2ab9b92d98eb1a9a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.10.0--https://src.fedoraproject.org/user/qulogic", "results": { "packages": [ { "name": "python3-xarray+io", "epoch": null, "version": "2025.12.0", "release": "1.fc44", "arch": "noarch" }, { "name": "python-xarray", "epoch": null, "version": "2025.12.0", "release": "1.fc44", "arch": "src" }, { "name": "python3-xarray", "epoch": null, "version": "2025.12.0", "release": "1.fc44", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.10.0", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0", "result_dir": "09914407-python-xarray", "built_packages": "python3-xarray+io 2025.12.0\npython3-xarray 2025.12.0", "id": 9914407, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.10.0", "vendor": "Fedora Project COPR (psimovec/scipy-1.10.0)" } } ] } [2025-12-16 06:47:26,150][ INFO][PID:2405263] Sending fedora-messaging bus message in build.end [2025-12-16 06:47:26,240][ INFO][PID:2405263] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/builder-live.log by gzip [2025-12-16 06:47:26,241][ INFO][PID:2405263] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/builder-live.log' as PID 2522819 [2025-12-16 06:47:26,254][ INFO][PID:2405263] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/builder-live.log) [2025-12-16 06:47:26,255][ INFO][PID:2405263] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/backend.log by gzip [2025-12-16 06:47:26,256][ INFO][PID:2405263] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09914407-python-xarray/backend.log' as PID 2522824