[2025-12-11 14:36:39,788][ INFO][PID:2985324] Marking build as starting [2025-12-11 14:36:39,829][ INFO][PID:2985324] Checking that /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/repodata/repomd.xml exists [2025-12-11 14:36:39,830][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:36:39,831][ INFO][PID:2985324] VM allocation process starts [2025-12-11 14:36:39,854][ INFO][PID:2985324] Trying to allocate VM: ResallocHost, ticket_id=284643, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-11 14:36:44,856][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:36:45,881][ INFO][PID:2985324] Allocated host ResallocHost, ticket_id=284643, hostname=163.107.90.248, name=copr_ic_s390x_br_sao_2_prod_00347927_20251211_141218, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-11 14:36:45,881][ INFO][PID:2985324] Allocating ssh connection to builder [2025-12-11 14:36:45,881][ INFO][PID:2985324] Checking that builder machine is OK [2025-12-11 14:36:47,648][ INFO][PID:2985324] Running remote command: copr-builder-ready centos-stream-9-s390x [2025-12-11 14:36:49,290][ INFO][PID:2985324] Red Hat subscription not needed for centos-stream-9-s390x Builder is ready to be used [2025-12-11 14:36:49,291][ INFO][PID:2985324] Filling build.info file with builder info [2025-12-11 14:36:49,292][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:36:49,293][ INFO][PID:2985324] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": null, "started_on": 1765463809.2928646, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9896316-centos-stream-9-s390x", "build_id": 9896316, "package_name": "fips-provider-next", "package_version": "1.2.0-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/fips-provider-next", "git_hash": "e6ea70b6c58bc8e6ecdd9e6ccaebeb683fb6fe90", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251209/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20251209", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20251209" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09896316-fips-provider-next", "built_packages": "", "id": 9896316, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-12-11 14:36:49,332][ INFO][PID:2985324] Sending fedora-messaging bus message in build.start [2025-12-11 14:36:49,887][ INFO][PID:2985324] Sending fedora-messaging bus message in chroot.start [2025-12-11 14:36:49,917][ INFO][PID:2985324] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9896316-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached [2025-12-11 14:36:51,720][ INFO][PID:2985324] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.248' (ED25519) to the list of known hosts. [2025-12-11 14:36:51,721][ INFO][PID:2985324] Downloading the builder-live.log file, attempt 1 [2025-12-11 14:36:51,723][ INFO][PID:2985324] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.248 copr-rpmbuild-log [2025-12-11 14:36:56,735][ INFO][PID:2985324] Periodic builder liveness probe: alive [2025-12-11 14:36:56,736][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:01,737][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:06,738][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:11,739][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:16,740][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:21,745][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:26,754][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:31,757][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:36,759][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:41,760][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:46,762][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:51,767][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:37:56,778][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:01,781][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:06,782][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:11,784][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:16,785][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:21,786][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:26,788][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:31,790][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:36,795][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:41,796][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:46,798][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:51,799][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:38:56,801][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:01,803][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:06,804][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:11,807][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:16,809][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:21,809][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:26,811][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:31,812][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:36,814][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:41,815][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:46,816][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:51,817][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:39:56,818][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:01,821][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:06,822][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:11,823][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:16,824][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:21,825][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:26,826][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:31,827][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:36,828][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:41,830][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:46,831][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:51,832][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:40:56,833][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:01,834][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:06,836][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:11,842][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:16,843][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:21,845][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:26,846][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:31,847][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:36,848][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:41,849][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:46,850][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:51,851][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:41:56,853][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:01,854][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:06,856][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:11,857][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:16,859][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:21,860][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:26,861][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:31,862][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:36,864][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:41,866][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:46,867][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:51,868][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:42:56,869][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:01,870][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:06,871][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:11,873][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:16,883][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:21,884][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:26,885][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:31,887][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:36,888][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:41,889][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:46,890][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:51,892][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:43:56,894][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:01,895][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:06,896][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:11,897][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:16,899][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:21,901][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:26,902][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:31,903][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:36,904][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:41,906][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:46,908][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:51,911][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:44:56,913][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:01,916][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:06,918][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:11,919][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:16,922][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:21,926][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:26,927][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:31,929][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:36,931][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:41,933][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:46,936][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:51,938][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:45:56,939][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:01,941][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:06,942][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:11,943][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:16,944][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:21,946][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:26,949][ INFO][PID:2985324] Checking for cancel request [2025-12-11 14:46:30,367][ INFO][PID:2985324] Downloading results from builder [2025-12-11 14:46:30,368][ INFO][PID:2985324] rsyncing of mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next started [2025-12-11 14:46:30,369][ INFO][PID:2985324] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/build-09896316.rsync.log [2025-12-11 14:46:39,682][ INFO][PID:2985324] rsyncing finished. [2025-12-11 14:46:39,683][ INFO][PID:2985324] Releasing VM back to pool [2025-12-11 14:46:39,697][ INFO][PID:2985324] Searching for 'success' file in resultdir [2025-12-11 14:46:39,698][ ERROR][PID:2985324] Build failed: Backend process error: No success file => build failure [2025-12-11 14:46:39,699][ INFO][PID:2985324] Finished build: id=9896316 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=centos-stream-9-s390x [2025-12-11 14:46:39,701][ ERROR][PID:2985324] Backend process error: No success file => build failure [2025-12-11 14:46:39,702][ INFO][PID:2985324] Worker failed build, took 590.4095013141632 [2025-12-11 14:46:39,703][ INFO][PID:2985324] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": 1765464399.7023659, "started_on": 1765463809.2928646, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9896316-centos-stream-9-s390x", "build_id": 9896316, "package_name": "fips-provider-next", "package_version": "1.2.0-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/fips-provider-next", "git_hash": "e6ea70b6c58bc8e6ecdd9e6ccaebeb683fb6fe90", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/s390x/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_s390x" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251209/centos-stream-9-s390x/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20251209", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20251209" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09896316-fips-provider-next", "built_packages": "", "id": 9896316, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-12-11 14:46:39,746][ INFO][PID:2985324] Sending fedora-messaging bus message in build.end [2025-12-11 14:46:39,781][ INFO][PID:2985324] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/builder-live.log by gzip [2025-12-11 14:46:39,783][ INFO][PID:2985324] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/builder-live.log' as PID 3057030 [2025-12-11 14:46:39,816][ INFO][PID:2985324] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/builder-live.log) [2025-12-11 14:46:39,817][ INFO][PID:2985324] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/backend.log by gzip [2025-12-11 14:46:39,819][ INFO][PID:2985324] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/centos-stream-9-s390x/09896316-fips-provider-next/backend.log' as PID 3057034