[2025-12-19 03:35:54,570][ INFO][PID:821109] Marking build as starting [2025-12-19 03:35:54,637][ INFO][PID:821109] Checking that /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/repodata/repomd.xml exists [2025-12-19 03:35:54,638][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:35:54,639][ INFO][PID:821109] VM allocation process starts [2025-12-19 03:35:54,648][ INFO][PID:821109] Trying to allocate VM: ResallocHost, ticket_id=433919, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-19 03:35:59,649][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:04,650][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:09,651][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:14,652][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:19,653][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:24,654][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:29,655][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:34,656][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:39,657][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:44,658][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:49,660][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:54,661][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:36:59,662][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:04,664][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:09,665][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:14,666][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:19,667][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:24,668][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:29,669][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:34,670][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:39,671][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:44,672][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:49,673][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:54,675][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:37:59,675][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:04,677][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:09,678][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:14,679][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:19,682][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:24,767][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:29,770][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:34,771][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:39,773][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:44,775][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:49,778][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:54,779][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:38:59,780][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:04,781][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:09,785][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:14,788][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:19,877][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:24,881][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:29,898][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:34,994][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:40,023][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:45,039][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:50,133][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:39:55,171][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:00,220][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:05,443][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:10,686][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:16,301][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:21,323][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:26,498][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:31,968][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:37,393][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:42,983][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:48,036][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:53,041][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:40:58,159][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:03,164][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:08,165][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:13,166][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:18,167][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:23,394][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:28,430][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:33,431][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:38,432][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:43,434][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:48,612][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:53,613][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:41:58,925][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:03,926][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:08,927][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:13,928][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:18,930][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:23,931][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:28,932][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:33,933][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:39,079][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:44,079][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:49,081][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:54,082][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:42:59,083][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:04,084][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:09,232][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:14,233][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:19,235][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:24,236][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:29,237][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:34,238][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:39,239][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:44,240][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:49,275][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:54,275][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:43:59,277][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:04,278][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:09,279][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:14,280][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:19,282][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:24,283][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:29,284][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:34,287][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:39,288][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:44,289][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:49,333][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:54,335][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:44:59,344][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:04,347][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:09,353][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:14,355][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:19,359][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:24,362][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:29,430][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:34,436][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:39,623][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:44,626][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:49,628][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:54,630][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:45:59,816][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:04,818][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:09,819][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:12,775][ INFO][PID:821109] Allocated host ResallocHost, ticket_id=433919, hostname=163.107.84.59, name=copr_ic_s390x_br_sao_2_prod_00696266_20251219_033451, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-19 03:46:12,776][ INFO][PID:821109] Allocating ssh connection to builder [2025-12-19 03:46:12,776][ INFO][PID:821109] Checking that builder machine is OK [2025-12-19 03:46:14,464][ INFO][PID:821109] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-12-19 03:46:16,049][ INFO][PID:821109] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-12-19 03:46:16,049][ INFO][PID:821109] Filling build.info file with builder info [2025-12-19 03:46:16,050][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:16,052][ INFO][PID:821109] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1766115976.052113, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9932616-fedora-rawhide-s390x", "build_id": 9932616, "package_name": "libmodulemd", "package_version": "2.15.3-0.20251219011745102433.main.1.g527ebfa", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libmodulemd", "git_hash": "9e73e1eb2ad441f1869d9c1d7637ebf20e685da8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09932616-libmodulemd", "built_packages": "", "id": 9932616, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-12-19 03:46:16,192][ INFO][PID:821109] Sending fedora-messaging bus message in build.start [2025-12-19 03:46:16,775][ INFO][PID:821109] Sending fedora-messaging bus message in chroot.start [2025-12-19 03:46:16,804][ INFO][PID:821109] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9932616-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-12-19 03:46:18,614][ INFO][PID:821109] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.84.59' (ED25519) to the list of known hosts. [2025-12-19 03:46:18,616][ INFO][PID:821109] Downloading the builder-live.log file, attempt 1 [2025-12-19 03:46:18,618][ INFO][PID:821109] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.84.59 copr-rpmbuild-log [2025-12-19 03:46:23,632][ INFO][PID:821109] Periodic builder liveness probe: alive [2025-12-19 03:46:23,632][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:28,634][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:33,635][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:38,636][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:43,638][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:48,638][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:53,639][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:46:58,640][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:03,641][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:08,642][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:13,643][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:18,644][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:23,645][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:28,646][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:33,649][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:38,650][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:43,651][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:48,652][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:53,653][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:47:58,654][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:03,655][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:08,656][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:13,657][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:18,658][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:23,659][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:28,660][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:33,661][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:38,662][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:43,663][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:48,666][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:53,667][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:48:58,668][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:49:03,669][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:49:08,670][ INFO][PID:821109] Checking for cancel request [2025-12-19 03:49:13,223][ INFO][PID:821109] Downloading results from builder [2025-12-19 03:49:13,224][ INFO][PID:821109] rsyncing of mockbuilder@163.107.84.59:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd started [2025-12-19 03:49:13,224][ INFO][PID:821109] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.84.59:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/build-09932616.rsync.log [2025-12-19 03:49:16,610][ INFO][PID:821109] rsyncing finished. [2025-12-19 03:49:16,610][ INFO][PID:821109] Releasing VM back to pool [2025-12-19 03:49:16,650][ INFO][PID:821109] Searching for 'success' file in resultdir [2025-12-19 03:49:16,650][ ERROR][PID:821109] Build failed: Backend process error: No success file => build failure [2025-12-19 03:49:16,651][ INFO][PID:821109] Finished build: id=9932616 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-rawhide-s390x [2025-12-19 03:49:16,652][ ERROR][PID:821109] Backend process error: No success file => build failure [2025-12-19 03:49:16,653][ INFO][PID:821109] Worker failed build, took 180.60105156898499 [2025-12-19 03:49:16,653][ INFO][PID:821109] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": 1766116156.6531646, "started_on": 1766115976.052113, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9932616-fedora-rawhide-s390x", "build_id": 9932616, "package_name": "libmodulemd", "package_version": "2.15.3-0.20251219011745102433.main.1.g527ebfa", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libmodulemd", "git_hash": "9e73e1eb2ad441f1869d9c1d7637ebf20e685da8", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09932616-libmodulemd", "built_packages": "", "id": 9932616, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-12-19 03:49:16,743][ INFO][PID:821109] Sending fedora-messaging bus message in build.end [2025-12-19 03:49:16,770][ INFO][PID:821109] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/builder-live.log by gzip [2025-12-19 03:49:16,771][ INFO][PID:821109] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/builder-live.log' as PID 884977 [2025-12-19 03:49:16,780][ INFO][PID:821109] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/builder-live.log) [2025-12-19 03:49:16,781][ INFO][PID:821109] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/backend.log by gzip [2025-12-19 03:49:16,782][ INFO][PID:821109] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09932616-libmodulemd/backend.log' as PID 884978