[2025-12-17 20:43:59,015][ INFO][PID:4125952] Marking build as starting [2025-12-17 20:43:59,200][ INFO][PID:4125952] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/repodata/repomd.xml exists [2025-12-17 20:43:59,543][ INFO][PID:4125952] Checking for cancel request [2025-12-17 20:43:59,544][ INFO][PID:4125952] VM allocation process starts [2025-12-17 20:43:59,580][ INFO][PID:4125952] Trying to allocate VM: ResallocHost, ticket_id=410409, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 20:44:04,582][ INFO][PID:4125952] Checking for cancel request [2025-12-17 20:44:05,641][ INFO][PID:4125952] Allocated host ResallocHost, ticket_id=410409, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00663562_20251217_203135, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 20:44:05,642][ INFO][PID:4125952] Allocating ssh connection to builder [2025-12-17 20:44:05,643][ INFO][PID:4125952] Checking that builder machine is OK [2025-12-17 20:45:05,722][ ERROR][PID:4125952] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Connection timed out [2025-12-17 20:45:15,723][ ERROR][PID:4125952] Re-try request for task on 'ResallocHost, ticket_id=410409, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00663562_20251217_203135, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-17 20:45:15,723][ INFO][PID:4125952] Releasing VM back to pool [2025-12-17 20:45:15,741][ INFO][PID:4125952] Retry #1 (on other host) [2025-12-17 20:45:15,742][ INFO][PID:4125952] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/repodata/repomd.xml exists [2025-12-17 20:45:15,743][ INFO][PID:4125952] Checking for cancel request [2025-12-17 20:45:15,743][ INFO][PID:4125952] VM allocation process starts [2025-12-17 20:45:15,760][ INFO][PID:4125952] Trying to allocate VM: ResallocHost, ticket_id=410456, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 20:45:18,775][ INFO][PID:4125952] Allocated host ResallocHost, ticket_id=410456, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00663812_20251217_203659, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 20:45:18,775][ INFO][PID:4125952] Allocating ssh connection to builder [2025-12-17 20:45:18,776][ INFO][PID:4125952] Checking that builder machine is OK [2025-12-17 20:45:19,930][ INFO][PID:4125952] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-12-17 20:47:00,138][ ERROR][PID:4125952] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18a' (ED25519) to the list of known hosts. Connection to 2620:52:6:1161:dead:beef:cafe:c18a port 22 timed out [2025-12-17 20:47:10,139][ ERROR][PID:4125952] Re-try request for task on 'ResallocHost, ticket_id=410456, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00663812_20251217_203659, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-17 20:47:10,140][ INFO][PID:4125952] Releasing VM back to pool [2025-12-17 20:47:10,170][ INFO][PID:4125952] Retry #2 (on other host) [2025-12-17 20:47:10,171][ INFO][PID:4125952] Checking that /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/repodata/repomd.xml exists [2025-12-17 20:47:10,171][ INFO][PID:4125952] Checking for cancel request [2025-12-17 20:47:10,173][ INFO][PID:4125952] VM allocation process starts [2025-12-17 20:47:10,192][ INFO][PID:4125952] Trying to allocate VM: ResallocHost, ticket_id=410520, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 20:47:13,211][ INFO][PID:4125952] Allocated host ResallocHost, ticket_id=410520, hostname=2620:52:6:1161:dead:beef:cafe:c18c, name=vmhost_p09_04_prod_00663898_20251217_203904, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-17 20:47:13,218][ INFO][PID:4125952] Allocating ssh connection to builder [2025-12-17 20:47:13,218][ INFO][PID:4125952] Checking that builder machine is OK [2025-12-17 20:48:13,291][ ERROR][PID:4125952] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18c port 22: Connection timed out [2025-12-17 20:48:23,292][ ERROR][PID:4125952] Re-try request for task on 'ResallocHost, ticket_id=410520, hostname=2620:52:6:1161:dead:beef:cafe:c18c, name=vmhost_p09_04_prod_00663898_20251217_203904, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-17 20:48:23,293][ INFO][PID:4125952] Releasing VM back to pool [2025-12-17 20:48:23,326][ ERROR][PID:4125952] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c18b', '2620:52:6:1161:dead:beef:cafe:c18a', '2620:52:6:1161:dead:beef:cafe:c18c'} [2025-12-17 20:48:23,327][WARNING][PID:4125952] Switching not-finished job state to 'failed' [2025-12-17 20:48:23,327][ INFO][PID:4125952] Worker failed build, took 264.33803367614746 [2025-12-17 20:48:23,328][ INFO][PID:4125952] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "podman-next", "project_dirname": "podman-next", "submitter": "packit", "ended_on": 1766004503.3275142, "started_on": 1766004238.9894805, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9928534-centos-stream-10-ppc64le", "build_id": 9928534, "package_name": "podman", "package_version": "102:6.0.0~dev-1.20251217204324896261.main.2136.ac91395e1d", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/podman-next/podman", "git_hash": "e57d67fd9d0d6a2c42b0d5e424b2d32e4c3c07ba", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/podman-next--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/podman-next", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/podman-next", "result_dir": "09928534-podman", "built_packages": "", "id": 9928534, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "podman-next", "vendor": "Fedora Project COPR (rhcontainerbot/podman-next)" } } ] } [2025-12-17 20:48:23,397][ INFO][PID:4125952] Sending fedora-messaging bus message in build.end [2025-12-17 20:48:23,984][ INFO][PID:4125952] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/builder-live.log by gzip [2025-12-17 20:48:23,985][ INFO][PID:4125952] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/builder-live.log' as PID 4159385 [2025-12-17 20:48:23,987][ INFO][PID:4125952] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/builder-live.log: No such file or directory [2025-12-17 20:48:23,988][ ERROR][PID:4125952] Unable to compress file /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/builder-live.log [2025-12-17 20:48:23,988][ INFO][PID:4125952] Compressing /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/backend.log by gzip [2025-12-17 20:48:23,989][ INFO][PID:4125952] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/podman-next/centos-stream-10-ppc64le/09928534-podman/backend.log' as PID 4159387