[2025-07-23 10:21:56,937][  INFO][PID:1765545] Marking build as starting
[2025-07-23 10:21:57,021][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:21:57,022][  INFO][PID:1765545] VM allocation process starts
[2025-07-23 10:21:57,039][  INFO][PID:1765545] Trying to allocate VM: ResallocHost, ticket_id=4063193, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 10:22:02,042][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:07,043][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:12,044][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:17,046][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:22,050][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:27,056][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:32,058][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:37,062][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:42,064][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:47,068][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:52,069][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:22:57,072][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:02,077][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:07,080][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:12,082][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:17,089][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:22,102][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:27,103][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:32,105][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:37,109][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:42,110][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:47,114][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:52,125][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:23:57,128][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:02,136][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:07,137][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:12,140][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:17,146][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:22,147][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:27,149][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:32,153][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:37,158][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:42,168][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:47,181][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:52,185][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:24:57,203][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:02,217][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:07,242][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:12,254][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:17,284][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:22,312][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:27,367][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:32,467][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:37,857][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:43,232][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:48,498][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:53,698][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:25:58,852][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:03,918][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:08,942][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:14,163][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:15,369][  INFO][PID:1765545] Allocated host ResallocHost, ticket_id=4063193, hostname=140.211.168.107, name=copr_osuosl_p09_prod_05756939_20250723_102200, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 10:26:15,369][  INFO][PID:1765545] Allocating ssh connection to builder
[2025-07-23 10:26:15,377][  INFO][PID:1765545] Checking that builder machine is OK
[2025-07-23 10:26:16,951][  INFO][PID:1765545] Running remote command: copr-builder-ready epel-10-ppc64le
[2025-07-23 10:26:18,111][  INFO][PID:1765545] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-07-23 10:26:18,113][  INFO][PID:1765545] Filling build.info file with builder info
[2025-07-23 10:26:18,117][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:18,128][  INFO][PID:1765545] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "nucleo",
            "project_name": "freerouter",
            "project_dirname": "freerouter",
            "submitter": "https://api.github.com/users/nuqleo",
            "ended_on": null,
            "started_on": 1753266378.127803,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9311979-epel-10-ppc64le",
            "build_id": 9311979,
            "package_name": "freerouter",
            "package_version": "25.7.22-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter",
            "git_hash": "594176e869f5f3245f4a98457310988b07d41c00",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter",
            "result_dir": "09311979-freerouter",
            "built_packages": "",
            "id": 9311979,
            "mockchain_macros": {
                "copr_username": "nucleo",
                "copr_projectname": "freerouter",
                "vendor": "Fedora Project COPR (nucleo/freerouter)"
            }
        }
    ]
}
[2025-07-23 10:26:18,183][  INFO][PID:1765545] Sending fedora-messaging bus message in build.start
[2025-07-23 10:26:20,180][  INFO][PID:1765545] Sending fedora-messaging bus message in chroot.start
[2025-07-23 10:26:20,319][  INFO][PID:1765545] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9311979-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2025-07-23 10:26:21,749][  INFO][PID:1765545] Downloading the builder-live.log file, attempt 1
[2025-07-23 10:26:21,764][  INFO][PID:1765545] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log
[2025-07-23 10:26:26,804][  INFO][PID:1765545] Periodic builder liveness probe: alive
[2025-07-23 10:26:26,806][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:31,828][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:37,005][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:42,101][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:47,114][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:52,123][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:26:57,136][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:02,154][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:07,173][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:12,175][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:17,178][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:22,184][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:27,187][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:32,245][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:37,264][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:42,322][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:47,687][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:53,018][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:27:58,389][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:03,532][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:08,592][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:13,596][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:18,705][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:24,025][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:29,344][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:34,598][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:39,743][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:44,833][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:49,981][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:28:55,204][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:00,537][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:05,630][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:10,659][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:15,684][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:20,891][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:26,020][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:31,070][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:36,254][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:41,529][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:46,689][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:51,987][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:29:57,043][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:02,163][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:07,254][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:12,446][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:17,859][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:22,945][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:28,148][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:31,155][ ERROR][PID:1765545] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 10:30:33,165][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:38,251][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:41,156][WARNING][PID:1765545] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 10:30:43,296][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:48,690][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:51,157][  INFO][PID:1765545] Downloading the builder-live.log file, attempt 2
[2025-07-23 10:30:51,170][  INFO][PID:1765545] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log
[2025-07-23 10:30:53,893][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:30:59,092][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:04,129][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:09,265][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:14,478][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:19,685][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:25,022][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:30,312][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:35,344][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:40,357][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:45,483][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:50,538][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:31:55,599][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:00,690][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:06,031][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:11,302][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:16,375][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:21,639][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:26,777][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:32,015][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:37,107][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:42,173][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:47,238][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:52,302][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:32:57,349][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:02,526][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:07,561][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:12,591][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:17,609][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:22,617][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:27,625][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:28,413][ ERROR][PID:1765545] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 10:33:32,645][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:37,677][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:38,427][WARNING][PID:1765545] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 10:33:42,881][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:48,023][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:48,432][  INFO][PID:1765545] Downloading the builder-live.log file, attempt 3
[2025-07-23 10:33:48,444][  INFO][PID:1765545] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log
[2025-07-23 10:33:53,038][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:33:58,074][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:03,246][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:08,479][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:13,623][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:18,807][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:24,043][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:29,149][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:34,386][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:39,610][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:44,674][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:48,628][ ERROR][PID:1765545] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 10:34:49,904][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:55,085][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:34:58,657][WARNING][PID:1765545] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 10:35:00,322][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:05,354][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:08,663][  INFO][PID:1765545] Downloading the builder-live.log file, attempt 4
[2025-07-23 10:35:08,679][  INFO][PID:1765545] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.107 copr-rpmbuild-log
[2025-07-23 10:35:10,385][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:15,440][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:20,547][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:25,735][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:30,908][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:36,065][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:41,178][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:46,237][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:51,440][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:35:56,490][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:01,551][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:06,608][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:08,825][ ERROR][PID:1765545] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 10:36:11,620][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:16,653][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:18,826][ ERROR][PID:1765545] Giving up for unstable SSH, failures: 1753266641.1565773, 1753266818.4277422, 1753266898.6577418, 1753266978.8265011
[2025-07-23 10:36:18,831][ ERROR][PID:1765545] Re-try request for task on 'ResallocHost, ticket_id=4063193, hostname=140.211.168.107, name=copr_osuosl_p09_prod_05756939_20250723_102200, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-23 10:36:18,832][  INFO][PID:1765545] Releasing VM back to pool
[2025-07-23 10:36:18,872][  INFO][PID:1765545] Retry #1 (on other host)
[2025-07-23 10:36:18,885][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:18,889][  INFO][PID:1765545] VM allocation process starts
[2025-07-23 10:36:18,922][  INFO][PID:1765545] Trying to allocate VM: ResallocHost, ticket_id=4063642, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 10:36:23,933][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:28,935][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:33,936][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:38,941][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:43,950][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:48,957][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:53,966][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:36:58,968][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:03,971][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:08,980][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:13,994][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:19,001][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:24,019][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:29,027][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:34,032][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:39,042][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:44,044][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:49,052][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:54,061][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:37:59,062][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:04,068][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:09,088][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:14,098][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:19,134][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:24,197][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:29,282][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:34,349][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:39,726][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:45,059][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:50,358][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:38:55,800][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:01,225][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:06,689][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:12,391][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:17,653][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:23,242][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:28,256][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:33,309][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:38,358][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:43,559][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:48,888][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:53,911][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:39:59,048][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:04,230][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:09,252][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:14,372][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:19,579][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:24,724][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:30,117][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:35,295][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:37,404][  INFO][PID:1765545] Allocated host ResallocHost, ticket_id=4063642, hostname=140.211.168.189, name=copr_osuosl_p09_prod_05757150_20250723_103220, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-23 10:40:37,406][  INFO][PID:1765545] Allocating ssh connection to builder
[2025-07-23 10:40:37,407][  INFO][PID:1765545] Checking that builder machine is OK
[2025-07-23 10:40:38,788][  INFO][PID:1765545] Running remote command: copr-builder-ready epel-10-ppc64le
[2025-07-23 10:40:39,896][  INFO][PID:1765545] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2025-07-23 10:40:39,897][  INFO][PID:1765545] Filling build.info file with builder info
[2025-07-23 10:40:39,924][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:39,925][  INFO][PID:1765545] Not re-notifying FE and msg buses for the new host.
[2025-07-23 10:40:39,926][  INFO][PID:1765545] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9311979-epel-10-ppc64le --chroot epel-10-ppc64le --detached
[2025-07-23 10:40:41,211][  INFO][PID:1765545] Downloading the builder-live.log file, attempt 1
[2025-07-23 10:40:41,213][  INFO][PID:1765545] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log
[2025-07-23 10:40:46,223][  INFO][PID:1765545] Periodic builder liveness probe: alive
[2025-07-23 10:40:46,321][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:51,344][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:40:56,491][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:01,647][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:06,832][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:11,965][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:17,323][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:22,786][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:28,059][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:33,386][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:38,836][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:43,951][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:49,128][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:54,148][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:41:59,518][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:04,783][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:10,127][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:15,589][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:20,903][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:26,330][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:31,873][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:36,879][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:41,995][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:47,060][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:52,335][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:42:57,792][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:03,370][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:08,610][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:13,788][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:19,001][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:24,553][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:29,804][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:34,809][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:39,936][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:45,334][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:50,778][  INFO][PID:1765545] Checking for cancel request
[2025-07-23 10:43:54,146][  INFO][PID:1765545] Downloading results from builder
[2025-07-23 10:43:54,149][  INFO][PID:1765545] rsyncing of mockbuilder@140.211.168.189:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter started
[2025-07-23 10:43:54,164][  INFO][PID:1765545] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.189:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter/ &> /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter/build-09311979.rsync.log
[2025-07-23 10:43:55,797][  INFO][PID:1765545] rsyncing finished.
[2025-07-23 10:43:55,803][  INFO][PID:1765545] Releasing VM back to pool
[2025-07-23 10:43:55,860][  INFO][PID:1765545] Searching for 'success' file in resultdir
[2025-07-23 10:43:55,863][ ERROR][PID:1765545] Build failed: Backend process error: No success file => build failure
[2025-07-23 10:43:55,865][  INFO][PID:1765545] Finished build: id=9311979 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/nucleo/freerouter chroot=epel-10-ppc64le 
[2025-07-23 10:43:55,869][ ERROR][PID:1765545] Backend process error: No success file => build failure
[2025-07-23 10:43:55,872][  INFO][PID:1765545] Worker failed build, took 195.94643235206604
[2025-07-23 10:43:55,874][  INFO][PID:1765545] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "nucleo",
            "project_name": "freerouter",
            "project_dirname": "freerouter",
            "submitter": "https://api.github.com/users/nuqleo",
            "ended_on": 1753267435.8720467,
            "started_on": 1753267239.9256144,
            "submitted_on": null,
            "status": 0,
            "chroot": "epel-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9311979-epel-10-ppc64le",
            "build_id": 9311979,
            "package_name": "freerouter",
            "package_version": "25.7.22-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/freerouter/freerouter",
            "git_hash": "594176e869f5f3245f4a98457310988b07d41c00",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "nucleo/freerouter--https://api.github.com/users/nuqleo",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter/epel-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/nucleo/freerouter",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/freerouter",
            "result_dir": "09311979-freerouter",
            "built_packages": "",
            "id": 9311979,
            "mockchain_macros": {
                "copr_username": "nucleo",
                "copr_projectname": "freerouter",
                "vendor": "Fedora Project COPR (nucleo/freerouter)"
            }
        }
    ]
}
[2025-07-23 10:43:55,923][  INFO][PID:1765545] Sending fedora-messaging bus message in build.end
[2025-07-23 10:43:55,991][  INFO][PID:1765545] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter/builder-live.log by gzip
[2025-07-23 10:43:55,994][  INFO][PID:1765545] Running command 'gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter/builder-live.log' as PID 1948848
[2025-07-23 10:43:56,005][  INFO][PID:1765545] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter/builder-live.log)
[2025-07-23 10:43:56,008][  INFO][PID:1765545] Compressing /var/lib/copr/public_html/results/nucleo/freerouter/epel-10-ppc64le/09311979-freerouter/backend.log by gzip