[2025-07-22 14:50:46,971][  INFO][PID:1275599] Marking build as starting
[2025-07-22 14:50:47,077][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:50:47,079][  INFO][PID:1275599] VM allocation process starts
[2025-07-22 14:50:47,115][  INFO][PID:1275599] Trying to allocate VM: ResallocHost, ticket_id=4027634, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 14:50:52,119][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:50:57,121][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:02,122][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:07,123][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:12,124][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:17,125][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:22,127][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:27,130][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:32,131][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:37,132][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:42,133][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:47,135][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:52,136][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:51:57,137][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:02,138][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:07,139][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:12,140][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:17,145][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:22,147][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:27,148][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:32,149][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:37,150][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:42,151][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:47,152][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:52,154][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:52:57,155][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:02,158][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:07,159][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:12,160][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:17,162][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:22,163][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:27,164][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:32,165][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:37,172][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:42,185][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:47,186][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:52,188][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:53:57,189][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:02,190][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:07,192][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:12,193][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:17,194][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:22,195][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:27,196][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:32,198][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:37,199][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:42,200][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:47,202][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:52,203][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:54:57,205][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:02,206][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:07,207][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:12,208][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:17,210][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:22,211][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:27,212][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:32,213][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:37,214][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:42,215][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:47,216][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:52,217][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:55:57,219][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:02,220][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:07,221][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:12,223][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:17,224][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:22,225][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:27,226][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:32,228][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:37,229][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:42,230][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:47,232][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:52,233][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:56:57,234][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:02,236][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:05,305][  INFO][PID:1275599] Allocated host ResallocHost, ticket_id=4027634, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05727736_20250722_145241, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 14:57:05,306][  INFO][PID:1275599] Allocating ssh connection to builder
[2025-07-22 14:57:05,306][  INFO][PID:1275599] Checking that builder machine is OK
[2025-07-22 14:57:06,757][  INFO][PID:1275599] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-22 14:57:07,749][  INFO][PID:1275599] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-22 14:57:07,749][  INFO][PID:1275599] Filling build.info file with builder info
[2025-07-22 14:57:07,750][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:07,751][  INFO][PID:1275599] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "alexsaezm",
            "project_name": "golang-rawhide",
            "project_dirname": "golang-rawhide",
            "submitter": "https://src.fedoraproject.org/user/alexsaezm",
            "ended_on": null,
            "started_on": 1753196227.7511508,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9297736-fedora-42-ppc64le",
            "build_id": 9297736,
            "package_name": "golang",
            "package_version": "1.25~rc2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/alexsaezm/golang-rawhide/golang",
            "git_hash": "77cc41ee93edc77d7324484f1aef49fb8112d54b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "alexsaezm/golang-rawhide--https://src.fedoraproject.org/user/alexsaezm",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/alexsaezm/golang-rawhide",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide",
            "result_dir": "09297736-golang",
            "built_packages": "",
            "id": 9297736,
            "mockchain_macros": {
                "copr_username": "alexsaezm",
                "copr_projectname": "golang-rawhide",
                "vendor": "Fedora Project COPR (alexsaezm/golang-rawhide)"
            }
        }
    ]
}
[2025-07-22 14:57:07,792][  INFO][PID:1275599] Sending fedora-messaging bus message in build.start
[2025-07-22 14:57:08,592][  INFO][PID:1275599] Sending fedora-messaging bus message in chroot.start
[2025-07-22 14:57:08,620][  INFO][PID:1275599] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9297736-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-22 14:57:09,954][  INFO][PID:1275599] Downloading the builder-live.log file, attempt 1
[2025-07-22 14:57:09,956][  INFO][PID:1275599] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-22 14:57:14,968][  INFO][PID:1275599] Periodic builder liveness probe: alive
[2025-07-22 14:57:14,968][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:19,970][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:24,972][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:29,973][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:34,974][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:39,977][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:44,979][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:49,981][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:54,982][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:57:59,983][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:04,984][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:09,985][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:14,986][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:19,987][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:24,988][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:29,989][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:34,990][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:39,992][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:44,993][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:49,994][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:54,995][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:58:59,996][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:04,997][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:09,999][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:15,000][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:20,001][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:25,002][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:30,004][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:35,005][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:40,006][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:45,007][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:50,008][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 14:59:55,009][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:00,010][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:05,012][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:10,013][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:15,016][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:20,017][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:25,018][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:30,019][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:35,020][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:40,021][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:45,023][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:50,024][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:00:52,139][ ERROR][PID:1275599] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:00:55,025][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:00,026][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:02,140][WARNING][PID:1275599] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 15:01:05,028][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:10,029][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:12,141][  INFO][PID:1275599] Downloading the builder-live.log file, attempt 2
[2025-07-22 15:01:12,143][  INFO][PID:1275599] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-22 15:01:15,030][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:20,031][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:25,032][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:30,034][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:35,035][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:40,039][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:45,040][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:50,041][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:01:55,043][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:00,044][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:05,045][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:10,047][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:12,279][ ERROR][PID:1275599] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:02:15,048][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:20,049][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:22,285][WARNING][PID:1275599] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 15:02:25,051][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:30,059][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:32,286][  INFO][PID:1275599] Downloading the builder-live.log file, attempt 3
[2025-07-22 15:02:32,288][  INFO][PID:1275599] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-22 15:02:35,060][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:40,061][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:45,062][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:50,064][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:02:55,065][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:00,066][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:05,068][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:10,069][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:15,070][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:20,072][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:25,073][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:30,075][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:32,425][ ERROR][PID:1275599] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:03:35,076][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:40,077][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:42,429][WARNING][PID:1275599] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 15:03:45,078][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:50,079][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:03:52,430][  INFO][PID:1275599] Downloading the builder-live.log file, attempt 4
[2025-07-22 15:03:52,432][  INFO][PID:1275599] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-22 15:03:55,080][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:00,082][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:05,083][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:10,084][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:15,085][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:20,086][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:25,087][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:30,089][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:35,090][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:40,091][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:45,092][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:50,093][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:04:52,569][ ERROR][PID:1275599] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 15:04:55,095][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:05:00,098][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:05:02,573][ ERROR][PID:1275599] Giving up for unstable SSH, failures: 1753196462.1406062, 1753196542.2853682, 1753196622.4295592, 1753196702.5729403
[2025-07-22 15:05:02,574][ ERROR][PID:1275599] Re-try request for task on 'ResallocHost, ticket_id=4027634, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05727736_20250722_145241, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-22 15:05:02,575][  INFO][PID:1275599] Releasing VM back to pool
[2025-07-22 15:05:02,594][  INFO][PID:1275599] Retry #1 (on other host)
[2025-07-22 15:05:02,595][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:05:02,596][  INFO][PID:1275599] VM allocation process starts
[2025-07-22 15:05:02,616][  INFO][PID:1275599] Trying to allocate VM: ResallocHost, ticket_id=4027845, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 15:05:07,618][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:05:12,620][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:05:17,621][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:05:20,688][  INFO][PID:1275599] Allocated host ResallocHost, ticket_id=4027845, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05727736_20250722_145241, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 15:05:20,689][  INFO][PID:1275599] Allocating ssh connection to builder
[2025-07-22 15:05:20,690][  INFO][PID:1275599] Checking that builder machine is OK
[2025-07-22 15:06:20,831][ ERROR][PID:1275599] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.163 port 22 timed out

[2025-07-22 15:06:30,832][ ERROR][PID:1275599] Re-try request for task on 'ResallocHost, ticket_id=4027845, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05727736_20250722_145241, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts
[2025-07-22 15:06:30,832][  INFO][PID:1275599] Releasing VM back to pool
[2025-07-22 15:06:30,845][  INFO][PID:1275599] Retry #2 (on other host)
[2025-07-22 15:06:30,845][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:06:30,846][  INFO][PID:1275599] VM allocation process starts
[2025-07-22 15:06:30,859][  INFO][PID:1275599] Trying to allocate VM: ResallocHost, ticket_id=4027890, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 15:06:35,861][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:06:40,864][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:06:45,867][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:06:50,872][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:06:55,875][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:00,879][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:05,882][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:10,890][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:15,892][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:20,894][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:25,899][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:30,902][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:35,904][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:40,909][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:45,918][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:50,925][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:07:55,932][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:00,933][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:05,942][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:10,948][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:15,958][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:20,965][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:25,967][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:30,972][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:35,977][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:40,982][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:45,990][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:50,993][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:08:56,005][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:01,013][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:06,020][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:11,022][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:16,032][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:21,038][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:26,040][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:31,042][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:36,045][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:41,054][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:46,061][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:49,383][  INFO][PID:1275599] Allocated host ResallocHost, ticket_id=4027890, hostname=140.211.168.248, name=copr_osuosl_p09_prod_05727958_20250722_145938, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-22 15:09:49,384][  INFO][PID:1275599] Allocating ssh connection to builder
[2025-07-22 15:09:49,384][  INFO][PID:1275599] Checking that builder machine is OK
[2025-07-22 15:09:50,769][  INFO][PID:1275599] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-22 15:09:51,797][  INFO][PID:1275599] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-22 15:09:51,799][  INFO][PID:1275599] Filling build.info file with builder info
[2025-07-22 15:09:51,804][  INFO][PID:1275599] Checking for cancel request
[2025-07-22 15:09:51,809][  INFO][PID:1275599] Not re-notifying FE and msg buses for the new host.
[2025-07-22 15:09:51,811][  INFO][PID:1275599] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9297736-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-22 15:09:53,072][  INFO][PID:1275599] Downloading the builder-live.log file, attempt 1
[2025-07-22 15:09:53,077][  INFO][PID:1275599] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.248 copr-rpmbuild-log
[2025-07-22 15:09:54,269][  INFO][PID:1275599] Downloading results from builder
[2025-07-22 15:09:54,271][  INFO][PID:1275599] rsyncing of mockbuilder@140.211.168.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang started
[2025-07-22 15:09:54,275][  INFO][PID:1275599] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/ &> /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/build-09297736.rsync.log
[2025-07-22 15:09:56,331][  INFO][PID:1275599] rsyncing finished.
[2025-07-22 15:09:56,332][  INFO][PID:1275599] Releasing VM back to pool
[2025-07-22 15:09:56,349][  INFO][PID:1275599] Searching for 'success' file in resultdir
[2025-07-22 15:09:56,353][ ERROR][PID:1275599] Build failed: Backend process error: No success file => build failure
[2025-07-22 15:09:56,355][  INFO][PID:1275599] Finished build: id=9297736 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/alexsaezm/golang-rawhide chroot=fedora-42-ppc64le 
[2025-07-22 15:09:56,359][ ERROR][PID:1275599] Backend process error: No success file => build failure
[2025-07-22 15:09:56,361][  INFO][PID:1275599] Worker failed build, took 4.5511274337768555
[2025-07-22 15:09:56,361][  INFO][PID:1275599] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "alexsaezm",
            "project_name": "golang-rawhide",
            "project_dirname": "golang-rawhide",
            "submitter": "https://src.fedoraproject.org/user/alexsaezm",
            "ended_on": 1753196996.3604836,
            "started_on": 1753196991.8093562,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9297736-fedora-42-ppc64le",
            "build_id": 9297736,
            "package_name": "golang",
            "package_version": "1.25~rc2-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/alexsaezm/golang-rawhide/golang",
            "git_hash": "77cc41ee93edc77d7324484f1aef49fb8112d54b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "alexsaezm/golang-rawhide--https://src.fedoraproject.org/user/alexsaezm",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/alexsaezm/golang-rawhide",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/alexsaezm/golang-rawhide",
            "result_dir": "09297736-golang",
            "built_packages": "",
            "id": 9297736,
            "mockchain_macros": {
                "copr_username": "alexsaezm",
                "copr_projectname": "golang-rawhide",
                "vendor": "Fedora Project COPR (alexsaezm/golang-rawhide)"
            }
        }
    ]
}
[2025-07-22 15:09:56,408][  INFO][PID:1275599] Sending fedora-messaging bus message in build.end
[2025-07-22 15:09:56,446][  INFO][PID:1275599] Compressing /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/builder-live.log by gzip
[2025-07-22 15:09:56,451][  INFO][PID:1275599] Running command 'gzip /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/builder-live.log' as PID 1416494
[2025-07-22 15:09:56,452][  INFO][PID:1275599] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/builder-live.log)
[2025-07-22 15:09:56,456][  INFO][PID:1275599] Compressing /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/backend.log by gzip
[2025-07-22 15:09:56,461][  INFO][PID:1275599] Running command 'gzip /var/lib/copr/public_html/results/alexsaezm/golang-rawhide/fedora-42-ppc64le/09297736-golang/backend.log' as PID 1416498