[2025-07-22 13:25:58,299][  INFO][PID:647594] Marking build as starting
[2025-07-22 13:25:58,475][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:25:58,477][  INFO][PID:647594] VM allocation process starts
[2025-07-22 13:25:58,491][  INFO][PID:647594] Trying to allocate VM: ResallocHost, ticket_id=4026398, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-22 13:26:01,545][  INFO][PID:647594] Allocated host ResallocHost, ticket_id=4026398, hostname=140.211.168.83, name=copr_osuosl_p09_prod_05724326_20250722_132031, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-22 13:26:01,545][  INFO][PID:647594] Allocating ssh connection to builder
[2025-07-22 13:26:01,546][  INFO][PID:647594] Checking that builder machine is OK
[2025-07-22 13:26:03,087][  INFO][PID:647594] Running remote command: copr-builder-ready alma+epel-9-ppc64le
[2025-07-22 13:26:04,157][  INFO][PID:647594] Red Hat subscription not needed for alma+epel-9-ppc64le
Builder is ready to be used

[2025-07-22 13:26:04,158][  INFO][PID:647594] Filling build.info file with builder info
[2025-07-22 13:26:04,159][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:04,160][  INFO][PID:647594] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "minfrin",
            "project_name": "minfrin-test",
            "project_dirname": "minfrin-test",
            "submitter": "minfrin",
            "ended_on": null,
            "started_on": 1753190764.1599183,
            "submitted_on": null,
            "status": 3,
            "chroot": "alma+epel-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9297497-alma+epel-9-ppc64le",
            "build_id": 9297497,
            "package_name": "redwax-tool",
            "package_version": "1.0.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/minfrin/minfrin-test/redwax-tool",
            "git_hash": "5db1cf3aa8a84bb0b3ae3c1b49decb7e3c9915a8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "minfrin/minfrin-test--minfrin",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/minfrin/minfrin-test/alma+epel-9-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/minfrin/minfrin-test",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/minfrin/minfrin-test",
            "result_dir": "09297497-redwax-tool",
            "built_packages": "",
            "id": 9297497,
            "mockchain_macros": {
                "copr_username": "minfrin",
                "copr_projectname": "minfrin-test",
                "vendor": "Fedora Project COPR (minfrin/minfrin-test)"
            }
        }
    ]
}
[2025-07-22 13:26:04,276][  INFO][PID:647594] Sending fedora-messaging bus message in build.start
[2025-07-22 13:26:05,002][  INFO][PID:647594] Sending fedora-messaging bus message in chroot.start
[2025-07-22 13:26:05,028][  INFO][PID:647594] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9297497-alma+epel-9-ppc64le --chroot alma+epel-9-ppc64le --detached
[2025-07-22 13:26:06,433][  INFO][PID:647594] Downloading the builder-live.log file, attempt 1
[2025-07-22 13:26:06,434][  INFO][PID:647594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log
[2025-07-22 13:26:11,441][  INFO][PID:647594] Periodic builder liveness probe: alive
[2025-07-22 13:26:11,442][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:16,442][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:21,444][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:26,446][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:31,447][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:36,448][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:41,449][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:46,453][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:51,455][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:26:56,456][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:01,457][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:06,460][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:11,462][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:16,463][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:21,464][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:26,465][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:31,467][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:36,469][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:41,470][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:46,471][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:51,473][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:27:56,474][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:01,475][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:06,476][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:11,477][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:16,478][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:21,479][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:26,480][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:31,481][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:36,482][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:41,483][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:46,484][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:51,485][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:28:56,486][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:01,487][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:06,489][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:11,490][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:16,491][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:21,492][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:26,493][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:31,494][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:36,496][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:41,500][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:46,501][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:51,503][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:29:56,504][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:01,505][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:06,506][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:11,507][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:16,509][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:21,510][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:26,511][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:31,512][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:36,513][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:41,515][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:46,518][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:51,520][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:30:56,521][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:01,522][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:06,525][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:11,526][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:16,530][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:21,532][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:26,541][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:31,543][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:36,553][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:41,554][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:46,555][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:51,556][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:31:56,558][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:01,559][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:06,560][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:11,562][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:16,564][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:21,567][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:26,570][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:31,576][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:36,579][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:41,580][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:46,584][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:51,586][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:32:56,588][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:01,589][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:06,597][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:11,599][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:16,601][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:21,603][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:26,605][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:31,609][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:36,610][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:41,612][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:46,613][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:51,618][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:33:56,619][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:01,621][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:06,623][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:11,624][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:16,626][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:21,631][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:26,632][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:31,634][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:36,635][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:41,637][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:46,638][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:51,640][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:34:56,641][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:01,642][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:06,644][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:11,649][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:16,650][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:21,651][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:26,652][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:31,654][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:36,656][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:41,657][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:46,658][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:51,660][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:35:56,661][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:01,662][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:06,663][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:11,677][  INFO][PID:647594] Periodic builder liveness probe: alive
[2025-07-22 13:36:11,677][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:16,678][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:21,682][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:26,685][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:31,687][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:36,696][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:41,698][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:46,699][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:51,700][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:36:56,702][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:01,703][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:06,704][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:11,706][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:16,707][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:21,710][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:26,711][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:31,714][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:36,715][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:41,716][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:46,718][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:51,720][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:37:56,721][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:01,722][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:06,723][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:11,725][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:16,726][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:21,727][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:26,728][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:31,729][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:36,730][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:41,731][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:46,733][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:51,734][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:38:56,736][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:01,738][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:06,739][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:11,741][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:16,742][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:21,743][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:26,745][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:31,746][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:36,747][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:41,748][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:46,750][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:51,751][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:39:56,753][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:01,766][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:06,767][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:11,768][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:16,770][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:21,771][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:26,772][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:31,774][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:36,778][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:41,779][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:46,780][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:51,782][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:40:56,784][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:01,786][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:06,787][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:11,788][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:16,789][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:21,790][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:26,791][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:31,792][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:36,793][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:41,795][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:46,796][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:51,797][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:41:56,798][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:01,799][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:06,801][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:11,803][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:16,804][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:21,806][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:26,807][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:31,808][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:36,809][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:41,810][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:46,811][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:51,812][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:42:56,813][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:01,814][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:06,816][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:11,817][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:16,818][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:21,820][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:26,821][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:31,822][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:36,823][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:41,824][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:46,826][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:51,831][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:43:56,832][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:01,833][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:06,834][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:11,835][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:16,836][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:21,837][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:26,838][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:31,839][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:36,840][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:41,841][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:46,843][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:51,844][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:44:56,845][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:01,846][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:06,847][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:11,848][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:16,849][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:21,850][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:26,851][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:31,852][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:36,853][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:41,854][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:46,855][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:51,856][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:45:56,857][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:46:01,858][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:46:06,859][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:46:11,865][  INFO][PID:647594] Periodic builder liveness probe: dead
[2025-07-22 13:47:12,002][ ERROR][PID:647594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.83 port 22 timed out

[2025-07-22 13:48:22,072][ ERROR][PID:647594] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.83 port 22: Connection timed out

[2025-07-22 13:48:30,140][ ERROR][PID:647594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 13:48:40,141][WARNING][PID:647594] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 13:48:50,142][  INFO][PID:647594] Downloading the builder-live.log file, attempt 2
[2025-07-22 13:48:50,144][  INFO][PID:647594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log
[2025-07-22 13:49:32,141][ ERROR][PID:647594] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.83 port 22: Connection timed out

[2025-07-22 13:49:50,215][ ERROR][PID:647594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 13:50:00,216][WARNING][PID:647594] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 13:50:10,217][  INFO][PID:647594] Downloading the builder-live.log file, attempt 3
[2025-07-22 13:50:10,218][  INFO][PID:647594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log
[2025-07-22 13:50:42,210][ ERROR][PID:647594] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.83 port 22: Connection timed out

[2025-07-22 13:50:52,211][ ERROR][PID:647594] Can't ssh to cancel build.
[2025-07-22 13:51:10,287][ ERROR][PID:647594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 13:51:20,291][WARNING][PID:647594] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-22 13:51:30,292][  INFO][PID:647594] Downloading the builder-live.log file, attempt 4
[2025-07-22 13:51:30,293][  INFO][PID:647594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.83 copr-rpmbuild-log
[2025-07-22 13:52:30,362][ ERROR][PID:647594] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-22 13:52:40,363][ ERROR][PID:647594] Giving up for unstable SSH, failures: 1753192120.141031, 1753192200.2164242, 1753192280.2912326, 1753192360.362887
[2025-07-22 13:52:40,363][ ERROR][PID:647594] Re-try request for task on 'ResallocHost, ticket_id=4026398, hostname=140.211.168.83, name=copr_osuosl_p09_prod_05724326_20250722_132031, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-22 13:52:40,364][  INFO][PID:647594] Releasing VM back to pool
[2025-07-22 13:52:40,372][  INFO][PID:647594] Retry #1 (on other host)
[2025-07-22 13:52:40,372][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:52:40,373][  INFO][PID:647594] VM allocation process starts
[2025-07-22 13:52:40,416][  INFO][PID:647594] Trying to allocate VM: ResallocHost, ticket_id=4026691, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-22 13:52:43,468][  INFO][PID:647594] Allocated host ResallocHost, ticket_id=4026691, hostname=140.211.168.9, name=copr_osuosl_p09_prod_05725044_20250722_133632, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-07-22 13:52:43,469][  INFO][PID:647594] Allocating ssh connection to builder
[2025-07-22 13:52:43,469][  INFO][PID:647594] Checking that builder machine is OK
[2025-07-22 13:52:44,837][  INFO][PID:647594] Running remote command: copr-builder-ready alma+epel-9-ppc64le
[2025-07-22 13:52:45,829][  INFO][PID:647594] Red Hat subscription not needed for alma+epel-9-ppc64le
Builder is ready to be used

[2025-07-22 13:52:45,830][  INFO][PID:647594] Filling build.info file with builder info
[2025-07-22 13:52:45,833][  INFO][PID:647594] Checking for cancel request
[2025-07-22 13:52:45,834][  INFO][PID:647594] Not re-notifying FE and msg buses for the new host.
[2025-07-22 13:52:45,835][  INFO][PID:647594] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9297497-alma+epel-9-ppc64le --chroot alma+epel-9-ppc64le --detached
[2025-07-22 13:52:47,164][  INFO][PID:647594] Downloading the builder-live.log file, attempt 1
[2025-07-22 13:52:47,165][  INFO][PID:647594] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.9 copr-rpmbuild-log
[2025-07-22 13:52:56,340][  INFO][PID:647594] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.9' (ED25519) to the list of known hosts.

[2025-07-22 13:52:56,340][  INFO][PID:647594] Downloading results from builder
[2025-07-22 13:52:56,341][  INFO][PID:647594] rsyncing of mockbuilder@140.211.168.9:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool started
[2025-07-22 13:52:56,341][  INFO][PID:647594] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.9:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/ &> /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/build-09297497.rsync.log
[2025-07-22 13:52:57,914][  INFO][PID:647594] rsyncing finished.
[2025-07-22 13:52:57,915][  INFO][PID:647594] Releasing VM back to pool
[2025-07-22 13:52:57,925][  INFO][PID:647594] Searching for 'success' file in resultdir
[2025-07-22 13:52:57,925][ ERROR][PID:647594] Build failed: Backend process error: No success file => build failure
[2025-07-22 13:52:57,926][  INFO][PID:647594] Finished build: id=9297497 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/minfrin/minfrin-test chroot=alma+epel-9-ppc64le 
[2025-07-22 13:52:57,927][ ERROR][PID:647594] Backend process error: No success file => build failure
[2025-07-22 13:52:57,927][  INFO][PID:647594] Worker failed build, took 12.093306064605713
[2025-07-22 13:52:57,928][  INFO][PID:647594] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "minfrin",
            "project_name": "minfrin-test",
            "project_dirname": "minfrin-test",
            "submitter": "minfrin",
            "ended_on": 1753192377.9277952,
            "started_on": 1753192365.834489,
            "submitted_on": null,
            "status": 0,
            "chroot": "alma+epel-9-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9297497-alma+epel-9-ppc64le",
            "build_id": 9297497,
            "package_name": "redwax-tool",
            "package_version": "1.0.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/minfrin/minfrin-test/redwax-tool",
            "git_hash": "5db1cf3aa8a84bb0b3ae3c1b49decb7e3c9915a8",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "minfrin/minfrin-test--minfrin",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/minfrin/minfrin-test/alma+epel-9-ppc64le/",
                    "id": "copr_base",
                    "module_hotfixes": true,
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/minfrin/minfrin-test",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/minfrin/minfrin-test",
            "result_dir": "09297497-redwax-tool",
            "built_packages": "",
            "id": 9297497,
            "mockchain_macros": {
                "copr_username": "minfrin",
                "copr_projectname": "minfrin-test",
                "vendor": "Fedora Project COPR (minfrin/minfrin-test)"
            }
        }
    ]
}
[2025-07-22 13:52:58,041][  INFO][PID:647594] Sending fedora-messaging bus message in build.end
[2025-07-22 13:52:58,065][  INFO][PID:647594] Compressing /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/builder-live.log by gzip
[2025-07-22 13:52:58,066][  INFO][PID:647594] Running command 'gzip /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/builder-live.log' as PID 836792
[2025-07-22 13:52:58,067][  INFO][PID:647594] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/builder-live.log)
[2025-07-22 13:52:58,068][  INFO][PID:647594] Compressing /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/backend.log by gzip
[2025-07-22 13:52:58,069][  INFO][PID:647594] Running command 'gzip /var/lib/copr/public_html/results/minfrin/minfrin-test/alma+epel-9-ppc64le/09297497-redwax-tool/backend.log' as PID 836793