[2025-07-14 19:48:04,533][  INFO][PID:1637385] Marking build as starting
[2025-07-14 19:48:04,591][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:04,593][  INFO][PID:1637385] VM allocation process starts
[2025-07-14 19:48:04,656][  INFO][PID:1637385] Trying to allocate VM: ResallocHost, ticket_id=3926395, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-14 19:48:09,661][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:14,663][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:16,716][  INFO][PID:1637385] Allocated host ResallocHost, ticket_id=3926395, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05390121_20250714_194352, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-14 19:48:16,717][  INFO][PID:1637385] Allocating ssh connection to builder
[2025-07-14 19:48:16,717][  INFO][PID:1637385] Checking that builder machine is OK
[2025-07-14 19:48:18,313][  INFO][PID:1637385] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-14 19:48:19,593][  INFO][PID:1637385] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-14 19:48:19,596][  INFO][PID:1637385] Filling build.info file with builder info
[2025-07-14 19:48:19,600][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:19,605][  INFO][PID:1637385] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/farchord",
            "ended_on": null,
            "started_on": 1752522499.6043284,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9272780-fedora-42-ppc64le",
            "build_id": 9272780,
            "package_name": "kmail",
            "package_version": "25.07.80-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kmail",
            "git_hash": "f655f4482cdde5912eb784a0214e90b91d40314b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09272780-kmail",
            "built_packages": "",
            "id": 9272780,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-14 19:48:19,658][  INFO][PID:1637385] Sending fedora-messaging bus message in build.start
[2025-07-14 19:48:20,870][  INFO][PID:1637385] Sending fedora-messaging bus message in chroot.start
[2025-07-14 19:48:20,900][  INFO][PID:1637385] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272780-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-14 19:48:22,438][  INFO][PID:1637385] Downloading the builder-live.log file, attempt 1
[2025-07-14 19:48:22,440][  INFO][PID:1637385] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-14 19:48:27,446][  INFO][PID:1637385] Periodic builder liveness probe: alive
[2025-07-14 19:48:27,447][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:32,451][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:37,455][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:42,458][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:47,466][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:52,469][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:48:57,481][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:02,484][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:07,489][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:12,491][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:17,494][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:22,495][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:27,498][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:32,500][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:37,506][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:42,511][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:47,524][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:52,528][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:49:57,539][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:02,547][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:07,556][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:12,559][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:17,567][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:22,574][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:27,578][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:32,579][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:37,585][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:42,588][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:47,590][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:52,601][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:50:57,611][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:02,612][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:07,617][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:12,618][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:17,628][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:22,629][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:27,630][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:32,634][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:37,637][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:42,641][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:47,643][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:52,648][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:51:57,649][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:02,650][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:07,652][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:12,654][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:17,656][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:22,661][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:27,664][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:32,667][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:37,669][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:42,674][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:47,676][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:52,679][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:52:57,681][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:02,684][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:07,685][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:12,686][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:17,687][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:22,689][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:27,691][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:32,698][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:37,700][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:42,705][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:47,706][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:52,708][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:53:57,709][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:02,710][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:07,711][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:12,713][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:17,714][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:22,716][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:27,719][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:32,723][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:37,734][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:42,735][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:47,738][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:52,741][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:54:57,742][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:02,744][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:07,745][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:12,747][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:17,748][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:22,750][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:27,751][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:32,753][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:37,754][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:42,755][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:47,756][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:52,760][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:55:57,766][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:02,767][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:07,768][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:12,769][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:17,772][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:22,775][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:27,776][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:32,777][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:37,778][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:42,779][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:47,780][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:52,781][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:56:57,782][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:02,783][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:07,784][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:12,785][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:17,786][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:22,788][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:27,789][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:32,790][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:37,791][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:42,793][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:47,795][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:52,797][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:57:57,798][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:02,799][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:07,800][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:12,801][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:17,802][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:22,803][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:27,809][  INFO][PID:1637385] Periodic builder liveness probe: alive
[2025-07-14 19:58:27,810][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:32,811][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:37,812][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:42,813][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:47,814][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:52,815][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:58:57,816][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:02,817][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:07,818][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:12,820][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:17,821][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:22,822][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:27,823][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:32,824][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:37,825][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:42,827][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:47,828][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:52,829][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 19:59:57,830][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:02,831][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:07,832][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:12,835][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:17,836][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:22,837][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:27,837][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:32,839][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:37,840][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:42,841][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:47,843][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:52,844][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:00:57,845][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:02,846][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:07,847][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:12,848][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:17,849][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:22,850][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:27,852][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:32,853][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:37,854][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:42,855][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:47,857][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:52,859][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:01:57,860][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:02,861][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:07,862][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:12,863][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:17,864][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:22,865][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:27,866][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:32,868][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:37,869][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:42,870][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:47,871][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:52,873][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:02:57,874][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:02,875][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:07,877][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:12,879][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:17,880][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:22,882][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:27,883][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:32,884][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:37,885][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:42,887][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:47,888][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:52,889][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:03:57,890][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:02,891][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:07,892][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:12,893][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:17,894][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:22,895][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:27,897][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:32,899][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:37,900][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:42,902][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:47,903][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:52,904][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:04:57,905][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:02,906][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:07,907][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:12,908][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:17,910][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:22,911][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:27,977][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:32,981][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:37,984][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:42,988][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:47,990][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:52,992][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:05:57,993][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:02,995][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:07,996][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:12,998][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:17,999][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:23,002][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:28,007][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:33,010][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:38,013][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:43,015][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:48,016][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:53,017][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:06:58,021][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:03,033][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:08,035][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:13,042][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:18,044][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:23,046][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:28,049][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:33,053][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:38,062][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:43,065][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:48,074][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:53,082][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:07:58,091][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:08:03,096][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:08:08,098][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:08:13,100][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:08:18,101][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:08:23,193][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:08:28,317][  INFO][PID:1637385] Periodic builder liveness probe: dead
[2025-07-14 20:09:28,534][ ERROR][PID:1637385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.229 port 22 timed out

[2025-07-14 20:10:38,672][ ERROR][PID:1637385] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.229 port 22: Connection timed out

[2025-07-14 20:11:00,150][ ERROR][PID:1637385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 20:11:10,153][WARNING][PID:1637385] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-14 20:11:20,157][  INFO][PID:1637385] Downloading the builder-live.log file, attempt 2
[2025-07-14 20:11:20,159][  INFO][PID:1637385] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-14 20:11:48,747][ ERROR][PID:1637385] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.229 port 22: Connection timed out

[2025-07-14 20:12:20,266][ ERROR][PID:1637385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 20:12:30,273][WARNING][PID:1637385] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-14 20:12:40,279][  INFO][PID:1637385] Downloading the builder-live.log file, attempt 3
[2025-07-14 20:12:40,284][  INFO][PID:1637385] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-14 20:12:58,867][ ERROR][PID:1637385] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.229 port 22: Connection timed out

[2025-07-14 20:13:08,867][ ERROR][PID:1637385] Can't ssh to cancel build.
[2025-07-14 20:13:40,368][ ERROR][PID:1637385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 20:13:50,535][WARNING][PID:1637385] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-14 20:14:00,536][  INFO][PID:1637385] Downloading the builder-live.log file, attempt 4
[2025-07-14 20:14:00,539][  INFO][PID:1637385] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-14 20:15:00,611][ ERROR][PID:1637385] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 20:15:10,614][ ERROR][PID:1637385] Giving up for unstable SSH, failures: 1752523870.1536553, 1752523950.273905, 1752524030.535464, 1752524110.6138587
[2025-07-14 20:15:10,614][ ERROR][PID:1637385] Re-try request for task on 'ResallocHost, ticket_id=3926395, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05390121_20250714_194352, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-14 20:15:10,615][  INFO][PID:1637385] Releasing VM back to pool
[2025-07-14 20:15:10,624][  INFO][PID:1637385] Retry #1 (on other host)
[2025-07-14 20:15:10,625][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:15:10,625][  INFO][PID:1637385] VM allocation process starts
[2025-07-14 20:15:10,694][  INFO][PID:1637385] Trying to allocate VM: ResallocHost, ticket_id=3926962, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-14 20:15:13,727][  INFO][PID:1637385] Allocated host ResallocHost, ticket_id=3926962, hostname=2620:52:3:1:dead:beef:cafe:c295, name=copr_p09_01_prod_05391163_20250714_201102, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-14 20:15:13,819][  INFO][PID:1637385] Allocating ssh connection to builder
[2025-07-14 20:15:13,820][  INFO][PID:1637385] Checking that builder machine is OK
[2025-07-14 20:15:14,588][  INFO][PID:1637385] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-14 20:15:15,006][  INFO][PID:1637385] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-14 20:15:15,007][  INFO][PID:1637385] Filling build.info file with builder info
[2025-07-14 20:15:15,052][  INFO][PID:1637385] Checking for cancel request
[2025-07-14 20:15:15,053][  INFO][PID:1637385] Not re-notifying FE and msg buses for the new host.
[2025-07-14 20:15:15,053][  INFO][PID:1637385] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272780-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-14 20:15:15,663][  INFO][PID:1637385] Downloading the builder-live.log file, attempt 1
[2025-07-14 20:15:15,665][  INFO][PID:1637385] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c295 copr-rpmbuild-log
[2025-07-14 20:15:24,610][  INFO][PID:1637385] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c295' (ED25519) to the list of known hosts.

[2025-07-14 20:15:24,612][  INFO][PID:1637385] Downloading results from builder
[2025-07-14 20:15:24,613][  INFO][PID:1637385] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c295]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail started
[2025-07-14 20:15:24,615][  INFO][PID:1637385] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c295]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/build-09272780.rsync.log
[2025-07-14 20:15:25,054][  INFO][PID:1637385] rsyncing finished.
[2025-07-14 20:15:25,055][  INFO][PID:1637385] Releasing VM back to pool
[2025-07-14 20:15:25,067][  INFO][PID:1637385] Searching for 'success' file in resultdir
[2025-07-14 20:15:25,068][ ERROR][PID:1637385] Build failed: Backend process error: No success file => build failure
[2025-07-14 20:15:25,069][  INFO][PID:1637385] Finished build: id=9272780 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le 
[2025-07-14 20:15:25,071][ ERROR][PID:1637385] Backend process error: No success file => build failure
[2025-07-14 20:15:25,071][  INFO][PID:1637385] Worker failed build, took 10.018551588058472
[2025-07-14 20:15:25,072][  INFO][PID:1637385] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/farchord",
            "ended_on": 1752524125.0718062,
            "started_on": 1752524115.0532546,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9272780-fedora-42-ppc64le",
            "build_id": 9272780,
            "package_name": "kmail",
            "package_version": "25.07.80-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kmail",
            "git_hash": "f655f4482cdde5912eb784a0214e90b91d40314b",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09272780-kmail",
            "built_packages": "",
            "id": 9272780,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-14 20:15:25,117][  INFO][PID:1637385] Sending fedora-messaging bus message in build.end
[2025-07-14 20:15:25,144][  INFO][PID:1637385] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/builder-live.log by gzip
[2025-07-14 20:15:25,146][  INFO][PID:1637385] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/builder-live.log' as PID 1838064
[2025-07-14 20:15:25,147][  INFO][PID:1637385] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/builder-live.log)
[2025-07-14 20:15:25,148][  INFO][PID:1637385] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/backend.log by gzip
[2025-07-14 20:15:25,149][  INFO][PID:1637385] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09272780-kmail/backend.log' as PID 1838065