[2025-07-15 18:06:13,526][  INFO][PID:570570] Marking build as starting
[2025-07-15 18:06:13,601][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:13,602][  INFO][PID:570570] VM allocation process starts
[2025-07-15 18:06:13,630][  INFO][PID:570570] Trying to allocate VM: ResallocHost, ticket_id=3941176, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 18:06:16,654][  INFO][PID:570570] Allocated host ResallocHost, ticket_id=3941176, hostname=140.211.168.150, name=copr_osuosl_p09_prod_05428550_20250715_180145, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 18:06:16,655][  INFO][PID:570570] Allocating ssh connection to builder
[2025-07-15 18:06:16,655][  INFO][PID:570570] Checking that builder machine is OK
[2025-07-15 18:06:18,030][  INFO][PID:570570] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-15 18:06:19,177][  INFO][PID:570570] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-15 18:06:19,181][  INFO][PID:570570] Filling build.info file with builder info
[2025-07-15 18:06:19,183][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:19,195][  INFO][PID:570570] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/farchord",
            "ended_on": null,
            "started_on": 1752602779.1945841,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9275838-fedora-42-ppc64le",
            "build_id": 9275838,
            "package_name": "plasma-thunderbolt",
            "package_version": "6.4.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/plasma-thunderbolt",
            "git_hash": "a4a0591541e5edec7a2bed563766c382f060172d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09275838-plasma-thunderbolt",
            "built_packages": "",
            "id": 9275838,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-15 18:06:19,270][  INFO][PID:570570] Sending fedora-messaging bus message in build.start
[2025-07-15 18:06:20,780][  INFO][PID:570570] Sending fedora-messaging bus message in chroot.start
[2025-07-15 18:06:20,832][  INFO][PID:570570] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9275838-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-15 18:06:22,238][  INFO][PID:570570] Downloading the builder-live.log file, attempt 1
[2025-07-15 18:06:22,241][  INFO][PID:570570] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.150 copr-rpmbuild-log
[2025-07-15 18:06:27,254][  INFO][PID:570570] Periodic builder liveness probe: alive
[2025-07-15 18:06:27,255][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:32,256][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:37,258][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:42,259][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:47,260][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:52,263][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:06:57,264][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:02,270][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:07,276][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:12,277][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:17,279][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:22,280][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:27,282][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:32,283][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:37,285][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:42,286][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:47,288][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:52,290][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:07:57,292][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:02,293][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:07,294][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:12,296][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:17,297][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:22,302][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:27,304][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:32,306][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:37,309][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:42,311][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:47,312][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:52,315][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:08:57,317][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:02,319][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:07,321][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:12,325][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:17,330][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:22,337][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:27,342][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:32,343][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:37,354][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:42,358][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:47,360][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:52,363][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:09:57,367][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:02,376][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:07,379][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:12,383][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:17,392][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:22,395][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:27,402][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:32,405][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:37,417][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:42,420][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:47,427][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:52,428][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:10:57,430][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:02,433][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:07,437][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:12,438][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:17,441][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:22,442][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:27,444][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:32,446][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:37,448][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:42,449][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:47,453][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:52,454][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:11:57,457][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:02,459][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:07,468][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:12,470][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:17,472][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:22,473][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:27,475][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:32,476][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:37,479][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:42,480][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:47,486][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:52,490][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:12:57,492][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:02,496][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:07,500][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:12,502][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:17,503][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:22,504][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:27,508][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:32,510][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:37,512][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:42,513][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:47,514][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:52,516][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:13:57,545][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:02,548][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:07,552][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:12,556][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:17,558][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:22,655][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:27,660][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:32,664][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:37,680][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:42,683][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:47,704][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:52,712][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:14:57,717][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:02,722][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:07,728][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:12,733][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:17,746][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:22,749][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:27,759][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:32,762][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:37,763][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:43,031][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:48,046][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:53,053][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:15:58,062][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:03,068][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:08,074][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:13,075][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:18,082][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:23,089][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:28,100][  INFO][PID:570570] Periodic builder liveness probe: alive
[2025-07-15 18:16:28,101][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:33,102][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:38,104][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:43,106][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:48,111][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:53,122][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:16:58,126][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:03,136][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:08,146][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:13,153][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:18,157][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:23,164][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:28,235][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:33,247][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:38,264][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:43,269][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:48,286][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:53,292][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:17:58,297][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:03,300][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:08,302][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:13,304][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:18,309][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:23,312][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:28,314][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:33,315][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:38,316][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:43,318][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:48,322][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:53,325][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:18:58,326][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:03,328][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:08,329][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:13,330][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:18,345][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:23,347][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:28,353][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:33,439][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:38,441][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:43,470][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:48,473][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:53,478][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:19:58,480][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:03,512][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:08,606][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:13,727][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:18,893][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:23,917][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:29,071][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:34,348][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:39,452][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:44,495][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:49,659][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:54,687][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:20:59,761][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:04,812][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:09,814][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:14,934][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:19,935][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:24,947][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:29,955][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:34,964][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:39,969][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:45,005][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:50,009][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:21:55,010][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:00,012][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:05,013][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:10,015][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:15,048][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:20,052][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:25,054][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:30,066][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:35,156][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:40,164][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:45,167][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:50,171][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:22:55,172][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:00,177][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:05,179][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:10,187][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:15,188][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:20,189][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:25,191][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:30,192][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:35,193][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:40,211][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:45,213][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:50,215][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:23:55,216][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:00,217][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:05,219][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:10,220][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:15,222][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:20,223][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:25,224][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:30,229][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:35,231][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:40,232][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:45,234][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:50,235][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:24:55,247][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:00,401][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:05,404][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:10,406][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:15,408][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:20,409][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:25,410][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:30,415][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:35,416][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:40,424][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:45,425][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:50,426][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:25:55,427][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:00,428][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:05,430][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:10,431][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:15,432][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:20,433][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:25,434][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:30,455][  INFO][PID:570570] Periodic builder liveness probe: alive
[2025-07-15 18:26:30,456][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:35,457][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:40,458][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:45,459][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:50,460][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:26:55,461][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:00,463][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:05,464][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:10,465][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:15,466][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:20,467][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:25,468][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:30,469][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:35,471][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:40,472][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:45,473][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:50,500][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:27:55,502][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:00,528][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:05,532][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:10,538][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:15,646][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:20,648][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:25,650][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:30,659][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:35,660][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:40,663][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:45,665][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:50,667][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:28:55,724][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:00,726][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:05,729][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:10,731][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:15,734][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:20,736][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:25,737][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:30,740][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:35,762][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:40,767][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:45,769][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:50,772][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:29:55,811][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:00,817][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:05,822][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:10,824][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:15,827][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:20,829][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:25,833][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:30,977][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:35,978][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:40,979][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:45,980][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:50,981][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:30:55,982][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:00,984][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:05,985][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:10,985][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:15,987][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:20,988][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:26,020][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:31,021][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:36,023][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:41,024][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:46,026][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:51,027][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:31:56,028][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:01,029][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:06,032][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:11,296][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:16,298][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:21,300][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:26,302][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:31,303][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:36,304][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:41,305][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:46,306][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:51,307][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:32:56,308][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:01,309][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:06,310][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:11,314][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:16,315][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:21,316][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:26,317][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:31,318][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:36,319][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:41,320][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:46,321][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:51,322][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:33:56,323][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:01,324][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:06,325][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:11,326][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:16,327][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:21,329][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:26,330][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:31,392][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:36,418][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:41,420][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:46,421][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:51,422][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:34:56,423][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:01,425][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:06,426][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:11,452][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:16,455][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:21,497][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:26,500][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:31,502][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:36,512][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:41,516][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:46,517][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:51,520][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:35:56,718][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:01,719][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:06,720][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:11,721][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:16,722][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:21,724][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:26,725][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:36:31,744][  INFO][PID:570570] Periodic builder liveness probe: dead
[2025-07-15 18:37:31,886][ ERROR][PID:570570] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.150 port 22 timed out

[2025-07-15 18:38:41,966][ ERROR][PID:570570] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.150 port 22: Connection timed out

[2025-07-15 18:39:07,148][ ERROR][PID:570570] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 18:39:17,151][WARNING][PID:570570] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 18:39:27,151][  INFO][PID:570570] Downloading the builder-live.log file, attempt 2
[2025-07-15 18:39:27,153][  INFO][PID:570570] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.150 copr-rpmbuild-log
[2025-07-15 18:39:52,036][ ERROR][PID:570570] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.150 port 22: Connection timed out

[2025-07-15 18:40:27,224][ ERROR][PID:570570] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 18:40:37,338][WARNING][PID:570570] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 18:40:47,339][  INFO][PID:570570] Downloading the builder-live.log file, attempt 3
[2025-07-15 18:40:47,341][  INFO][PID:570570] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.150 copr-rpmbuild-log
[2025-07-15 18:41:02,105][ ERROR][PID:570570] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.150 port 22: Connection timed out

[2025-07-15 18:41:12,106][ ERROR][PID:570570] Can't ssh to cancel build.
[2025-07-15 18:41:47,408][ ERROR][PID:570570] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 18:41:57,512][WARNING][PID:570570] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 18:42:07,514][  INFO][PID:570570] Downloading the builder-live.log file, attempt 4
[2025-07-15 18:42:07,515][  INFO][PID:570570] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.150 copr-rpmbuild-log
[2025-07-15 18:43:07,588][ ERROR][PID:570570] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 18:43:17,617][ ERROR][PID:570570] Giving up for unstable SSH, failures: 1752604757.151056, 1752604837.338799, 1752604917.5126863, 1752604997.617723
[2025-07-15 18:43:17,618][ ERROR][PID:570570] Re-try request for task on 'ResallocHost, ticket_id=3941176, hostname=140.211.168.150, name=copr_osuosl_p09_prod_05428550_20250715_180145, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-15 18:43:17,619][  INFO][PID:570570] Releasing VM back to pool
[2025-07-15 18:43:17,667][  INFO][PID:570570] Retry #1 (on other host)
[2025-07-15 18:43:17,668][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:43:17,669][  INFO][PID:570570] VM allocation process starts
[2025-07-15 18:43:17,697][  INFO][PID:570570] Trying to allocate VM: ResallocHost, ticket_id=3941660, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 18:43:20,724][  INFO][PID:570570] Allocated host ResallocHost, ticket_id=3941660, hostname=2620:52:3:1:dead:beef:cafe:c29a, name=copr_p09_01_prod_05429709_20250715_182302, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 18:43:20,725][  INFO][PID:570570] Allocating ssh connection to builder
[2025-07-15 18:43:20,725][  INFO][PID:570570] Checking that builder machine is OK
[2025-07-15 18:43:21,662][  INFO][PID:570570] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-15 18:43:22,062][  INFO][PID:570570] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-15 18:43:22,063][  INFO][PID:570570] Filling build.info file with builder info
[2025-07-15 18:43:22,093][  INFO][PID:570570] Checking for cancel request
[2025-07-15 18:43:22,094][  INFO][PID:570570] Not re-notifying FE and msg buses for the new host.
[2025-07-15 18:43:22,094][  INFO][PID:570570] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9275838-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-15 18:43:22,875][  INFO][PID:570570] Downloading the builder-live.log file, attempt 1
[2025-07-15 18:43:22,876][  INFO][PID:570570] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c29a copr-rpmbuild-log
[2025-07-15 18:43:31,479][  INFO][PID:570570] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29a' (ED25519) to the list of known hosts.

[2025-07-15 18:43:31,479][  INFO][PID:570570] Downloading results from builder
[2025-07-15 18:43:31,480][  INFO][PID:570570] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c29a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt started
[2025-07-15 18:43:31,480][  INFO][PID:570570] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c29a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/build-09275838.rsync.log
[2025-07-15 18:43:31,936][  INFO][PID:570570] rsyncing finished.
[2025-07-15 18:43:31,937][  INFO][PID:570570] Releasing VM back to pool
[2025-07-15 18:43:31,945][  INFO][PID:570570] Searching for 'success' file in resultdir
[2025-07-15 18:43:31,946][ ERROR][PID:570570] Build failed: Backend process error: No success file => build failure
[2025-07-15 18:43:31,947][  INFO][PID:570570] Finished build: id=9275838 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le 
[2025-07-15 18:43:31,949][ ERROR][PID:570570] Backend process error: No success file => build failure
[2025-07-15 18:43:31,949][  INFO][PID:570570] Worker failed build, took 9.85515809059143
[2025-07-15 18:43:31,949][  INFO][PID:570570] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/farchord",
            "ended_on": 1752605011.9494247,
            "started_on": 1752605002.0942667,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9275838-fedora-42-ppc64le",
            "build_id": 9275838,
            "package_name": "plasma-thunderbolt",
            "package_version": "6.4.3-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/plasma-thunderbolt",
            "git_hash": "a4a0591541e5edec7a2bed563766c382f060172d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09275838-plasma-thunderbolt",
            "built_packages": "",
            "id": 9275838,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-15 18:43:31,992][  INFO][PID:570570] Sending fedora-messaging bus message in build.end
[2025-07-15 18:43:32,017][  INFO][PID:570570] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/builder-live.log by gzip
[2025-07-15 18:43:32,018][  INFO][PID:570570] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/builder-live.log' as PID 831213
[2025-07-15 18:43:32,020][  INFO][PID:570570] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/builder-live.log)
[2025-07-15 18:43:32,021][  INFO][PID:570570] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/backend.log by gzip
[2025-07-15 18:43:32,022][  INFO][PID:570570] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09275838-plasma-thunderbolt/backend.log' as PID 831214