[2025-07-24 09:44:15,391][  INFO][PID:2848679] Marking build as starting
[2025-07-24 09:44:15,433][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:15,434][  INFO][PID:2848679] VM allocation process starts
[2025-07-24 09:44:15,475][  INFO][PID:2848679] Trying to allocate VM: ResallocHost, ticket_id=4089776, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 09:44:18,521][  INFO][PID:2848679] Allocated host ResallocHost, ticket_id=4089776, hostname=140.211.168.248, name=copr_osuosl_p09_prod_05780963_20250724_093950, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 09:44:18,522][  INFO][PID:2848679] Allocating ssh connection to builder
[2025-07-24 09:44:18,523][  INFO][PID:2848679] Checking that builder machine is OK
[2025-07-24 09:44:19,862][  INFO][PID:2848679] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-24 09:44:20,919][  INFO][PID:2848679] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-24 09:44:20,920][  INFO][PID:2848679] Filling build.info file with builder info
[2025-07-24 09:44:20,920][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:20,921][  INFO][PID:2848679] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/releng",
            "ended_on": null,
            "started_on": 1753350260.9216478,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9313865-fedora-42-ppc64le",
            "build_id": 9313865,
            "package_name": "R-jose",
            "package_version": "1.2.0-12",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-jose",
            "git_hash": "1781ae2a3d17918cba09c7f465dfcd139d388327",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09313865-R-jose",
            "built_packages": "",
            "id": 9313865,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-24 09:44:20,962][  INFO][PID:2848679] Sending fedora-messaging bus message in build.start
[2025-07-24 09:44:21,974][  INFO][PID:2848679] Sending fedora-messaging bus message in chroot.start
[2025-07-24 09:44:22,006][  INFO][PID:2848679] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313865-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-24 09:44:23,315][  INFO][PID:2848679] Downloading the builder-live.log file, attempt 1
[2025-07-24 09:44:23,318][  INFO][PID:2848679] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.248 copr-rpmbuild-log
[2025-07-24 09:44:28,324][  INFO][PID:2848679] Periodic builder liveness probe: alive
[2025-07-24 09:44:28,325][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:33,326][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:38,329][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:43,332][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:48,334][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:53,337][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:44:58,340][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:03,342][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:08,347][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:13,348][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:18,349][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:23,350][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:28,352][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:33,356][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:38,357][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:43,359][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:48,361][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:53,362][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:45:58,363][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:03,364][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:08,371][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:13,373][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:18,376][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:23,378][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:28,380][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:33,382][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:38,384][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:43,385][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:48,387][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:53,390][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:46:58,391][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:03,392][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:08,395][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:13,397][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:18,401][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:23,404][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:28,406][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:33,408][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:38,410][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:43,411][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:48,413][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:53,414][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:47:58,416][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:03,418][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:08,419][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:13,421][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:18,422][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:23,423][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:28,425][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:33,427][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:38,428][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:43,430][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:48,435][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:53,437][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:48:58,439][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:03,442][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:08,444][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:13,446][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:18,447][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:23,448][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:28,450][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:33,451][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:38,453][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:43,454][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:48,456][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:53,457][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:49:58,459][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:03,460][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:08,461][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:13,462][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:18,463][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:23,465][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:28,467][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:33,472][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:38,473][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:43,476][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:48,478][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:53,481][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:50:58,486][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:03,491][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:08,492][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:13,493][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:18,495][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:23,496][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:28,497][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:33,499][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:38,499][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:43,501][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:48,502][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:53,503][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:51:58,504][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:03,505][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:08,506][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:13,508][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:18,509][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:23,511][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:28,513][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:33,514][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:38,515][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:43,516][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:48,517][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:53,518][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:52:58,519][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:03,521][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:08,522][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:13,523][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:18,524][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:23,525][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:28,526][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:33,529][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:38,532][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:43,537][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:48,538][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:53,539][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:53:58,540][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:03,541][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:08,542][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:13,543][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:18,546][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:23,547][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:28,553][  INFO][PID:2848679] Periodic builder liveness probe: alive
[2025-07-24 09:54:28,554][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:33,555][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:38,556][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:43,557][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:48,558][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:53,559][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:54:58,561][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:03,562][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:08,563][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:13,564][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:18,565][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:23,566][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:28,567][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:33,568][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:38,570][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:43,571][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:48,572][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:53,573][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:55:58,574][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:03,575][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:08,576][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:13,577][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:18,578][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:23,579][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:28,581][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:33,582][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:38,583][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:43,584][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:48,585][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:53,586][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:56:58,587][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:03,588][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:08,589][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:13,590][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:18,591][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:23,592][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:28,593][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:33,594][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:38,595][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:43,596][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:48,598][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:53,599][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:57:58,600][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:03,601][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:08,602][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:13,603][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:18,604][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:23,605][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:28,606][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:33,607][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:38,608][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:43,609][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:48,611][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:53,612][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:58:58,612][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:03,614][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:08,615][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:13,616][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:18,617][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:23,618][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:28,619][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:33,621][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:38,622][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:43,623][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:48,624][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:53,625][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 09:59:58,626][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:03,627][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:08,628][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:13,629][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:18,630][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:23,631][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:28,632][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:33,633][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:38,634][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:43,636][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:48,637][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:53,638][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:00:58,639][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:03,640][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:08,641][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:13,642][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:18,643][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:23,644][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:28,645][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:33,647][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:38,648][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:43,649][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:48,650][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:53,651][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:01:58,652][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:03,653][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:08,654][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:13,655][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:18,656][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:23,657][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:28,658][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:33,659][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:38,660][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:43,661][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:48,662][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:53,664][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:02:58,664][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:03,666][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:08,667][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:13,668][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:18,669][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:23,670][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:28,671][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:33,672][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:38,673][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:43,674][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:48,675][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:53,676][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:03:58,678][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:03,679][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:08,680][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:13,682][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:18,683][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:23,684][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:28,692][  INFO][PID:2848679] Periodic builder liveness probe: alive
[2025-07-24 10:04:28,692][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:33,693][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:38,694][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:43,695][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:48,697][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:53,698][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:04:58,699][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:03,700][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:08,701][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:13,702][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:18,703][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:23,704][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:28,706][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:33,707][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:38,708][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:43,709][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:48,710][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:53,711][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:05:58,712][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:03,713][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:08,715][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:13,719][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:18,720][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:23,721][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:28,723][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:33,723][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:38,725][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:43,726][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:48,727][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:53,728][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:06:58,730][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:03,731][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:08,732][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:13,733][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:18,735][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:23,736][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:28,740][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:33,748][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:38,756][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:43,759][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:48,763][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:53,769][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:07:58,771][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:03,773][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:08,774][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:13,777][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:18,779][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:23,788][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:28,797][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:33,799][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:38,802][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:43,805][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:48,808][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:53,811][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:08:58,816][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:03,821][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:08,823][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:13,828][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:18,832][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:23,839][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:28,841][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:33,846][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:38,849][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:43,852][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:48,854][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:53,862][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:09:58,866][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:03,874][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:08,884][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:13,887][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:18,893][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:23,897][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:28,900][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:33,905][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:38,913][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:43,919][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:48,922][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:53,925][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:10:58,930][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:03,938][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:08,941][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:13,952][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:18,955][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:23,958][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:28,960][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:33,962][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:38,968][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:43,977][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:48,981][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:53,987][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:11:58,990][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:03,991][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:08,995][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:14,000][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:19,002][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:24,004][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:29,006][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:34,010][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:39,013][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:44,017][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:49,021][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:54,027][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:12:59,030][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:04,031][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:09,033][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:14,035][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:19,039][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:24,040][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:29,041][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:34,043][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:39,048][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:44,050][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:49,058][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:54,060][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:13:59,063][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:14:04,068][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:14:09,069][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:14:14,074][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:14:19,079][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:14:24,083][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:14:29,139][  INFO][PID:2848679] Periodic builder liveness probe: dead
[2025-07-24 10:14:30,290][ ERROR][PID:2848679] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.248 port 22: Connection refused

[2025-07-24 10:14:42,450][  INFO][PID:2848679] Cancel request succeeded
out:
err:
Warning: Permanently added '140.211.168.248' (ED25519) to the list of known hosts.
Unexpected exception
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 86, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2025-07-24 10:14:50,574][ ERROR][PID:2848679] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 10:15:00,576][WARNING][PID:2848679] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 10:15:10,577][  INFO][PID:2848679] Downloading the builder-live.log file, attempt 2
[2025-07-24 10:15:10,583][  INFO][PID:2848679] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.248 copr-rpmbuild-log
[2025-07-24 10:17:12,452][ ERROR][PID:2848679] Re-try request for task on 'ResallocHost, ticket_id=4089776, hostname=140.211.168.248, name=copr_osuosl_p09_prod_05780963_20250724_093950, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-24 10:17:12,454][  INFO][PID:2848679] Releasing VM back to pool
[2025-07-24 10:17:12,468][  INFO][PID:2848679] Retry #1 (on other host)
[2025-07-24 10:17:12,469][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:17:12,470][  INFO][PID:2848679] VM allocation process starts
[2025-07-24 10:17:12,488][  INFO][PID:2848679] Trying to allocate VM: ResallocHost, ticket_id=4090340, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 10:17:15,555][  INFO][PID:2848679] Allocated host ResallocHost, ticket_id=4090340, hostname=2620:52:3:1:dead:beef:cafe:c254, name=copr_hv_ppc64le_02_prod_05781159_20250724_094947, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 10:17:15,556][  INFO][PID:2848679] Allocating ssh connection to builder
[2025-07-24 10:17:15,557][  INFO][PID:2848679] Checking that builder machine is OK
[2025-07-24 10:17:16,430][  INFO][PID:2848679] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-24 10:17:16,927][  INFO][PID:2848679] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-24 10:17:16,930][  INFO][PID:2848679] Filling build.info file with builder info
[2025-07-24 10:17:16,931][  INFO][PID:2848679] Checking for cancel request
[2025-07-24 10:17:16,932][  INFO][PID:2848679] Not re-notifying FE and msg buses for the new host.
[2025-07-24 10:17:16,932][  INFO][PID:2848679] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313865-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-24 10:17:17,825][  INFO][PID:2848679] Downloading the builder-live.log file, attempt 1
[2025-07-24 10:17:17,826][  INFO][PID:2848679] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c254 copr-rpmbuild-log
[2025-07-24 10:17:26,541][  INFO][PID:2848679] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c254' (ED25519) to the list of known hosts.

[2025-07-24 10:17:26,542][  INFO][PID:2848679] Downloading results from builder
[2025-07-24 10:17:26,543][  INFO][PID:2848679] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c254]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose started
[2025-07-24 10:17:26,544][  INFO][PID:2848679] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c254]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/build-09313865.rsync.log
[2025-07-24 10:17:27,283][  INFO][PID:2848679] rsyncing finished.
[2025-07-24 10:17:27,285][  INFO][PID:2848679] Releasing VM back to pool
[2025-07-24 10:17:27,303][  INFO][PID:2848679] Searching for 'success' file in resultdir
[2025-07-24 10:17:27,304][ ERROR][PID:2848679] Build failed: Backend process error: No success file => build failure
[2025-07-24 10:17:27,305][  INFO][PID:2848679] Finished build: id=9313865 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le 
[2025-07-24 10:17:27,307][ ERROR][PID:2848679] Backend process error: No success file => build failure
[2025-07-24 10:17:27,308][  INFO][PID:2848679] Worker failed build, took 10.376803874969482
[2025-07-24 10:17:27,309][  INFO][PID:2848679] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/releng",
            "ended_on": 1753352247.308782,
            "started_on": 1753352236.9319782,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9313865-fedora-42-ppc64le",
            "build_id": 9313865,
            "package_name": "R-jose",
            "package_version": "1.2.0-12",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-jose",
            "git_hash": "1781ae2a3d17918cba09c7f465dfcd139d388327",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09313865-R-jose",
            "built_packages": "",
            "id": 9313865,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-24 10:17:27,354][  INFO][PID:2848679] Sending fedora-messaging bus message in build.end
[2025-07-24 10:17:27,381][  INFO][PID:2848679] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/builder-live.log by gzip
[2025-07-24 10:17:27,384][  INFO][PID:2848679] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/builder-live.log' as PID 3070493
[2025-07-24 10:17:27,386][  INFO][PID:2848679] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/builder-live.log)
[2025-07-24 10:17:27,387][  INFO][PID:2848679] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/backend.log by gzip
[2025-07-24 10:17:27,389][  INFO][PID:2848679] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313865-R-jose/backend.log' as PID 3070494