[2025-07-24 07:01:49,259][  INFO][PID:2065148] Marking build as starting
[2025-07-24 07:01:49,290][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:01:49,291][  INFO][PID:2065148] VM allocation process starts
[2025-07-24 07:01:49,303][  INFO][PID:2065148] Trying to allocate VM: ResallocHost, ticket_id=4087880, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 07:01:52,322][  INFO][PID:2065148] Allocated host ResallocHost, ticket_id=4087880, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05779079_20250724_065701, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 07:01:52,322][  INFO][PID:2065148] Allocating ssh connection to builder
[2025-07-24 07:01:52,323][  INFO][PID:2065148] Checking that builder machine is OK
[2025-07-24 07:01:53,873][  INFO][PID:2065148] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-24 07:01:54,891][  INFO][PID:2065148] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-24 07:01:54,891][  INFO][PID:2065148] Filling build.info file with builder info
[2025-07-24 07:01:54,892][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:01:54,893][  INFO][PID:2065148] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/releng",
            "ended_on": null,
            "started_on": 1753340514.8932698,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9313753-fedora-42-ppc64le",
            "build_id": 9313753,
            "package_name": "R-chron",
            "package_version": "2.3.60-13",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-chron",
            "git_hash": "cf16adeb025ea581c993b14a46c571aa7ba50185",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09313753-R-chron",
            "built_packages": "",
            "id": 9313753,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-24 07:01:54,925][  INFO][PID:2065148] Sending fedora-messaging bus message in build.start
[2025-07-24 07:01:55,604][  INFO][PID:2065148] Sending fedora-messaging bus message in chroot.start
[2025-07-24 07:01:55,629][  INFO][PID:2065148] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313753-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-24 07:01:56,983][  INFO][PID:2065148] Downloading the builder-live.log file, attempt 1
[2025-07-24 07:01:56,985][  INFO][PID:2065148] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-24 07:02:01,991][  INFO][PID:2065148] Periodic builder liveness probe: alive
[2025-07-24 07:02:01,991][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:06,992][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:11,994][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:16,995][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:21,996][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:26,997][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:31,998][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:36,999][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:42,000][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:47,001][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:52,003][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:02:57,005][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:02,006][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:07,007][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:12,008][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:17,010][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:22,011][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:27,012][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:32,015][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:37,017][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:42,018][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:47,019][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:52,020][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:03:57,021][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:02,023][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:07,024][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:12,025][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:17,026][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:22,027][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:27,028][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:32,029][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:37,031][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:42,032][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:47,033][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:52,034][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:04:57,036][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:02,037][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:07,038][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:12,039][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:17,040][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:22,042][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:27,043][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:32,044][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:37,045][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:42,046][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:47,047][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:52,049][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:05:57,050][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:02,053][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:07,054][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:12,055][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:17,056][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:22,057][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:27,058][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:32,060][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:37,061][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:42,062][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:47,063][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:52,064][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:06:57,066][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:02,067][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:07,068][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:12,069][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:17,071][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:22,072][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:27,073][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:32,074][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:37,075][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:42,076][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:47,077][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:52,078][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:07:57,079][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:02,080][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:07,082][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:12,084][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:17,085][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:22,086][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:27,088][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:32,089][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:37,090][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:42,092][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:47,093][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:52,094][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:08:57,095][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:02,096][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:07,097][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:12,098][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:17,099][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:22,100][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:27,102][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:32,104][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:37,105][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:42,106][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:47,107][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:52,108][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:09:57,110][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:02,113][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:07,115][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:12,116][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:17,118][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:22,120][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:27,121][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:32,122][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:37,123][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:42,124][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:47,127][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:52,128][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:10:57,129][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:02,130][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:07,131][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:12,132][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:17,134][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:22,137][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:27,138][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:32,139][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:37,140][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:42,142][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:47,144][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:52,145][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:11:57,146][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:02,153][  INFO][PID:2065148] Periodic builder liveness probe: alive
[2025-07-24 07:12:02,154][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:07,154][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:12,155][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:17,156][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:22,157][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:27,159][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:32,160][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:37,161][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:42,163][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:47,164][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:52,165][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:12:57,166][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:02,167][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:07,168][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:12,169][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:17,170][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:22,171][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:27,172][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:32,174][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:37,175][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:42,176][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:47,177][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:52,178][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:13:57,179][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:02,180][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:07,181][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:12,182][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:17,183][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:22,184][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:27,185][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:32,186][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:37,187][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:42,188][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:47,189][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:52,190][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:14:57,191][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:02,192][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:07,193][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:12,194][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:17,195][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:22,196][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:27,197][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:32,199][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:37,200][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:42,201][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:47,202][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:52,204][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:15:57,205][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:02,206][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:07,208][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:12,209][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:17,210][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:22,211][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:27,212][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:32,213][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:37,214][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:42,215][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:47,216][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:52,218][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:16:57,219][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:02,220][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:07,221][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:12,222][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:17,223][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:22,224][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:27,225][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:32,226][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:37,227][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:42,228][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:47,229][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:52,230][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:17:57,231][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:02,232][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:07,233][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:12,234][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:17,235][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:22,236][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:27,237][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:32,238][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:37,239][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:42,240][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:47,241][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:52,242][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:18:57,243][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:02,244][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:07,245][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:12,247][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:17,248][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:22,249][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:27,250][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:32,251][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:37,252][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:42,253][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:47,254][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:52,255][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:19:57,256][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:02,257][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:07,259][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:12,260][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:17,263][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:22,264][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:27,265][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:32,266][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:37,268][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:42,269][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:47,270][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:52,271][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:20:57,272][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:02,273][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:07,275][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:12,276][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:17,277][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:22,278][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:27,279][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:32,281][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:37,284][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:42,285][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:47,287][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:52,287][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:21:57,289][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:02,295][  INFO][PID:2065148] Periodic builder liveness probe: alive
[2025-07-24 07:22:02,295][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:07,296][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:12,297][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:17,298][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:22,299][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:27,300][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:32,301][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:37,302][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:42,303][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:47,305][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:52,310][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:22:57,311][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:02,312][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:07,313][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:12,314][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:17,315][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:22,317][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:27,318][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:32,319][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:37,320][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:42,321][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:47,322][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:52,323][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:23:57,324][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:02,326][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:07,327][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:12,328][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:17,329][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:22,330][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:27,331][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:32,332][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:37,333][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:42,335][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:47,336][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:52,337][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:24:57,338][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:02,339][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:07,340][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:12,342][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:17,343][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:22,344][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:27,345][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:32,346][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:37,347][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:42,348][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:47,349][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:52,350][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:25:57,352][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:02,353][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:07,354][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:12,355][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:17,356][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:22,357][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:27,358][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:32,359][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:37,360][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:42,361][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:47,363][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:52,364][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:26:57,365][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:02,366][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:07,367][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:12,368][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:17,369][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:22,370][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:27,372][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:32,373][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:37,374][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:42,375][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:47,376][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:52,377][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:27:57,379][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:02,380][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:07,381][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:12,382][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:17,383][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:22,384][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:27,386][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:32,387][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:37,388][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:42,389][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:47,390][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:52,391][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:28:57,392][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:02,399][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:07,400][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:12,402][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:17,403][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:22,404][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:27,405][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:32,407][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:37,408][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:42,409][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:47,410][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:52,411][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:29:57,412][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:02,413][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:07,414][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:12,415][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:17,416][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:22,418][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:27,419][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:32,420][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:37,421][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:42,422][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:47,423][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:52,424][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:30:57,426][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:02,427][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:07,428][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:12,430][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:17,431][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:22,432][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:27,434][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:28,843][ ERROR][PID:2065148] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 07:31:32,436][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:37,437][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:38,844][WARNING][PID:2065148] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 07:31:42,438][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:47,439][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:48,849][  INFO][PID:2065148] Downloading the builder-live.log file, attempt 2
[2025-07-24 07:31:48,850][  INFO][PID:2065148] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.163 copr-rpmbuild-log
[2025-07-24 07:31:52,441][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:31:57,442][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:32:02,450][  INFO][PID:2065148] Periodic builder liveness probe: dead
[2025-07-24 07:32:03,638][  INFO][PID:2065148] Cancel request succeeded
out:
err:
Warning: Permanently added '140.211.168.163' (ED25519) to the list of known hosts.
Unexpected exception
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 86, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2025-07-24 07:33:51,062][ ERROR][PID:2065148] Re-try request for task on 'ResallocHost, ticket_id=4087880, hostname=140.211.168.163, name=copr_osuosl_p09_prod_05779079_20250724_065701, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-24 07:33:51,062][  INFO][PID:2065148] Releasing VM back to pool
[2025-07-24 07:33:51,072][  INFO][PID:2065148] Retry #1 (on other host)
[2025-07-24 07:33:51,073][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:33:51,073][  INFO][PID:2065148] VM allocation process starts
[2025-07-24 07:33:51,118][  INFO][PID:2065148] Trying to allocate VM: ResallocHost, ticket_id=4088224, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 07:33:54,161][  INFO][PID:2065148] Allocated host ResallocHost, ticket_id=4088224, hostname=140.211.168.229, name=copr_osuosl_p09_prod_05779573_20250724_073013, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 07:33:54,162][  INFO][PID:2065148] Allocating ssh connection to builder
[2025-07-24 07:33:54,162][  INFO][PID:2065148] Checking that builder machine is OK
[2025-07-24 07:33:55,597][  INFO][PID:2065148] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-24 07:33:56,624][  INFO][PID:2065148] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-24 07:33:56,625][  INFO][PID:2065148] Filling build.info file with builder info
[2025-07-24 07:33:56,629][  INFO][PID:2065148] Checking for cancel request
[2025-07-24 07:33:56,630][  INFO][PID:2065148] Not re-notifying FE and msg buses for the new host.
[2025-07-24 07:33:56,631][  INFO][PID:2065148] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313753-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-24 07:33:57,885][  INFO][PID:2065148] Downloading the builder-live.log file, attempt 1
[2025-07-24 07:33:57,888][  INFO][PID:2065148] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.229 copr-rpmbuild-log
[2025-07-24 07:34:07,034][  INFO][PID:2065148] Cancel request succeeded
out:
success
err:
Warning: Permanently added '140.211.168.229' (ED25519) to the list of known hosts.

[2025-07-24 07:34:07,035][  INFO][PID:2065148] Downloading results from builder
[2025-07-24 07:34:07,035][  INFO][PID:2065148] rsyncing of mockbuilder@140.211.168.229:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron started
[2025-07-24 07:34:07,036][  INFO][PID:2065148] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@140.211.168.229:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/build-09313753.rsync.log
[2025-07-24 07:34:08,614][  INFO][PID:2065148] rsyncing finished.
[2025-07-24 07:34:08,615][  INFO][PID:2065148] Releasing VM back to pool
[2025-07-24 07:34:08,648][  INFO][PID:2065148] Searching for 'success' file in resultdir
[2025-07-24 07:34:08,649][ ERROR][PID:2065148] Build failed: Backend process error: No success file => build failure
[2025-07-24 07:34:08,650][  INFO][PID:2065148] Finished build: id=9313753 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le 
[2025-07-24 07:34:08,651][ ERROR][PID:2065148] Backend process error: No success file => build failure
[2025-07-24 07:34:08,652][  INFO][PID:2065148] Worker failed build, took 12.021543264389038
[2025-07-24 07:34:08,652][  INFO][PID:2065148] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/releng",
            "ended_on": 1753342448.6523619,
            "started_on": 1753342436.6308186,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9313753-fedora-42-ppc64le",
            "build_id": 9313753,
            "package_name": "R-chron",
            "package_version": "2.3.60-13",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-chron",
            "git_hash": "cf16adeb025ea581c993b14a46c571aa7ba50185",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09313753-R-chron",
            "built_packages": "",
            "id": 9313753,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-24 07:34:08,685][  INFO][PID:2065148] Sending fedora-messaging bus message in build.end
[2025-07-24 07:34:08,710][  INFO][PID:2065148] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/builder-live.log by gzip
[2025-07-24 07:34:08,711][  INFO][PID:2065148] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/builder-live.log' as PID 2230873
[2025-07-24 07:34:08,713][  INFO][PID:2065148] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/builder-live.log)
[2025-07-24 07:34:08,714][  INFO][PID:2065148] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/backend.log by gzip
[2025-07-24 07:34:08,715][  INFO][PID:2065148] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313753-R-chron/backend.log' as PID 2230875