[2025-07-24 09:51:42,342][ INFO][PID:2917590] Marking build as starting [2025-07-24 09:51:42,395][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:51:42,395][ INFO][PID:2917590] VM allocation process starts [2025-07-24 09:51:42,410][ INFO][PID:2917590] Trying to allocate VM: ResallocHost, ticket_id=4089897, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 09:51:45,428][ INFO][PID:2917590] Allocated host ResallocHost, ticket_id=4089897, hostname=140.211.168.189, name=copr_osuosl_p09_prod_05781100_20250724_094721, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 09:51:45,429][ INFO][PID:2917590] Allocating ssh connection to builder [2025-07-24 09:51:45,429][ INFO][PID:2917590] Checking that builder machine is OK [2025-07-24 09:51:46,954][ INFO][PID:2917590] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 09:51:48,001][ INFO][PID:2917590] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 09:51:48,002][ INFO][PID:2917590] Filling build.info file with builder info [2025-07-24 09:51:48,003][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:51:48,004][ INFO][PID:2917590] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": null, "started_on": 1753350708.003845, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9313871-fedora-42-ppc64le", "build_id": 9313871, "package_name": "R-lambda.r", "package_version": "1.2.4-22", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-lambda.r", "git_hash": "2cc61743f4e38cbd7f765e38e2274d325c485069", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09313871-R-lambda.r", "built_packages": "", "id": 9313871, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-24 09:51:48,038][ INFO][PID:2917590] Sending fedora-messaging bus message in build.start [2025-07-24 09:51:48,738][ INFO][PID:2917590] Sending fedora-messaging bus message in chroot.start [2025-07-24 09:51:48,766][ INFO][PID:2917590] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313871-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 09:51:50,085][ INFO][PID:2917590] Downloading the builder-live.log file, attempt 1 [2025-07-24 09:51:50,087][ INFO][PID:2917590] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-07-24 09:51:55,092][ INFO][PID:2917590] Periodic builder liveness probe: alive [2025-07-24 09:51:55,093][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:00,094][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:05,096][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:10,097][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:15,098][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:20,099][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:25,100][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:30,102][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:35,103][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:40,104][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:45,105][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:50,107][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:52:55,108][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:00,109][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:05,110][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:10,111][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:15,112][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:20,113][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:25,114][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:30,115][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:35,116][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:40,117][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:45,119][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:50,119][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:53:55,121][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:00,122][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:05,123][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:10,124][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:15,126][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:20,128][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:25,129][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:30,133][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:35,134][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:40,137][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:45,138][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:50,139][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:54:55,141][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:00,142][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:05,143][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:10,144][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:15,145][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:20,146][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:25,149][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:30,150][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:35,151][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:40,153][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:45,154][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:50,155][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:55:55,156][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:00,157][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:05,158][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:10,159][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:15,160][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:20,161][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:25,162][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:30,163][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:35,164][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:40,165][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:45,166][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:50,167][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:56:55,168][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:00,169][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:05,170][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:10,171][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:15,173][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:20,174][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:25,175][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:30,176][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:35,177][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:40,178][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:45,179][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:50,180][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:57:55,181][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:00,182][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:05,183][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:10,185][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:15,186][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:20,187][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:25,188][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:30,189][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:35,190][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:40,191][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:45,192][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:50,193][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:58:55,194][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:00,195][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:05,196][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:10,197][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:15,199][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:20,200][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:25,201][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:30,202][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:35,203][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:40,204][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:45,205][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:50,207][ INFO][PID:2917590] Checking for cancel request [2025-07-24 09:59:55,210][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:00,211][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:05,212][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:10,213][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:15,214][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:20,215][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:25,216][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:30,217][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:35,218][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:40,219][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:45,220][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:50,221][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:00:55,222][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:00,223][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:05,224][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:10,225][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:15,226][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:20,227][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:25,229][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:30,230][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:35,231][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:40,232][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:45,233][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:50,235][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:01:55,240][ INFO][PID:2917590] Periodic builder liveness probe: alive [2025-07-24 10:01:55,241][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:00,242][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:05,243][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:10,244][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:15,245][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:20,246][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:25,247][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:30,248][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:35,249][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:40,250][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:45,251][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:50,252][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:02:55,253][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:00,254][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:05,255][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:10,256][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:15,257][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:20,259][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:25,260][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:30,261][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:35,262][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:40,263][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:45,264][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:50,269][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:03:55,270][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:00,272][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:05,273][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:10,275][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:15,276][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:20,277][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:25,278][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:30,279][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:35,280][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:40,281][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:45,283][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:50,284][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:04:55,285][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:00,286][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:05,287][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:10,288][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:15,289][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:20,291][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:25,301][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:30,305][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:35,306][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:40,307][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:45,309][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:50,310][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:05:55,311][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:00,312][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:05,313][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:10,314][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:15,315][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:20,316][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:25,317][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:30,318][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:35,319][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:40,320][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:45,322][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:50,323][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:06:55,324][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:00,325][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:05,327][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:10,328][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:15,331][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:20,335][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:25,338][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:30,342][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:35,350][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:40,355][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:45,361][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:50,364][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:07:55,366][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:00,373][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:05,375][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:10,376][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:15,378][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:20,382][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:25,389][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:30,393][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:35,396][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:40,398][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:45,402][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:50,405][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:08:55,407][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:00,410][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:05,417][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:10,419][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:15,421][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:20,427][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:25,432][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:30,446][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:35,451][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:40,456][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:45,458][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:50,461][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:09:55,463][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:00,468][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:05,475][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:10,480][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:15,483][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:20,485][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:25,490][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:30,491][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:35,498][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:40,506][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:45,509][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:50,511][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:10:55,513][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:00,516][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:05,523][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:10,533][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:15,541][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:20,542][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:25,550][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:30,552][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:35,553][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:40,558][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:45,560][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:50,562][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:11:55,590][ INFO][PID:2917590] Periodic builder liveness probe: alive [2025-07-24 10:11:55,592][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:00,600][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:05,606][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:10,609][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:15,613][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:20,616][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:25,618][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:30,621][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:35,624][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:40,631][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:45,633][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:50,635][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:12:55,640][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:00,648][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:05,651][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:10,652][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:15,660][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:20,667][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:25,669][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:30,672][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:35,674][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:40,677][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:45,679][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:50,682][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:13:55,685][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:00,687][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:05,698][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:10,700][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:15,702][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:20,706][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:25,715][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:30,724][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:35,728][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:40,729][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:45,733][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:50,736][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:14:55,738][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:00,741][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:05,747][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:10,749][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:15,757][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:20,758][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:25,760][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:30,762][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:35,773][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:40,775][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:45,776][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:50,778][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:15:55,783][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:00,786][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:05,787][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:10,788][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:15,793][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:20,798][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:25,804][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:30,805][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:35,815][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:40,823][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:45,825][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:50,831][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:16:55,838][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:00,840][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:05,846][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:10,850][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:15,851][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:20,852][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:25,854][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:30,855][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:35,856][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:40,859][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:45,860][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:50,861][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:17:55,864][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:00,866][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:05,867][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:10,869][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:15,870][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:20,871][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:25,872][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:30,874][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:35,875][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:40,876][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:45,878][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:50,879][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:18:55,881][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:00,882][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:05,883][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:10,885][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:15,886][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:20,887][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:25,889][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:30,890][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:35,892][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:40,895][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:45,896][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:50,897][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:19:55,901][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:00,903][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:05,904][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:10,905][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:15,906][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:20,907][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:25,908][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:30,910][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:35,911][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:40,912][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:45,913][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:50,914][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:20:55,915][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:00,916][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:05,917][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:10,918][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:15,920][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:20,921][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:25,922][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:30,923][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:35,924][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:40,925][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:45,926][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:50,927][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:21:55,933][ INFO][PID:2917590] Periodic builder liveness probe: dead [2025-07-24 10:21:57,139][ ERROR][PID:2917590] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:22:07,139][WARNING][PID:2917590] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 10:22:17,140][ INFO][PID:2917590] Downloading the builder-live.log file, attempt 2 [2025-07-24 10:22:17,142][ INFO][PID:2917590] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-07-24 10:22:56,003][ ERROR][PID:2917590] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.189 port 22: Connection timed out [2025-07-24 10:23:17,210][ ERROR][PID:2917590] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:23:27,211][WARNING][PID:2917590] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 10:23:37,212][ INFO][PID:2917590] Downloading the builder-live.log file, attempt 3 [2025-07-24 10:23:37,213][ INFO][PID:2917590] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-07-24 10:24:06,072][ ERROR][PID:2917590] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.189 port 22: Connection timed out [2025-07-24 10:24:37,281][ ERROR][PID:2917590] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:24:47,283][WARNING][PID:2917590] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 10:24:57,284][ INFO][PID:2917590] Downloading the builder-live.log file, attempt 4 [2025-07-24 10:24:57,285][ INFO][PID:2917590] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.189 copr-rpmbuild-log [2025-07-24 10:25:16,142][ ERROR][PID:2917590] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.189 port 22: Connection timed out [2025-07-24 10:25:57,353][ ERROR][PID:2917590] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 10:26:07,355][ ERROR][PID:2917590] Giving up for unstable SSH, failures: 1753352527.1397688, 1753352607.211504, 1753352687.2836661, 1753352767.3552918 [2025-07-24 10:26:26,211][ ERROR][PID:2917590] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.189 port 22: Connection timed out [2025-07-24 10:26:36,212][ ERROR][PID:2917590] Can't ssh to cancel build. [2025-07-24 10:26:36,213][ ERROR][PID:2917590] Re-try request for task on 'ResallocHost, ticket_id=4089897, hostname=140.211.168.189, name=copr_osuosl_p09_prod_05781100_20250724_094721, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-24 10:26:36,213][ INFO][PID:2917590] Releasing VM back to pool [2025-07-24 10:26:36,223][ INFO][PID:2917590] Retry #1 (on other host) [2025-07-24 10:26:36,223][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:26:36,224][ INFO][PID:2917590] VM allocation process starts [2025-07-24 10:26:36,278][ INFO][PID:2917590] Trying to allocate VM: ResallocHost, ticket_id=4090439, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 10:26:39,333][ INFO][PID:2917590] Allocated host ResallocHost, ticket_id=4090439, hostname=2620:52:3:1:dead:beef:cafe:c20f, name=copr_hv_ppc64le_01_prod_05781492_20250724_101609, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 10:26:39,333][ INFO][PID:2917590] Allocating ssh connection to builder [2025-07-24 10:26:39,334][ INFO][PID:2917590] Checking that builder machine is OK [2025-07-24 10:26:40,643][ INFO][PID:2917590] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 10:26:41,267][ INFO][PID:2917590] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 10:26:41,267][ INFO][PID:2917590] Filling build.info file with builder info [2025-07-24 10:26:41,271][ INFO][PID:2917590] Checking for cancel request [2025-07-24 10:26:41,272][ INFO][PID:2917590] Not re-notifying FE and msg buses for the new host. [2025-07-24 10:26:41,272][ INFO][PID:2917590] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313871-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 10:26:42,028][ INFO][PID:2917590] Downloading the builder-live.log file, attempt 1 [2025-07-24 10:26:42,030][ INFO][PID:2917590] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20f copr-rpmbuild-log [2025-07-24 10:26:54,097][ INFO][PID:2917590] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20f' (ED25519) to the list of known hosts. [2025-07-24 10:26:54,098][ INFO][PID:2917590] Downloading results from builder [2025-07-24 10:26:54,098][ INFO][PID:2917590] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r started [2025-07-24 10:26:54,099][ INFO][PID:2917590] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/build-09313871.rsync.log [2025-07-24 10:26:54,696][ INFO][PID:2917590] rsyncing finished. [2025-07-24 10:26:54,697][ INFO][PID:2917590] Releasing VM back to pool [2025-07-24 10:26:54,705][ INFO][PID:2917590] Searching for 'success' file in resultdir [2025-07-24 10:26:54,706][ ERROR][PID:2917590] Build failed: Backend process error: No success file => build failure [2025-07-24 10:26:54,707][ INFO][PID:2917590] Finished build: id=9313871 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le [2025-07-24 10:26:54,709][ ERROR][PID:2917590] Backend process error: No success file => build failure [2025-07-24 10:26:54,709][ INFO][PID:2917590] Worker failed build, took 13.437415838241577 [2025-07-24 10:26:54,710][ INFO][PID:2917590] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": 1753352814.7095914, "started_on": 1753352801.2721756, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9313871-fedora-42-ppc64le", "build_id": 9313871, "package_name": "R-lambda.r", "package_version": "1.2.4-22", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-lambda.r", "git_hash": "2cc61743f4e38cbd7f765e38e2274d325c485069", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09313871-R-lambda.r", "built_packages": "", "id": 9313871, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-24 10:26:54,842][ INFO][PID:2917590] Sending fedora-messaging bus message in build.end [2025-07-24 10:26:54,866][ INFO][PID:2917590] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/builder-live.log by gzip [2025-07-24 10:26:54,867][ INFO][PID:2917590] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/builder-live.log' as PID 3124430 [2025-07-24 10:26:54,869][ INFO][PID:2917590] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/builder-live.log) [2025-07-24 10:26:54,869][ INFO][PID:2917590] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/backend.log by gzip [2025-07-24 10:26:54,870][ INFO][PID:2917590] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313871-R-lambda.r/backend.log' as PID 3124432