[2025-07-24 05:26:02,928][ INFO][PID:1572758] Marking build as starting [2025-07-24 05:26:02,973][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:02,973][ INFO][PID:1572758] VM allocation process starts [2025-07-24 05:26:02,988][ INFO][PID:1572758] Trying to allocate VM: ResallocHost, ticket_id=4086757, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:26:07,990][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:12,991][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:17,992][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:22,993][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:27,995][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:32,996][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:37,998][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:42,999][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:48,001][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:53,002][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:26:58,006][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:03,008][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:08,010][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:13,011][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:18,013][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:23,015][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:28,016][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:33,019][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:38,020][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:43,021][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:48,026][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:53,028][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:27:58,030][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:03,041][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:08,043][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:13,049][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:18,051][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:23,055][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:28,058][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:33,059][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:38,060][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:43,061][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:48,063][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:53,064][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:28:58,065][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:03,066][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:08,067][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:13,069][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:18,070][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:23,071][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:28,072][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:33,073][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:38,074][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:43,076][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:48,077][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:53,078][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:29:58,079][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:03,080][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:08,081][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:13,082][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:18,083][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:21,127][ INFO][PID:1572758] Allocated host ResallocHost, ticket_id=4086757, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05778077_20250724_052358, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:30:21,128][ INFO][PID:1572758] Allocating ssh connection to builder [2025-07-24 05:30:21,128][ INFO][PID:1572758] Checking that builder machine is OK [2025-07-24 05:30:22,415][ INFO][PID:1572758] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 05:30:23,409][ INFO][PID:1572758] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 05:30:23,410][ INFO][PID:1572758] Filling build.info file with builder info [2025-07-24 05:30:23,410][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:23,411][ INFO][PID:1572758] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": null, "started_on": 1753335023.4114087, "submitted_on": null, "status": 3, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9313673-fedora-42-ppc64le", "build_id": 9313673, "package_name": "R-RMariaDB", "package_version": "1.2.2-13", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-RMariaDB", "git_hash": "8a6505c5aaa78a93350557602325965d14d61d6b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09313673-R-RMariaDB", "built_packages": "", "id": 9313673, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-24 05:30:23,446][ INFO][PID:1572758] Sending fedora-messaging bus message in build.start [2025-07-24 05:30:24,139][ INFO][PID:1572758] Sending fedora-messaging bus message in chroot.start [2025-07-24 05:30:24,165][ INFO][PID:1572758] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313673-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 05:30:25,338][ INFO][PID:1572758] Downloading the builder-live.log file, attempt 1 [2025-07-24 05:30:25,339][ INFO][PID:1572758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 05:30:30,343][ INFO][PID:1572758] Periodic builder liveness probe: alive [2025-07-24 05:30:30,344][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:35,345][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:40,346][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:45,347][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:50,348][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:30:55,349][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:00,351][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:05,352][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:10,353][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:15,354][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:20,356][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:25,357][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:30,358][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:35,359][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:40,597][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:45,598][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:50,599][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:31:55,601][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:00,602][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:05,602][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:10,604][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:15,605][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:20,606][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:25,607][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:30,608][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:35,609][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:40,610][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:45,611][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:50,613][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:32:55,614][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:00,615][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:05,616][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:10,617][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:15,618][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:20,619][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:25,621][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:30,626][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:35,627][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:40,628][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:45,629][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:50,630][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:33:55,631][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:00,632][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:05,633][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:10,635][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:15,636][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:20,637][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:25,638][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:30,639][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:35,640][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:40,641][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:45,643][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:50,644][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:34:55,645][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:00,646][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:05,647][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:10,648][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:15,649][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:20,650][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:25,651][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:30,652][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:35,653][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:40,655][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:45,655][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:50,656][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:35:55,658][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:00,659][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:05,661][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:10,662][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:15,665][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:20,666][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:25,681][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:30,725][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:35,727][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:40,729][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:45,968][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:51,136][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:36:56,146][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:01,211][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:06,351][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:11,532][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:16,751][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:22,154][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:27,157][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:32,159][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:37,163][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:42,165][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:47,166][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:52,168][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:37:57,169][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:02,170][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:07,171][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:12,173][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:17,174][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:22,175][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:27,176][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:32,177][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:37,184][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:42,298][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:48,166][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:53,171][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:38:58,173][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:03,198][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:08,209][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:13,364][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:18,691][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:23,953][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:29,241][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:34,537][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:39,823][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:45,108][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:50,263][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:39:55,274][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:00,776][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:05,813][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:10,973][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:16,298][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:21,299][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:26,301][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:31,307][ INFO][PID:1572758] Periodic builder liveness probe: alive [2025-07-24 05:40:31,308][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:36,309][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:41,310][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:46,311][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:51,312][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:40:56,316][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:01,318][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:06,320][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:11,321][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:16,323][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:21,325][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:26,327][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:31,328][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:36,330][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:41,331][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:46,334][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:51,338][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:41:56,358][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:01,359][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:06,618][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:11,624][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:16,625][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:21,799][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:26,859][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:32,043][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:37,045][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:42,316][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:47,570][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:52,609][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:42:57,713][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:02,860][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:07,922][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:13,053][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:18,278][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:23,350][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:28,746][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:33,813][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:38,817][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:43,821][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:48,827][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:53,828][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:43:59,135][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:04,138][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:09,140][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:14,144][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:19,145][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:24,146][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:29,147][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:34,149][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:39,155][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:44,158][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:49,165][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:54,166][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:44:59,167][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:04,168][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:09,342][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:14,449][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:19,506][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:24,544][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:29,551][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:34,553][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:39,555][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:44,563][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:49,565][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:54,567][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:45:59,568][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:04,570][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:09,572][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:14,574][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:19,576][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:24,579][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:29,586][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:34,587][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:39,588][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:44,590][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:49,591][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:54,592][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:46:59,593][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:04,595][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:09,596][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:14,599][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:19,600][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:24,606][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:29,619][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:34,621][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:39,622][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:44,624][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:49,627][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:54,642][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:47:59,643][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:04,645][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:09,646][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:14,647][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:19,648][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:24,649][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:29,650][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:34,652][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:39,655][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:44,656][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:49,658][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:54,661][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:48:59,664][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:04,665][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:09,668][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:14,669][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:19,674][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:24,682][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:29,686][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:34,687][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:39,692][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:44,694][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:49,695][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:54,696][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:49:59,698][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:04,700][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:09,703][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:14,708][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:19,714][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:24,716][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:29,718][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:50:34,735][ INFO][PID:1572758] Periodic builder liveness probe: dead [2025-07-24 05:51:34,887][ ERROR][PID:1572758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.89 port 22 timed out [2025-07-24 05:52:45,025][ ERROR][PID:1572758] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.89 port 22 timed out [2025-07-24 05:53:55,165][ ERROR][PID:1572758] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.89 port 22 timed out [2025-07-24 05:55:05,236][ ERROR][PID:1572758] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.89 port 22: Connection timed out [2025-07-24 05:55:15,238][ ERROR][PID:1572758] Can't ssh to cancel build. [2025-07-24 05:55:26,144][ ERROR][PID:1572758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:55:36,145][WARNING][PID:1572758] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:55:46,145][ INFO][PID:1572758] Downloading the builder-live.log file, attempt 2 [2025-07-24 05:55:46,147][ INFO][PID:1572758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 05:56:46,215][ ERROR][PID:1572758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:56:56,220][WARNING][PID:1572758] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:57:06,220][ INFO][PID:1572758] Downloading the builder-live.log file, attempt 3 [2025-07-24 05:57:06,222][ INFO][PID:1572758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 05:58:06,290][ ERROR][PID:1572758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:58:16,291][WARNING][PID:1572758] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-24 05:58:26,291][ INFO][PID:1572758] Downloading the builder-live.log file, attempt 4 [2025-07-24 05:58:26,293][ INFO][PID:1572758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-24 05:59:26,360][ ERROR][PID:1572758] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-24 05:59:36,361][ ERROR][PID:1572758] Giving up for unstable SSH, failures: 1753336536.145029, 1753336616.2201102, 1753336696.2910788, 1753336776.3612587 [2025-07-24 05:59:36,362][ ERROR][PID:1572758] Re-try request for task on 'ResallocHost, ticket_id=4086757, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05778077_20250724_052358, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-24 05:59:36,362][ INFO][PID:1572758] Releasing VM back to pool [2025-07-24 05:59:36,371][ INFO][PID:1572758] Retry #1 (on other host) [2025-07-24 05:59:36,372][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:59:36,373][ INFO][PID:1572758] VM allocation process starts [2025-07-24 05:59:36,411][ INFO][PID:1572758] Trying to allocate VM: ResallocHost, ticket_id=4087102, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:59:39,474][ INFO][PID:1572758] Allocated host ResallocHost, ticket_id=4087102, hostname=2620:52:3:1:dead:beef:cafe:c20e, name=copr_hv_ppc64le_01_prod_05778337_20250724_055325, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-24 05:59:39,475][ INFO][PID:1572758] Allocating ssh connection to builder [2025-07-24 05:59:39,475][ INFO][PID:1572758] Checking that builder machine is OK [2025-07-24 05:59:42,396][ INFO][PID:1572758] Running remote command: copr-builder-ready fedora-42-ppc64le [2025-07-24 05:59:43,947][ INFO][PID:1572758] Red Hat subscription not needed for fedora-42-ppc64le Builder is ready to be used [2025-07-24 05:59:43,947][ INFO][PID:1572758] Filling build.info file with builder info [2025-07-24 05:59:43,951][ INFO][PID:1572758] Checking for cancel request [2025-07-24 05:59:43,952][ INFO][PID:1572758] Not re-notifying FE and msg buses for the new host. [2025-07-24 05:59:43,953][ INFO][PID:1572758] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9313673-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached [2025-07-24 05:59:47,390][ INFO][PID:1572758] Downloading the builder-live.log file, attempt 1 [2025-07-24 05:59:47,391][ INFO][PID:1572758] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20e copr-rpmbuild-log [2025-07-24 05:59:56,806][ INFO][PID:1572758] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20e' (ED25519) to the list of known hosts. [2025-07-24 05:59:56,807][ INFO][PID:1572758] Downloading results from builder [2025-07-24 05:59:56,808][ INFO][PID:1572758] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB started [2025-07-24 05:59:56,808][ INFO][PID:1572758] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/build-09313673.rsync.log [2025-07-24 05:59:58,398][ INFO][PID:1572758] rsyncing finished. [2025-07-24 05:59:58,398][ INFO][PID:1572758] Releasing VM back to pool [2025-07-24 05:59:58,407][ INFO][PID:1572758] Searching for 'success' file in resultdir [2025-07-24 05:59:58,408][ ERROR][PID:1572758] Build failed: Backend process error: No success file => build failure [2025-07-24 05:59:58,408][ INFO][PID:1572758] Finished build: id=9313673 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-42-ppc64le [2025-07-24 05:59:58,410][ ERROR][PID:1572758] Backend process error: No success file => build failure [2025-07-24 05:59:58,410][ INFO][PID:1572758] Worker failed build, took 14.45838713645935 [2025-07-24 05:59:58,411][ INFO][PID:1572758] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": 1753336798.4108672, "started_on": 1753336783.95248, "submitted_on": null, "status": 0, "chroot": "fedora-42-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9313673-fedora-42-ppc64le", "build_id": 9313673, "package_name": "R-RMariaDB", "package_version": "1.2.2-13", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/R-RMariaDB", "git_hash": "8a6505c5aaa78a93350557602325965d14d61d6b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09313673-R-RMariaDB", "built_packages": "", "id": 9313673, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-24 05:59:58,443][ INFO][PID:1572758] Sending fedora-messaging bus message in build.end [2025-07-24 05:59:58,468][ INFO][PID:1572758] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/builder-live.log by gzip [2025-07-24 05:59:58,470][ INFO][PID:1572758] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/builder-live.log' as PID 1734381 [2025-07-24 05:59:58,471][ INFO][PID:1572758] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/builder-live.log) [2025-07-24 05:59:58,472][ INFO][PID:1572758] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/backend.log by gzip [2025-07-24 05:59:58,473][ INFO][PID:1572758] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-42-ppc64le/09313673-R-RMariaDB/backend.log' as PID 1734382