[2025-07-16 01:24:34,985][ INFO][PID:3076019] Marking build as starting [2025-07-16 01:24:35,158][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:24:35,159][ INFO][PID:3076019] VM allocation process starts [2025-07-16 01:24:35,172][ INFO][PID:3076019] Trying to allocate VM: ResallocHost, ticket_id=3949253, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-16 01:24:40,175][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:24:45,176][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:24:50,178][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:24:55,180][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:00,181][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:05,184][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:10,185][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:15,187][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:20,191][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:25,192][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:30,194][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:35,197][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:40,198][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:45,200][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:50,201][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:25:55,202][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:00,203][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:05,204][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:10,205][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:15,206][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:20,208][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:25,210][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:30,211][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:35,212][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:40,214][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:45,220][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:50,227][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:26:55,231][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:00,236][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:05,238][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:10,239][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:15,241][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:20,242][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:25,243][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:30,244][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:35,245][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:40,246][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:45,247][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:50,252][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:27:55,253][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:00,255][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:05,257][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:10,259][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:15,260][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:20,261][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:25,263][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:30,264][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:35,265][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:40,266][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:45,267][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:50,268][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:28:55,270][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:00,272][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:05,273][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:10,274][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:15,275][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:20,276][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:25,277][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:30,278][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:35,279][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:40,281][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:45,282][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:50,283][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:29:55,285][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:00,286][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:05,287][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:10,289][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:15,290][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:20,291][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:25,293][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:30,294][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:35,295][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:40,296][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:45,298][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:50,299][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:30:55,300][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:00,307][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:05,309][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:10,315][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:15,319][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:20,324][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:25,328][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:30,330][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:35,333][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:40,334][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:45,337][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:50,358][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:53,362][ INFO][PID:3076019] Allocated host ResallocHost, ticket_id=3949253, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05440059_20250716_012820, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-16 01:31:53,363][ INFO][PID:3076019] Allocating ssh connection to builder [2025-07-16 01:31:53,364][ INFO][PID:3076019] Checking that builder machine is OK [2025-07-16 01:31:54,878][ INFO][PID:3076019] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-16 01:31:55,943][ INFO][PID:3076019] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-16 01:31:55,944][ INFO][PID:3076019] Filling build.info file with builder info [2025-07-16 01:31:55,945][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:31:55,948][ INFO][PID:3076019] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1752629515.947954, "submitted_on": null, "status": 3, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9277767-fedora-eln-ppc64le", "build_id": 9277767, "package_name": "libcomps", "package_version": "0.1.21-20250716011915.5.g702ec14", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libcomps", "git_hash": "2138556e43bc9fcb1f80d2b487343bdf7147f6ae", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09277767-libcomps", "built_packages": "", "id": 9277767, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-07-16 01:31:55,996][ INFO][PID:3076019] Sending fedora-messaging bus message in build.start [2025-07-16 01:31:57,104][ INFO][PID:3076019] Sending fedora-messaging bus message in chroot.start [2025-07-16 01:31:57,144][ INFO][PID:3076019] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9277767-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-16 01:31:58,438][ INFO][PID:3076019] Downloading the builder-live.log file, attempt 1 [2025-07-16 01:31:58,446][ INFO][PID:3076019] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-16 01:32:03,453][ INFO][PID:3076019] Periodic builder liveness probe: alive [2025-07-16 01:32:03,455][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:08,457][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:13,459][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:18,464][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:23,465][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:28,466][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:33,468][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:38,469][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:43,471][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:48,472][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:53,475][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:32:58,479][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:03,481][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:08,483][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:13,485][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:18,486][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:23,488][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:28,489][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:33,490][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:38,492][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:43,493][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:48,494][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:53,495][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:33:58,497][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:03,498][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:08,499][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:13,500][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:18,502][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:23,506][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:28,512][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:33,513][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:38,514][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:43,516][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:48,517][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:53,518][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:34:58,519][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:03,520][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:08,521][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:13,523][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:18,525][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:23,528][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:28,530][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:33,532][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:38,534][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:43,536][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:48,545][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:53,552][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:35:58,562][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:03,568][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:08,577][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:13,587][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:18,589][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:23,591][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:28,595][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:33,598][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:38,600][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:43,601][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:48,603][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:53,606][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:36:58,611][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:03,612][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:08,614][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:13,615][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:18,617][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:23,618][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:28,619][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:33,620][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:38,621][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:43,622][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:48,624][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:53,625][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:37:58,626][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:03,627][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:08,628][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:13,630][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:18,635][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:23,636][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:28,637][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:33,638][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:38,639][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:43,640][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:48,641][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:53,642][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:38:58,644][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:03,645][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:08,646][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:13,647][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:18,648][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:23,649][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:28,650][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:33,651][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:38,652][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:43,654][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:48,656][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:53,657][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:39:58,658][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:03,659][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:08,660][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:13,661][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:18,662][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:23,663][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:28,664][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:33,665][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:38,666][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:43,667][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:48,668][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:53,669][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:40:58,670][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:03,671][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:08,672][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:13,674][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:18,675][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:23,676][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:28,677][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:33,678][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:38,679][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:43,680][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:48,682][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:53,683][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:41:58,684][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:03,694][ INFO][PID:3076019] Periodic builder liveness probe: alive [2025-07-16 01:42:03,695][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:08,696][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:13,698][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:18,699][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:23,701][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:28,702][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:33,703][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:38,705][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:43,706][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:48,707][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:53,711][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:42:58,712][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:03,713][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:08,715][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:13,716][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:18,717][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:23,718][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:28,719][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:33,721][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:38,722][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:43,723][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:48,724][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:53,725][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:43:58,727][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:03,728][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:08,729][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:13,730][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:18,730][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:23,732][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:28,733][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:33,734][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:38,735][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:43,737][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:48,739][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:53,740][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:44:58,741][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:03,742][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:08,743][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:13,744][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:18,745][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:23,746][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:28,747][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:33,749][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:38,750][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:43,751][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:48,752][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:53,753][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:45:58,754][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:03,755][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:08,756][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:13,757][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:18,758][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:23,759][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:28,760][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:33,762][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:38,763][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:43,764][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:48,765][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:53,766][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:46:58,767][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:03,769][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:08,770][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:13,771][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:18,772][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:23,773][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:28,774][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:33,775][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:38,776][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:43,777][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:48,778][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:53,779][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:47:58,781][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:03,782][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:08,783][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:13,784][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:18,785][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:23,786][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:28,787][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:33,788][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:38,790][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:43,791][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:48,792][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:53,793][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:48:58,794][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:03,795][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:08,796][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:13,798][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:18,799][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:23,800][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:28,801][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:33,802][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:38,803][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:43,804][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:48,806][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:53,807][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:49:58,808][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:03,809][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:08,810][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:13,811][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:18,812][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:23,813][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:28,814][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:33,815][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:38,816][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:43,817][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:48,818][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:53,819][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:50:58,820][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:03,821][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:08,823][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:13,824][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:18,825][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:23,826][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:28,827][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:33,828][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:38,829][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:43,830][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:48,831][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:53,832][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:51:58,833][ INFO][PID:3076019] Checking for cancel request [2025-07-16 01:52:03,841][ INFO][PID:3076019] Periodic builder liveness probe: dead [2025-07-16 01:53:03,978][ ERROR][PID:3076019] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.89 port 22 timed out [2025-07-16 01:54:14,117][ ERROR][PID:3076019] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.89 port 22 timed out [2025-07-16 01:55:24,255][ ERROR][PID:3076019] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: Connection timed out during banner exchange Connection to 140.211.168.89 port 22 timed out [2025-07-16 01:56:34,324][ ERROR][PID:3076019] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.89 port 22: Connection timed out [2025-07-16 01:56:44,325][ ERROR][PID:3076019] Can't ssh to cancel build. [2025-07-16 01:57:12,144][ ERROR][PID:3076019] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-16 01:57:22,147][WARNING][PID:3076019] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-16 01:57:32,148][ INFO][PID:3076019] Downloading the builder-live.log file, attempt 2 [2025-07-16 01:57:32,150][ INFO][PID:3076019] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-16 01:58:32,217][ ERROR][PID:3076019] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-16 01:58:42,221][WARNING][PID:3076019] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-16 01:58:52,222][ INFO][PID:3076019] Downloading the builder-live.log file, attempt 3 [2025-07-16 01:58:52,223][ INFO][PID:3076019] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-16 01:59:52,290][ ERROR][PID:3076019] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-16 02:00:02,291][WARNING][PID:3076019] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-16 02:00:12,292][ INFO][PID:3076019] Downloading the builder-live.log file, attempt 4 [2025-07-16 02:00:12,293][ INFO][PID:3076019] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.89 copr-rpmbuild-log [2025-07-16 02:01:12,361][ ERROR][PID:3076019] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-16 02:01:22,365][ ERROR][PID:3076019] Giving up for unstable SSH, failures: 1752631042.1474454, 1752631122.2216048, 1752631202.291722, 1752631282.365758 [2025-07-16 02:01:22,366][ ERROR][PID:3076019] Re-try request for task on 'ResallocHost, ticket_id=3949253, hostname=140.211.168.89, name=copr_osuosl_p09_prod_05440059_20250716_012820, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-16 02:01:22,367][ INFO][PID:3076019] Releasing VM back to pool [2025-07-16 02:01:22,378][ INFO][PID:3076019] Retry #1 (on other host) [2025-07-16 02:01:22,379][ INFO][PID:3076019] Checking for cancel request [2025-07-16 02:01:22,380][ INFO][PID:3076019] VM allocation process starts [2025-07-16 02:01:22,391][ INFO][PID:3076019] Trying to allocate VM: ResallocHost, ticket_id=3949752, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-16 02:01:25,404][ INFO][PID:3076019] Allocated host ResallocHost, ticket_id=3949752, hostname=2620:52:3:1:dead:beef:cafe:c29d, name=copr_p09_01_prod_05440527_20250716_014608, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-07-16 02:01:25,405][ INFO][PID:3076019] Allocating ssh connection to builder [2025-07-16 02:01:25,405][ INFO][PID:3076019] Checking that builder machine is OK [2025-07-16 02:01:26,377][ INFO][PID:3076019] Running remote command: copr-builder-ready fedora-eln-ppc64le [2025-07-16 02:01:26,833][ INFO][PID:3076019] Red Hat subscription not needed for fedora-eln-ppc64le Builder is ready to be used [2025-07-16 02:01:26,833][ INFO][PID:3076019] Filling build.info file with builder info [2025-07-16 02:01:26,837][ INFO][PID:3076019] Checking for cancel request [2025-07-16 02:01:26,838][ INFO][PID:3076019] Not re-notifying FE and msg buses for the new host. [2025-07-16 02:01:26,839][ INFO][PID:3076019] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9277767-fedora-eln-ppc64le --chroot fedora-eln-ppc64le --detached [2025-07-16 02:01:27,726][ INFO][PID:3076019] Downloading the builder-live.log file, attempt 1 [2025-07-16 02:01:27,727][ INFO][PID:3076019] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c29d copr-rpmbuild-log [2025-07-16 02:01:36,471][ INFO][PID:3076019] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29d' (ED25519) to the list of known hosts. [2025-07-16 02:01:36,472][ INFO][PID:3076019] Downloading results from builder [2025-07-16 02:01:36,474][ INFO][PID:3076019] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c29d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps started [2025-07-16 02:01:36,476][ INFO][PID:3076019] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c29d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/build-09277767.rsync.log [2025-07-16 02:01:36,991][ INFO][PID:3076019] rsyncing finished. [2025-07-16 02:01:36,992][ INFO][PID:3076019] Releasing VM back to pool [2025-07-16 02:01:37,007][ INFO][PID:3076019] Searching for 'success' file in resultdir [2025-07-16 02:01:37,007][ ERROR][PID:3076019] Build failed: Backend process error: No success file => build failure [2025-07-16 02:01:37,008][ INFO][PID:3076019] Finished build: id=9277767 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-eln-ppc64le [2025-07-16 02:01:37,009][ ERROR][PID:3076019] Backend process error: No success file => build failure [2025-07-16 02:01:37,010][ INFO][PID:3076019] Worker failed build, took 10.171635627746582 [2025-07-16 02:01:37,010][ INFO][PID:3076019] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": 1752631297.0103362, "started_on": 1752631286.8387005, "submitted_on": null, "status": 0, "chroot": "fedora-eln-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9277767-fedora-eln-ppc64le", "build_id": 9277767, "package_name": "libcomps", "package_version": "0.1.21-20250716011915.5.g702ec14", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libcomps", "git_hash": "2138556e43bc9fcb1f80d2b487343bdf7147f6ae", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/eln-build/latest/$basearch", "id": "https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_eln_build_latest_basearch" } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09277767-libcomps", "built_packages": "", "id": 9277767, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-07-16 02:01:37,055][ INFO][PID:3076019] Sending fedora-messaging bus message in build.end [2025-07-16 02:01:37,080][ INFO][PID:3076019] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/builder-live.log by gzip [2025-07-16 02:01:37,081][ INFO][PID:3076019] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/builder-live.log' as PID 3329512 [2025-07-16 02:01:37,083][ INFO][PID:3076019] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/builder-live.log) [2025-07-16 02:01:37,084][ INFO][PID:3076019] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/backend.log by gzip [2025-07-16 02:01:37,085][ INFO][PID:3076019] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-eln-ppc64le/09277767-libcomps/backend.log' as PID 3329513