[2025-12-24 14:12:15,607][ INFO][PID:1671951] Marking build as starting [2025-12-24 14:12:15,663][ INFO][PID:1671951] Checking that /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-24 14:12:15,664][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:15,665][ INFO][PID:1671951] VM allocation process starts [2025-12-24 14:12:15,702][ INFO][PID:1671951] Trying to allocate VM: ResallocHost, ticket_id=495001, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-24 14:12:18,724][ INFO][PID:1671951] Allocated host ResallocHost, ticket_id=495001, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00749283_20251224_133445, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-24 14:12:18,724][ INFO][PID:1671951] Allocating ssh connection to builder [2025-12-24 14:12:18,725][ INFO][PID:1671951] Checking that builder machine is OK [2025-12-24 14:12:19,753][ INFO][PID:1671951] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-24 14:12:20,324][ INFO][PID:1671951] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-24 14:12:20,325][ INFO][PID:1671951] Filling build.info file with builder info [2025-12-24 14:12:20,325][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:20,326][ INFO][PID:1671951] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mtasaka", "project_name": "ruby-40-01", "project_dirname": "ruby-40-01", "submitter": "mtasaka", "ended_on": null, "started_on": 1766585540.3261476, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9947993-fedora-rawhide-ppc64le", "build_id": 9947993, "package_name": "ruby", "package_version": "4.0.0~20251224.1357git8de2622c12-29.fc44.git8de2622c12", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mtasaka/ruby-40-01/ruby", "git_hash": "807219ee248c0c668f24bab4c9cd430da361613f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mtasaka/ruby-40-01--mtasaka", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mtasaka/ruby-40-01", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01", "result_dir": "09947993-ruby", "built_packages": "", "id": 9947993, "mockchain_macros": { "copr_username": "mtasaka", "copr_projectname": "ruby-40-01", "vendor": "Fedora Project COPR (mtasaka/ruby-40-01)" } } ] } [2025-12-24 14:12:20,369][ INFO][PID:1671951] Sending fedora-messaging bus message in build.start [2025-12-24 14:12:20,860][ INFO][PID:1671951] Sending fedora-messaging bus message in chroot.start [2025-12-24 14:12:20,886][ INFO][PID:1671951] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9947993-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-24 14:12:21,881][ INFO][PID:1671951] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c148' (ED25519) to the list of known hosts. [2025-12-24 14:12:21,882][ INFO][PID:1671951] Downloading the builder-live.log file, attempt 1 [2025-12-24 14:12:21,883][ INFO][PID:1671951] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log [2025-12-24 14:12:26,887][ INFO][PID:1671951] Periodic builder liveness probe: alive [2025-12-24 14:12:26,888][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:31,888][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:36,889][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:41,890][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:46,891][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:51,892][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:12:56,893][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:01,894][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:06,895][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:11,896][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:16,897][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:21,898][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:26,899][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:31,900][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:36,900][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:41,901][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:46,902][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:51,903][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:13:56,904][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:01,905][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:06,907][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:11,907][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:16,908][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:21,910][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:26,911][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:31,912][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:36,913][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:41,927][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:46,928][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:51,928][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:14:56,930][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:01,931][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:06,931][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:11,956][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:16,957][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:21,958][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:26,959][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:31,960][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:36,961][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:41,962][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:46,963][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:51,964][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:15:56,965][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:01,969][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:06,970][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:11,971][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:16,972][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:21,973][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:26,974][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:31,975][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:36,976][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:41,977][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:46,978][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:51,979][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:16:56,980][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:01,981][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:06,983][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:11,984][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:16,985][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:21,986][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:26,987][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:31,988][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:36,989][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:41,990][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:46,994][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:51,996][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:17:56,997][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:01,998][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:07,004][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:12,007][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:17,008][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:22,010][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:27,011][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:32,012][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:37,013][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:42,028][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:47,029][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:52,030][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:18:57,031][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:02,031][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:07,033][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:12,034][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:17,035][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:22,040][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:27,041][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:32,042][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:37,043][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:42,044][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:47,045][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:52,046][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:19:57,047][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:02,048][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:07,049][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:12,050][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:17,051][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:22,052][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:27,053][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:32,053][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:37,054][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:42,055][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:47,056][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:52,057][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:20:57,058][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:02,059][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:07,060][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:12,072][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:17,073][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:22,074][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:27,075][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:32,076][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:37,076][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:42,077][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:47,078][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:52,079][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:21:57,080][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:02,081][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:07,082][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:12,083][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:17,083][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:22,084][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:27,090][ INFO][PID:1671951] Periodic builder liveness probe: alive [2025-12-24 14:22:27,091][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:32,091][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:37,092][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:42,093][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:47,094][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:52,095][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:22:57,096][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:02,522][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:07,588][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:12,589][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:17,590][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:22,591][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:27,592][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:32,593][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:37,594][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:42,595][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:47,605][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:53,022][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:23:58,023][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:03,024][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:08,025][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:13,026][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:18,089][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:23,090][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:28,091][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:33,092][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:38,093][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:43,094][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:48,095][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:53,096][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:24:58,097][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:03,098][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:08,099][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:13,203][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:18,204][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:23,205][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:28,206][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:33,248][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:38,258][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:43,301][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:48,304][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:53,306][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:25:58,423][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:03,424][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:08,620][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:13,621][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:18,622][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:23,623][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:28,623][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:33,624][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:38,625][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:43,626][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:48,681][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:53,826][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:26:58,957][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:03,958][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:08,959][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:13,960][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:19,071][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:24,078][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:29,081][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:34,082][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:39,083][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:44,275][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:49,276][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:54,277][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:27:59,278][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:04,400][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:09,459][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:14,460][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:19,471][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:24,475][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:29,478][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:34,480][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:39,481][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:44,580][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:49,582][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:54,739][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:28:59,740][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:04,741][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:09,742][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:14,861][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:19,863][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:24,864][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:29,866][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:34,867][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:39,868][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:45,008][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:50,009][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:29:55,014][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:00,021][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:05,022][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:10,023][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:15,107][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:20,108][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:25,284][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:30,285][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:35,289][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:40,290][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:40,400][ ERROR][PID:1671951] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-24 14:30:45,291][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:50,398][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:30:50,401][WARNING][PID:1671951] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-24 14:30:55,403][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:00,403][ INFO][PID:1671951] Downloading the builder-live.log file, attempt 2 [2025-12-24 14:31:00,407][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:00,550][ INFO][PID:1671951] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log [2025-12-24 14:31:05,534][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:10,704][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:15,844][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:20,845][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:25,846][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:30,847][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:35,849][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:40,850][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:45,851][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:50,852][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:31:55,853][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:00,854][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:05,855][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:10,856][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:15,857][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:20,858][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:26,117][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:32:31,140][ INFO][PID:1671951] Periodic builder liveness probe: dead [2025-12-24 14:32:31,140][ INFO][PID:1671951] calling cancel callback, and waiting [2025-12-24 14:32:31,880][WARNING][PID:1671951] Can't cancel build out: err: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c148' (ED25519) to the list of known hosts. Traceback (most recent call last): File "/usr/bin/copr-rpmbuild-cancel", line 85, in _main() ~~~~~^^ File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main with open(pidfile, "r") as pidfd: ~~~~^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid' [2025-12-24 14:33:01,877][ ERROR][PID:1671951] Re-try request for task on 'ResallocHost, ticket_id=495001, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00749283_20251224_133445, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-12-24 14:33:01,877][ INFO][PID:1671951] Releasing VM back to pool [2025-12-24 14:33:01,886][ INFO][PID:1671951] Retry #1 (on other host) [2025-12-24 14:33:01,886][ INFO][PID:1671951] Checking that /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-24 14:33:01,887][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:33:01,888][ INFO][PID:1671951] VM allocation process starts [2025-12-24 14:33:01,919][ INFO][PID:1671951] Trying to allocate VM: ResallocHost, ticket_id=495096, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-24 14:33:04,960][ INFO][PID:1671951] Allocated host ResallocHost, ticket_id=495096, hostname=2620:52:6:1161:dead:beef:cafe:c196, name=vmhost_p09_04_prod_00749383_20251224_134532, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-24 14:33:04,961][ INFO][PID:1671951] Allocating ssh connection to builder [2025-12-24 14:33:04,961][ INFO][PID:1671951] Checking that builder machine is OK [2025-12-24 14:33:05,990][ INFO][PID:1671951] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-24 14:33:06,499][ INFO][PID:1671951] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-24 14:33:06,500][ INFO][PID:1671951] Filling build.info file with builder info [2025-12-24 14:33:06,515][ INFO][PID:1671951] Checking for cancel request [2025-12-24 14:33:06,516][ INFO][PID:1671951] Not re-notifying FE and msg buses for the new host. [2025-12-24 14:33:06,516][ INFO][PID:1671951] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9947993-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-24 14:33:07,537][ INFO][PID:1671951] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts. [2025-12-24 14:33:07,537][ INFO][PID:1671951] Downloading the builder-live.log file, attempt 1 [2025-12-24 14:33:07,539][ INFO][PID:1671951] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c196 copr-rpmbuild-log [2025-12-24 14:33:12,538][ INFO][PID:1671951] calling cancel callback, and waiting [2025-12-24 14:33:16,293][ INFO][PID:1671951] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts. [2025-12-24 14:33:16,293][ INFO][PID:1671951] Downloading results from builder [2025-12-24 14:33:16,294][ INFO][PID:1671951] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby started [2025-12-24 14:33:16,294][ INFO][PID:1671951] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c196]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/ &> /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/build-09947993.rsync.log [2025-12-24 14:33:17,210][ INFO][PID:1671951] rsyncing finished. [2025-12-24 14:33:17,211][ INFO][PID:1671951] Releasing VM back to pool [2025-12-24 14:33:17,219][ INFO][PID:1671951] Searching for 'success' file in resultdir [2025-12-24 14:33:17,220][ ERROR][PID:1671951] Build failed: Backend process error: No success file => build failure [2025-12-24 14:33:17,220][ INFO][PID:1671951] Finished build: id=9947993 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mtasaka/ruby-40-01 chroot=fedora-rawhide-ppc64le [2025-12-24 14:33:17,222][ ERROR][PID:1671951] Backend process error: No success file => build failure [2025-12-24 14:33:17,222][ INFO][PID:1671951] Worker failed build, took 10.706405878067017 [2025-12-24 14:33:17,223][ INFO][PID:1671951] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mtasaka", "project_name": "ruby-40-01", "project_dirname": "ruby-40-01", "submitter": "mtasaka", "ended_on": 1766586797.222873, "started_on": 1766586786.516467, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9947993-fedora-rawhide-ppc64le", "build_id": 9947993, "package_name": "ruby", "package_version": "4.0.0~20251224.1357git8de2622c12-29.fc44.git8de2622c12", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mtasaka/ruby-40-01/ruby", "git_hash": "807219ee248c0c668f24bab4c9cd430da361613f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mtasaka/ruby-40-01--mtasaka", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mtasaka/ruby-40-01", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01", "result_dir": "09947993-ruby", "built_packages": "", "id": 9947993, "mockchain_macros": { "copr_username": "mtasaka", "copr_projectname": "ruby-40-01", "vendor": "Fedora Project COPR (mtasaka/ruby-40-01)" } } ] } [2025-12-24 14:33:17,268][ INFO][PID:1671951] Sending fedora-messaging bus message in build.end [2025-12-24 14:33:17,295][ INFO][PID:1671951] Compressing /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/builder-live.log by gzip [2025-12-24 14:33:17,296][ INFO][PID:1671951] Running command 'gzip /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/builder-live.log' as PID 1731371 [2025-12-24 14:33:17,298][ INFO][PID:1671951] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/builder-live.log) [2025-12-24 14:33:17,298][ INFO][PID:1671951] Compressing /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/backend.log by gzip [2025-12-24 14:33:17,299][ INFO][PID:1671951] Running command 'gzip /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09947993-ruby/backend.log' as PID 1731372