[2025-12-12 14:14:41,285][ INFO][PID:634773] Marking build as starting [2025-12-12 14:14:41,340][ INFO][PID:634773] Checking that /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/repodata/repomd.xml exists [2025-12-12 14:14:41,342][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:14:41,343][ INFO][PID:634773] VM allocation process starts [2025-12-12 14:14:41,356][ INFO][PID:634773] Trying to allocate VM: ResallocHost, ticket_id=304903, requested_tags=['copr_builder', 'arch_i386'] [2025-12-12 14:14:46,360][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:14:51,362][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:14:56,364][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:01,370][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:06,374][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:11,375][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:16,377][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:21,380][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:26,383][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:31,390][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:36,393][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:41,397][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:46,398][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:51,403][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:15:56,405][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:01,406][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:06,409][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:11,412][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:16,417][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:21,420][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:26,422][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:29,526][ INFO][PID:634773] Allocated host ResallocHost, ticket_id=304903, hostname=54.198.119.223, name=aws_x86_64_spot_prod_00497304_20251212_135643, requested_tags=['copr_builder', 'arch_i386'] [2025-12-12 14:16:29,530][ INFO][PID:634773] Allocating ssh connection to builder [2025-12-12 14:16:29,530][ INFO][PID:634773] Checking that builder machine is OK [2025-12-12 14:16:29,857][ INFO][PID:634773] Running remote command: copr-builder-ready fedora-rawhide-i386 [2025-12-12 14:16:30,067][ INFO][PID:634773] Red Hat subscription not needed for fedora-rawhide-i386 Builder is ready to be used [2025-12-12 14:16:30,068][ INFO][PID:634773] Filling build.info file with builder info [2025-12-12 14:16:30,069][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:30,071][ INFO][PID:634773] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jwakely", "project_name": "boost-190-rebuild", "project_dirname": "boost-190-rebuild", "submitter": "jwakely", "ended_on": null, "started_on": 1765548990.0708745, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-i386", "arch": "i386", "buildroot_pkgs": [], "task_id": "9902472-fedora-rawhide-i386", "build_id": 9902472, "package_name": "kdepimlibs", "package_version": "4.14.10-49", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwakely/boost-190-rebuild/kdepimlibs", "git_hash": "c411ab8dea5f21b5ed9c17ea23c4ddaedac62e92", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwakely/boost-190-rebuild--jwakely", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwakely/boost-190-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild", "result_dir": "09902472-kdepimlibs", "built_packages": "", "id": 9902472, "mockchain_macros": { "copr_username": "jwakely", "copr_projectname": "boost-190-rebuild", "vendor": "Fedora Project COPR (jwakely/boost-190-rebuild)" } } ] } [2025-12-12 14:16:30,152][ INFO][PID:634773] Sending fedora-messaging bus message in build.start [2025-12-12 14:16:30,975][ INFO][PID:634773] Sending fedora-messaging bus message in chroot.start [2025-12-12 14:16:31,013][ INFO][PID:634773] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9902472-fedora-rawhide-i386 --chroot fedora-rawhide-i386 --detached [2025-12-12 14:16:31,341][ INFO][PID:634773] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.198.119.223' (ED25519) to the list of known hosts. [2025-12-12 14:16:31,343][ INFO][PID:634773] Downloading the builder-live.log file, attempt 1 [2025-12-12 14:16:31,346][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.119.223 copr-rpmbuild-log [2025-12-12 14:16:36,362][ INFO][PID:634773] Periodic builder liveness probe: alive [2025-12-12 14:16:36,363][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:41,366][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:46,375][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:51,379][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:16:56,381][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:01,388][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:06,390][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:11,400][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:16,402][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:21,403][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:26,404][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:31,407][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:36,416][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:41,427][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:46,431][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:51,435][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:17:56,443][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:01,448][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:06,449][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:11,450][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:16,452][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:21,453][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:26,455][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:31,460][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:36,466][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:41,467][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:46,468][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:51,470][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:18:56,471][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:01,473][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:06,474][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:11,476][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:16,477][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:21,479][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:26,481][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:31,484][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:36,487][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:41,491][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:46,501][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:51,503][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:19:54,038][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:19:56,505][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:01,509][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:04,039][WARNING][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:20:06,510][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:11,513][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:14,040][ INFO][PID:634773] Downloading the builder-live.log file, attempt 2 [2025-12-12 14:20:14,045][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.119.223 copr-rpmbuild-log [2025-12-12 14:20:16,519][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:21,521][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:26,522][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:31,524][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:36,525][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:41,527][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:46,529][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:51,530][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:20:56,532][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:01,533][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:06,535][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:11,537][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:14,094][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:21:16,538][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:21,539][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:24,100][WARNING][PID:634773] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:21:26,540][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:31,541][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:34,101][ INFO][PID:634773] Downloading the builder-live.log file, attempt 3 [2025-12-12 14:21:34,102][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.119.223 copr-rpmbuild-log [2025-12-12 14:21:36,542][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:41,543][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:46,548][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:51,550][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:21:56,554][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:01,557][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:06,560][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:11,564][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:16,566][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:21,569][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:26,570][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:31,573][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:34,170][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:22:36,576][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:41,579][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:44,191][WARNING][PID:634773] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:22:46,580][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:51,584][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:22:54,193][ INFO][PID:634773] Downloading the builder-live.log file, attempt 4 [2025-12-12 14:22:54,200][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.198.119.223 copr-rpmbuild-log [2025-12-12 14:22:56,589][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:01,593][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:06,595][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:11,601][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:16,602][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:21,603][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:26,605][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:31,606][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:36,609][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:41,610][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:46,619][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:51,620][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:23:54,271][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:23:56,622][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:01,623][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:04,276][ ERROR][PID:634773] Giving up for unstable SSH, failures: 1765549204.039744, 1765549284.100549, 1765549364.1917098, 1765549444.27643 [2025-12-12 14:24:04,279][ ERROR][PID:634773] Re-try request for task on 'ResallocHost, ticket_id=304903, hostname=54.198.119.223, name=aws_x86_64_spot_prod_00497304_20251212_135643, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-12 14:24:04,281][ INFO][PID:634773] Releasing VM back to pool [2025-12-12 14:24:04,299][ INFO][PID:634773] Retry #1 (on other host) [2025-12-12 14:24:04,299][ INFO][PID:634773] Checking that /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/repodata/repomd.xml exists [2025-12-12 14:24:04,300][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:04,303][ INFO][PID:634773] VM allocation process starts [2025-12-12 14:24:04,327][ INFO][PID:634773] Trying to allocate VM: ResallocHost, ticket_id=305115, requested_tags=['copr_builder', 'arch_i386'] [2025-12-12 14:24:09,331][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:10,385][ INFO][PID:634773] Allocated host ResallocHost, ticket_id=305115, hostname=54.157.30.149, name=aws_x86_64_spot_prod_00498403_20251212_141925, requested_tags=['copr_builder', 'arch_i386'] [2025-12-12 14:24:10,386][ INFO][PID:634773] Allocating ssh connection to builder [2025-12-12 14:24:10,387][ INFO][PID:634773] Checking that builder machine is OK [2025-12-12 14:24:10,594][ INFO][PID:634773] Running remote command: copr-builder-ready fedora-rawhide-i386 [2025-12-12 14:24:10,788][ INFO][PID:634773] Red Hat subscription not needed for fedora-rawhide-i386 Builder is ready to be used [2025-12-12 14:24:10,789][ INFO][PID:634773] Filling build.info file with builder info [2025-12-12 14:24:10,791][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:10,792][ INFO][PID:634773] Not re-notifying FE and msg buses for the new host. [2025-12-12 14:24:10,793][ INFO][PID:634773] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9902472-fedora-rawhide-i386 --chroot fedora-rawhide-i386 --detached [2025-12-12 14:24:11,120][ INFO][PID:634773] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.157.30.149' (ED25519) to the list of known hosts. [2025-12-12 14:24:11,120][ INFO][PID:634773] Downloading the builder-live.log file, attempt 1 [2025-12-12 14:24:11,122][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.157.30.149 copr-rpmbuild-log [2025-12-12 14:24:16,123][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:21,124][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:26,126][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:31,127][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:36,128][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:41,129][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:46,132][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:51,134][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:24:56,143][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:01,144][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:06,146][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:11,150][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:16,151][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:21,153][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:26,155][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:31,160][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:36,161][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:41,163][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:46,166][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:51,168][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:25:56,170][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:01,175][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:06,179][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:11,181][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:16,183][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:21,185][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:26,190][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:31,191][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:36,193][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:41,211][ INFO][PID:634773] Periodic builder liveness probe: alive [2025-12-12 14:26:41,213][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:46,220][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:51,221][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:26:56,223][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:01,224][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:06,227][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:11,229][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:16,231][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:21,233][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:26,234][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:31,241][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:36,243][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:41,244][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:46,246][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:51,248][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:27:56,250][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:01,257][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:06,273][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:11,278][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:16,280][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:21,281][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:26,289][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:31,290][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:36,291][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:41,293][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:46,303][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:51,308][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:28:56,309][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:01,310][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:06,312][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:11,313][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:16,316][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:21,320][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:26,326][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:31,332][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:36,334][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:41,339][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:46,340][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:51,343][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:29:56,347][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:01,357][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:06,359][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:11,360][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:16,362][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:21,365][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:26,366][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:31,367][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:36,369][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:41,374][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:46,375][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:51,377][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:30:56,380][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:01,382][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:06,383][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:11,386][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:16,388][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:21,390][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:26,393][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:31,398][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:36,399][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:41,402][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:46,407][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:51,410][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:31:56,418][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:01,419][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:06,424][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:11,426][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:16,427][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:21,429][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:26,432][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:31,434][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:36,440][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:41,443][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:46,451][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:51,455][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:32:56,460][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:01,462][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:06,465][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:11,468][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:16,473][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:21,476][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:26,481][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:31,487][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:36,488][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:41,492][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:46,496][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:48,644][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:33:51,499][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:56,501][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:33:58,645][WARNING][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:34:01,517][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:06,520][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:08,646][ INFO][PID:634773] Downloading the builder-live.log file, attempt 2 [2025-12-12 14:34:08,676][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.157.30.149 copr-rpmbuild-log [2025-12-12 14:34:11,523][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:16,524][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:21,527][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:26,538][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:31,541][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:36,542][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:41,544][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:46,546][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:51,550][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:34:56,554][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:01,559][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:06,562][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:08,755][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:35:11,565][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:16,567][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:18,758][WARNING][PID:634773] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:35:21,569][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:26,573][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:28,759][ INFO][PID:634773] Downloading the builder-live.log file, attempt 3 [2025-12-12 14:35:28,761][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.157.30.149 copr-rpmbuild-log [2025-12-12 14:35:31,575][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:36,577][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:41,578][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:46,581][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:51,586][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:35:56,588][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:01,592][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:06,593][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:11,595][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:16,600][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:21,601][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:26,603][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:28,833][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:36:31,610][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:36,612][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:38,834][WARNING][PID:634773] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:36:41,634][ INFO][PID:634773] Periodic builder liveness probe: alive [2025-12-12 14:36:41,638][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:46,640][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:48,840][ INFO][PID:634773] Downloading the builder-live.log file, attempt 4 [2025-12-12 14:36:48,841][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.157.30.149 copr-rpmbuild-log [2025-12-12 14:36:51,652][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:36:56,654][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:01,655][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:06,657][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:11,659][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:16,672][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:21,673][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:26,675][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:31,679][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:36,680][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:41,683][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:46,688][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:48,913][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:37:51,690][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:56,691][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:58,919][ ERROR][PID:634773] Giving up for unstable SSH, failures: 1765550038.6457052, 1765550118.7582037, 1765550198.8348076, 1765550278.9192631 [2025-12-12 14:37:58,928][ ERROR][PID:634773] Re-try request for task on 'ResallocHost, ticket_id=305115, hostname=54.157.30.149, name=aws_x86_64_spot_prod_00498403_20251212_141925, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-12 14:37:58,929][ INFO][PID:634773] Releasing VM back to pool [2025-12-12 14:37:59,012][ INFO][PID:634773] Retry #2 (on other host) [2025-12-12 14:37:59,016][ INFO][PID:634773] Checking that /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/repodata/repomd.xml exists [2025-12-12 14:37:59,031][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:37:59,034][ INFO][PID:634773] VM allocation process starts [2025-12-12 14:37:59,092][ INFO][PID:634773] Trying to allocate VM: ResallocHost, ticket_id=305523, requested_tags=['copr_builder', 'arch_i386'] [2025-12-12 14:38:04,099][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:05,171][ INFO][PID:634773] Allocated host ResallocHost, ticket_id=305523, hostname=3.235.190.53, name=aws_x86_64_spot_prod_00499423_20251212_143638, requested_tags=['copr_builder', 'arch_i386'] [2025-12-12 14:38:05,171][ INFO][PID:634773] Allocating ssh connection to builder [2025-12-12 14:38:05,173][ INFO][PID:634773] Checking that builder machine is OK [2025-12-12 14:38:05,504][ INFO][PID:634773] Running remote command: copr-builder-ready fedora-rawhide-i386 [2025-12-12 14:38:05,752][ INFO][PID:634773] Red Hat subscription not needed for fedora-rawhide-i386 Builder is ready to be used [2025-12-12 14:38:05,753][ INFO][PID:634773] Filling build.info file with builder info [2025-12-12 14:38:05,754][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:05,757][ INFO][PID:634773] Not re-notifying FE and msg buses for the new host. [2025-12-12 14:38:05,758][ INFO][PID:634773] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9902472-fedora-rawhide-i386 --chroot fedora-rawhide-i386 --detached [2025-12-12 14:38:06,090][ INFO][PID:634773] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.235.190.53' (ED25519) to the list of known hosts. [2025-12-12 14:38:06,091][ INFO][PID:634773] Downloading the builder-live.log file, attempt 1 [2025-12-12 14:38:06,094][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.190.53 copr-rpmbuild-log [2025-12-12 14:38:11,092][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:16,094][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:21,095][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:26,097][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:31,098][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:36,099][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:41,102][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:46,103][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:51,105][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:38:56,109][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:01,111][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:06,114][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:11,116][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:16,117][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:21,118][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:26,120][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:31,121][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:36,122][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:41,123][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:46,124][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:51,125][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:39:56,126][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:01,127][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:06,128][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:11,130][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:16,131][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:21,132][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:26,133][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:31,134][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:36,136][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:41,137][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:46,139][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:51,141][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:40:56,142][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:01,143][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:06,144][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:11,145][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:16,146][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:21,149][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:26,153][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:31,156][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:36,157][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:41,160][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:46,161][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:51,162][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:41:56,163][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:01,164][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:06,166][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:11,167][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:16,168][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:21,172][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:26,176][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:31,178][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:36,180][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:41,181][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:46,183][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:51,185][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:42:56,187][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:01,188][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:06,190][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:11,193][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:16,195][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:21,198][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:26,201][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:31,203][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:36,204][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:41,206][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:46,207][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:51,208][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:43:56,212][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:01,215][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:06,216][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:11,219][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:16,222][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:21,227][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:22,737][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:44:26,229][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:31,230][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:32,739][WARNING][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:44:36,231][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:41,232][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:42,739][ INFO][PID:634773] Downloading the builder-live.log file, attempt 2 [2025-12-12 14:44:42,742][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.190.53 copr-rpmbuild-log [2025-12-12 14:44:46,233][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:51,234][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:44:56,236][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:01,237][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:06,239][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:11,240][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:16,242][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:21,243][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:26,245][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:31,246][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:36,247][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:41,249][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:42,811][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:45:46,250][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:51,251][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:45:52,812][WARNING][PID:634773] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:45:56,253][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:01,254][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:02,813][ INFO][PID:634773] Downloading the builder-live.log file, attempt 3 [2025-12-12 14:46:02,817][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.190.53 copr-rpmbuild-log [2025-12-12 14:46:06,256][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:11,257][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:16,260][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:21,262][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:26,264][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:31,265][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:36,266][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:41,268][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:46,316][ INFO][PID:634773] Periodic builder liveness probe: alive [2025-12-12 14:46:46,317][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:51,318][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:46:56,320][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:01,321][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:02,896][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:47:06,323][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:11,333][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:12,900][WARNING][PID:634773] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-12 14:47:16,335][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:21,337][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:22,906][ INFO][PID:634773] Downloading the builder-live.log file, attempt 4 [2025-12-12 14:47:22,909][ INFO][PID:634773] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.235.190.53 copr-rpmbuild-log [2025-12-12 14:47:26,342][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:31,345][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:36,346][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:41,347][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:46,349][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:51,350][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:47:56,351][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:01,352][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:06,353][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:11,356][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:16,363][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:21,364][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:23,003][ ERROR][PID:634773] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-12 14:48:26,366][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:31,367][ INFO][PID:634773] Checking for cancel request [2025-12-12 14:48:33,005][ ERROR][PID:634773] Giving up for unstable SSH, failures: 1765550672.7390578, 1765550752.8125775, 1765550832.9000044, 1765550913.0055432 [2025-12-12 14:48:33,006][ ERROR][PID:634773] Re-try request for task on 'ResallocHost, ticket_id=305523, hostname=3.235.190.53, name=aws_x86_64_spot_prod_00499423_20251212_143638, requested_tags=['copr_builder', 'arch_i386']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-12 14:48:33,007][ INFO][PID:634773] Releasing VM back to pool [2025-12-12 14:48:33,023][ ERROR][PID:634773] Backend process error: Three host tried without success: {'3.235.190.53', '54.157.30.149', '54.198.119.223'} [2025-12-12 14:48:33,026][WARNING][PID:634773] Switching not-finished job state to 'failed' [2025-12-12 14:48:33,027][ INFO][PID:634773] Worker failed build, took 627.2683203220367 [2025-12-12 14:48:33,036][ INFO][PID:634773] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jwakely", "project_name": "boost-190-rebuild", "project_dirname": "boost-190-rebuild", "submitter": "jwakely", "ended_on": 1765550913.0260253, "started_on": 1765550285.757705, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-i386", "arch": "i386", "buildroot_pkgs": [], "task_id": "9902472-fedora-rawhide-i386", "build_id": 9902472, "package_name": "kdepimlibs", "package_version": "4.14.10-49", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jwakely/boost-190-rebuild/kdepimlibs", "git_hash": "c411ab8dea5f21b5ed9c17ea23c4ddaedac62e92", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jwakely/boost-190-rebuild--jwakely", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_i386" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jwakely/boost-190-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jwakely/boost-190-rebuild", "result_dir": "09902472-kdepimlibs", "built_packages": "", "id": 9902472, "mockchain_macros": { "copr_username": "jwakely", "copr_projectname": "boost-190-rebuild", "vendor": "Fedora Project COPR (jwakely/boost-190-rebuild)" } } ] } [2025-12-12 14:48:33,810][ INFO][PID:634773] Sending fedora-messaging bus message in build.end [2025-12-12 14:48:34,102][ INFO][PID:634773] Compressing /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/09902472-kdepimlibs/builder-live.log by gzip [2025-12-12 14:48:34,109][ INFO][PID:634773] Running command 'gzip /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/09902472-kdepimlibs/builder-live.log' as PID 970068 [2025-12-12 14:48:34,127][ INFO][PID:634773] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/09902472-kdepimlibs/builder-live.log) [2025-12-12 14:48:34,132][ INFO][PID:634773] Compressing /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/09902472-kdepimlibs/backend.log by gzip [2025-12-12 14:48:34,133][ INFO][PID:634773] Running command 'gzip /var/lib/copr/public_html/results/jwakely/boost-190-rebuild/fedora-rawhide-i386/09902472-kdepimlibs/backend.log' as PID 970076