[2025-07-10 18:24:29,897][ INFO][PID:372554] Marking build as starting [2025-07-10 18:24:29,923][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:24:29,924][ INFO][PID:372554] VM allocation process starts [2025-07-10 18:24:29,945][ INFO][PID:372554] Trying to allocate VM: ResallocHost, ticket_id=3883251, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-10 18:24:34,951][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:24:39,952][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:24:44,953][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:24:49,960][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:24:54,962][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:24:59,964][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:04,965][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:09,967][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:14,968][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:18,039][ INFO][PID:372554] Allocated host ResallocHost, ticket_id=3883251, hostname=44.201.142.201, name=aws_x86_64_spot_prod_05266106_20250710_181813, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-10 18:25:18,039][ INFO][PID:372554] Allocating ssh connection to builder [2025-07-10 18:25:18,040][ INFO][PID:372554] Checking that builder machine is OK [2025-07-10 18:25:18,454][ INFO][PID:372554] Running remote command: copr-builder-ready srpm-builds [2025-07-10 18:25:18,671][ INFO][PID:372554] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2025-07-10 18:25:18,672][ INFO][PID:372554] Filling build.info file with builder info [2025-07-10 18:25:18,675][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:18,679][ INFO][PID:372554] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "averbyts", "project_name": "HEPrpms", "project_dirname": "HEPrpms", "submitter": "averbyts", "ended_on": null, "started_on": 1752171918.679483, "submitted_on": null, "status": 3, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "9263768", "build_id": 9263768, "package_name": "f2c", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"#!/bin/bash\\ngit clone --depth 1 https://github.com/andriish/HEPrpms.git\\ncd HEPrpms\\nsh srpmsbuild.sh f2c 20240504\\n\", \"chroot\": \"epel-8-x86_64\", \"builddeps\": \"git spectool wget\", \"resultdir\": \"HEPrpms/f2c/20240504/rpmbuild/SOURCES/\", \"repos\": \"\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "averbyts/HEPrpms--averbyts", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "destdir": "/var/lib/copr/public_html/results/averbyts/HEPrpms", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/averbyts/HEPrpms", "result_dir": "09263768", "built_packages": "", "tags": [ "arch_x86_64" ], "id": 9263768, "mockchain_macros": { "copr_username": "averbyts", "copr_projectname": "HEPrpms", "vendor": "Fedora Project COPR (averbyts/HEPrpms)" } } ] } [2025-07-10 18:25:18,707][ INFO][PID:372554] Sending fedora-messaging bus message in build.start [2025-07-10 18:25:19,745][ INFO][PID:372554] Sending fedora-messaging bus message in chroot.start [2025-07-10 18:25:19,808][ INFO][PID:372554] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9263768 --detached [2025-07-10 18:25:20,200][ INFO][PID:372554] Downloading the builder-live.log file, attempt 1 [2025-07-10 18:25:20,204][ INFO][PID:372554] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.142.201 copr-rpmbuild-log [2025-07-10 18:25:25,216][ INFO][PID:372554] Periodic builder liveness probe: alive [2025-07-10 18:25:25,216][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:30,217][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:35,220][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:40,222][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:45,224][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:50,226][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:25:55,229][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:00,234][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:05,236][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:10,237][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:15,238][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:20,239][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:25,241][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:30,242][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:35,243][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:40,246][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:45,247][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:50,248][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:26:55,250][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:00,254][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:05,256][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:10,260][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:15,263][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:20,264][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:25,266][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:30,267][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:35,271][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:40,273][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:45,274][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:50,275][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:27:55,276][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:00,278][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:05,279][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:10,281][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:15,284][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:20,286][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:25,288][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:30,291][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:35,297][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:40,298][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:45,301][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:50,302][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:28:55,304][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:00,305][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:05,306][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:10,308][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:15,309][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:20,311][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:25,313][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:30,316][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:35,321][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:40,322][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:45,324][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:50,327][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:29:55,328][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:00,329][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:05,330][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:10,332][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:15,333][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:20,334][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:25,335][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:30,336][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:35,337][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:40,339][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:45,340][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:50,341][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:30:55,342][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:00,343][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:05,345][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:10,345][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:15,346][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:20,347][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:25,349][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:30,350][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:35,352][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:40,353][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:45,354][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:50,355][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:31:55,356][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:00,357][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:05,358][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:10,359][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:15,360][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:20,361][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:25,363][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:30,364][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:35,365][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:40,366][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:45,367][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:50,368][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:32:55,369][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:00,370][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:05,371][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:10,372][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:15,373][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:20,374][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:25,376][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:30,377][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:35,378][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:40,379][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:45,380][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:50,381][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:33:55,382][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:00,383][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:05,384][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:10,385][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:15,386][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:20,387][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:25,388][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:28,865][ ERROR][PID:372554] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-10 18:34:30,389][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:35,390][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:38,866][WARNING][PID:372554] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-10 18:34:40,391][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:45,392][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:48,866][ INFO][PID:372554] Downloading the builder-live.log file, attempt 2 [2025-07-10 18:34:48,868][ INFO][PID:372554] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.142.201 copr-rpmbuild-log [2025-07-10 18:34:50,393][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:34:55,394][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:00,395][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:05,396][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:10,397][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:15,399][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:20,400][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:25,406][ INFO][PID:372554] Periodic builder liveness probe: alive [2025-07-10 18:35:25,407][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:30,407][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:35,408][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:40,409][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:45,410][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:48,936][ ERROR][PID:372554] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-10 18:35:50,412][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:55,413][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:35:58,937][WARNING][PID:372554] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-10 18:36:00,414][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:05,415][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:08,937][ INFO][PID:372554] Downloading the builder-live.log file, attempt 3 [2025-07-10 18:36:08,938][ INFO][PID:372554] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.142.201 copr-rpmbuild-log [2025-07-10 18:36:10,416][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:15,417][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:20,418][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:25,419][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:30,420][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:35,421][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:40,422][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:45,423][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:50,424][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:36:55,424][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:00,425][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:05,427][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:09,007][ ERROR][PID:372554] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-10 18:37:10,428][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:15,429][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:19,008][WARNING][PID:372554] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-10 18:37:20,430][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:25,431][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:29,009][ INFO][PID:372554] Downloading the builder-live.log file, attempt 4 [2025-07-10 18:37:29,010][ INFO][PID:372554] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.142.201 copr-rpmbuild-log [2025-07-10 18:37:30,432][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:35,433][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:40,434][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:45,435][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:50,436][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:37:55,437][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:00,439][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:05,439][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:10,440][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:15,441][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:20,443][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:25,444][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:29,076][ ERROR][PID:372554] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-10 18:38:30,445][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:35,446][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:39,078][ ERROR][PID:372554] Giving up for unstable SSH, failures: 1752172478.8659675, 1752172558.9371119, 1752172639.0085423, 1752172719.078521 [2025-07-10 18:38:39,079][ ERROR][PID:372554] Re-try request for task on 'ResallocHost, ticket_id=3883251, hostname=44.201.142.201, name=aws_x86_64_spot_prod_05266106_20250710_181813, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-10 18:38:39,079][ INFO][PID:372554] Releasing VM back to pool [2025-07-10 18:38:39,142][ INFO][PID:372554] Retry #1 (on other host) [2025-07-10 18:38:39,142][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:39,143][ INFO][PID:372554] VM allocation process starts [2025-07-10 18:38:39,166][ INFO][PID:372554] Trying to allocate VM: ResallocHost, ticket_id=3883390, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-10 18:38:42,187][ INFO][PID:372554] Allocated host ResallocHost, ticket_id=3883390, hostname=34.201.99.226, name=aws_x86_64_normalreserved_prod_05266529_20250710_183433, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-10 18:38:42,188][ INFO][PID:372554] Allocating ssh connection to builder [2025-07-10 18:38:42,188][ INFO][PID:372554] Checking that builder machine is OK [2025-07-10 18:38:42,670][ INFO][PID:372554] Running remote command: copr-builder-ready srpm-builds [2025-07-10 18:38:42,882][ INFO][PID:372554] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2025-07-10 18:38:42,883][ INFO][PID:372554] Filling build.info file with builder info [2025-07-10 18:38:42,883][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:42,884][ INFO][PID:372554] Not re-notifying FE and msg buses for the new host. [2025-07-10 18:38:42,885][ INFO][PID:372554] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9263768 --detached [2025-07-10 18:38:43,230][ INFO][PID:372554] Downloading the builder-live.log file, attempt 1 [2025-07-10 18:38:43,232][ INFO][PID:372554] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.201.99.226 copr-rpmbuild-log [2025-07-10 18:38:48,232][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:53,233][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:38:58,234][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:03,235][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:08,236][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:13,237][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:18,238][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:23,239][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:28,240][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:33,241][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:38,242][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:43,244][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:48,245][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:53,246][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:39:58,247][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:03,248][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:08,249][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:13,250][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:18,251][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:23,253][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:28,254][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:33,255][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:38,256][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:43,257][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:48,258][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:53,259][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:40:58,260][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:03,261][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:08,263][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:13,264][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:18,265][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:23,266][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:28,267][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:33,268][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:38,269][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:43,270][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:48,271][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:53,273][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:41:58,274][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:03,275][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:08,280][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:13,281][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:18,282][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:23,284][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:28,285][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:33,286][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:38,287][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:43,288][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:48,289][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:53,290][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:42:58,291][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:03,292][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:08,293][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:13,294][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:18,295][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:23,296][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:28,297][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:33,298][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:38,299][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:43,300][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:48,301][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:53,302][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:43:58,303][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:03,304][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:08,305][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:13,306][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:18,307][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:23,308][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:28,309][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:33,310][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:38,311][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:43,312][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:48,313][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:53,314][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:44:58,315][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:03,316][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:08,317][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:13,318][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:18,319][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:23,320][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:28,354][ INFO][PID:372554] Periodic builder liveness probe: alive [2025-07-10 18:45:28,355][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:33,356][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:38,357][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:43,358][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:48,359][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:53,360][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:45:58,361][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:03,362][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:08,363][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:13,364][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:18,365][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:23,366][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:28,367][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:33,368][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:38,369][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:43,370][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:48,371][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:53,372][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:46:58,374][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:03,375][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:08,376][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:13,377][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:18,378][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:23,379][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:28,380][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:33,381][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:38,382][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:43,383][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:48,384][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:53,385][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:47:58,401][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:03,406][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:08,407][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:13,408][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:18,410][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:23,411][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:28,412][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:33,413][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:38,414][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:43,415][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:48,417][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:53,418][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:48:58,419][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:49:03,420][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:49:08,422][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:49:13,423][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:49:18,424][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:49:23,425][ INFO][PID:372554] Checking for cancel request [2025-07-10 18:49:24,675][ INFO][PID:372554] Downloading results from builder [2025-07-10 18:49:24,676][ INFO][PID:372554] rsyncing of mockbuilder@34.201.99.226:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768 started [2025-07-10 18:49:24,676][ INFO][PID:372554] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.201.99.226:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/ &> /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/build-09263768.rsync.log [2025-07-10 18:49:25,045][ INFO][PID:372554] rsyncing finished. [2025-07-10 18:49:25,046][ INFO][PID:372554] Releasing VM back to pool [2025-07-10 18:49:25,057][ INFO][PID:372554] Searching for 'success' file in resultdir [2025-07-10 18:49:25,057][ ERROR][PID:372554] Build failed: Backend process error: No success file => build failure [2025-07-10 18:49:25,058][ INFO][PID:372554] Finished build: id=9263768 failed=True timeout=108000 destdir=/var/lib/copr/public_html/results/averbyts/HEPrpms chroot=srpm-builds [2025-07-10 18:49:25,060][ ERROR][PID:372554] Backend process error: No success file => build failure [2025-07-10 18:49:25,061][ INFO][PID:372554] Worker failed build, took 642.176557302475 [2025-07-10 18:49:25,061][ INFO][PID:372554] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "averbyts", "project_name": "HEPrpms", "project_dirname": "HEPrpms", "submitter": "averbyts", "ended_on": 1752173365.0611515, "started_on": 1752172722.8845942, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": "x86_64", "buildroot_pkgs": null, "task_id": "9263768", "build_id": 9263768, "package_name": "f2c", "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 9, "source_json": "{\"script\": \"#!/bin/bash\\ngit clone --depth 1 https://github.com/andriish/HEPrpms.git\\ncd HEPrpms\\nsh srpmsbuild.sh f2c 20240504\\n\", \"chroot\": \"epel-8-x86_64\", \"builddeps\": \"git spectool wget\", \"resultdir\": \"HEPrpms/f2c/20240504/rpmbuild/SOURCES/\", \"repos\": \"\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "averbyts/HEPrpms--averbyts", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "destdir": "/var/lib/copr/public_html/results/averbyts/HEPrpms", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/averbyts/HEPrpms", "result_dir": "09263768", "built_packages": "", "tags": [ "arch_x86_64" ], "id": 9263768, "mockchain_macros": { "copr_username": "averbyts", "copr_projectname": "HEPrpms", "vendor": "Fedora Project COPR (averbyts/HEPrpms)" } } ] } [2025-07-10 18:49:25,088][ INFO][PID:372554] Sending fedora-messaging bus message in build.end [2025-07-10 18:49:25,115][ INFO][PID:372554] Compressing /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/builder-live.log by gzip [2025-07-10 18:49:25,116][ INFO][PID:372554] Running command 'gzip /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/builder-live.log' as PID 485389 [2025-07-10 18:49:25,121][ INFO][PID:372554] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/builder-live.log) [2025-07-10 18:49:25,122][ INFO][PID:372554] Compressing /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/backend.log by gzip [2025-07-10 18:49:25,123][ INFO][PID:372554] Running command 'gzip /var/lib/copr/public_html/results/averbyts/HEPrpms/srpm-builds/09263768/backend.log' as PID 485391