[2025-12-18 17:05:19,678][ INFO][PID:2262936] Marking build as starting [2025-12-18 17:05:19,752][ INFO][PID:2262936] Checking that /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/repodata/repomd.xml exists [2025-12-18 17:05:19,753][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:19,754][ INFO][PID:2262936] VM allocation process starts [2025-12-18 17:05:19,773][ INFO][PID:2262936] Trying to allocate VM: ResallocHost, ticket_id=427008, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 17:05:22,788][ INFO][PID:2262936] Allocated host ResallocHost, ticket_id=427008, hostname=3.80.108.9, name=aws_x86_64_spot_prod_00683808_20251218_170219, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 17:05:22,789][ INFO][PID:2262936] Allocating ssh connection to builder [2025-12-18 17:05:22,789][ INFO][PID:2262936] Checking that builder machine is OK [2025-12-18 17:05:23,115][ INFO][PID:2262936] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-12-18 17:05:23,319][ INFO][PID:2262936] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-12-18 17:05:23,320][ INFO][PID:2262936] Filling build.info file with builder info [2025-12-18 17:05:23,323][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:23,324][ INFO][PID:2262936] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "vpp-git", "project_dirname": "vpp-git", "submitter": "nucleo", "ended_on": null, "started_on": 1766077523.3247056, "submitted_on": null, "status": 3, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9931902-fedora-41-x86_64", "build_id": 9931902, "package_name": "vpp-ext-deps", "package_version": "26.02-0.395.rc0.20251218git8e9e63a0e", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/vpp-git/vpp-ext-deps", "git_hash": "27c2657e1d2236665c9f264ae7efd9d39814d202", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/vpp-git--nucleo", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/vpp-git/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/vpp-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/vpp-git", "result_dir": "09931902-vpp-ext-deps", "built_packages": "", "id": 9931902, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "vpp-git", "vendor": "Fedora Project COPR (nucleo/vpp-git)" } } ] } [2025-12-18 17:05:23,420][ INFO][PID:2262936] Sending fedora-messaging bus message in build.start [2025-12-18 17:05:24,090][ INFO][PID:2262936] Sending fedora-messaging bus message in chroot.start [2025-12-18 17:05:24,120][ INFO][PID:2262936] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9931902-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-12-18 17:05:24,441][ INFO][PID:2262936] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.80.108.9' (ED25519) to the list of known hosts. [2025-12-18 17:05:24,442][ INFO][PID:2262936] Downloading the builder-live.log file, attempt 1 [2025-12-18 17:05:24,444][ INFO][PID:2262936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.108.9 copr-rpmbuild-log [2025-12-18 17:05:29,450][ INFO][PID:2262936] Periodic builder liveness probe: alive [2025-12-18 17:05:29,451][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:34,452][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:39,453][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:44,454][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:49,455][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:54,456][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:05:59,458][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:04,459][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:09,460][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:14,461][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:19,465][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:24,466][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:29,467][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:34,468][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:39,469][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:44,470][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:49,471][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:54,473][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:06:59,474][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:04,476][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:09,477][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:14,478][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:19,479][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:24,480][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:29,481][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:34,482][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:39,483][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:44,498][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:49,500][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:54,501][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:07:59,502][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:04,503][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:09,505][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:14,507][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:15,839][ ERROR][PID:2262936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 17:08:19,511][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:24,513][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:25,843][WARNING][PID:2262936] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-18 17:08:29,514][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:34,515][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:35,844][ INFO][PID:2262936] Downloading the builder-live.log file, attempt 2 [2025-12-18 17:08:35,846][ INFO][PID:2262936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.108.9 copr-rpmbuild-log [2025-12-18 17:08:39,518][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:44,519][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:49,522][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:54,525][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:08:59,527][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:04,531][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:09,533][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:14,536][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:19,539][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:24,542][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:29,543][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:34,550][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:35,914][ ERROR][PID:2262936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 17:09:39,551][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:44,554][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:45,928][WARNING][PID:2262936] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-18 17:09:49,557][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:54,558][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:09:55,929][ INFO][PID:2262936] Downloading the builder-live.log file, attempt 3 [2025-12-18 17:09:55,930][ INFO][PID:2262936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.108.9 copr-rpmbuild-log [2025-12-18 17:09:59,559][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:04,560][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:09,563][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:14,567][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:19,568][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:24,570][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:29,571][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:34,572][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:39,573][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:44,574][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:49,575][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:54,577][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:10:55,998][ ERROR][PID:2262936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 17:10:59,578][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:04,579][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:06,029][WARNING][PID:2262936] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-12-18 17:11:09,580][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:14,581][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:16,030][ INFO][PID:2262936] Downloading the builder-live.log file, attempt 4 [2025-12-18 17:11:16,035][ INFO][PID:2262936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.80.108.9 copr-rpmbuild-log [2025-12-18 17:11:19,583][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:24,584][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:29,591][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:34,594][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:39,596][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:44,600][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:49,601][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:54,602][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:11:59,603][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:04,605][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:09,610][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:14,614][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:16,118][ ERROR][PID:2262936] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-12-18 17:12:19,615][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:24,617][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:26,143][ ERROR][PID:2262936] Giving up for unstable SSH, failures: 1766077705.8438904, 1766077785.9283247, 1766077866.029449, 1766077946.1430197 [2025-12-18 17:12:26,144][ ERROR][PID:2262936] Re-try request for task on 'ResallocHost, ticket_id=427008, hostname=3.80.108.9, name=aws_x86_64_spot_prod_00683808_20251218_170219, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-12-18 17:12:26,145][ INFO][PID:2262936] Releasing VM back to pool [2025-12-18 17:12:26,164][ INFO][PID:2262936] Retry #1 (on other host) [2025-12-18 17:12:26,165][ INFO][PID:2262936] Checking that /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/repodata/repomd.xml exists [2025-12-18 17:12:26,167][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:26,168][ INFO][PID:2262936] VM allocation process starts [2025-12-18 17:12:26,181][ INFO][PID:2262936] Trying to allocate VM: ResallocHost, ticket_id=427146, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 17:12:29,203][ INFO][PID:2262936] Allocated host ResallocHost, ticket_id=427146, hostname=54.234.102.137, name=aws_x86_64_normal_prod_00684136_20251218_170813, requested_tags=['copr_builder', 'arch_x86_64'] [2025-12-18 17:12:29,204][ INFO][PID:2262936] Allocating ssh connection to builder [2025-12-18 17:12:29,206][ INFO][PID:2262936] Checking that builder machine is OK [2025-12-18 17:12:29,581][ INFO][PID:2262936] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-12-18 17:12:29,798][ INFO][PID:2262936] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-12-18 17:12:29,798][ INFO][PID:2262936] Filling build.info file with builder info [2025-12-18 17:12:29,907][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:29,909][ INFO][PID:2262936] Not re-notifying FE and msg buses for the new host. [2025-12-18 17:12:29,910][ INFO][PID:2262936] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9931902-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-12-18 17:12:30,334][ INFO][PID:2262936] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.234.102.137' (ED25519) to the list of known hosts. [2025-12-18 17:12:30,336][ INFO][PID:2262936] Downloading the builder-live.log file, attempt 1 [2025-12-18 17:12:30,345][ INFO][PID:2262936] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.234.102.137 copr-rpmbuild-log [2025-12-18 17:12:35,340][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:40,342][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:45,343][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:50,347][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:12:55,351][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:00,352][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:05,356][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:10,362][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:15,366][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:20,372][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:25,374][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:30,376][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:35,380][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:40,381][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:45,383][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:50,386][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:13:55,387][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:00,389][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:05,392][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:10,394][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:15,396][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:20,397][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:25,399][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:30,400][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:35,404][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:40,407][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:45,409][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:50,415][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:14:55,418][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:00,420][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:05,430][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:10,432][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:15,434][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:20,436][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:25,439][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:30,492][ INFO][PID:2262936] Periodic builder liveness probe: alive [2025-12-18 17:15:30,493][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:35,494][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:40,496][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:45,498][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:50,501][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:15:55,502][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:00,503][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:05,504][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:10,505][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:15,506][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:20,508][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:25,509][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:30,510][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:35,514][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:40,515][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:45,516][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:50,517][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:16:55,518][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:00,520][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:05,521][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:10,522][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:15,523][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:20,524][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:25,525][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:30,526][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:35,527][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:40,528][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:45,529][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:50,530][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:17:55,531][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:00,532][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:05,533][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:10,534][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:15,535][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:20,536][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:25,537][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:30,538][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:35,539][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:40,540][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:45,541][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:50,542][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:18:55,543][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:00,544][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:05,545][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:10,546][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:15,547][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:20,548][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:25,549][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:30,550][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:35,551][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:40,552][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:45,553][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:50,554][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:19:55,555][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:00,556][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:05,557][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:10,558][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:15,560][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:20,564][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:25,565][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:30,566][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:35,567][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:40,568][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:45,569][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:50,570][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:20:55,571][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:00,572][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:05,573][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:10,574][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:15,575][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:20,576][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:25,577][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:30,578][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:35,579][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:40,580][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:45,581][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:50,582][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:21:55,583][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:00,583][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:05,584][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:10,585][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:15,586][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:20,587][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:25,588][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:30,589][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:35,592][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:40,593][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:45,594][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:50,595][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:22:55,596][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:00,597][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:05,599][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:10,601][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:15,602][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:20,603][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:25,604][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:30,611][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:35,612][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:40,613][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:45,615][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:50,616][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:23:55,617][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:00,618][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:05,619][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:10,620][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:15,623][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:20,624][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:25,626][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:30,627][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:35,628][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:40,629][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:45,630][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:50,631][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:24:55,632][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:00,633][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:05,635][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:10,638][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:15,640][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:20,640][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:25,642][ INFO][PID:2262936] Checking for cancel request [2025-12-18 17:25:29,313][ INFO][PID:2262936] Downloading results from builder [2025-12-18 17:25:29,600][ INFO][PID:2262936] rsyncing of mockbuilder@54.234.102.137:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps started [2025-12-18 17:25:29,601][ INFO][PID:2262936] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.234.102.137:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/ &> /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/build-09931902.rsync.log [2025-12-18 17:25:30,630][ INFO][PID:2262936] rsyncing finished. [2025-12-18 17:25:30,631][ INFO][PID:2262936] Releasing VM back to pool [2025-12-18 17:25:30,640][ INFO][PID:2262936] Searching for 'success' file in resultdir [2025-12-18 17:25:30,640][ INFO][PID:2262936] Going to sign pkgs from source: 9931902-fedora-41-x86_64 in chroot: /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64 [2025-12-18 17:25:30,641][ INFO][PID:2262936] Calling '/bin/sign -u nucleo#vpp-git@copr.fedorahosted.org -p' (attempt #1) [2025-12-18 17:25:30,907][ INFO][PID:2262936] Calling '/bin/sign -4 -h sha256 -u nucleo#vpp-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.x86_64.rpm' (attempt #1) [2025-12-18 17:25:33,064][ INFO][PID:2262936] signed rpm: /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.x86_64.rpm [2025-12-18 17:25:33,064][ INFO][PID:2262936] Calling '/bin/sign -4 -h sha256 -u nucleo#vpp-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-debugsource-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.x86_64.rpm' (attempt #1) [2025-12-18 17:25:33,824][ INFO][PID:2262936] signed rpm: /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-debugsource-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.x86_64.rpm [2025-12-18 17:25:33,825][ INFO][PID:2262936] Calling '/bin/sign -4 -h sha256 -u nucleo#vpp-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-debuginfo-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.x86_64.rpm' (attempt #1) [2025-12-18 17:25:34,781][ INFO][PID:2262936] signed rpm: /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-debuginfo-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.x86_64.rpm [2025-12-18 17:25:34,781][ INFO][PID:2262936] Calling '/bin/sign -4 -h sha256 -u nucleo#vpp-git@copr.fedorahosted.org -r /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.src.rpm' (attempt #1) [2025-12-18 17:25:36,254][ INFO][PID:2262936] signed rpm: /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/vpp-ext-deps-26.02-0.395.rc0.20251218git8e9e63a0e.fc41.src.rpm [2025-12-18 17:25:36,254][ INFO][PID:2262936] Sign done [2025-12-18 17:25:36,255][ INFO][PID:2262936] Incremental createrepo run, adding 09931902-vpp-ext-deps into https://download.copr.fedorainfracloud.org/results/nucleo/vpp-git/fedora-41-x86_64, (auto-create-repo=True) [2025-12-18 17:25:36,256][ INFO][PID:2262936] Running command 'copr-repo --batched /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64 --add 09931902-vpp-ext-deps --no-appstream-metadata' as PID 2383190 [2025-12-18 17:25:37,725][ INFO][PID:2262936] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64 --add 09931902-vpp-ext-deps --no-appstream-metadata) [2025-12-18 17:25:37,726][ INFO][PID:2262936] Getting build details [2025-12-18 17:25:37,726][ INFO][PID:2262936] Listing built binary packages in /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps [2025-12-18 17:25:37,726][ INFO][PID:2262936] Built packages: ['vpp-ext-deps-debuginfo 26.02', 'vpp-ext-deps-debugsource 26.02', 'vpp-ext-deps 26.02'] [2025-12-18 17:25:37,727][ INFO][PID:2262936] build details: {'built_packages': 'vpp-ext-deps-debuginfo 26.02\nvpp-ext-deps-debugsource 26.02\nvpp-ext-deps 26.02'} [2025-12-18 17:25:37,727][ INFO][PID:2262936] Retrieving pubkey [2025-12-18 17:25:37,728][ INFO][PID:2262936] Calling '/bin/sign -u nucleo#vpp-git@copr.fedorahosted.org -p' (attempt #1) [2025-12-18 17:25:38,010][ INFO][PID:2262936] Added pubkey for user nucleo project vpp-git into: /var/lib/copr/public_html/results/nucleo/vpp-git/pubkey.gpg [2025-12-18 17:25:38,011][ INFO][PID:2262936] Finished build: id=9931902 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/nucleo/vpp-git chroot=fedora-41-x86_64 [2025-12-18 17:25:38,013][ INFO][PID:2262936] Worker succeeded build, took 788.1035141944885 [2025-12-18 17:25:38,013][ INFO][PID:2262936] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "nucleo", "project_name": "vpp-git", "project_dirname": "vpp-git", "submitter": "nucleo", "ended_on": 1766078738.0132513, "started_on": 1766077949.909737, "submitted_on": null, "status": 1, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9931902-fedora-41-x86_64", "build_id": 9931902, "package_name": "vpp-ext-deps", "package_version": "26.02-0.395.rc0.20251218git8e9e63a0e", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/nucleo/vpp-git/vpp-ext-deps", "git_hash": "27c2657e1d2236665c9f264ae7efd9d39814d202", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "nucleo/vpp-git--nucleo", "results": { "packages": [ { "name": "vpp-ext-deps-debuginfo", "epoch": null, "version": "26.02", "release": "0.395.rc0.20251218git8e9e63a0e.fc41", "arch": "x86_64" }, { "name": "vpp-ext-deps", "epoch": null, "version": "26.02", "release": "0.395.rc0.20251218git8e9e63a0e.fc41", "arch": "src" }, { "name": "vpp-ext-deps-debugsource", "epoch": null, "version": "26.02", "release": "0.395.rc0.20251218git8e9e63a0e.fc41", "arch": "x86_64" }, { "name": "vpp-ext-deps", "epoch": null, "version": "26.02", "release": "0.395.rc0.20251218git8e9e63a0e.fc41", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/nucleo/vpp-git/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/nucleo/vpp-git", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/nucleo/vpp-git", "result_dir": "09931902-vpp-ext-deps", "built_packages": "vpp-ext-deps-debuginfo 26.02\nvpp-ext-deps-debugsource 26.02\nvpp-ext-deps 26.02", "id": 9931902, "mockchain_macros": { "copr_username": "nucleo", "copr_projectname": "vpp-git", "vendor": "Fedora Project COPR (nucleo/vpp-git)" } } ] } [2025-12-18 17:25:38,076][ INFO][PID:2262936] Sending fedora-messaging bus message in build.end [2025-12-18 17:25:38,104][ INFO][PID:2262936] Compressing /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/builder-live.log by gzip [2025-12-18 17:25:38,105][ INFO][PID:2262936] Running command 'gzip /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/builder-live.log' as PID 2383462 [2025-12-18 17:25:38,204][ INFO][PID:2262936] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/builder-live.log) [2025-12-18 17:25:38,205][ INFO][PID:2262936] Compressing /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/backend.log by gzip [2025-12-18 17:25:38,206][ INFO][PID:2262936] Running command 'gzip /var/lib/copr/public_html/results/nucleo/vpp-git/fedora-41-x86_64/09931902-vpp-ext-deps/backend.log' as PID 2383477