[2025-07-22 17:48:38,316][ INFO][PID:2846863] Marking build as starting [2025-07-22 17:48:38,379][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:48:38,381][ INFO][PID:2846863] VM allocation process starts [2025-07-22 17:48:38,398][ INFO][PID:2846863] Trying to allocate VM: ResallocHost, ticket_id=4034645, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-22 17:48:41,421][ INFO][PID:2846863] Allocated host ResallocHost, ticket_id=4034645, hostname=98.81.234.49, name=aws_x86_64_spot_prod_05733377_20250722_174216, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-22 17:48:41,422][ INFO][PID:2846863] Allocating ssh connection to builder [2025-07-22 17:48:41,422][ INFO][PID:2846863] Checking that builder machine is OK [2025-07-22 17:48:41,938][ INFO][PID:2846863] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-07-22 17:48:42,145][ INFO][PID:2846863] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-07-22 17:48:42,146][ INFO][PID:2846863] Filling build.info file with builder info [2025-07-22 17:48:42,147][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:48:42,148][ INFO][PID:2846863] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": null, "started_on": 1753206522.1485462, "submitted_on": null, "status": 3, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9301977-fedora-41-x86_64", "build_id": 9301977, "package_name": "bootc", "package_version": "202507221737.gfe7e44c88e-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "b69a38257eddd049605e5d0480df53a425fd37fa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "09301977-bootc", "built_packages": "", "id": 9301977, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2025-07-22 17:48:42,196][ INFO][PID:2846863] Sending fedora-messaging bus message in build.start [2025-07-22 17:48:43,564][ INFO][PID:2846863] Sending fedora-messaging bus message in chroot.start [2025-07-22 17:48:43,651][ INFO][PID:2846863] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9301977-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-07-22 17:48:44,005][ INFO][PID:2846863] Downloading the builder-live.log file, attempt 1 [2025-07-22 17:48:44,006][ INFO][PID:2846863] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.234.49 copr-rpmbuild-log [2025-07-22 17:48:49,014][ INFO][PID:2846863] Periodic builder liveness probe: alive [2025-07-22 17:48:49,015][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:48:54,016][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:48:59,017][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:04,018][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:09,019][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:14,020][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:19,023][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:24,024][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:29,025][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:34,027][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:39,029][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:42,007][ ERROR][PID:2846863] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:49:44,030][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:49,033][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:52,008][WARNING][PID:2846863] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 17:49:54,036][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:49:59,037][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:02,009][ INFO][PID:2846863] Downloading the builder-live.log file, attempt 2 [2025-07-22 17:50:02,012][ INFO][PID:2846863] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.234.49 copr-rpmbuild-log [2025-07-22 17:50:04,038][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:09,039][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:14,040][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:19,041][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:24,042][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:29,043][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:34,045][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:39,046][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:44,047][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:49,049][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:54,050][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:50:59,054][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:02,081][ ERROR][PID:2846863] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:51:04,058][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:09,059][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:12,084][WARNING][PID:2846863] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 17:51:14,061][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:19,063][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:22,085][ INFO][PID:2846863] Downloading the builder-live.log file, attempt 3 [2025-07-22 17:51:22,092][ INFO][PID:2846863] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.234.49 copr-rpmbuild-log [2025-07-22 17:51:24,066][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:29,072][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:34,076][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:39,079][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:44,080][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:49,083][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:54,084][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:51:59,087][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:04,089][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:09,091][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:14,092][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:19,094][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:22,160][ ERROR][PID:2846863] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:52:24,098][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:29,099][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:32,165][WARNING][PID:2846863] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-22 17:52:34,102][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:39,103][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:42,167][ INFO][PID:2846863] Downloading the builder-live.log file, attempt 4 [2025-07-22 17:52:42,172][ INFO][PID:2846863] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.234.49 copr-rpmbuild-log [2025-07-22 17:52:44,105][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:49,106][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:54,107][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:52:59,108][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:04,109][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:09,111][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:14,112][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:19,114][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:24,115][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:29,116][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:34,117][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:39,118][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:42,258][ ERROR][PID:2846863] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-22 17:53:44,119][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:49,121][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:52,261][ ERROR][PID:2846863] Giving up for unstable SSH, failures: 1753206592.0087476, 1753206672.0844524, 1753206752.1657097, 1753206832.2611837 [2025-07-22 17:53:52,262][ ERROR][PID:2846863] Re-try request for task on 'ResallocHost, ticket_id=4034645, hostname=98.81.234.49, name=aws_x86_64_spot_prod_05733377_20250722_174216, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-22 17:53:52,263][ INFO][PID:2846863] Releasing VM back to pool [2025-07-22 17:53:52,281][ INFO][PID:2846863] Retry #1 (on other host) [2025-07-22 17:53:52,282][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:53:52,283][ INFO][PID:2846863] VM allocation process starts [2025-07-22 17:53:52,297][ INFO][PID:2846863] Trying to allocate VM: ResallocHost, ticket_id=4034750, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-22 17:53:57,299][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:02,300][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:07,301][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:12,302][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:17,305][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:20,383][ INFO][PID:2846863] Allocated host ResallocHost, ticket_id=4034750, hostname=34.228.225.96, name=aws_x86_64_spot_prod_05733727_20250722_175252, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-22 17:54:20,384][ INFO][PID:2846863] Allocating ssh connection to builder [2025-07-22 17:54:20,385][ INFO][PID:2846863] Checking that builder machine is OK [2025-07-22 17:54:20,888][ INFO][PID:2846863] Running remote command: copr-builder-ready fedora-41-x86_64 [2025-07-22 17:54:21,086][ INFO][PID:2846863] Red Hat subscription not needed for fedora-41-x86_64 Builder is ready to be used [2025-07-22 17:54:21,087][ INFO][PID:2846863] Filling build.info file with builder info [2025-07-22 17:54:21,090][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:21,092][ INFO][PID:2846863] Not re-notifying FE and msg buses for the new host. [2025-07-22 17:54:21,093][ INFO][PID:2846863] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9301977-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached [2025-07-22 17:54:21,429][ INFO][PID:2846863] Downloading the builder-live.log file, attempt 1 [2025-07-22 17:54:21,430][ INFO][PID:2846863] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.228.225.96 copr-rpmbuild-log [2025-07-22 17:54:26,429][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:31,431][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:36,432][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:41,434][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:46,436][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:51,438][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:54:56,439][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:01,442][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:06,444][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:11,445][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:16,446][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:21,449][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:26,450][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:31,451][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:36,452][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:41,454][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:46,455][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:51,456][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:55:56,457][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:01,458][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:06,460][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:11,461][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:16,462][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:21,464][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:26,465][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:31,466][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:36,467][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:41,469][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:46,470][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:51,473][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:56:56,474][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:01,475][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:06,477][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:11,479][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:16,484][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:21,485][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:26,490][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:31,492][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:36,495][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:41,496][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:46,497][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:51,498][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:57:56,499][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:01,500][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:06,501][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:11,503][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:16,504][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:21,510][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:26,512][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:31,513][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:36,515][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:41,516][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:46,517][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:51,527][ INFO][PID:2846863] Periodic builder liveness probe: alive [2025-07-22 17:58:51,528][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:58:56,529][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:01,531][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:06,532][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:11,535][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:16,536][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:21,538][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:26,539][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:31,540][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:36,541][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:41,542][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:46,544][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:51,545][ INFO][PID:2846863] Checking for cancel request [2025-07-22 17:59:56,546][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:01,547][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:06,548][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:11,550][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:16,551][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:21,552][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:26,553][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:31,554][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:36,555][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:41,556][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:46,557][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:51,558][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:00:56,560][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:01,561][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:06,562][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:11,563][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:16,564][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:21,565][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:26,567][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:31,568][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:36,571][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:41,574][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:46,576][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:51,577][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:01:56,578][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:01,580][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:06,581][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:11,582][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:16,583][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:21,585][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:26,587][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:31,589][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:36,591][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:41,592][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:46,593][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:51,594][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:02:56,595][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:01,596][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:06,597][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:11,599][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:16,600][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:21,601][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:26,602][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:31,603][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:36,605][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:41,606][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:46,607][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:51,608][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:03:56,610][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:01,612][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:06,613][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:11,614][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:16,617][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:21,618][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:26,619][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:31,621][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:36,622][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:41,624][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:46,625][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:51,626][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:04:56,635][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:01,636][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:06,637][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:11,639][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:16,640][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:21,641][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:26,645][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:31,648][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:36,652][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:41,655][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:46,657][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:51,659][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:05:56,660][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:01,662][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:06,665][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:11,667][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:16,678][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:21,680][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:26,694][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:31,695][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:36,702][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:41,704][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:46,705][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:51,707][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:06:56,713][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:01,715][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:06,718][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:11,720][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:16,722][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:21,724][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:26,725][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:31,731][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:36,733][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:41,736][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:46,739][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:51,740][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:07:56,743][ INFO][PID:2846863] Checking for cancel request [2025-07-22 18:08:01,093][ INFO][PID:2846863] Downloading results from builder [2025-07-22 18:08:01,095][ INFO][PID:2846863] rsyncing of mockbuilder@34.228.225.96:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc started [2025-07-22 18:08:01,100][ INFO][PID:2846863] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.228.225.96:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/ &> /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/build-09301977.rsync.log [2025-07-22 18:08:02,478][ INFO][PID:2846863] rsyncing finished. [2025-07-22 18:08:02,479][ INFO][PID:2846863] Releasing VM back to pool [2025-07-22 18:08:02,501][ INFO][PID:2846863] Searching for 'success' file in resultdir [2025-07-22 18:08:02,503][ INFO][PID:2846863] Going to sign pkgs from source: 9301977-fedora-41-x86_64 in chroot: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64 [2025-07-22 18:08:02,504][ INFO][PID:2846863] Calling '/bin/sign -u rhcontainerbot#bootc@copr.fedorahosted.org -p' (attempt #1) [2025-07-22 18:08:02,701][ INFO][PID:2846863] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/system-reinstall-bootc-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm' (attempt #1) [2025-07-22 18:08:03,406][ INFO][PID:2846863] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/system-reinstall-bootc-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm [2025-07-22 18:08:03,407][ INFO][PID:2846863] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-debuginfo-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm' (attempt #1) [2025-07-22 18:08:04,951][ INFO][PID:2846863] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-debuginfo-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm [2025-07-22 18:08:04,952][ INFO][PID:2846863] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-202507221737.gfe7e44c88e-1.fc41.src.rpm' (attempt #1) [2025-07-22 18:08:06,342][ INFO][PID:2846863] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-202507221737.gfe7e44c88e-1.fc41.src.rpm [2025-07-22 18:08:06,346][ INFO][PID:2846863] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm' (attempt #1) [2025-07-22 18:08:07,227][ INFO][PID:2846863] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm [2025-07-22 18:08:07,229][ INFO][PID:2846863] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-debugsource-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm' (attempt #1) [2025-07-22 18:08:08,275][ INFO][PID:2846863] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/bootc-debugsource-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm [2025-07-22 18:08:08,276][ INFO][PID:2846863] Calling '/bin/sign -4 -h sha256 -u rhcontainerbot#bootc@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/system-reinstall-bootc-debuginfo-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm' (attempt #1) [2025-07-22 18:08:09,385][ INFO][PID:2846863] signed rpm: /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/system-reinstall-bootc-debuginfo-202507221737.gfe7e44c88e-1.fc41.x86_64.rpm [2025-07-22 18:08:09,386][ INFO][PID:2846863] Sign done [2025-07-22 18:08:09,386][ INFO][PID:2846863] Incremental createrepo run, adding 09301977-bootc into https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-41-x86_64, (auto-create-repo=True) [2025-07-22 18:08:09,399][ INFO][PID:2846863] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64 --add 09301977-bootc --no-appstream-metadata' as PID 2996785 [2025-07-22 18:08:12,521][ INFO][PID:2846863] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64 --add 09301977-bootc --no-appstream-metadata) [2025-07-22 18:08:12,522][ INFO][PID:2846863] Getting build details [2025-07-22 18:08:12,524][ INFO][PID:2846863] Listing built binary packages in /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc [2025-07-22 18:08:12,525][ INFO][PID:2846863] Built packages: ['bootc-debuginfo 202507221737.gfe7e44c88e', 'system-reinstall-bootc 202507221737.gfe7e44c88e', 'bootc 202507221737.gfe7e44c88e', 'system-reinstall-bootc-debuginfo 202507221737.gfe7e44c88e', 'bootc-debugsource 202507221737.gfe7e44c88e'] [2025-07-22 18:08:12,527][ INFO][PID:2846863] build details: {'built_packages': 'bootc-debuginfo 202507221737.gfe7e44c88e\nsystem-reinstall-bootc 202507221737.gfe7e44c88e\nbootc 202507221737.gfe7e44c88e\nsystem-reinstall-bootc-debuginfo 202507221737.gfe7e44c88e\nbootc-debugsource 202507221737.gfe7e44c88e'} [2025-07-22 18:08:12,528][ INFO][PID:2846863] Retrieving pubkey [2025-07-22 18:08:12,530][ INFO][PID:2846863] Calling '/bin/sign -u rhcontainerbot#bootc@copr.fedorahosted.org -p' (attempt #1) [2025-07-22 18:08:12,885][ INFO][PID:2846863] Added pubkey for user rhcontainerbot project bootc into: /var/lib/copr/public_html/results/rhcontainerbot/bootc/pubkey.gpg [2025-07-22 18:08:12,888][ INFO][PID:2846863] Finished build: id=9301977 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/rhcontainerbot/bootc chroot=fedora-41-x86_64 [2025-07-22 18:08:12,901][ INFO][PID:2846863] Worker succeeded build, took 831.8087298870087 [2025-07-22 18:08:12,902][ INFO][PID:2846863] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rhcontainerbot", "project_name": "bootc", "project_dirname": "bootc", "submitter": "packit", "ended_on": 1753207692.901201, "started_on": 1753206861.0924711, "submitted_on": null, "status": 1, "chroot": "fedora-41-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9301977-fedora-41-x86_64", "build_id": 9301977, "package_name": "bootc", "package_version": "202507221737.gfe7e44c88e-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rhcontainerbot/bootc/bootc", "git_hash": "b69a38257eddd049605e5d0480df53a425fd37fa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rhcontainerbot/bootc--packit", "results": { "packages": [ { "name": "bootc-debuginfo", "epoch": null, "version": "202507221737.gfe7e44c88e", "release": "1.fc41", "arch": "x86_64" }, { "name": "bootc", "epoch": null, "version": "202507221737.gfe7e44c88e", "release": "1.fc41", "arch": "src" }, { "name": "system-reinstall-bootc", "epoch": null, "version": "202507221737.gfe7e44c88e", "release": "1.fc41", "arch": "x86_64" }, { "name": "bootc", "epoch": null, "version": "202507221737.gfe7e44c88e", "release": "1.fc41", "arch": "x86_64" }, { "name": "system-reinstall-bootc-debuginfo", "epoch": null, "version": "202507221737.gfe7e44c88e", "release": "1.fc41", "arch": "x86_64" }, { "name": "bootc-debugsource", "epoch": null, "version": "202507221737.gfe7e44c88e", "release": "1.fc41", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc/fedora-41-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rhcontainerbot/bootc", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rhcontainerbot/bootc", "result_dir": "09301977-bootc", "built_packages": "bootc-debuginfo 202507221737.gfe7e44c88e\nsystem-reinstall-bootc 202507221737.gfe7e44c88e\nbootc 202507221737.gfe7e44c88e\nsystem-reinstall-bootc-debuginfo 202507221737.gfe7e44c88e\nbootc-debugsource 202507221737.gfe7e44c88e", "id": 9301977, "mockchain_macros": { "copr_username": "rhcontainerbot", "copr_projectname": "bootc", "vendor": "Fedora Project COPR (rhcontainerbot/bootc)" } } ] } [2025-07-22 18:08:12,967][ INFO][PID:2846863] Sending fedora-messaging bus message in build.end [2025-07-22 18:08:13,059][ INFO][PID:2846863] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/builder-live.log by gzip [2025-07-22 18:08:13,064][ INFO][PID:2846863] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/builder-live.log' as PID 2997455 [2025-07-22 18:08:13,231][ INFO][PID:2846863] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/builder-live.log) [2025-07-22 18:08:13,232][ INFO][PID:2846863] Compressing /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/backend.log by gzip [2025-07-22 18:08:13,248][ INFO][PID:2846863] Running command 'gzip /var/lib/copr/public_html/results/rhcontainerbot/bootc/fedora-41-x86_64/09301977-bootc/backend.log' as PID 2997484