[2025-06-25 18:49:08,931][ INFO][PID:1372298] Marking build as starting [2025-06-25 18:49:08,990][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:08,998][ INFO][PID:1372298] VM allocation process starts [2025-06-25 18:49:09,036][ INFO][PID:1372298] Trying to allocate VM: ResallocHost, ticket_id=3667180, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-06-25 18:49:14,039][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:19,042][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:24,049][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:29,051][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:34,054][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:39,057][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:44,060][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:49,066][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:54,069][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:49:59,071][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:04,073][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:09,075][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:14,079][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:19,081][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:24,082][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:29,083][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:34,084][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:39,090][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:44,094][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:49,095][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:54,096][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:50:59,101][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:04,103][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:09,104][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:14,105][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:19,106][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:24,116][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:29,122][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:34,130][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:39,132][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:44,137][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:49,138][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:54,141][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:51:59,148][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:04,151][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:09,156][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:14,157][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:19,158][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:24,160][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:29,164][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:34,168][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:39,169][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:44,170][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:49,176][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:54,180][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:52:59,182][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:04,185][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:09,199][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:14,203][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:19,211][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:24,217][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:27,333][ INFO][PID:1372298] Allocated host ResallocHost, ticket_id=3667180, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05002312_20250625_184842, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-06-25 18:53:27,339][ INFO][PID:1372298] Allocating ssh connection to builder [2025-06-25 18:53:27,342][ INFO][PID:1372298] Checking that builder machine is OK [2025-06-25 18:53:28,918][ INFO][PID:1372298] Running remote command: copr-builder-ready epel-7-ppc64le [2025-06-25 18:53:30,000][ INFO][PID:1372298] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-06-25 18:53:30,004][ INFO][PID:1372298] Filling build.info file with builder info [2025-06-25 18:53:30,005][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:30,010][ INFO][PID:1372298] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "whitestar", "project_name": "connection-agent", "project_dirname": "connection-agent", "submitter": "whitestar", "ended_on": null, "started_on": 1750877610.0107253, "submitted_on": null, "status": 3, "chroot": "epel-7-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9210914-epel-7-ppc64le", "build_id": 9210914, "package_name": "connection-agent", "package_version": "5.0.280-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/whitestar/connection-agent/connection-agent", "git_hash": "c168fa474635b6b0f82bb4fc0aed596639cb22c3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "whitestar/connection-agent--whitestar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/whitestar/connection-agent/epel-7-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/whitestar/connection-agent", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/whitestar/connection-agent", "result_dir": "09210914-connection-agent", "built_packages": "", "id": 9210914, "mockchain_macros": { "copr_username": "whitestar", "copr_projectname": "connection-agent", "vendor": "Fedora Project COPR (whitestar/connection-agent)" } } ] } [2025-06-25 18:53:30,086][ INFO][PID:1372298] Sending fedora-messaging bus message in build.start [2025-06-25 18:53:32,000][ INFO][PID:1372298] Sending fedora-messaging bus message in chroot.start [2025-06-25 18:53:32,087][ INFO][PID:1372298] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9210914-epel-7-ppc64le --chroot epel-7-ppc64le --detached [2025-06-25 18:53:33,514][ INFO][PID:1372298] Downloading the builder-live.log file, attempt 1 [2025-06-25 18:53:33,520][ INFO][PID:1372298] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log [2025-06-25 18:53:38,555][ INFO][PID:1372298] Periodic builder liveness probe: alive [2025-06-25 18:53:38,561][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:43,565][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:48,577][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:53,581][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:53:58,587][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:03,589][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:08,593][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:13,603][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:18,607][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:23,610][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:28,612][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:33,614][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:38,616][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:43,623][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:48,625][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:53,627][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:54:58,630][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:03,631][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:08,632][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:13,634][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:18,636][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:23,639][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:28,642][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:33,646][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:38,649][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:43,652][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:48,659][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:53,662][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:55:58,667][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:03,669][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:08,676][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:13,680][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:18,682][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:23,685][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:28,687][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:33,690][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:38,692][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:43,695][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:48,698][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:53,703][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:56:58,706][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:03,708][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:08,710][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:13,711][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:18,720][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:23,721][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:28,723][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:33,726][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:38,730][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:43,732][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:48,736][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:53,745][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:57:58,746][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:03,748][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:05,140][ ERROR][PID:1372298] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 18:58:08,754][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:13,755][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:15,144][WARNING][PID:1372298] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 18:58:18,758][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:23,765][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:25,147][ INFO][PID:1372298] Downloading the builder-live.log file, attempt 2 [2025-06-25 18:58:25,149][ INFO][PID:1372298] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log [2025-06-25 18:58:28,768][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:33,774][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:38,776][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:43,779][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:48,793][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:53,797][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:58:58,800][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:03,804][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:08,809][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:13,811][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:18,814][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:23,824][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:25,304][ ERROR][PID:1372298] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 18:59:28,825][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:33,827][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:35,308][WARNING][PID:1372298] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 18:59:38,836][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:43,839][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:45,310][ INFO][PID:1372298] Downloading the builder-live.log file, attempt 3 [2025-06-25 18:59:45,319][ INFO][PID:1372298] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log [2025-06-25 18:59:48,841][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:53,845][ INFO][PID:1372298] Checking for cancel request [2025-06-25 18:59:58,849][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:03,850][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:08,856][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:13,857][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:18,860][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:23,865][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:28,873][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:33,889][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:38,892][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:43,893][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:45,477][ ERROR][PID:1372298] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:00:48,898][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:53,901][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:00:55,480][WARNING][PID:1372298] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-06-25 19:00:58,903][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:03,909][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:05,484][ INFO][PID:1372298] Downloading the builder-live.log file, attempt 4 [2025-06-25 19:01:05,490][ INFO][PID:1372298] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.240 copr-rpmbuild-log [2025-06-25 19:01:08,914][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:13,917][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:18,920][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:23,923][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:28,925][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:33,936][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:38,937][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:43,941][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:48,949][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:53,961][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:01:58,969][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:03,971][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:05,664][ ERROR][PID:1372298] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-06-25 19:02:08,977][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:13,982][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:15,666][ ERROR][PID:1372298] Giving up for unstable SSH, failures: 1750877895.144289, 1750877975.3086405, 1750878055.48068, 1750878135.6660948 [2025-06-25 19:02:15,671][ ERROR][PID:1372298] Re-try request for task on 'ResallocHost, ticket_id=3667180, hostname=140.211.168.240, name=copr_osuosl_p09_prod_05002312_20250625_184842, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-06-25 19:02:15,672][ INFO][PID:1372298] Releasing VM back to pool [2025-06-25 19:02:15,723][ INFO][PID:1372298] Retry #1 (on other host) [2025-06-25 19:02:15,727][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:15,732][ INFO][PID:1372298] VM allocation process starts [2025-06-25 19:02:15,791][ INFO][PID:1372298] Trying to allocate VM: ResallocHost, ticket_id=3667530, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-06-25 19:02:20,802][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:25,804][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:30,805][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:35,811][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:40,815][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:43,951][ INFO][PID:1372298] Allocated host ResallocHost, ticket_id=3667530, hostname=2620:52:3:1:dead:beef:cafe:c20c, name=copr_hv_ppc64le_01_prod_05002231_20250625_184550, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-06-25 19:02:43,952][ INFO][PID:1372298] Allocating ssh connection to builder [2025-06-25 19:02:43,953][ INFO][PID:1372298] Checking that builder machine is OK [2025-06-25 19:02:46,196][ INFO][PID:1372298] Running remote command: copr-builder-ready epel-7-ppc64le [2025-06-25 19:02:47,300][ INFO][PID:1372298] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-06-25 19:02:47,302][ INFO][PID:1372298] Filling build.info file with builder info [2025-06-25 19:02:47,306][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:47,309][ INFO][PID:1372298] Not re-notifying FE and msg buses for the new host. [2025-06-25 19:02:47,310][ INFO][PID:1372298] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9210914-epel-7-ppc64le --chroot epel-7-ppc64le --detached [2025-06-25 19:02:48,544][ INFO][PID:1372298] Downloading the builder-live.log file, attempt 1 [2025-06-25 19:02:48,545][ INFO][PID:1372298] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20c copr-rpmbuild-log [2025-06-25 19:02:53,547][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:02:58,552][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:03,553][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:08,555][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:13,557][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:18,561][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:23,564][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:28,568][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:33,572][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:38,607][ INFO][PID:1372298] Periodic builder liveness probe: alive [2025-06-25 19:03:38,610][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:43,611][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:48,613][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:53,618][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:03:58,623][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:03,624][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:08,628][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:13,632][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:18,634][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:23,637][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:28,639][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:33,642][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:38,644][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:43,651][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:48,652][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:53,654][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:04:58,656][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:03,657][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:08,660][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:13,668][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:18,671][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:23,673][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:28,676][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:33,678][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:38,682][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:43,686][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:48,687][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:53,689][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:05:58,692][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:03,695][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:08,696][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:13,698][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:18,702][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:23,705][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:28,709][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:33,711][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:38,715][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:43,721][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:48,722][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:53,724][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:06:58,727][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:03,732][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:08,735][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:13,742][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:18,743][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:23,744][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:28,746][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:33,748][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:38,750][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:43,757][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:48,761][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:53,766][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:07:58,767][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:03,769][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:08,776][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:13,780][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:18,781][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:23,784][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:28,788][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:33,789][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:38,791][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:43,792][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:48,794][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:53,798][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:08:58,802][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:03,804][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:08,806][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:13,807][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:18,812][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:23,814][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:28,815][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:33,818][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:38,821][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:43,826][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:48,829][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:53,833][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:09:58,837][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:03,840][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:08,841][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:13,846][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:18,848][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:23,854][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:28,855][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:33,856][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:38,861][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:43,865][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:48,866][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:53,868][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:10:58,870][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:11:03,871][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:11:08,878][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:11:13,880][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:11:18,883][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:11:23,892][ INFO][PID:1372298] Checking for cancel request [2025-06-25 19:11:28,645][ INFO][PID:1372298] Downloading results from builder [2025-06-25 19:11:28,645][ INFO][PID:1372298] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent started [2025-06-25 19:11:28,648][ INFO][PID:1372298] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/ &> /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/build-09210914.rsync.log [2025-06-25 19:11:35,238][ INFO][PID:1372298] rsyncing finished. [2025-06-25 19:11:35,240][ INFO][PID:1372298] Releasing VM back to pool [2025-06-25 19:11:35,254][ INFO][PID:1372298] Searching for 'success' file in resultdir [2025-06-25 19:11:35,254][ INFO][PID:1372298] Going to sign pkgs from source: 9210914-epel-7-ppc64le in chroot: /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le [2025-06-25 19:11:35,255][ INFO][PID:1372298] Calling '/bin/sign -u whitestar#connection-agent@copr.fedorahosted.org -p' (attempt #1) [2025-06-25 19:11:35,432][ INFO][PID:1372298] Calling '/bin/sign -4 -h sha256 -u whitestar#connection-agent@copr.fedorahosted.org -r /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/connection-agent-5.0.280-1.el7_9.src.rpm' (attempt #1) [2025-06-25 19:11:40,121][ INFO][PID:1372298] signed rpm: /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/connection-agent-5.0.280-1.el7_9.src.rpm [2025-06-25 19:11:40,122][ INFO][PID:1372298] Calling '/bin/sign -4 -h sha256 -u whitestar#connection-agent@copr.fedorahosted.org -r /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/connection-agent-5.0.280-1.el7_9.noarch.rpm' (attempt #1) [2025-06-25 19:11:42,005][ INFO][PID:1372298] signed rpm: /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/connection-agent-5.0.280-1.el7_9.noarch.rpm [2025-06-25 19:11:42,006][ INFO][PID:1372298] Sign done [2025-06-25 19:11:42,007][ INFO][PID:1372298] Incremental createrepo run, adding 09210914-connection-agent into https://download.copr.fedorainfracloud.org/results/whitestar/connection-agent/epel-7-ppc64le, (auto-create-repo=True) [2025-06-25 19:11:42,009][ INFO][PID:1372298] Running command 'copr-repo --batched /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le --add 09210914-connection-agent --no-appstream-metadata' as PID 1632396 [2025-06-25 19:11:44,502][ INFO][PID:1372298] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le --add 09210914-connection-agent --no-appstream-metadata) [2025-06-25 19:11:44,503][ INFO][PID:1372298] Getting build details [2025-06-25 19:11:44,505][ INFO][PID:1372298] Listing built binary packages in /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent [2025-06-25 19:11:44,505][ INFO][PID:1372298] Built packages: ['connection-agent 5.0.280'] [2025-06-25 19:11:44,510][ INFO][PID:1372298] build details: {'built_packages': 'connection-agent 5.0.280'} [2025-06-25 19:11:44,510][ INFO][PID:1372298] Retrieving pubkey [2025-06-25 19:11:44,511][ INFO][PID:1372298] Calling '/bin/sign -u whitestar#connection-agent@copr.fedorahosted.org -p' (attempt #1) [2025-06-25 19:11:44,691][ INFO][PID:1372298] Added pubkey for user whitestar project connection-agent into: /var/lib/copr/public_html/results/whitestar/connection-agent/pubkey.gpg [2025-06-25 19:11:44,693][ INFO][PID:1372298] Finished build: id=9210914 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/whitestar/connection-agent chroot=epel-7-ppc64le [2025-06-25 19:11:44,698][ INFO][PID:1372298] Worker succeeded build, took 537.3893349170685 [2025-06-25 19:11:44,700][ INFO][PID:1372298] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "whitestar", "project_name": "connection-agent", "project_dirname": "connection-agent", "submitter": "whitestar", "ended_on": 1750878704.698564, "started_on": 1750878167.3092291, "submitted_on": null, "status": 1, "chroot": "epel-7-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9210914-epel-7-ppc64le", "build_id": 9210914, "package_name": "connection-agent", "package_version": "5.0.280-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/whitestar/connection-agent/connection-agent", "git_hash": "c168fa474635b6b0f82bb4fc0aed596639cb22c3", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "whitestar/connection-agent--whitestar", "results": { "packages": [ { "name": "connection-agent", "epoch": null, "version": "5.0.280", "release": "1.el7_9", "arch": "noarch" }, { "name": "connection-agent", "epoch": null, "version": "5.0.280", "release": "1.el7_9", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/whitestar/connection-agent/epel-7-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/whitestar/connection-agent", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/whitestar/connection-agent", "result_dir": "09210914-connection-agent", "built_packages": "connection-agent 5.0.280", "id": 9210914, "mockchain_macros": { "copr_username": "whitestar", "copr_projectname": "connection-agent", "vendor": "Fedora Project COPR (whitestar/connection-agent)" } } ] } [2025-06-25 19:11:44,768][ INFO][PID:1372298] Sending fedora-messaging bus message in build.end [2025-06-25 19:11:44,827][ INFO][PID:1372298] Compressing /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/builder-live.log by gzip [2025-06-25 19:11:44,835][ INFO][PID:1372298] Running command 'gzip /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/builder-live.log' as PID 1632767 [2025-06-25 19:11:44,851][ INFO][PID:1372298] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/builder-live.log) [2025-06-25 19:11:44,855][ INFO][PID:1372298] Compressing /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/backend.log by gzip [2025-06-25 19:11:44,857][ INFO][PID:1372298] Running command 'gzip /var/lib/copr/public_html/results/whitestar/connection-agent/epel-7-ppc64le/09210914-connection-agent/backend.log' as PID 1632776