[2026-01-03 06:17:38,826][ INFO][PID:4063688] Marking build as starting [2026-01-03 06:17:39,111][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:17:39,127][ INFO][PID:4063688] VM allocation process starts [2026-01-03 06:17:39,316][ INFO][PID:4063688] Trying to allocate VM: ResallocHost, ticket_id=632675, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-03 06:17:44,374][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:17:49,455][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:17:54,462][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:17:59,500][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:04,583][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:09,584][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:14,592][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:19,670][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:24,710][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:29,738][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:34,868][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:39,869][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:44,889][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:49,892][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:54,925][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:18:59,949][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:04,990][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:10,003][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:15,033][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:20,039][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:25,043][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:30,059][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:35,079][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:40,082][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:45,093][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:50,113][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:19:55,124][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:00,166][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:05,171][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:10,174][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:15,183][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:20,202][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:25,205][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:30,216][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:35,243][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:40,254][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:45,316][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:50,326][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:20:55,373][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:00,464][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:05,529][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:10,619][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:15,713][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:20,891][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:25,934][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:30,996][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:36,010][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:41,050][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:46,270][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:51,466][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:21:56,487][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:01,511][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:06,516][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:11,529][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:16,552][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:21,598][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:26,610][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:31,620][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:36,757][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:41,865][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:46,866][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:51,873][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:22:56,893][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:01,894][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:06,898][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:12,044][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:17,123][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:22,168][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:27,219][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:32,242][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:37,280][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:42,302][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:47,306][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:52,363][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:23:57,685][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:02,686][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:07,689][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:12,692][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:17,768][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:22,815][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:27,817][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:32,829][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:38,007][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:43,806][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:48,949][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:54,218][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:24:59,231][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:04,377][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:09,492][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:14,770][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:19,783][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:24,790][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:29,877][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:34,883][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:39,893][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:45,264][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:50,404][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:25:55,515][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:00,788][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:05,863][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:11,026][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:16,151][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:21,154][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:26,181][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:31,196][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:36,272][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:41,346][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:46,372][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:51,404][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:26:56,971][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:27:01,724][ INFO][PID:4063688] Allocated host ResallocHost, ticket_id=632675, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00898782_20260103_061834, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-03 06:27:01,726][ INFO][PID:4063688] Allocating ssh connection to builder [2026-01-03 06:27:01,727][ INFO][PID:4063688] Checking that builder machine is OK [2026-01-03 06:28:01,812][ ERROR][PID:4063688] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18a port 22: Connection timed out [2026-01-03 06:28:11,813][ ERROR][PID:4063688] Re-try request for task on 'ResallocHost, ticket_id=632675, hostname=2620:52:6:1161:dead:beef:cafe:c18a, name=vmhost_p09_04_prod_00898782_20260103_061834, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts [2026-01-03 06:28:11,814][ INFO][PID:4063688] Releasing VM back to pool [2026-01-03 06:28:11,873][ INFO][PID:4063688] Retry #1 (on other host) [2026-01-03 06:28:11,915][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:11,917][ INFO][PID:4063688] VM allocation process starts [2026-01-03 06:28:11,942][ INFO][PID:4063688] Trying to allocate VM: ResallocHost, ticket_id=633030, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-03 06:28:16,949][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:21,972][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:27,005][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:32,029][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:37,030][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:42,036][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:47,095][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:52,096][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:28:57,097][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:02,099][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:07,102][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:18,269][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:23,526][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:28,585][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:33,600][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:38,700][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:43,720][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:48,794][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:53,867][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:29:58,874][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:03,878][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:08,924][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:13,997][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:19,143][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:24,196][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:29,409][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:34,501][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:39,668][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:44,699][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:49,712][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:54,727][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:30:59,749][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:04,762][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:09,765][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:14,769][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:19,781][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:24,793][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:29,804][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:34,806][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:39,820][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:44,822][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:49,825][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:54,829][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:31:59,837][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:04,841][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:09,845][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:15,039][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:20,042][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:25,050][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:30,059][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:30,616][ INFO][PID:4063688] Allocated host ResallocHost, ticket_id=633030, hostname=54.167.41.28, name=aws_x86_64_normal_prod_00898805_20260103_061843, requested_tags=['copr_builder', 'arch_noarch'] [2026-01-03 06:32:30,617][ INFO][PID:4063688] Allocating ssh connection to builder [2026-01-03 06:32:30,617][ INFO][PID:4063688] Checking that builder machine is OK [2026-01-03 06:32:31,178][ INFO][PID:4063688] Running remote command: copr-builder-ready srpm-builds [2026-01-03 06:32:31,644][ INFO][PID:4063688] Red Hat subscription not needed for srpm-builds Builder is ready to be used [2026-01-03 06:32:31,651][ INFO][PID:4063688] Filling build.info file with builder info [2026-01-03 06:32:31,737][ INFO][PID:4063688] Checking for cancel request [2026-01-03 06:32:31,750][ INFO][PID:4063688] Not re-notifying FE and msg buses for the new host. [2026-01-03 06:32:31,754][ INFO][PID:4063688] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9971016 --detached [2026-01-03 06:32:32,166][ INFO][PID:4063688] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '54.167.41.28' (ED25519) to the list of known hosts. [2026-01-03 06:32:32,170][ INFO][PID:4063688] Downloading the builder-live.log file, attempt 1 [2026-01-03 06:32:32,204][ INFO][PID:4063688] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.167.41.28 copr-rpmbuild-log [2026-01-03 06:32:32,742][ INFO][PID:4063688] Downloading results from builder [2026-01-03 06:32:32,749][ INFO][PID:4063688] rsyncing of mockbuilder@54.167.41.28:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016 started [2026-01-03 06:32:32,775][ INFO][PID:4063688] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.167.41.28:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/build-09971016.rsync.log [2026-01-03 06:32:33,443][ INFO][PID:4063688] rsyncing finished. [2026-01-03 06:32:33,445][ INFO][PID:4063688] Releasing VM back to pool [2026-01-03 06:32:33,489][ INFO][PID:4063688] Searching for 'success' file in resultdir [2026-01-03 06:32:33,492][ INFO][PID:4063688] Getting build details [2026-01-03 06:32:33,496][ INFO][PID:4063688] Retrieving SRPM info from /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016 [2026-01-03 06:32:33,498][ INFO][PID:4063688] SRPM URL: https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/microdnf-3.10.1-1.20260103020308270193.master.4.g3597412.fc43.src.rpm [2026-01-03 06:32:33,504][ INFO][PID:4063688] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/microdnf-3.10.1-1.20260103020308270193.master.4.g3597412.fc43.src.rpm', 'pkg_name': 'microdnf', 'pkg_version': '3.10.1-1.20260103020308270193.master.4.g3597412'} [2026-01-03 06:32:33,523][ INFO][PID:4063688] Finished build: id=9971016 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers chroot=srpm-builds [2026-01-03 06:32:33,543][ INFO][PID:4063688] Worker succeeded build, took 1.7930395603179932 [2026-01-03 06:32:33,553][ INFO][PID:4063688] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": null, "enable_net": true, "project_owner": "amatej", "project_name": "dnf-nightly-sanitizers", "project_dirname": "dnf-nightly-sanitizers", "submitter": "amatej", "ended_on": 1767421953.543566, "started_on": 1767421951.7505264, "submitted_on": null, "status": 1, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "9971016", "build_id": 9971016, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 2, "source_json": "{\"url\": \"https://copr.fedorainfracloud.org/tmp/tmp62359ctg/microdnf-3.10.1-1.20260103020308270193.master.4.g3597412.fc43.src.rpm\", \"pkg\": \"microdnf-3.10.1-1.20260103020308270193.master.4.g3597412.fc43.src.rpm\", \"tmp\": \"tmp62359ctg\"}", "pkg_name": "microdnf", "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/microdnf-3.10.1-1.20260103020308270193.master.4.g3597412.fc43.src.rpm", "uses_devel_repo": null, "sandbox": "amatej/dnf-nightly-sanitizers--amatej", "results": { "name": "microdnf", "epoch": null, "version": "3.10.1", "release": "1.20260103020308270193.master.4.g3597412", "exclusivearch": [], "excludearch": [] }, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers", "result_dir": "09971016", "built_packages": "", "tags": [ "arch_noarch" ], "pkg_version": "3.10.1-1.20260103020308270193.master.4.g3597412", "id": 9971016, "mockchain_macros": { "copr_username": "amatej", "copr_projectname": "dnf-nightly-sanitizers", "vendor": "Fedora Project COPR (amatej/dnf-nightly-sanitizers)" } } ] } [2026-01-03 06:32:34,061][ INFO][PID:4063688] Sending fedora-messaging bus message in build.end [2026-01-03 06:32:36,097][ INFO][PID:4063688] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/builder-live.log by gzip [2026-01-03 06:32:36,138][ INFO][PID:4063688] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/builder-live.log' as PID 55839 [2026-01-03 06:32:36,154][ INFO][PID:4063688] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/builder-live.log) [2026-01-03 06:32:36,161][ INFO][PID:4063688] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/backend.log by gzip [2026-01-03 06:32:36,198][ INFO][PID:4063688] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/srpm-builds/09971016/backend.log' as PID 55846