[2026-01-13 16:06:12,641][  INFO][PID:4117095] Marking build as starting
[2026-01-13 16:06:12,752][  INFO][PID:4117095] Checking that /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/repodata/repomd.xml exists
[2026-01-13 16:06:12,823][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:12,825][  INFO][PID:4117095] VM allocation process starts
[2026-01-13 16:06:12,849][  INFO][PID:4117095] Trying to allocate VM: ResallocHost, ticket_id=795444, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 16:06:15,890][  INFO][PID:4117095] Allocated host ResallocHost, ticket_id=795444, hostname=100.52.228.126, name=aws_x86_64_normal_prod_01197142_20260113_160207, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 16:06:15,890][  INFO][PID:4117095] Allocating ssh connection to builder
[2026-01-13 16:06:15,891][  INFO][PID:4117095] Checking that builder machine is OK
[2026-01-13 16:06:16,279][  INFO][PID:4117095] Running remote command: copr-builder-ready epel-8-x86_64
[2026-01-13 16:06:16,508][  INFO][PID:4117095] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-01-13 16:06:16,509][  INFO][PID:4117095] Filling build.info file with builder info
[2026-01-13 16:06:16,510][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:16,511][  INFO][PID:4117095] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "solemnwarning",
            "project_name": "rehex-ci",
            "project_dirname": "rehex-ci",
            "submitter": "solemnwarning",
            "ended_on": null,
            "started_on": 1768320376.5109322,
            "submitted_on": null,
            "status": 3,
            "chroot": "epel-8-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10004325-epel-8-x86_64",
            "build_id": 10004325,
            "package_name": "rehex",
            "package_version": "0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/solemnwarning/rehex-ci/rehex",
            "git_hash": "38b2e92330b3c52085c93599a473e39803d660ab",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "solemnwarning/rehex-ci--solemnwarning",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci/epel-8-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/solemnwarning/rehex-ci",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci",
            "result_dir": "10004325-rehex",
            "built_packages": "",
            "id": 10004325,
            "mockchain_macros": {
                "copr_username": "solemnwarning",
                "copr_projectname": "rehex-ci",
                "vendor": "Fedora Project COPR (solemnwarning/rehex-ci)"
            }
        }
    ]
}
[2026-01-13 16:06:16,607][  INFO][PID:4117095] Sending fedora-messaging bus message in build.start
[2026-01-13 16:06:17,553][  INFO][PID:4117095] Sending fedora-messaging bus message in chroot.start
[2026-01-13 16:06:17,589][  INFO][PID:4117095] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10004325-epel-8-x86_64 --chroot epel-8-x86_64 --detached
[2026-01-13 16:06:17,959][  INFO][PID:4117095] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '100.52.228.126' (ED25519) to the list of known hosts.


[2026-01-13 16:06:17,960][  INFO][PID:4117095] Downloading the builder-live.log file, attempt 1
[2026-01-13 16:06:17,961][  INFO][PID:4117095] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.52.228.126 copr-rpmbuild-log
[2026-01-13 16:06:22,969][  INFO][PID:4117095] Periodic builder liveness probe: alive
[2026-01-13 16:06:22,970][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:27,971][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:32,975][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:37,981][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:42,985][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:47,989][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:52,994][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:06:57,998][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:02,999][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:08,000][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:13,005][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:18,009][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:23,013][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:28,015][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:33,019][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:38,022][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:43,027][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:48,030][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:53,043][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:07:58,052][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:03,053][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:08,060][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:13,062][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:18,066][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:23,072][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:28,097][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:33,099][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:38,106][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:43,113][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:48,115][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:53,117][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:08:58,119][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:03,124][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:08,143][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:13,150][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:18,151][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:23,158][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:28,159][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:33,162][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:38,164][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:43,165][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:48,174][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:53,178][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:09:58,180][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:03,194][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:08,197][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:13,200][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:18,201][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:23,209][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:28,214][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:33,216][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:38,224][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:43,239][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:48,245][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:53,249][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:10:58,258][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:03,265][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:08,274][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:13,284][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:18,290][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:23,294][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:28,297][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:33,298][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:38,306][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:43,307][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:48,309][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:53,311][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:11:58,322][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:03,331][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:08,333][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:13,337][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:18,339][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:23,341][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:28,344][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:33,352][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:38,385][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:43,387][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:48,389][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:53,395][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:12:58,399][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:03,401][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:08,407][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:13,410][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:18,421][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:23,427][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:28,431][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:32,565][ ERROR][PID:4117095] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 16:13:33,436][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:38,450][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:42,568][WARNING][PID:4117095] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-13 16:13:43,462][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:48,466][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:52,571][  INFO][PID:4117095] Downloading the builder-live.log file, attempt 2
[2026-01-13 16:13:52,578][  INFO][PID:4117095] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.52.228.126 copr-rpmbuild-log
[2026-01-13 16:13:53,467][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:13:58,475][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:03,478][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:08,486][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:13,487][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:18,499][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:23,500][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:28,501][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:33,504][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:38,528][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:43,529][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:48,533][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:52,704][ ERROR][PID:4117095] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 16:14:53,536][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:14:58,543][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:02,731][WARNING][PID:4117095] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-13 16:15:03,545][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:08,547][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:12,733][  INFO][PID:4117095] Downloading the builder-live.log file, attempt 3
[2026-01-13 16:15:12,735][  INFO][PID:4117095] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.52.228.126 copr-rpmbuild-log
[2026-01-13 16:15:13,550][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:18,551][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:23,558][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:28,567][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:33,569][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:38,573][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:43,574][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:48,576][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:53,577][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:15:58,579][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:03,580][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:08,590][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:12,805][ ERROR][PID:4117095] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 16:16:13,591][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:18,592][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:22,808][WARNING][PID:4117095] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-13 16:16:23,601][  INFO][PID:4117095] Periodic builder liveness probe: alive
[2026-01-13 16:16:23,602][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:28,604][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:32,809][  INFO][PID:4117095] Downloading the builder-live.log file, attempt 4
[2026-01-13 16:16:32,812][  INFO][PID:4117095] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@100.52.228.126 copr-rpmbuild-log
[2026-01-13 16:16:33,607][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:38,609][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:43,611][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:48,612][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:53,614][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:16:58,615][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:03,617][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:08,732][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:13,737][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:18,922][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:23,924][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:28,928][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:32,886][ ERROR][PID:4117095] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 16:17:33,932][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:38,935][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:42,897][ ERROR][PID:4117095] Giving up for unstable SSH, failures: 1768320822.568432, 1768320902.7317102, 1768320982.808492, 1768321062.8971663
[2026-01-13 16:17:42,898][ ERROR][PID:4117095] Re-try request for task on 'ResallocHost, ticket_id=795444, hostname=100.52.228.126, name=aws_x86_64_normal_prod_01197142_20260113_160207, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-01-13 16:17:42,899][  INFO][PID:4117095] Releasing VM back to pool
[2026-01-13 16:17:42,918][  INFO][PID:4117095] Retry #1 (on other host)
[2026-01-13 16:17:42,922][  INFO][PID:4117095] Checking that /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/repodata/repomd.xml exists
[2026-01-13 16:17:42,923][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:42,924][  INFO][PID:4117095] VM allocation process starts
[2026-01-13 16:17:42,941][  INFO][PID:4117095] Trying to allocate VM: ResallocHost, ticket_id=795664, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 16:17:45,971][  INFO][PID:4117095] Allocated host ResallocHost, ticket_id=795664, hostname=3.238.120.38, name=aws_x86_64_normalreserved_prod_01197420_20260113_160424, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 16:17:45,974][  INFO][PID:4117095] Allocating ssh connection to builder
[2026-01-13 16:17:45,974][  INFO][PID:4117095] Checking that builder machine is OK
[2026-01-13 16:17:46,339][  INFO][PID:4117095] Running remote command: copr-builder-ready epel-8-x86_64
[2026-01-13 16:17:46,552][  INFO][PID:4117095] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used

[2026-01-13 16:17:46,553][  INFO][PID:4117095] Filling build.info file with builder info
[2026-01-13 16:17:46,554][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:46,555][  INFO][PID:4117095] Not re-notifying FE and msg buses for the new host.
[2026-01-13 16:17:46,556][  INFO][PID:4117095] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10004325-epel-8-x86_64 --chroot epel-8-x86_64 --detached
[2026-01-13 16:17:46,901][  INFO][PID:4117095] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '3.238.120.38' (ED25519) to the list of known hosts.


[2026-01-13 16:17:46,903][  INFO][PID:4117095] Downloading the builder-live.log file, attempt 1
[2026-01-13 16:17:46,906][  INFO][PID:4117095] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.238.120.38 copr-rpmbuild-log
[2026-01-13 16:17:51,903][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:17:56,907][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:01,908][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:06,914][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:11,915][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:16,916][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:21,917][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:26,919][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:31,921][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:36,923][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:41,926][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:46,929][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:51,930][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:18:56,932][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:01,934][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:06,935][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:11,942][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:16,944][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:21,948][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:26,953][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:31,959][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:36,961][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:41,964][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:46,966][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:51,967][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:19:56,970][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:01,975][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:06,978][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:11,982][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:16,987][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:21,988][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:26,992][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:31,998][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:37,006][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:42,009][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:47,011][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:52,019][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:20:57,028][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:02,030][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:07,034][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:12,035][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:17,039][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:22,040][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:27,042][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:32,043][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:37,047][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:42,049][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:47,052][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:52,054][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:21:57,056][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:02,059][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:07,067][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:12,068][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:17,069][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:22,071][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:27,074][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:32,075][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:37,077][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:42,079][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:47,082][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:52,084][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:22:57,089][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:02,090][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:07,091][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:12,093][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:17,095][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:22,097][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:27,109][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:32,110][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:37,144][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:42,146][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:47,149][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:52,151][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:23:57,154][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:02,155][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:07,156][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:12,157][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:17,158][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:22,159][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:27,161][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:32,166][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:37,172][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:42,174][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:47,177][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:52,179][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:24:57,183][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:02,184][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:07,187][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:12,190][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:17,192][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:22,195][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:27,198][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:32,200][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:37,202][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:42,203][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:47,207][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:52,212][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:25:57,214][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:26:02,217][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:26:07,218][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:26:12,226][  INFO][PID:4117095] Checking for cancel request
[2026-01-13 16:26:12,917][  INFO][PID:4117095] Downloading results from builder
[2026-01-13 16:26:12,919][  INFO][PID:4117095] rsyncing of mockbuilder@3.238.120.38:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex started
[2026-01-13 16:26:12,929][  INFO][PID:4117095] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.238.120.38:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/ &> /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/build-10004325.rsync.log
[2026-01-13 16:26:13,680][  INFO][PID:4117095] rsyncing finished.
[2026-01-13 16:26:13,682][  INFO][PID:4117095] Releasing VM back to pool
[2026-01-13 16:26:13,703][  INFO][PID:4117095] Searching for 'success' file in resultdir
[2026-01-13 16:26:13,705][  INFO][PID:4117095] Going to sign pkgs from source: 10004325-epel-8-x86_64 in chroot: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64
[2026-01-13 16:26:13,713][  INFO][PID:4117095] Calling '/bin/sign -u solemnwarning#rehex-ci@copr.fedorahosted.org -p' (attempt #1)
[2026-01-13 16:26:13,985][  INFO][PID:4117095] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-debugsource-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.x86_64.rpm' (attempt #1)
[2026-01-13 16:26:14,761][  INFO][PID:4117095] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-debugsource-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.x86_64.rpm
[2026-01-13 16:26:14,762][  INFO][PID:4117095] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.src.rpm' (attempt #1)
[2026-01-13 16:26:15,605][  INFO][PID:4117095] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.src.rpm
[2026-01-13 16:26:15,608][  INFO][PID:4117095] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-debuginfo-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.x86_64.rpm' (attempt #1)
[2026-01-13 16:26:16,852][  INFO][PID:4117095] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-debuginfo-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.x86_64.rpm
[2026-01-13 16:26:16,853][  INFO][PID:4117095] Calling '/bin/sign -4 -h sha256 -u solemnwarning#rehex-ci@copr.fedorahosted.org -r /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.x86_64.rpm' (attempt #1)
[2026-01-13 16:26:17,698][  INFO][PID:4117095] signed rpm: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/rehex-0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0~el8.x86_64.rpm
[2026-01-13 16:26:17,705][  INFO][PID:4117095] Sign done
[2026-01-13 16:26:17,707][  INFO][PID:4117095] Incremental createrepo run, adding 10004325-rehex into https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci/epel-8-x86_64, (auto-create-repo=True)
[2026-01-13 16:26:17,712][  INFO][PID:4117095] Running command 'copr-repo --batched /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64 --add 10004325-rehex --no-appstream-metadata' as PID 107888
[2026-01-13 16:26:19,365][  INFO][PID:4117095] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64 --add 10004325-rehex --no-appstream-metadata)
[2026-01-13 16:26:19,368][  INFO][PID:4117095] Getting build details
[2026-01-13 16:26:19,371][  INFO][PID:4117095] Listing built binary packages in /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex
[2026-01-13 16:26:19,373][  INFO][PID:4117095] Built packages:
['rehex-debuginfo 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e', 'rehex-debugsource 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e', 'rehex 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e']
[2026-01-13 16:26:19,384][  INFO][PID:4117095] build details: {'built_packages': 'rehex-debuginfo 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e\nrehex-debugsource 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e\nrehex 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e'}
[2026-01-13 16:26:19,384][  INFO][PID:4117095] Retrieving pubkey
[2026-01-13 16:26:19,386][  INFO][PID:4117095] Calling '/bin/sign -u solemnwarning#rehex-ci@copr.fedorahosted.org -p' (attempt #1)
[2026-01-13 16:26:19,589][  INFO][PID:4117095] Added pubkey for user solemnwarning project rehex-ci into: /var/lib/copr/public_html/results/solemnwarning/rehex-ci/pubkey.gpg
[2026-01-13 16:26:19,590][  INFO][PID:4117095] Finished build: id=10004325 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/solemnwarning/rehex-ci chroot=epel-8-x86_64 
[2026-01-13 16:26:19,594][  INFO][PID:4117095] Worker succeeded build, took 513.0384278297424
[2026-01-13 16:26:19,595][  INFO][PID:4117095] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "solemnwarning",
            "project_name": "rehex-ci",
            "project_dirname": "rehex-ci",
            "submitter": "solemnwarning",
            "ended_on": 1768321579.5942824,
            "started_on": 1768321066.5558546,
            "submitted_on": null,
            "status": 1,
            "chroot": "epel-8-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10004325-epel-8-x86_64",
            "build_id": 10004325,
            "package_name": "rehex",
            "package_version": "0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e-0",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/solemnwarning/rehex-ci/rehex",
            "git_hash": "38b2e92330b3c52085c93599a473e39803d660ab",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "solemnwarning/rehex-ci--solemnwarning",
            "results": {
                "packages": [
                    {
                        "name": "rehex-debuginfo",
                        "epoch": null,
                        "version": "0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e",
                        "release": "0~el8",
                        "arch": "x86_64"
                    },
                    {
                        "name": "rehex",
                        "epoch": null,
                        "version": "0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e",
                        "release": "0~el8",
                        "arch": "src"
                    },
                    {
                        "name": "rehex-debugsource",
                        "epoch": null,
                        "version": "0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e",
                        "release": "0~el8",
                        "arch": "x86_64"
                    },
                    {
                        "name": "rehex",
                        "epoch": null,
                        "version": "0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e",
                        "release": "0~el8",
                        "arch": "x86_64"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci/epel-8-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/solemnwarning/rehex-ci",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/solemnwarning/rehex-ci",
            "result_dir": "10004325-rehex",
            "built_packages": "rehex-debuginfo 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e\nrehex-debugsource 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e\nrehex 0.63.4+40de3d8a88bb2090aab2654914681ec994e7224e",
            "id": 10004325,
            "mockchain_macros": {
                "copr_username": "solemnwarning",
                "copr_projectname": "rehex-ci",
                "vendor": "Fedora Project COPR (solemnwarning/rehex-ci)"
            }
        }
    ]
}
[2026-01-13 16:26:19,713][  INFO][PID:4117095] Sending fedora-messaging bus message in build.end
[2026-01-13 16:26:19,775][  INFO][PID:4117095] Compressing /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/builder-live.log by gzip
[2026-01-13 16:26:19,781][  INFO][PID:4117095] Running command 'gzip /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/builder-live.log' as PID 108242
[2026-01-13 16:26:19,881][  INFO][PID:4117095] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/builder-live.log)
[2026-01-13 16:26:19,882][  INFO][PID:4117095] Compressing /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/backend.log by gzip
[2026-01-13 16:26:19,884][  INFO][PID:4117095] Running command 'gzip /var/lib/copr/public_html/results/solemnwarning/rehex-ci/epel-8-x86_64/10004325-rehex/backend.log' as PID 108270