[2026-01-13 08:33:33,926][  INFO][PID:650304] Marking build as starting
[2026-01-13 08:33:34,000][  INFO][PID:650304] Checking that /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/repodata/repomd.xml exists
[2026-01-13 08:33:34,079][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:33:34,080][  INFO][PID:650304] VM allocation process starts
[2026-01-13 08:33:34,111][  INFO][PID:650304] Trying to allocate VM: ResallocHost, ticket_id=787471, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 08:33:39,137][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:33:44,159][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:33:49,160][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:33:54,167][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:33:59,193][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:04,212][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:09,219][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:14,220][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:19,222][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:24,232][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:29,238][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:34,239][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:39,240][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:44,241][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:49,244][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:54,253][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:34:59,265][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:04,274][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:09,275][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:14,278][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:19,279][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:24,280][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:29,284][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:34,303][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:39,308][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:44,314][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:49,320][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:54,329][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:35:59,341][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:04,343][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:09,353][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:14,354][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:19,356][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:24,359][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:29,362][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:34,365][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:39,367][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:44,369][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:49,370][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:54,373][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:36:59,382][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:04,384][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:09,391][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:14,401][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:19,404][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:24,406][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:29,412][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:34,422][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:39,426][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:44,428][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:49,430][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:54,433][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:37:59,446][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:04,448][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:09,484][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:14,485][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:19,495][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:24,499][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:29,501][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:34,506][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:39,510][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:44,514][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:49,522][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:54,524][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:38:59,534][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:04,543][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:09,545][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:14,547][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:19,557][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:24,569][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:29,587][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:34,591][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:39,593][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:44,597][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:49,600][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:54,602][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:39:59,607][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:04,608][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:09,617][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:14,637][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:19,666][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:24,687][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:29,690][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:34,692][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:39,698][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:44,703][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:49,717][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:54,718][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:40:59,720][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:04,725][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:09,728][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:14,729][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:19,735][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:24,761][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:29,782][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:34,783][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:39,784][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:44,785][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:49,787][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:52,730][  INFO][PID:650304] Allocated host ResallocHost, ticket_id=787471, hostname=98.81.26.62, name=aws_x86_64_normal_prod_01173390_20260113_083845, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 08:41:52,732][  INFO][PID:650304] Allocating ssh connection to builder
[2026-01-13 08:41:52,732][  INFO][PID:650304] Checking that builder machine is OK
[2026-01-13 08:41:53,080][  INFO][PID:650304] Running remote command: copr-builder-ready fedora-43-x86_64
[2026-01-13 08:41:53,306][  INFO][PID:650304] Red Hat subscription not needed for fedora-43-x86_64
Builder is ready to be used

[2026-01-13 08:41:53,307][  INFO][PID:650304] Filling build.info file with builder info
[2026-01-13 08:41:53,308][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:41:53,309][  INFO][PID:650304] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@meshtastic",
            "project_name": "daily",
            "project_dirname": "daily",
            "submitter": "vidplace7",
            "ended_on": null,
            "started_on": 1768293713.3094597,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-43-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10002673-fedora-43-x86_64",
            "build_id": 10002673,
            "package_name": "meshtasticd",
            "package_version": "2.7.18-12416.daily.gitf73a944fc",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@meshtastic/daily/meshtasticd",
            "git_hash": "0fbd885db9603af4c009ad400a1a25f2dd63ea9d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@meshtastic/daily--vidplace7",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily/fedora-43-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/build-tools/fedora-43-x86_64/",
                    "id": "copr_meshtastic_build_tools",
                    "name": "Additional repo copr_meshtastic_build_tools"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@meshtastic/daily",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily",
            "result_dir": "10002673-meshtasticd",
            "built_packages": "",
            "id": 10002673,
            "mockchain_macros": {
                "copr_username": "@meshtastic",
                "copr_projectname": "daily",
                "vendor": "Fedora Project COPR (@meshtastic/daily)"
            }
        }
    ]
}
[2026-01-13 08:41:53,368][  INFO][PID:650304] Sending fedora-messaging bus message in build.start
[2026-01-13 08:41:54,139][  INFO][PID:650304] Sending fedora-messaging bus message in chroot.start
[2026-01-13 08:41:54,201][  INFO][PID:650304] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10002673-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached
[2026-01-13 08:41:54,565][  INFO][PID:650304] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.81.26.62' (ED25519) to the list of known hosts.


[2026-01-13 08:41:54,566][  INFO][PID:650304] Downloading the builder-live.log file, attempt 1
[2026-01-13 08:41:54,574][  INFO][PID:650304] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.26.62 copr-rpmbuild-log
[2026-01-13 08:41:59,642][  INFO][PID:650304] Periodic builder liveness probe: alive
[2026-01-13 08:41:59,661][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:04,674][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:09,677][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:14,688][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:19,690][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:24,691][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:29,694][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:34,697][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:39,710][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:44,731][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:49,733][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:54,736][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:42:59,738][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:04,740][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:09,748][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:14,757][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:19,764][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:24,770][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:29,840][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:34,842][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:39,847][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:44,849][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:49,874][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:54,879][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:43:59,882][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:04,888][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:09,889][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:14,890][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:19,892][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:24,899][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:29,901][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:34,915][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:39,920][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:44,924][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:49,926][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:54,927][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:44:59,929][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:04,935][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:09,941][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:14,949][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:19,968][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:24,970][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:29,971][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:34,975][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:39,984][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:44,986][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:47,212][ ERROR][PID:650304] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 08:45:49,989][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:55,011][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:45:57,224][WARNING][PID:650304] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-13 08:46:00,020][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:05,025][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:07,232][  INFO][PID:650304] Downloading the builder-live.log file, attempt 2
[2026-01-13 08:46:07,247][  INFO][PID:650304] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.26.62 copr-rpmbuild-log
[2026-01-13 08:46:10,027][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:15,028][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:20,031][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:25,032][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:30,037][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:35,044][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:40,047][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:45,048][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:50,050][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:46:55,053][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:00,059][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:05,060][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:07,313][ ERROR][PID:650304] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 08:47:10,066][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:15,067][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:17,353][WARNING][PID:650304] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-13 08:47:20,073][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:25,076][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:27,357][  INFO][PID:650304] Downloading the builder-live.log file, attempt 3
[2026-01-13 08:47:27,363][  INFO][PID:650304] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.26.62 copr-rpmbuild-log
[2026-01-13 08:47:30,082][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:35,088][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:40,091][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:45,094][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:50,098][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:47:55,105][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:00,115][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:05,118][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:10,122][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:15,125][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:20,128][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:25,133][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:27,441][ ERROR][PID:650304] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 08:48:30,136][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:35,140][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:37,493][WARNING][PID:650304] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2026-01-13 08:48:40,161][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:45,172][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:47,505][  INFO][PID:650304] Downloading the builder-live.log file, attempt 4
[2026-01-13 08:48:47,513][  INFO][PID:650304] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.81.26.62 copr-rpmbuild-log
[2026-01-13 08:48:50,187][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:48:55,189][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:00,191][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:05,195][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:10,201][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:15,209][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:20,272][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:25,275][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:30,285][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:35,297][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:40,298][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:45,302][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:47,634][ ERROR][PID:650304] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2026-01-13 08:49:50,304][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:55,312][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:57,680][ ERROR][PID:650304] Giving up for unstable SSH, failures: 1768293957.224803, 1768294037.353889, 1768294117.493801, 1768294197.6801577
[2026-01-13 08:49:57,684][ ERROR][PID:650304] Re-try request for task on 'ResallocHost, ticket_id=787471, hostname=98.81.26.62, name=aws_x86_64_normal_prod_01173390_20260113_083845, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2026-01-13 08:49:57,684][  INFO][PID:650304] Releasing VM back to pool
[2026-01-13 08:49:57,762][  INFO][PID:650304] Retry #1 (on other host)
[2026-01-13 08:49:57,765][  INFO][PID:650304] Checking that /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/repodata/repomd.xml exists
[2026-01-13 08:49:57,880][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:49:57,882][  INFO][PID:650304] VM allocation process starts
[2026-01-13 08:49:57,905][  INFO][PID:650304] Trying to allocate VM: ResallocHost, ticket_id=788019, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 08:50:02,913][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:07,916][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:12,919][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:17,920][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:22,922][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:27,932][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:32,938][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:37,948][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:42,957][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:47,961][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:52,963][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:50:57,964][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:02,972][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:06,215][  INFO][PID:650304] Allocated host ResallocHost, ticket_id=788019, hostname=18.207.133.232, name=aws_x86_64_normalreserved_prod_01173366_20260113_083843, requested_tags=['copr_builder', 'arch_x86_64']
[2026-01-13 08:51:06,215][  INFO][PID:650304] Allocating ssh connection to builder
[2026-01-13 08:51:06,216][  INFO][PID:650304] Checking that builder machine is OK
[2026-01-13 08:51:06,736][  INFO][PID:650304] Running remote command: copr-builder-ready fedora-43-x86_64
[2026-01-13 08:51:07,304][  INFO][PID:650304] Red Hat subscription not needed for fedora-43-x86_64
Builder is ready to be used

[2026-01-13 08:51:07,305][  INFO][PID:650304] Filling build.info file with builder info
[2026-01-13 08:51:07,372][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:07,380][  INFO][PID:650304] Not re-notifying FE and msg buses for the new host.
[2026-01-13 08:51:07,385][  INFO][PID:650304] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10002673-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached
[2026-01-13 08:51:08,108][  INFO][PID:650304] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '18.207.133.232' (ED25519) to the list of known hosts.


[2026-01-13 08:51:08,116][  INFO][PID:650304] Downloading the builder-live.log file, attempt 1
[2026-01-13 08:51:08,126][  INFO][PID:650304] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.207.133.232 copr-rpmbuild-log
[2026-01-13 08:51:13,119][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:18,122][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:23,128][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:28,129][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:33,130][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:38,132][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:43,152][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:48,164][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:53,171][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:51:58,172][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:03,225][  INFO][PID:650304] Periodic builder liveness probe: alive
[2026-01-13 08:52:03,227][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:08,231][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:13,235][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:18,236][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:23,243][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:28,245][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:33,248][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:38,253][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:43,254][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:48,256][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:53,259][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:52:58,282][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:03,295][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:08,297][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:13,306][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:18,319][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:23,324][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:28,325][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:33,327][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:38,336][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:43,350][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:48,360][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:53,370][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:53:58,371][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:03,373][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:08,375][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:13,383][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:18,385][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:23,394][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:28,396][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:33,399][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:38,421][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:43,425][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:48,426][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:53,428][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:54:58,439][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:03,477][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:08,481][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:13,486][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:18,492][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:23,495][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:28,534][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:33,537][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:38,545][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:43,550][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:48,552][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:53,553][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:55:58,556][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:03,561][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:08,569][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:13,571][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:18,572][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:23,575][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:28,578][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:33,580][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:38,590][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:43,598][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:48,612][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:53,615][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:56:58,618][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:57:03,619][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:57:08,622][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:57:13,626][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:57:18,627][  INFO][PID:650304] Checking for cancel request
[2026-01-13 08:57:19,236][  INFO][PID:650304] Downloading results from builder
[2026-01-13 08:57:19,237][  INFO][PID:650304] rsyncing of mockbuilder@18.207.133.232:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd started
[2026-01-13 08:57:19,242][  INFO][PID:650304] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@18.207.133.232:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/ &> /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/build-10002673.rsync.log
[2026-01-13 08:57:19,706][  INFO][PID:650304] rsyncing finished.
[2026-01-13 08:57:19,707][  INFO][PID:650304] Releasing VM back to pool
[2026-01-13 08:57:19,756][  INFO][PID:650304] Searching for 'success' file in resultdir
[2026-01-13 08:57:19,758][ ERROR][PID:650304] Build failed: Backend process error: No success file => build failure
[2026-01-13 08:57:19,764][  INFO][PID:650304] Finished build: id=10002673 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@meshtastic/daily chroot=fedora-43-x86_64 
[2026-01-13 08:57:19,782][ ERROR][PID:650304] Backend process error: No success file => build failure
[2026-01-13 08:57:19,788][  INFO][PID:650304] Worker failed build, took 372.4077250957489
[2026-01-13 08:57:19,799][  INFO][PID:650304] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": true,
            "project_owner": "@meshtastic",
            "project_name": "daily",
            "project_dirname": "daily",
            "submitter": "vidplace7",
            "ended_on": 1768294639.7882638,
            "started_on": 1768294267.3805387,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-43-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10002673-fedora-43-x86_64",
            "build_id": 10002673,
            "package_name": "meshtasticd",
            "package_version": "2.7.18-12416.daily.gitf73a944fc",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@meshtastic/daily/meshtasticd",
            "git_hash": "0fbd885db9603af4c009ad400a1a25f2dd63ea9d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@meshtastic/daily--vidplace7",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily/fedora-43-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@meshtastic/build-tools/fedora-43-x86_64/",
                    "id": "copr_meshtastic_build_tools",
                    "name": "Additional repo copr_meshtastic_build_tools"
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@meshtastic/daily",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@meshtastic/daily",
            "result_dir": "10002673-meshtasticd",
            "built_packages": "",
            "id": 10002673,
            "mockchain_macros": {
                "copr_username": "@meshtastic",
                "copr_projectname": "daily",
                "vendor": "Fedora Project COPR (@meshtastic/daily)"
            }
        }
    ]
}
[2026-01-13 08:57:20,064][  INFO][PID:650304] Sending fedora-messaging bus message in build.end
[2026-01-13 08:57:20,150][  INFO][PID:650304] Compressing /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/builder-live.log by gzip
[2026-01-13 08:57:20,152][  INFO][PID:650304] Running command 'gzip /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/builder-live.log' as PID 943724
[2026-01-13 08:57:20,205][  INFO][PID:650304] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/builder-live.log)
[2026-01-13 08:57:20,206][  INFO][PID:650304] Compressing /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/backend.log by gzip
[2026-01-13 08:57:20,212][  INFO][PID:650304] Running command 'gzip /var/lib/copr/public_html/results/@meshtastic/daily/fedora-43-x86_64/10002673-meshtasticd/backend.log' as PID 943735