[2025-12-30 03:28:54,336][  INFO][PID:4176493] Marking build as starting
[2025-12-30 03:28:54,414][  INFO][PID:4176493] Checking that /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-30 03:28:54,509][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:28:54,510][  INFO][PID:4176493] VM allocation process starts
[2025-12-30 03:28:54,521][  INFO][PID:4176493] Trying to allocate VM: ResallocHost, ticket_id=570073, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-30 03:28:59,523][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:04,524][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:09,526][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:14,527][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:19,530][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:24,532][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:29,534][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:34,536][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:39,538][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:44,539][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:49,540][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:54,541][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:29:59,543][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:04,544][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:09,545][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:14,546][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:19,547][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:24,548][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:29,549][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:34,549][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:39,550][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:44,551][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:49,553][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:54,554][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:30:59,555][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:04,556][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:09,557][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:14,558][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:19,559][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:24,560][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:29,561][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:34,562][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:39,563][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:44,564][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:49,565][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:54,566][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:31:59,568][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:04,569][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:09,570][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:14,571][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:19,572][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:24,573][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:29,574][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:34,575][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:39,576][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:44,577][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:49,578][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:54,579][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:32:59,580][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:04,581][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:09,585][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:14,586][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:19,599][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:24,639][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:29,641][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:34,642][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:39,709][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:44,710][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:49,711][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:54,712][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:33:59,713][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:04,714][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:09,715][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:12,668][  INFO][PID:4176493] Allocated host ResallocHost, ticket_id=570073, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_00836625_20251230_032846, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-30 03:34:12,669][  INFO][PID:4176493] Allocating ssh connection to builder
[2025-12-30 03:34:12,669][  INFO][PID:4176493] Checking that builder machine is OK
[2025-12-30 03:34:13,629][  INFO][PID:4176493] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-12-30 03:34:14,130][  INFO][PID:4176493] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-12-30 03:34:14,130][  INFO][PID:4176493] Filling build.info file with builder info
[2025-12-30 03:34:14,131][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:14,132][  INFO][PID:4176493] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@avocado",
            "project_name": "avocado-vt-latest",
            "project_dirname": "avocado-vt-latest",
            "submitter": "https://api.github.com/users/zhencliu",
            "ended_on": null,
            "started_on": 1767065654.13205,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9960173-fedora-41-ppc64le",
            "build_id": 9960173,
            "package_name": "avocado-plugins-vt",
            "package_version": "109.0-1.20251230git043f5115",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@avocado/avocado-vt-latest/avocado-plugins-vt",
            "git_hash": "32f764ed7eaf4ce276c4f7f19d2fadf22a8d4703",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@avocado/avocado-vt-latest--https://api.github.com/users/zhencliu",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@avocado/avocado-vt-latest",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@avocado/avocado-vt-latest",
            "result_dir": "09960173-avocado-plugins-vt",
            "built_packages": "",
            "id": 9960173,
            "mockchain_macros": {
                "copr_username": "@avocado",
                "copr_projectname": "avocado-vt-latest",
                "vendor": "Fedora Project COPR (@avocado/avocado-vt-latest)"
            }
        }
    ]
}
[2025-12-30 03:34:14,202][  INFO][PID:4176493] Sending fedora-messaging bus message in build.start
[2025-12-30 03:34:14,745][  INFO][PID:4176493] Sending fedora-messaging bus message in chroot.start
[2025-12-30 03:34:14,773][  INFO][PID:4176493] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9960173-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-12-30 03:34:15,794][  INFO][PID:4176493] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c190' (ED25519) to the list of known hosts.


[2025-12-30 03:34:15,794][  INFO][PID:4176493] Downloading the builder-live.log file, attempt 1
[2025-12-30 03:34:15,797][  INFO][PID:4176493] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 03:34:20,817][  INFO][PID:4176493] Periodic builder liveness probe: alive
[2025-12-30 03:34:20,819][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:25,823][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:30,824][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:35,825][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:40,826][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:45,827][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:50,828][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:34:55,829][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:00,830][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:05,831][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:10,832][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:15,833][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:20,834][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:25,835][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:30,836][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:35,837][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:40,838][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:45,839][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:50,840][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:35:55,841][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:00,842][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:05,843][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:10,844][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:15,845][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:20,846][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:25,847][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:30,848][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:35,849][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:40,850][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:45,851][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:50,852][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:36:55,853][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:00,854][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:05,855][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:10,856][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:15,857][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:20,858][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:25,860][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:30,861][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:35,862][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:40,863][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:45,864][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:50,867][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:37:55,868][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:00,869][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:05,870][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:10,871][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:15,872][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:20,874][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:25,876][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:30,877][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:35,878][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:40,879][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:45,880][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:50,880][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:38:55,882][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:00,883][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:05,884][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:10,885][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:15,886][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:20,887][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:25,888][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:30,889][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:34,355][ ERROR][PID:4176493] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 03:39:35,890][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:40,891][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:44,356][WARNING][PID:4176493] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 03:39:45,892][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:50,893][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:39:54,357][  INFO][PID:4176493] Downloading the builder-live.log file, attempt 2
[2025-12-30 03:39:54,358][  INFO][PID:4176493] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 03:39:55,895][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:00,896][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:05,897][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:10,898][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:15,899][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:20,900][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:25,902][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:30,903][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:35,905][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:40,906][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:45,908][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:50,909][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:40:54,427][ ERROR][PID:4176493] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 03:40:55,910][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:00,911][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:04,431][WARNING][PID:4176493] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 03:41:06,205][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:11,206][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:14,432][  INFO][PID:4176493] Downloading the builder-live.log file, attempt 3
[2025-12-30 03:41:14,433][  INFO][PID:4176493] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 03:41:16,207][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:21,208][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:26,210][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:31,211][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:36,213][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:41,214][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:46,215][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:51,216][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:41:56,217][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:01,218][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:06,220][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:11,221][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:14,496][ ERROR][PID:4176493] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 03:42:16,222][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:21,223][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:25,051][WARNING][PID:4176493] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-30 03:42:26,224][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:31,225][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:35,052][  INFO][PID:4176493] Downloading the builder-live.log file, attempt 4
[2025-12-30 03:42:35,054][  INFO][PID:4176493] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c190 copr-rpmbuild-log
[2025-12-30 03:42:36,226][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:41,227][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:46,228][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:51,229][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:42:56,230][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:01,232][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:06,233][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:11,234][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:16,236][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:21,237][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:26,238][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:31,239][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:35,070][ ERROR][PID:4176493] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-30 03:43:36,245][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:41,246][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:45,426][ ERROR][PID:4176493] Giving up for unstable SSH, failures: 1767065984.3565838, 1767066064.4317534, 1767066145.0514705, 1767066225.4260209
[2025-12-30 03:43:45,427][ ERROR][PID:4176493] Re-try request for task on 'ResallocHost, ticket_id=570073, hostname=2620:52:6:1161:dead:beef:cafe:c190, name=vmhost_p09_04_prod_00836625_20251230_032846, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-12-30 03:43:45,427][  INFO][PID:4176493] Releasing VM back to pool
[2025-12-30 03:43:45,450][  INFO][PID:4176493] Retry #1 (on other host)
[2025-12-30 03:43:45,451][  INFO][PID:4176493] Checking that /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/repodata/repomd.xml exists
[2025-12-30 03:43:45,452][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:45,453][  INFO][PID:4176493] VM allocation process starts
[2025-12-30 03:43:45,469][  INFO][PID:4176493] Trying to allocate VM: ResallocHost, ticket_id=570228, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-30 03:43:48,490][  INFO][PID:4176493] Allocated host ResallocHost, ticket_id=570228, hostname=2620:52:6:1161:dead:beef:cafe:c148, name=vmhost_p09_03_prod_00836545_20251230_032419, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-30 03:43:48,491][  INFO][PID:4176493] Allocating ssh connection to builder
[2025-12-30 03:43:48,492][  INFO][PID:4176493] Checking that builder machine is OK
[2025-12-30 03:43:48,926][  INFO][PID:4176493] Running remote command: copr-builder-ready fedora-41-ppc64le
[2025-12-30 03:43:49,384][  INFO][PID:4176493] Red Hat subscription not needed for fedora-41-ppc64le
Builder is ready to be used

[2025-12-30 03:43:49,385][  INFO][PID:4176493] Filling build.info file with builder info
[2025-12-30 03:43:49,395][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:43:49,396][  INFO][PID:4176493] Not re-notifying FE and msg buses for the new host.
[2025-12-30 03:43:49,396][  INFO][PID:4176493] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9960173-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached
[2025-12-30 03:43:50,233][  INFO][PID:4176493] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c148' (ED25519) to the list of known hosts.


[2025-12-30 03:43:50,234][  INFO][PID:4176493] Downloading the builder-live.log file, attempt 1
[2025-12-30 03:43:50,235][  INFO][PID:4176493] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c148 copr-rpmbuild-log
[2025-12-30 03:43:55,234][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:00,331][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:05,332][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:10,333][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:15,334][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:20,381][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:25,387][  INFO][PID:4176493] Periodic builder liveness probe: alive
[2025-12-30 03:44:25,388][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:30,389][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:35,390][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:40,567][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:45,569][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:50,570][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:44:55,571][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:00,574][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:05,575][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:10,578][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:15,579][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:20,580][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:25,582][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:30,621][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:35,622][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:40,629][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:45,634][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:50,635][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:45:55,637][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:00,638][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:05,639][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:10,640][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:15,641][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:20,642][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:25,642][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:30,643][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:35,644][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:40,645][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:45,646][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:50,649][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:46:55,650][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:00,651][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:05,652][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:10,653][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:15,655][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:20,656][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:25,657][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:30,661][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:35,663][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:40,664][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:45,665][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:50,666][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:47:55,667][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:00,668][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:05,739][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:10,740][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:15,741][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:20,744][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:25,746][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:30,748][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:35,749][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:40,751][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:45,759][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:50,763][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:48:55,844][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:01,165][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:06,229][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:11,356][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:16,493][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:21,503][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:26,731][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:31,734][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:36,738][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:41,740][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:46,764][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:51,806][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:49:56,810][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:01,812][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:06,814][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:11,815][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:16,816][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:21,825][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:26,826][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:31,827][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:36,828][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:41,830][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:46,831][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:51,832][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:50:56,833][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:01,833][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:06,834][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:11,835][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:16,836][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:21,837][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:26,838][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:31,839][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:36,840][  INFO][PID:4176493] Checking for cancel request
[2025-12-30 03:51:41,184][  INFO][PID:4176493] Downloading results from builder
[2025-12-30 03:51:41,185][  INFO][PID:4176493] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c148]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt started
[2025-12-30 03:51:41,186][  INFO][PID:4176493] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c148]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/ &> /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/build-09960173.rsync.log
[2025-12-30 03:51:41,951][  INFO][PID:4176493] rsyncing finished.
[2025-12-30 03:51:41,952][  INFO][PID:4176493] Releasing VM back to pool
[2025-12-30 03:51:41,960][  INFO][PID:4176493] Searching for 'success' file in resultdir
[2025-12-30 03:51:41,960][  INFO][PID:4176493] Going to sign pkgs from source: 9960173-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le
[2025-12-30 03:51:41,961][  INFO][PID:4176493] Calling '/bin/sign -u @avocado#avocado-vt-latest@copr.fedorahosted.org -p' (attempt #1)
[2025-12-30 03:51:42,426][  INFO][PID:4176493] Calling '/bin/sign -4 -h sha256 -u @avocado#avocado-vt-latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/avocado-plugins-vt-109.0-1.20251230git043f5115.fc41.src.rpm' (attempt #1)
[2025-12-30 03:51:43,087][  INFO][PID:4176493] signed rpm: /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/avocado-plugins-vt-109.0-1.20251230git043f5115.fc41.src.rpm
[2025-12-30 03:51:43,087][  INFO][PID:4176493] Calling '/bin/sign -4 -h sha256 -u @avocado#avocado-vt-latest@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/python3-avocado-plugins-vt-109.0-1.20251230git043f5115.fc41.noarch.rpm' (attempt #1)
[2025-12-30 03:51:43,674][  INFO][PID:4176493] signed rpm: /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/python3-avocado-plugins-vt-109.0-1.20251230git043f5115.fc41.noarch.rpm
[2025-12-30 03:51:43,674][  INFO][PID:4176493] Sign done
[2025-12-30 03:51:43,675][  INFO][PID:4176493] Incremental createrepo run, adding 09960173-avocado-plugins-vt into https://download.copr.fedorainfracloud.org/results/@avocado/avocado-vt-latest/fedora-41-ppc64le, (auto-create-repo=True)
[2025-12-30 03:51:43,676][  INFO][PID:4176493] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le --add 09960173-avocado-plugins-vt --no-appstream-metadata' as PID 113077
[2025-12-30 03:51:46,105][  INFO][PID:4176493] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le --add 09960173-avocado-plugins-vt --no-appstream-metadata)
[2025-12-30 03:51:46,106][  INFO][PID:4176493] Getting build details
[2025-12-30 03:51:46,106][  INFO][PID:4176493] Listing built binary packages in /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt
[2025-12-30 03:51:46,107][  INFO][PID:4176493] Built packages:
['python3-avocado-plugins-vt 109.0']
[2025-12-30 03:51:46,107][  INFO][PID:4176493] build details: {'built_packages': 'python3-avocado-plugins-vt 109.0'}
[2025-12-30 03:51:46,108][  INFO][PID:4176493] Retrieving pubkey
[2025-12-30 03:51:46,108][  INFO][PID:4176493] Calling '/bin/sign -u @avocado#avocado-vt-latest@copr.fedorahosted.org -p' (attempt #1)
[2025-12-30 03:51:46,353][  INFO][PID:4176493] Added pubkey for user @avocado project avocado-vt-latest into: /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/pubkey.gpg
[2025-12-30 03:51:46,353][  INFO][PID:4176493] Finished build: id=9960173 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@avocado/avocado-vt-latest chroot=fedora-41-ppc64le 
[2025-12-30 03:51:46,355][  INFO][PID:4176493] Worker succeeded build, took 476.9589443206787
[2025-12-30 03:51:46,355][  INFO][PID:4176493] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@avocado",
            "project_name": "avocado-vt-latest",
            "project_dirname": "avocado-vt-latest",
            "submitter": "https://api.github.com/users/zhencliu",
            "ended_on": 1767066706.3553312,
            "started_on": 1767066229.3963869,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-41-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9960173-fedora-41-ppc64le",
            "build_id": 9960173,
            "package_name": "avocado-plugins-vt",
            "package_version": "109.0-1.20251230git043f5115",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@avocado/avocado-vt-latest/avocado-plugins-vt",
            "git_hash": "32f764ed7eaf4ce276c4f7f19d2fadf22a8d4703",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@avocado/avocado-vt-latest--https://api.github.com/users/zhencliu",
            "results": {
                "packages": [
                    {
                        "name": "avocado-plugins-vt",
                        "epoch": null,
                        "version": "109.0",
                        "release": "1.20251230git043f5115.fc41",
                        "arch": "src"
                    },
                    {
                        "name": "python3-avocado-plugins-vt",
                        "epoch": null,
                        "version": "109.0",
                        "release": "1.20251230git043f5115.fc41",
                        "arch": "noarch"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@avocado/avocado-vt-latest",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@avocado/avocado-vt-latest",
            "result_dir": "09960173-avocado-plugins-vt",
            "built_packages": "python3-avocado-plugins-vt 109.0",
            "id": 9960173,
            "mockchain_macros": {
                "copr_username": "@avocado",
                "copr_projectname": "avocado-vt-latest",
                "vendor": "Fedora Project COPR (@avocado/avocado-vt-latest)"
            }
        }
    ]
}
[2025-12-30 03:51:46,438][  INFO][PID:4176493] Sending fedora-messaging bus message in build.end
[2025-12-30 03:51:46,465][  INFO][PID:4176493] Compressing /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/builder-live.log by gzip
[2025-12-30 03:51:46,466][  INFO][PID:4176493] Running command 'gzip /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/builder-live.log' as PID 113215
[2025-12-30 03:51:46,507][  INFO][PID:4176493] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/builder-live.log)
[2025-12-30 03:51:46,507][  INFO][PID:4176493] Compressing /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/backend.log by gzip
[2025-12-30 03:51:46,508][  INFO][PID:4176493] Running command 'gzip /var/lib/copr/public_html/results/@avocado/avocado-vt-latest/fedora-41-ppc64le/09960173-avocado-plugins-vt/backend.log' as PID 113218