[2025-07-23 01:24:21,688][  INFO][PID:1649710] Marking build as starting
[2025-07-23 01:24:21,745][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:21,752][  INFO][PID:1649710] VM allocation process starts
[2025-07-23 01:24:21,776][  INFO][PID:1649710] Trying to allocate VM: ResallocHost, ticket_id=4045724, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-23 01:24:26,786][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:31,788][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:36,789][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:41,790][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:46,792][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:51,794][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:24:56,795][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:01,796][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:06,801][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:11,804][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:16,806][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:21,807][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:26,809][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:31,811][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:36,814][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:41,815][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:46,818][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:51,823][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:25:56,826][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:01,829][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:06,831][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:09,941][  INFO][PID:1649710] Allocated host ResallocHost, ticket_id=4045724, hostname=140.211.168.199, name=copr_osuosl_p09_prod_05745641_20250723_012235, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-23 01:26:09,942][  INFO][PID:1649710] Allocating ssh connection to builder
[2025-07-23 01:26:09,942][  INFO][PID:1649710] Checking that builder machine is OK
[2025-07-23 01:26:11,173][  INFO][PID:1649710] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-23 01:26:12,163][  INFO][PID:1649710] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-23 01:26:12,164][  INFO][PID:1649710] Filling build.info file with builder info
[2025-07-23 01:26:12,164][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:12,165][  INFO][PID:1649710] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1753233972.165579,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9306936-fedora-42-ppc64le",
            "build_id": 9306936,
            "package_name": "libmodulemd",
            "package_version": "2.15.2-20250723012101.0.gb8b11b4",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libmodulemd",
            "git_hash": "5d60ff4f7d376b141890c6546ec139625576d828",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09306936-libmodulemd",
            "built_packages": "",
            "id": 9306936,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-23 01:26:12,209][  INFO][PID:1649710] Sending fedora-messaging bus message in build.start
[2025-07-23 01:26:12,921][  INFO][PID:1649710] Sending fedora-messaging bus message in chroot.start
[2025-07-23 01:26:12,945][  INFO][PID:1649710] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9306936-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-23 01:26:14,225][  INFO][PID:1649710] Downloading the builder-live.log file, attempt 1
[2025-07-23 01:26:14,231][  INFO][PID:1649710] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log
[2025-07-23 01:26:19,256][  INFO][PID:1649710] Periodic builder liveness probe: alive
[2025-07-23 01:26:19,259][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:24,262][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:29,265][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:34,269][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:39,273][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:44,278][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:49,279][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:54,281][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:26:59,283][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:04,285][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:09,287][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:14,289][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:19,290][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:24,295][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:29,299][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:34,301][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:39,305][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:44,309][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:49,312][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:54,313][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:27:59,315][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:04,317][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:09,324][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:14,325][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:19,327][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:24,330][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:29,334][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:34,336][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:39,340][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:44,341][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:49,344][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:54,348][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:28:59,349][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:04,354][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:09,355][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:14,359][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:19,360][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:24,361][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:29,363][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:34,365][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:39,367][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:44,369][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:49,370][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:54,371][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:29:59,372][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:04,374][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:09,376][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:14,377][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:19,379][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:24,381][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:29,383][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:34,386][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:39,387][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:44,388][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:49,392][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:54,394][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:30:59,395][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:04,398][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:09,399][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:14,401][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:19,402][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:24,403][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:29,404][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:34,405][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:39,406][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:44,408][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:49,412][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:54,415][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:31:59,417][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:04,418][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:09,419][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:14,421][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:19,423][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:24,424][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:29,425][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:34,426][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:39,427][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:44,430][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:49,431][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:54,433][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:32:59,436][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:04,438][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:09,439][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:14,440][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:19,442][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:24,444][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:29,446][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:34,453][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:39,454][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:44,456][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:49,457][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:54,458][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:33:59,460][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:04,461][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:09,464][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:14,465][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:19,466][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:24,467][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:29,469][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:34,470][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:39,471][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:44,473][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:49,474][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:54,476][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:34:59,477][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:04,478][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:09,479][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:14,480][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:19,482][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:24,483][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:29,484][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:34,485][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:39,488][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:44,489][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:49,490][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:54,491][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:35:59,493][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:04,494][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:09,495][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:14,496][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:19,504][  INFO][PID:1649710] Periodic builder liveness probe: alive
[2025-07-23 01:36:19,505][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:24,506][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:29,507][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:34,509][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:39,511][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:44,513][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:49,514][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:54,516][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:36:59,517][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:04,518][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:09,521][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:14,523][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:19,524][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:24,525][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:29,526][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:34,527][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:39,528][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:44,529][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:49,530][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:54,532][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:37:59,533][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:04,534][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:09,535][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:14,536][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:19,536][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:24,538][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:29,539][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:34,540][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:39,541][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:44,542][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:49,543][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:54,544][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:38:59,545][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:04,546][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:09,547][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:14,548][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:19,550][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:24,552][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:29,553][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:34,554][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:39,556][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:44,557][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:49,558][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:54,559][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:39:59,568][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:04,575][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:09,576][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:14,577][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:19,578][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:24,579][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:29,580][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:34,581][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:39,583][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:44,584][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:49,585][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:54,586][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:40:59,587][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:04,588][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:09,589][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:14,590][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:19,591][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:24,592][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:29,594][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:34,595][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:39,597][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:44,598][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:49,600][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:54,601][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:41:59,602][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:04,603][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:09,604][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:14,605][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:19,607][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:24,608][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:29,609][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:34,610][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:39,612][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:44,614][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:49,615][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:54,616][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:42:59,617][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:04,618][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:09,619][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:14,621][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:19,622][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:24,624][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:29,625][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:34,627][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:39,628][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:44,629][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:49,630][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:54,631][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:43:59,632][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:04,634][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:09,636][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:14,637][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:19,638][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:24,639][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:29,640][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:34,641][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:39,642][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:44,645][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:49,649][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:54,653][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:44:59,657][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:04,658][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:09,660][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:14,663][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:19,664][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:24,665][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:29,666][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:34,668][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:39,670][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:44,671][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:49,674][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:54,676][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:45:59,677][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:46:04,679][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:46:09,680][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:46:14,682][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:46:19,737][  INFO][PID:1649710] Periodic builder liveness probe: dead
[2025-07-23 01:47:19,806][ ERROR][PID:1649710] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.199 port 22: Connection timed out

[2025-07-23 01:47:43,139][ ERROR][PID:1649710] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 01:47:53,140][WARNING][PID:1649710] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 01:48:03,141][  INFO][PID:1649710] Downloading the builder-live.log file, attempt 2
[2025-07-23 01:48:03,142][  INFO][PID:1649710] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log
[2025-07-23 01:48:29,877][ ERROR][PID:1649710] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.199 port 22: Connection timed out

[2025-07-23 01:49:03,212][ ERROR][PID:1649710] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 01:49:13,215][WARNING][PID:1649710] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 01:49:23,216][  INFO][PID:1649710] Downloading the builder-live.log file, attempt 3
[2025-07-23 01:49:23,217][  INFO][PID:1649710] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log
[2025-07-23 01:49:39,946][ ERROR][PID:1649710] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.199 port 22: Connection timed out

[2025-07-23 01:50:23,285][ ERROR][PID:1649710] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 01:50:33,289][WARNING][PID:1649710] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-23 01:50:43,289][  INFO][PID:1649710] Downloading the builder-live.log file, attempt 4
[2025-07-23 01:50:43,290][  INFO][PID:1649710] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.199 copr-rpmbuild-log
[2025-07-23 01:50:50,017][ ERROR][PID:1649710] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.199 port 22: Connection timed out

[2025-07-23 01:51:00,017][ ERROR][PID:1649710] Can't ssh to cancel build.
[2025-07-23 01:51:43,358][ ERROR][PID:1649710] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-23 01:51:53,361][ ERROR][PID:1649710] Giving up for unstable SSH, failures: 1753235273.1402707, 1753235353.2155116, 1753235433.2889555, 1753235513.3610656
[2025-07-23 01:51:53,362][ ERROR][PID:1649710] Re-try request for task on 'ResallocHost, ticket_id=4045724, hostname=140.211.168.199, name=copr_osuosl_p09_prod_05745641_20250723_012235, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-23 01:51:53,362][  INFO][PID:1649710] Releasing VM back to pool
[2025-07-23 01:51:53,374][  INFO][PID:1649710] Retry #1 (on other host)
[2025-07-23 01:51:53,375][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:51:53,375][  INFO][PID:1649710] VM allocation process starts
[2025-07-23 01:51:53,389][  INFO][PID:1649710] Trying to allocate VM: ResallocHost, ticket_id=4046123, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-23 01:51:56,403][  INFO][PID:1649710] Allocated host ResallocHost, ticket_id=4046123, hostname=2620:52:3:1:dead:beef:cafe:c24a, name=copr_hv_ppc64le_02_prod_05746037_20250723_013404, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-23 01:51:56,404][  INFO][PID:1649710] Allocating ssh connection to builder
[2025-07-23 01:51:56,404][  INFO][PID:1649710] Checking that builder machine is OK
[2025-07-23 01:51:57,211][  INFO][PID:1649710] Running remote command: copr-builder-ready fedora-42-ppc64le
[2025-07-23 01:51:57,573][  INFO][PID:1649710] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2025-07-23 01:51:57,573][  INFO][PID:1649710] Filling build.info file with builder info
[2025-07-23 01:51:57,574][  INFO][PID:1649710] Checking for cancel request
[2025-07-23 01:51:57,575][  INFO][PID:1649710] Not re-notifying FE and msg buses for the new host.
[2025-07-23 01:51:57,575][  INFO][PID:1649710] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9306936-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2025-07-23 01:51:58,197][  INFO][PID:1649710] Downloading the builder-live.log file, attempt 1
[2025-07-23 01:51:58,198][  INFO][PID:1649710] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24a copr-rpmbuild-log
[2025-07-23 01:52:06,802][  INFO][PID:1649710] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24a' (ED25519) to the list of known hosts.

[2025-07-23 01:52:06,802][  INFO][PID:1649710] Downloading results from builder
[2025-07-23 01:52:06,803][  INFO][PID:1649710] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24a]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd started
[2025-07-23 01:52:06,804][  INFO][PID:1649710] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24a]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/build-09306936.rsync.log
[2025-07-23 01:52:07,272][  INFO][PID:1649710] rsyncing finished.
[2025-07-23 01:52:07,273][  INFO][PID:1649710] Releasing VM back to pool
[2025-07-23 01:52:07,283][  INFO][PID:1649710] Searching for 'success' file in resultdir
[2025-07-23 01:52:07,284][ ERROR][PID:1649710] Build failed: Backend process error: No success file => build failure
[2025-07-23 01:52:07,284][  INFO][PID:1649710] Finished build: id=9306936 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-42-ppc64le 
[2025-07-23 01:52:07,286][ ERROR][PID:1649710] Backend process error: No success file => build failure
[2025-07-23 01:52:07,287][  INFO][PID:1649710] Worker failed build, took 9.7118501663208
[2025-07-23 01:52:07,287][  INFO][PID:1649710] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1753235527.2872424,
            "started_on": 1753235517.5753922,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9306936-fedora-42-ppc64le",
            "build_id": 9306936,
            "package_name": "libmodulemd",
            "package_version": "2.15.2-20250723012101.0.gb8b11b4",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/libmodulemd",
            "git_hash": "5d60ff4f7d376b141890c6546ec139625576d828",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09306936-libmodulemd",
            "built_packages": "",
            "id": 9306936,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-23 01:52:07,329][  INFO][PID:1649710] Sending fedora-messaging bus message in build.end
[2025-07-23 01:52:07,421][  INFO][PID:1649710] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/builder-live.log by gzip
[2025-07-23 01:52:07,423][  INFO][PID:1649710] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/builder-live.log' as PID 1826572
[2025-07-23 01:52:07,425][  INFO][PID:1649710] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/builder-live.log)
[2025-07-23 01:52:07,425][  INFO][PID:1649710] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/backend.log by gzip
[2025-07-23 01:52:07,427][  INFO][PID:1649710] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-42-ppc64le/09306936-libmodulemd/backend.log' as PID 1826577