[2025-07-24 04:56:42,191][  INFO][PID:1396249] Marking build as starting
[2025-07-24 04:56:42,361][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:56:42,367][  INFO][PID:1396249] VM allocation process starts
[2025-07-24 04:56:42,401][  INFO][PID:1396249] Trying to allocate VM: ResallocHost, ticket_id=4086387, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 04:56:47,409][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:56:48,433][  INFO][PID:1396249] Allocated host ResallocHost, ticket_id=4086387, hostname=140.211.168.94, name=copr_osuosl_p09_prod_05777655_20250724_044609, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 04:56:48,434][  INFO][PID:1396249] Allocating ssh connection to builder
[2025-07-24 04:56:48,434][  INFO][PID:1396249] Checking that builder machine is OK
[2025-07-24 04:56:49,795][  INFO][PID:1396249] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-24 04:56:50,836][  INFO][PID:1396249] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-24 04:56:50,836][  INFO][PID:1396249] Filling build.info file with builder info
[2025-07-24 04:56:50,837][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:56:50,839][  INFO][PID:1396249] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1753333010.8389459,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9316868-fedora-rawhide-ppc64le",
            "build_id": 9316868,
            "package_name": "microdnf",
            "package_version": "3.10.1-20250724012027.1.g26c9397",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/microdnf",
            "git_hash": "c941bc5195a931095acf07f8c9cd1b2bf2a392af",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09316868-microdnf",
            "built_packages": "",
            "id": 9316868,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-24 04:56:50,873][  INFO][PID:1396249] Sending fedora-messaging bus message in build.start
[2025-07-24 04:56:51,588][  INFO][PID:1396249] Sending fedora-messaging bus message in chroot.start
[2025-07-24 04:56:51,613][  INFO][PID:1396249] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9316868-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-24 04:56:52,908][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 1
[2025-07-24 04:56:52,910][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log
[2025-07-24 04:56:57,913][  INFO][PID:1396249] Periodic builder liveness probe: alive
[2025-07-24 04:56:57,914][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:02,915][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:07,916][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:12,917][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:17,919][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:22,920][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:27,921][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:32,922][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:37,923][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:42,924][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:47,926][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:52,927][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:57:57,928][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:02,929][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:07,930][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:12,931][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:17,933][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:22,934][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:27,935][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:32,936][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:37,937][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:42,938][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:47,939][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:52,940][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:58:57,942][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:02,943][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:07,947][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:12,948][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:17,951][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:22,952][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:27,953][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:32,955][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:37,956][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:42,957][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:47,958][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:52,960][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 04:59:57,961][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:02,963][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:07,964][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:12,966][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:17,969][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:22,971][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:27,972][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:32,975][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:37,977][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:42,978][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:47,983][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:52,985][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:00:57,987][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:02,988][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:07,990][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:12,992][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:17,996][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:22,998][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:27,999][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:33,007][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:38,009][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:43,013][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:48,014][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:53,016][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:01:58,018][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:03,020][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:08,021][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:13,023][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:18,024][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:23,025][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:28,026][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:33,027][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:38,028][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:43,030][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:48,031][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:53,032][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:02:58,033][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:03,035][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:08,036][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:13,037][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:18,038][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:23,039][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:28,040][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:33,041][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:38,042][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:43,044][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:48,045][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:53,046][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:03:58,047][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:03,048][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:08,050][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:13,051][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:18,052][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:23,053][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:28,055][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:33,056][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:38,058][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:43,059][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:48,065][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:53,066][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:04:58,067][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:03,068][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:08,072][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:13,073][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:18,074][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:23,075][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:28,079][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:33,081][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:38,082][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:43,083][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:48,084][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:53,085][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:05:58,086][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:03,087][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:08,089][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:13,090][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:18,091][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:23,092][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:28,101][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:33,106][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:38,109][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:43,111][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:48,112][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:53,113][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:06:58,119][  INFO][PID:1396249] Periodic builder liveness probe: alive
[2025-07-24 05:06:58,120][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:03,121][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:08,123][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:13,127][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:18,130][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:23,131][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:28,132][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:33,143][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:38,144][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:43,146][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:48,154][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:53,155][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:07:58,157][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:03,204][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:08,209][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:13,211][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:18,212][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:23,217][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:28,221][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:33,222][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:38,225][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:43,229][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:48,233][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:53,238][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:08:58,259][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:03,262][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:08,266][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:13,271][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:18,272][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:23,274][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:28,279][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:33,281][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:38,283][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:43,286][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:48,288][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:53,289][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:09:58,293][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:03,295][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:08,298][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:13,303][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:18,307][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:23,308][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:28,313][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:33,318][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:38,332][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:43,344][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:48,348][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:53,362][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:10:58,370][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:03,375][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:08,385][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:13,389][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:18,395][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:23,399][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:28,403][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:33,406][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:38,410][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:43,416][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:48,423][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:53,425][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:11:58,428][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:03,431][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:08,436][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:13,444][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:18,446][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:23,448][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:28,449][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:33,452][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:38,457][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:43,459][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:48,460][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:53,462][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:12:58,463][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:03,464][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:08,465][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:13,466][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:18,468][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:23,469][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:28,470][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:33,472][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:38,474][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:43,477][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:48,479][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:53,480][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:13:58,481][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:03,482][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:08,483][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:13,484][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:18,485][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:23,486][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:28,487][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:33,489][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:38,490][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:43,491][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:48,492][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:53,493][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:14:58,495][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:03,496][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:08,497][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:13,498][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:18,500][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:23,501][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:28,502][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:33,504][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:38,505][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:43,506][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:48,507][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:53,508][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:15:58,509][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:03,510][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:08,511][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:13,512][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:18,513][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:23,514][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:28,515][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:33,517][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:38,518][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:43,519][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:48,520][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:53,522][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:16:58,530][  INFO][PID:1396249] Periodic builder liveness probe: alive
[2025-07-24 05:16:58,531][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:03,532][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:08,533][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:13,533][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:18,534][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:23,536][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:28,537][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:33,538][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:38,540][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:43,541][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:48,542][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:53,544][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:17:58,545][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:03,546][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:08,547][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:13,548][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:18,551][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:23,552][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:28,553][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:33,554][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:38,556][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:43,557][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:48,558][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:53,559][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:18:58,561][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:03,562][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:08,564][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:13,566][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:18,568][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:23,570][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:28,571][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:33,572][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:38,574][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:43,578][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:48,579][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:53,580][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:19:58,582][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:03,583][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:08,584][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:13,585][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:18,588][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:23,592][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:28,593][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:33,599][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:38,601][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:43,602][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:48,604][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:53,605][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:20:58,606][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:03,608][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:08,609][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:13,610][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:18,611][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:23,616][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:28,618][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:33,619][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:38,621][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:43,622][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:48,623][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:53,625][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:21:58,626][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:03,627][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:08,628][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:13,629][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:18,633][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:23,634][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:28,635][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:33,636][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:38,637][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:43,638][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:48,639][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:53,641][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:22:58,642][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:03,643][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:08,644][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:13,646][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:18,647][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:23,649][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:28,650][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:33,651][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:38,652][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:43,653][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:48,654][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:53,656][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:23:58,657][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:03,659][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:08,660][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:13,661][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:18,662][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:23,663][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:28,665][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:33,666][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:38,668][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:43,669][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:48,670][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:53,672][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:24:58,673][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:03,675][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:08,676][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:13,678][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:18,679][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:23,680][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:28,681][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:33,683][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:38,684][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:43,685][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:48,686][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:53,687][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:25:58,688][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:03,689][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:08,691][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:13,692][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:18,694][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:23,695][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:28,697][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:33,699][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:38,703][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:43,704][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:48,709][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:53,714][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:26:58,725][  INFO][PID:1396249] Periodic builder liveness probe: dead
[2025-07-24 05:27:58,866][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Connection timed out during banner exchange
Connection to 140.211.168.94 port 22 timed out

[2025-07-24 05:28:55,145][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 05:29:05,146][WARNING][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 05:29:08,953][ ERROR][PID:1396249] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.94 port 22: Connection timed out

[2025-07-24 05:29:15,147][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 2
[2025-07-24 05:29:15,148][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log
[2025-07-24 05:30:15,216][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 05:30:19,022][ ERROR][PID:1396249] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.94 port 22: Connection timed out

[2025-07-24 05:30:25,248][WARNING][PID:1396249] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 05:30:35,249][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 3
[2025-07-24 05:30:35,250][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log
[2025-07-24 05:31:29,091][ ERROR][PID:1396249] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.94 port 22: Connection timed out

[2025-07-24 05:31:35,319][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 05:31:39,092][ ERROR][PID:1396249] Can't ssh to cancel build.
[2025-07-24 05:31:45,320][WARNING][PID:1396249] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 05:31:55,321][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 4
[2025-07-24 05:31:55,322][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.94 copr-rpmbuild-log
[2025-07-24 05:32:55,389][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 05:33:05,405][ ERROR][PID:1396249] Giving up for unstable SSH, failures: 1753334945.1461744, 1753335025.2486067, 1753335105.320465, 1753335185.405095
[2025-07-24 05:33:05,406][ ERROR][PID:1396249] Re-try request for task on 'ResallocHost, ticket_id=4086387, hostname=140.211.168.94, name=copr_osuosl_p09_prod_05777655_20250724_044609, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-24 05:33:05,406][  INFO][PID:1396249] Releasing VM back to pool
[2025-07-24 05:33:05,418][  INFO][PID:1396249] Retry #1 (on other host)
[2025-07-24 05:33:05,419][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:05,419][  INFO][PID:1396249] VM allocation process starts
[2025-07-24 05:33:05,432][  INFO][PID:1396249] Trying to allocate VM: ResallocHost, ticket_id=4086809, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 05:33:10,434][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:15,435][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:20,436][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:25,437][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:30,438][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:35,439][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:40,440][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:45,441][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:50,442][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:33:55,443][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:00,445][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:05,446][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:10,447][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:15,448][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:20,449][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:25,450][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:30,451][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:35,452][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:40,456][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:45,457][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:50,458][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:34:55,459][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:00,460][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:05,460][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:10,461][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:15,462][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:20,463][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:25,464][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:30,465][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:35,468][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:40,469][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:45,470][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:50,471][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:35:55,472][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:00,474][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:05,475][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:10,477][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:15,478][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:20,481][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:25,482][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:30,483][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:35,484][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:40,485][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:45,487][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:50,488][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:36:55,489][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:00,490][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:05,491][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:10,493][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:15,681][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:20,682][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:25,683][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:30,684][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:35,686][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:40,689][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:45,691][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:50,725][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:37:55,820][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:00,821][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:05,823][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:10,901][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:16,060][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:21,246][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:23,575][  INFO][PID:1396249] Allocated host ResallocHost, ticket_id=4086809, hostname=140.211.168.243, name=copr_osuosl_p09_prod_05778179_20250724_053423, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 05:38:23,575][  INFO][PID:1396249] Allocating ssh connection to builder
[2025-07-24 05:38:23,576][  INFO][PID:1396249] Checking that builder machine is OK
[2025-07-24 05:38:25,004][  INFO][PID:1396249] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-24 05:38:26,105][  INFO][PID:1396249] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-24 05:38:26,105][  INFO][PID:1396249] Filling build.info file with builder info
[2025-07-24 05:38:26,131][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:26,132][  INFO][PID:1396249] Not re-notifying FE and msg buses for the new host.
[2025-07-24 05:38:26,132][  INFO][PID:1396249] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9316868-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-24 05:38:27,399][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 1
[2025-07-24 05:38:27,400][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-24 05:38:32,443][  INFO][PID:1396249] Periodic builder liveness probe: alive
[2025-07-24 05:38:32,443][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:37,444][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:42,445][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:47,541][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:52,812][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:38:58,115][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:03,199][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:08,211][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:13,296][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:18,771][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:24,063][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:29,269][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:34,621][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:39,823][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:45,108][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:50,401][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:39:55,403][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:00,773][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:05,814][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:10,877][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:16,142][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:21,146][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:26,148][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:31,150][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:36,152][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:41,153][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:46,154][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:51,155][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:40:56,158][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:01,161][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:06,178][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:11,179][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:16,180][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:21,181][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:26,184][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:31,189][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:36,191][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:41,192][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:46,193][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:51,196][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:41:56,247][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:01,286][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:06,526][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:11,542][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:16,606][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:21,798][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:26,846][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:32,040][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:37,042][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:42,316][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:47,566][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:52,571][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:42:57,780][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:02,864][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:07,956][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:13,066][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:18,274][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:23,353][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:28,533][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:33,625][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:38,629][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:43,633][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:48,634][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:53,636][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:43:58,744][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:03,747][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:08,751][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:13,755][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:18,756][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:23,770][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:28,773][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:33,776][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:38,778][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:43,780][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:48,784][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:53,787][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:44:58,788][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:03,789][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:09,326][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:14,449][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:19,529][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:24,546][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:29,551][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:34,553][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:39,554][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:44,559][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:49,561][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:54,562][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:45:59,563][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:04,564][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:09,565][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:14,567][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:19,568][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:24,569][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:29,571][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:34,572][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:39,574][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:44,575][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:49,576][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:54,577][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:46:59,578][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:04,580][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:09,581][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:14,582][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:19,583][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:24,585][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:29,592][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:34,594][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:39,596][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:44,600][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:49,606][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:54,610][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:47:59,612][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:04,618][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:09,620][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:14,621][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:19,622][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:24,623][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:29,624][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:34,642][  INFO][PID:1396249] Periodic builder liveness probe: alive
[2025-07-24 05:48:34,642][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:39,645][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:44,646][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:49,647][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:54,648][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:48:59,650][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:04,651][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:09,652][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:14,653][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:19,659][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:24,661][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:29,662][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:34,664][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:39,665][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:44,668][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:49,670][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:54,671][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:49:59,672][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:04,673][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:09,677][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:14,679][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:19,684][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:24,833][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:29,834][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:34,836][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:39,837][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:44,839][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:49,841][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:54,842][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:50:59,844][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:04,845][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:09,846][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:14,848][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:19,850][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:24,851][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:29,852][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:34,853][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:39,855][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:44,856][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:49,857][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:54,858][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:51:59,859][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:04,860][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:09,861][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:14,862][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:19,863][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:24,865][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:29,866][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:34,867][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:39,869][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:44,870][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:49,871][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:54,872][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:52:59,874][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:04,875][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:09,877][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:14,879][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:19,880][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:24,881][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:29,882][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:34,883][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:39,884][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:44,885][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:49,887][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:54,888][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:53:59,889][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:04,890][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:09,891][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:14,893][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:19,894][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:24,895][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:29,896][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:34,898][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:39,899][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:44,900][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:49,901][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:54,902][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:54:59,903][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:04,904][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:09,911][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:14,913][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:19,914][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:24,916][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:29,917][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:34,918][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:39,919][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:44,920][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:49,922][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:54,923][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:55:59,924][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:04,925][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:09,926][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:14,927][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:19,928][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:24,929][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:29,931][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:34,932][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:39,933][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:44,934][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:49,935][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:54,936][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:56:59,937][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:04,938][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:09,939][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:14,940][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:19,941][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:24,942][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:29,943][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:34,944][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:39,945][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:44,946][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:49,947][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:54,948][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:57:59,950][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:04,951][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:09,952][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:14,953][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:19,954][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:24,955][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:29,956][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:34,962][  INFO][PID:1396249] Periodic builder liveness probe: alive
[2025-07-24 05:58:34,962][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:39,963][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:44,964][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:49,965][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:54,966][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:58:59,967][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:04,969][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:09,970][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:14,971][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:19,972][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:24,973][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:29,974][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:34,975][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:39,977][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:44,978][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:49,979][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:54,980][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 05:59:59,981][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:04,982][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:09,983][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:14,984][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:19,985][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:24,988][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:29,989][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:34,990][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:39,991][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:44,992][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:49,993][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:54,995][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:00:59,996][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:04,997][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:09,999][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:15,000][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:20,001][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:25,002][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:30,003][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:35,005][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:40,006][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:45,007][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:50,008][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:01:55,009][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:00,010][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:05,012][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:10,013][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:15,015][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:20,016][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:25,017][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:30,018][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:35,020][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:40,021][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:45,022][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:50,023][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:02:55,024][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:00,025][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:05,027][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:10,028][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:15,029][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:20,030][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:25,031][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:30,032][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:35,033][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:40,034][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:45,035][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:50,036][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:03:55,037][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:00,039][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:05,040][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:10,041][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:15,042][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:20,043][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:25,044][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:30,045][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:35,046][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:40,048][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:45,049][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:50,050][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:04:55,051][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:00,052][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:05,054][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:10,055][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:15,056][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:20,057][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:25,058][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:30,059][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:35,061][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:40,062][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:45,063][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:50,064][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:05:55,065][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:00,066][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:05,069][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:09,144][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:06:10,070][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:15,071][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:19,145][WARNING][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 06:06:20,072][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:25,073][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:29,146][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 2
[2025-07-24 06:06:29,147][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-24 06:06:30,078][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:35,086][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:40,089][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:45,090][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:50,091][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:06:55,093][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:00,094][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:05,095][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:10,096][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:15,099][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:20,100][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:25,101][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:29,215][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:07:30,105][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:35,108][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:39,218][WARNING][PID:1396249] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 06:07:40,109][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:45,110][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:49,220][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 3
[2025-07-24 06:07:49,221][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-24 06:07:50,114][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:07:55,116][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:00,118][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:05,121][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:10,122][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:15,124][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:20,133][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:25,138][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:30,140][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:08:35,176][  INFO][PID:1396249] Periodic builder liveness probe: dead
[2025-07-24 06:08:49,232][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:08:59,235][WARNING][PID:1396249] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-24 06:09:09,237][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 4
[2025-07-24 06:09:09,241][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-24 06:09:35,248][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.243 port 22: Connection timed out

[2025-07-24 06:10:09,310][ ERROR][PID:1396249] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-24 06:10:19,314][ ERROR][PID:1396249] Giving up for unstable SSH, failures: 1753337179.145561, 1753337259.2186627, 1753337339.2354703, 1753337419.3143034
[2025-07-24 06:10:45,334][ ERROR][PID:1396249] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.243 port 22: Connection timed out

[2025-07-24 06:11:55,404][ ERROR][PID:1396249] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.243 port 22: Connection timed out

[2025-07-24 06:13:05,474][ ERROR][PID:1396249] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.243 port 22: Connection timed out

[2025-07-24 06:13:15,476][ ERROR][PID:1396249] Can't ssh to cancel build.
[2025-07-24 06:13:15,476][ ERROR][PID:1396249] Re-try request for task on 'ResallocHost, ticket_id=4086809, hostname=140.211.168.243, name=copr_osuosl_p09_prod_05778179_20250724_053423, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-07-24 06:13:15,480][  INFO][PID:1396249] Releasing VM back to pool
[2025-07-24 06:13:15,501][  INFO][PID:1396249] Retry #2 (on other host)
[2025-07-24 06:13:15,507][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:13:15,510][  INFO][PID:1396249] VM allocation process starts
[2025-07-24 06:13:15,536][  INFO][PID:1396249] Trying to allocate VM: ResallocHost, ticket_id=4087244, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 06:13:18,561][  INFO][PID:1396249] Allocated host ResallocHost, ticket_id=4087244, hostname=2620:52:3:1:dead:beef:cafe:c20e, name=copr_hv_ppc64le_01_prod_05778400_20250724_060138, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-24 06:13:18,562][  INFO][PID:1396249] Allocating ssh connection to builder
[2025-07-24 06:13:18,562][  INFO][PID:1396249] Checking that builder machine is OK
[2025-07-24 06:13:19,906][  INFO][PID:1396249] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-24 06:13:20,455][  INFO][PID:1396249] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-24 06:13:20,456][  INFO][PID:1396249] Filling build.info file with builder info
[2025-07-24 06:13:20,464][  INFO][PID:1396249] Checking for cancel request
[2025-07-24 06:13:20,465][  INFO][PID:1396249] Not re-notifying FE and msg buses for the new host.
[2025-07-24 06:13:20,466][  INFO][PID:1396249] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9316868-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-24 06:13:21,443][  INFO][PID:1396249] Downloading the builder-live.log file, attempt 1
[2025-07-24 06:13:21,444][  INFO][PID:1396249] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c20e copr-rpmbuild-log
[2025-07-24 06:13:33,452][  INFO][PID:1396249] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c20e' (ED25519) to the list of known hosts.

[2025-07-24 06:13:33,453][  INFO][PID:1396249] Downloading results from builder
[2025-07-24 06:13:33,453][  INFO][PID:1396249] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c20e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf started
[2025-07-24 06:13:33,454][  INFO][PID:1396249] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c20e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/build-09316868.rsync.log
[2025-07-24 06:13:34,134][  INFO][PID:1396249] rsyncing finished.
[2025-07-24 06:13:34,135][  INFO][PID:1396249] Releasing VM back to pool
[2025-07-24 06:13:34,145][  INFO][PID:1396249] Searching for 'success' file in resultdir
[2025-07-24 06:13:34,146][ ERROR][PID:1396249] Build failed: Backend process error: No success file => build failure
[2025-07-24 06:13:34,147][  INFO][PID:1396249] Finished build: id=9316868 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-rawhide-ppc64le 
[2025-07-24 06:13:34,148][ ERROR][PID:1396249] Backend process error: No success file => build failure
[2025-07-24 06:13:34,149][  INFO][PID:1396249] Worker failed build, took 13.68378758430481
[2025-07-24 06:13:34,150][  INFO][PID:1396249] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly",
            "project_dirname": "dnf-nightly",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1753337614.149412,
            "started_on": 1753337600.4656243,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9316868-fedora-rawhide-ppc64le",
            "build_id": 9316868,
            "package_name": "microdnf",
            "package_version": "3.10.1-20250724012027.1.g26c9397",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/microdnf",
            "git_hash": "c941bc5195a931095acf07f8c9cd1b2bf2a392af",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly",
            "result_dir": "09316868-microdnf",
            "built_packages": "",
            "id": 9316868,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)"
            }
        }
    ]
}
[2025-07-24 06:13:34,242][  INFO][PID:1396249] Sending fedora-messaging bus message in build.end
[2025-07-24 06:13:34,268][  INFO][PID:1396249] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/builder-live.log by gzip
[2025-07-24 06:13:34,270][  INFO][PID:1396249] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/builder-live.log' as PID 1810371
[2025-07-24 06:13:34,272][  INFO][PID:1396249] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/builder-live.log)
[2025-07-24 06:13:34,273][  INFO][PID:1396249] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/backend.log by gzip
[2025-07-24 06:13:34,274][  INFO][PID:1396249] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/09316868-microdnf/backend.log' as PID 1810372