[2025-07-15 16:57:57,235][  INFO][PID:127430] Marking build as starting
[2025-07-15 16:57:57,291][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:57:57,291][  INFO][PID:127430] VM allocation process starts
[2025-07-15 16:57:57,302][  INFO][PID:127430] Trying to allocate VM: ResallocHost, ticket_id=3939803, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-15 16:58:00,320][  INFO][PID:127430] Allocated host ResallocHost, ticket_id=3939803, hostname=3.224.114.51, name=aws_x86_64_spot_prod_05425331_20250715_165540, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-15 16:58:00,321][  INFO][PID:127430] Allocating ssh connection to builder
[2025-07-15 16:58:00,322][  INFO][PID:127430] Checking that builder machine is OK
[2025-07-15 16:58:00,725][  INFO][PID:127430] Running remote command: copr-builder-ready fedora-41-x86_64
[2025-07-15 16:58:00,955][  INFO][PID:127430] Red Hat subscription not needed for fedora-41-x86_64
Builder is ready to be used

[2025-07-15 16:58:00,957][  INFO][PID:127430] Filling build.info file with builder info
[2025-07-15 16:58:00,961][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:00,967][  INFO][PID:127430] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/limb",
            "ended_on": null,
            "started_on": 1752598680.9672303,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9275696-fedora-41-x86_64",
            "build_id": 9275696,
            "package_name": "0ad",
            "package_version": "0.27.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/0ad",
            "git_hash": "0acc1e9815b52a675c076395424f549e1f8a1da9",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/limb",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09275696-0ad",
            "built_packages": "",
            "id": 9275696,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-15 16:58:01,019][  INFO][PID:127430] Sending fedora-messaging bus message in build.start
[2025-07-15 16:58:01,965][  INFO][PID:127430] Sending fedora-messaging bus message in chroot.start
[2025-07-15 16:58:01,994][  INFO][PID:127430] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9275696-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached
[2025-07-15 16:58:02,336][  INFO][PID:127430] Downloading the builder-live.log file, attempt 1
[2025-07-15 16:58:02,338][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.224.114.51 copr-rpmbuild-log
[2025-07-15 16:58:07,343][  INFO][PID:127430] Periodic builder liveness probe: alive
[2025-07-15 16:58:07,343][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:12,344][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:17,345][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:22,346][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:27,347][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:32,348][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:37,350][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:42,351][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:47,352][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:52,354][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:58:57,355][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:02,357][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:07,358][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:12,359][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:17,360][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:22,362][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:27,363][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:32,364][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:37,366][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:42,367][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:47,368][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:52,369][  INFO][PID:127430] Checking for cancel request
[2025-07-15 16:59:57,370][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:02,371][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:07,372][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:12,374][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:17,375][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:22,376][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:27,377][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:32,378][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:37,379][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:42,380][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:47,381][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:52,382][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:00:57,383][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:02,384][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:07,386][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:12,387][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:17,388][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:22,389][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:27,390][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:32,391][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:37,392][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:42,393][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:47,394][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:52,395][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:01:57,396][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:02,398][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:07,399][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:12,400][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:17,401][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:22,402][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:27,403][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:32,404][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:37,405][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:42,406][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:47,407][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:52,408][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:02:57,409][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:02,410][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:07,412][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:12,413][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:17,414][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:22,415][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:27,416][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:32,417][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:37,418][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:42,419][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:47,420][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:52,421][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:03:57,422][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:02,424][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:07,425][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:12,426][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:17,427][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:22,428][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:27,429][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:32,430][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:37,431][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:42,432][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:47,433][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:52,434][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:04:56,407][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:04:57,435][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:02,436][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:06,407][WARNING][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 17:05:07,437][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:12,438][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:16,409][  INFO][PID:127430] Downloading the builder-live.log file, attempt 2
[2025-07-15 17:05:16,413][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.224.114.51 copr-rpmbuild-log
[2025-07-15 17:05:17,440][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:22,441][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:27,442][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:32,443][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:37,444][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:42,446][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:47,450][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:52,452][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:05:57,453][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:02,455][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:07,457][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:12,458][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:16,481][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:06:17,460][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:22,461][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:26,567][WARNING][PID:127430] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 17:06:27,463][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:32,465][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:36,568][  INFO][PID:127430] Downloading the builder-live.log file, attempt 3
[2025-07-15 17:06:36,569][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.224.114.51 copr-rpmbuild-log
[2025-07-15 17:06:37,466][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:42,468][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:47,469][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:52,470][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:06:57,471][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:02,472][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:07,473][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:12,474][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:17,476][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:22,477][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:27,478][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:32,480][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:36,637][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:07:37,481][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:42,482][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:46,638][WARNING][PID:127430] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 17:07:47,483][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:52,484][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:07:56,639][  INFO][PID:127430] Downloading the builder-live.log file, attempt 4
[2025-07-15 17:07:56,640][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.224.114.51 copr-rpmbuild-log
[2025-07-15 17:07:57,485][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:02,486][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:07,500][  INFO][PID:127430] Periodic builder liveness probe: alive
[2025-07-15 17:08:07,501][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:12,502][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:17,503][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:22,505][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:27,506][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:32,507][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:37,508][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:42,511][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:47,513][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:52,515][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:08:56,708][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:08:57,517][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:02,518][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:06,710][ ERROR][PID:127430] Giving up for unstable SSH, failures: 1752599106.4079123, 1752599186.5673482, 1752599266.6381526, 1752599346.7099502
[2025-07-15 17:09:06,711][ ERROR][PID:127430] Re-try request for task on 'ResallocHost, ticket_id=3939803, hostname=3.224.114.51, name=aws_x86_64_spot_prod_05425331_20250715_165540, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-15 17:09:06,711][  INFO][PID:127430] Releasing VM back to pool
[2025-07-15 17:09:06,724][  INFO][PID:127430] Retry #1 (on other host)
[2025-07-15 17:09:06,724][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:06,725][  INFO][PID:127430] VM allocation process starts
[2025-07-15 17:09:06,737][  INFO][PID:127430] Trying to allocate VM: ResallocHost, ticket_id=3939976, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-15 17:09:11,740][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:16,741][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:21,755][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:26,757][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:31,759][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:36,763][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:41,766][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:46,769][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:51,773][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:09:56,778][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:01,781][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:06,783][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:11,787][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:14,865][  INFO][PID:127430] Allocated host ResallocHost, ticket_id=3939976, hostname=3.231.151.48, name=aws_x86_64_spot_prod_05425872_20250715_170835, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-15 17:10:14,866][  INFO][PID:127430] Allocating ssh connection to builder
[2025-07-15 17:10:14,866][  INFO][PID:127430] Checking that builder machine is OK
[2025-07-15 17:10:15,358][  INFO][PID:127430] Running remote command: copr-builder-ready fedora-41-x86_64
[2025-07-15 17:10:15,575][  INFO][PID:127430] Red Hat subscription not needed for fedora-41-x86_64
Builder is ready to be used

[2025-07-15 17:10:15,576][  INFO][PID:127430] Filling build.info file with builder info
[2025-07-15 17:10:15,581][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:15,583][  INFO][PID:127430] Not re-notifying FE and msg buses for the new host.
[2025-07-15 17:10:15,584][  INFO][PID:127430] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9275696-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached
[2025-07-15 17:10:15,931][  INFO][PID:127430] Downloading the builder-live.log file, attempt 1
[2025-07-15 17:10:15,969][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.231.151.48 copr-rpmbuild-log
[2025-07-15 17:10:20,932][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:25,933][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:30,938][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:35,943][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:40,952][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:45,953][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:50,958][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:10:56,076][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:01,083][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:06,086][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:11,091][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:16,092][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:21,093][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:26,094][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:31,098][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:36,100][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:41,140][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:46,164][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:51,233][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:11:56,237][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:01,241][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:06,243][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:11,245][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:16,247][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:21,249][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:26,271][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:31,272][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:36,275][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:41,285][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:46,317][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:51,340][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:12:56,342][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:01,343][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:06,344][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:11,702][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:16,703][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:21,705][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:26,707][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:31,709][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:36,714][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:41,715][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:46,716][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:51,723][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:13:56,725][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:01,726][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:06,730][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:11,735][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:16,737][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:21,739][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:26,746][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:31,749][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:36,757][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:41,759][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:46,762][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:51,765][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:14:56,768][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:01,776][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:06,778][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:11,779][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:16,784][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:21,790][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:26,792][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:31,797][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:36,798][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:41,802][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:46,806][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:51,811][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:15:56,819][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:01,822][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:06,824][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:11,832][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:16,834][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:21,837][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:26,839][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:31,842][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:36,845][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:41,847][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:46,848][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:51,853][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:16:56,855][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:01,856][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:06,911][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:11,917][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:16,924][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:19,914][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:17:21,927][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:26,929][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:29,921][WARNING][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 17:17:31,931][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:36,938][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:39,925][  INFO][PID:127430] Downloading the builder-live.log file, attempt 2
[2025-07-15 17:17:39,933][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.231.151.48 copr-rpmbuild-log
[2025-07-15 17:17:41,940][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:46,944][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:51,952][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:17:56,954][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:01,955][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:06,956][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:11,989][  INFO][PID:127430] Periodic builder liveness probe: alive
[2025-07-15 17:18:11,990][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:16,993][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:21,994][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:26,995][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:31,996][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:36,998][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:40,008][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:18:41,999][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:47,000][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:50,093][WARNING][PID:127430] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 17:18:52,002][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:18:57,003][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:00,094][  INFO][PID:127430] Downloading the builder-live.log file, attempt 3
[2025-07-15 17:19:00,096][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.231.151.48 copr-rpmbuild-log
[2025-07-15 17:19:02,004][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:07,042][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:12,043][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:17,046][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:22,049][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:27,056][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:32,057][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:37,062][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:42,136][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:47,188][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:52,190][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:19:57,192][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:00,170][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:20:02,193][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:07,195][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:10,178][WARNING][PID:127430] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 17:20:12,196][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:17,197][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:20,178][  INFO][PID:127430] Downloading the builder-live.log file, attempt 4
[2025-07-15 17:20:20,180][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.231.151.48 copr-rpmbuild-log
[2025-07-15 17:20:22,199][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:27,200][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:32,215][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:37,216][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:42,217][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:47,219][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:52,220][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:20:57,221][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:02,222][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:07,327][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:12,328][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:17,330][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:20,247][ ERROR][PID:127430] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 17:21:22,331][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:27,332][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:30,307][ ERROR][PID:127430] Giving up for unstable SSH, failures: 1752599849.9213326, 1752599930.0934944, 1752600010.1780875, 1752600090.307139
[2025-07-15 17:21:30,308][ ERROR][PID:127430] Re-try request for task on 'ResallocHost, ticket_id=3939976, hostname=3.231.151.48, name=aws_x86_64_spot_prod_05425872_20250715_170835, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-15 17:21:30,309][  INFO][PID:127430] Releasing VM back to pool
[2025-07-15 17:21:30,386][  INFO][PID:127430] Retry #2 (on other host)
[2025-07-15 17:21:30,386][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:30,387][  INFO][PID:127430] VM allocation process starts
[2025-07-15 17:21:30,408][  INFO][PID:127430] Trying to allocate VM: ResallocHost, ticket_id=3940199, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-15 17:21:33,429][  INFO][PID:127430] Allocated host ResallocHost, ticket_id=3940199, hostname=44.201.186.214, name=aws_x86_64_normalreserved_prod_05426597_20250715_171940, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-15 17:21:33,429][  INFO][PID:127430] Allocating ssh connection to builder
[2025-07-15 17:21:33,430][  INFO][PID:127430] Checking that builder machine is OK
[2025-07-15 17:21:33,940][  INFO][PID:127430] Running remote command: copr-builder-ready fedora-41-x86_64
[2025-07-15 17:21:34,150][  INFO][PID:127430] Red Hat subscription not needed for fedora-41-x86_64
Builder is ready to be used

[2025-07-15 17:21:34,151][  INFO][PID:127430] Filling build.info file with builder info
[2025-07-15 17:21:34,180][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:34,181][  INFO][PID:127430] Not re-notifying FE and msg buses for the new host.
[2025-07-15 17:21:34,181][  INFO][PID:127430] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9275696-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached
[2025-07-15 17:21:34,541][  INFO][PID:127430] Downloading the builder-live.log file, attempt 1
[2025-07-15 17:21:34,542][  INFO][PID:127430] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.201.186.214 copr-rpmbuild-log
[2025-07-15 17:21:39,541][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:44,542][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:49,543][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:54,544][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:21:59,545][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:04,547][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:09,548][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:14,550][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:19,552][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:24,553][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:29,555][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:34,555][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:39,556][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:44,558][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:49,559][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:54,560][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:22:59,561][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:04,562][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:09,563][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:14,565][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:19,566][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:24,567][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:29,568][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:34,569][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:39,570][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:44,572][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:49,573][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:54,574][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:23:59,576][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:04,577][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:09,578][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:14,579][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:19,580][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:24,581][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:29,582][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:34,583][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:39,584][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:44,585][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:49,587][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:54,588][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:24:59,589][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:04,590][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:09,592][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:14,593][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:19,594][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:24,595][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:29,596][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:34,601][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:39,603][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:44,606][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:49,607][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:54,608][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:25:59,609][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:04,610][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:09,611][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:14,612][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:19,613][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:24,615][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:29,616][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:34,618][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:39,619][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:44,620][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:49,622][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:54,623][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:26:59,628][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:04,640][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:09,641][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:14,642][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:19,643][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:24,644][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:29,647][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:34,651][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:39,654][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:44,655][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:49,656][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:54,656][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:27:59,657][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:04,660][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:09,663][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:14,672][  INFO][PID:127430] Periodic builder liveness probe: alive
[2025-07-15 17:28:14,673][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:19,674][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:24,678][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:29,680][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:34,683][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:39,688][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:44,692][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:49,694][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:54,698][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:28:59,701][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:04,703][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:09,706][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:14,711][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:19,718][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:24,720][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:29,724][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:34,729][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:39,731][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:44,733][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:49,735][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:54,738][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:29:59,739][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:04,741][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:09,744][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:14,749][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:19,753][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:24,754][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:29,755][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:34,759][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:39,765][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:44,769][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:49,770][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:54,773][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:30:59,775][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:04,776][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:09,778][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:14,779][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:19,781][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:24,783][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:29,785][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:34,787][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:39,790][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:44,792][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:49,793][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:54,795][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:31:59,801][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:04,803][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:09,804][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:14,806][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:19,810][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:24,814][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:29,815][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:34,820][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:39,827][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:44,830][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:49,837][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:54,840][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:32:59,844][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:04,848][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:09,851][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:14,852][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:19,853][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:24,854][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:29,856][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:34,857][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:39,858][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:44,859][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:49,861][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:54,867][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:33:59,868][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:04,869][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:09,872][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:14,873][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:19,874][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:24,879][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:29,880][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:34,882][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:39,883][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:44,884][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:49,885][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:54,888][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:34:59,890][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:04,895][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:09,897][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:14,899][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:19,901][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:24,903][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:29,905][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:34,906][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:39,909][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:44,910][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:49,912][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:54,913][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:35:59,915][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:04,917][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:09,923][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:14,925][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:19,927][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:24,928][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:29,929][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:34,930][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:39,931][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:44,933][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:49,934][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:54,935][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:36:59,938][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:37:04,940][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:37:09,941][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:37:14,942][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:37:19,943][  INFO][PID:127430] Checking for cancel request
[2025-07-15 17:37:23,526][  INFO][PID:127430] Downloading results from builder
[2025-07-15 17:37:23,527][  INFO][PID:127430] rsyncing of mockbuilder@44.201.186.214:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad started
[2025-07-15 17:37:23,530][  INFO][PID:127430] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.201.186.214:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/build-09275696.rsync.log
[2025-07-15 17:37:25,590][  INFO][PID:127430] rsyncing finished.
[2025-07-15 17:37:25,591][  INFO][PID:127430] Releasing VM back to pool
[2025-07-15 17:37:25,601][  INFO][PID:127430] Searching for 'success' file in resultdir
[2025-07-15 17:37:25,601][  INFO][PID:127430] Going to sign pkgs from source: 9275696-fedora-41-x86_64 in chroot: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64
[2025-07-15 17:37:25,602][  INFO][PID:127430] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1)
[2025-07-15 17:37:25,927][  INFO][PID:127430] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-0.27.0-1.fc43.src.rpm' (attempt #1)
[2025-07-15 17:37:30,398][  INFO][PID:127430] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-0.27.0-1.fc43.src.rpm
[2025-07-15 17:37:30,399][  INFO][PID:127430] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-debugsource-0.27.0-1.fc43.x86_64.rpm' (attempt #1)
[2025-07-15 17:37:31,254][  INFO][PID:127430] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-debugsource-0.27.0-1.fc43.x86_64.rpm
[2025-07-15 17:37:31,256][  INFO][PID:127430] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-debuginfo-0.27.0-1.fc43.x86_64.rpm' (attempt #1)
[2025-07-15 17:37:33,483][  INFO][PID:127430] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-debuginfo-0.27.0-1.fc43.x86_64.rpm
[2025-07-15 17:37:33,484][  INFO][PID:127430] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-0.27.0-1.fc43.x86_64.rpm' (attempt #1)
[2025-07-15 17:37:34,207][  INFO][PID:127430] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/0ad-0.27.0-1.fc43.x86_64.rpm
[2025-07-15 17:37:34,207][  INFO][PID:127430] Sign done
[2025-07-15 17:37:34,208][  INFO][PID:127430] Incremental createrepo run, adding 09275696-0ad into https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-x86_64, (auto-create-repo=True)
[2025-07-15 17:37:34,209][  INFO][PID:127430] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64 --add 09275696-0ad --no-appstream-metadata' as PID 382853
[2025-07-15 17:37:47,219][  INFO][PID:127430] Finished after 13 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64 --add 09275696-0ad --no-appstream-metadata)
[2025-07-15 17:37:47,219][  INFO][PID:127430] Getting build details
[2025-07-15 17:37:47,220][  INFO][PID:127430] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad
[2025-07-15 17:37:47,220][  INFO][PID:127430] Built packages:
['0ad 0.27.0', '0ad-debugsource 0.27.0', '0ad-debuginfo 0.27.0']
[2025-07-15 17:37:47,221][  INFO][PID:127430] build details: {'built_packages': '0ad 0.27.0\n0ad-debugsource 0.27.0\n0ad-debuginfo 0.27.0'}
[2025-07-15 17:37:47,221][  INFO][PID:127430] Retrieving pubkey
[2025-07-15 17:37:47,222][  INFO][PID:127430] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1)
[2025-07-15 17:37:47,561][  INFO][PID:127430] Added pubkey for user psimovec project openblas-0.3.23 into: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/pubkey.gpg
[2025-07-15 17:37:47,561][  INFO][PID:127430] Finished build: id=9275696 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-x86_64 
[2025-07-15 17:37:47,564][  INFO][PID:127430] Worker succeeded build, took 973.3826463222504
[2025-07-15 17:37:47,564][  INFO][PID:127430] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/limb",
            "ended_on": 1752601067.5639153,
            "started_on": 1752600094.181269,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-41-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9275696-fedora-41-x86_64",
            "build_id": 9275696,
            "package_name": "0ad",
            "package_version": "0.27.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/0ad",
            "git_hash": "0acc1e9815b52a675c076395424f549e1f8a1da9",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/limb",
            "results": {
                "packages": [
                    {
                        "name": "0ad",
                        "epoch": null,
                        "version": "0.27.0",
                        "release": "1.fc43",
                        "arch": "src"
                    },
                    {
                        "name": "0ad",
                        "epoch": null,
                        "version": "0.27.0",
                        "release": "1.fc43",
                        "arch": "x86_64"
                    },
                    {
                        "name": "0ad-debugsource",
                        "epoch": null,
                        "version": "0.27.0",
                        "release": "1.fc43",
                        "arch": "x86_64"
                    },
                    {
                        "name": "0ad-debuginfo",
                        "epoch": null,
                        "version": "0.27.0",
                        "release": "1.fc43",
                        "arch": "x86_64"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09275696-0ad",
            "built_packages": "0ad 0.27.0\n0ad-debugsource 0.27.0\n0ad-debuginfo 0.27.0",
            "id": 9275696,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-15 17:37:47,606][  INFO][PID:127430] Sending fedora-messaging bus message in build.end
[2025-07-15 17:37:47,634][  INFO][PID:127430] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/builder-live.log by gzip
[2025-07-15 17:37:47,637][  INFO][PID:127430] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/builder-live.log' as PID 383715
[2025-07-15 17:37:47,750][  INFO][PID:127430] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/builder-live.log)
[2025-07-15 17:37:47,753][  INFO][PID:127430] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/backend.log by gzip
[2025-07-15 17:37:47,762][  INFO][PID:127430] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09275696-0ad/backend.log' as PID 383726