[2025-07-14 17:19:29,867][  INFO][PID:566882] Marking build as starting
[2025-07-14 17:19:29,928][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:19:29,931][  INFO][PID:566882] VM allocation process starts
[2025-07-14 17:19:29,947][  INFO][PID:566882] Trying to allocate VM: ResallocHost, ticket_id=3923543, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-14 17:19:34,954][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:19:39,956][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:19:44,957][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:19:49,960][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:19:54,963][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:19:59,965][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:04,966][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:09,973][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:14,974][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:19,976][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:24,978][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:29,983][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:34,986][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:39,992][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:44,994][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:49,997][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:20:55,000][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:00,002][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:05,005][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:10,007][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:15,009][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:20,012][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:25,015][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:30,017][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:35,019][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:40,020][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:45,021][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:50,024][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:21:55,026][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:00,031][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:05,037][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:10,039][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:15,043][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:20,045][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:25,050][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:30,051][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:35,060][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:40,061][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:45,071][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:50,072][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:22:55,074][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:00,075][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:05,077][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:10,083][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:15,084][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:20,085][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:25,086][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:30,088][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:35,089][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:40,091][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:45,092][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:50,095][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:23:55,097][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:00,098][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:05,102][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:10,103][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:15,110][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:20,112][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:25,114][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:30,116][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:35,118][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:40,122][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:45,127][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:50,132][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:24:55,136][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:00,139][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:05,141][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:10,144][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:15,145][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:20,150][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:25,155][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:30,160][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:35,163][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:40,165][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:45,186][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:50,187][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:25:55,188][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:00,189][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:05,191][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:10,199][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:15,200][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:20,205][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:25,208][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:30,220][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:35,222][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:40,223][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:45,231][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:48,234][  INFO][PID:566882] Allocated host ResallocHost, ticket_id=3923543, hostname=54.158.250.123, name=aws_x86_64_spot_prod_05382836_20250714_172315, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-14 17:26:48,248][  INFO][PID:566882] Allocating ssh connection to builder
[2025-07-14 17:26:48,249][  INFO][PID:566882] Checking that builder machine is OK
[2025-07-14 17:26:48,715][  INFO][PID:566882] Running remote command: copr-builder-ready fedora-41-x86_64
[2025-07-14 17:26:49,058][  INFO][PID:566882] Red Hat subscription not needed for fedora-41-x86_64
Builder is ready to be used

[2025-07-14 17:26:49,058][  INFO][PID:566882] Filling build.info file with builder info
[2025-07-14 17:26:49,060][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:26:49,062][  INFO][PID:566882] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/farchord",
            "ended_on": null,
            "started_on": 1752514009.0621245,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9272681-fedora-41-x86_64",
            "build_id": 9272681,
            "package_name": "akonadi-import-wizard",
            "package_version": "25.07.80-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/akonadi-import-wizard",
            "git_hash": "5d67a68299152af822bae26462b1bd5377bcd110",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09272681-akonadi-import-wizard",
            "built_packages": "",
            "id": 9272681,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-14 17:26:49,143][  INFO][PID:566882] Sending fedora-messaging bus message in build.start
[2025-07-14 17:26:52,813][  INFO][PID:566882] Sending fedora-messaging bus message in chroot.start
[2025-07-14 17:26:52,886][  INFO][PID:566882] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272681-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached
[2025-07-14 17:26:53,281][  INFO][PID:566882] Downloading the builder-live.log file, attempt 1
[2025-07-14 17:26:53,307][  INFO][PID:566882] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.158.250.123 copr-rpmbuild-log
[2025-07-14 17:26:58,314][  INFO][PID:566882] Periodic builder liveness probe: alive
[2025-07-14 17:26:58,315][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:03,322][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:08,331][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:11,408][ ERROR][PID:566882] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 17:27:13,346][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:18,355][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:21,409][WARNING][PID:566882] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-14 17:27:23,358][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:28,360][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:31,410][  INFO][PID:566882] Downloading the builder-live.log file, attempt 2
[2025-07-14 17:27:31,415][  INFO][PID:566882] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.158.250.123 copr-rpmbuild-log
[2025-07-14 17:27:33,380][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:38,384][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:43,388][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:48,390][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:53,392][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:27:58,396][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:03,401][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:08,406][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:13,409][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:18,410][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:23,413][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:28,418][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:31,513][ ERROR][PID:566882] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 17:28:33,420][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:38,426][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:41,514][WARNING][PID:566882] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-14 17:28:43,431][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:48,434][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:51,515][  INFO][PID:566882] Downloading the builder-live.log file, attempt 3
[2025-07-14 17:28:51,519][  INFO][PID:566882] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.158.250.123 copr-rpmbuild-log
[2025-07-14 17:28:53,437][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:28:58,445][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:03,447][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:08,449][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:13,452][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:18,454][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:23,457][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:28,466][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:33,469][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:38,472][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:43,474][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:48,480][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:51,606][ ERROR][PID:566882] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 17:29:53,481][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:29:58,483][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:01,611][WARNING][PID:566882] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-14 17:30:03,486][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:08,487][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:11,612][  INFO][PID:566882] Downloading the builder-live.log file, attempt 4
[2025-07-14 17:30:11,621][  INFO][PID:566882] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.158.250.123 copr-rpmbuild-log
[2025-07-14 17:30:13,497][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:18,498][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:23,500][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:28,502][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:33,514][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:38,516][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:43,518][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:48,529][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:53,531][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:30:58,533][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:03,535][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:08,544][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:11,691][ ERROR][PID:566882] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-14 17:31:13,546][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:18,548][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:21,694][ ERROR][PID:566882] Giving up for unstable SSH, failures: 1752514041.4091797, 1752514121.514212, 1752514201.6113076, 1752514281.693819
[2025-07-14 17:31:21,695][ ERROR][PID:566882] Re-try request for task on 'ResallocHost, ticket_id=3923543, hostname=54.158.250.123, name=aws_x86_64_spot_prod_05382836_20250714_172315, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-14 17:31:21,696][  INFO][PID:566882] Releasing VM back to pool
[2025-07-14 17:31:21,709][  INFO][PID:566882] Retry #1 (on other host)
[2025-07-14 17:31:21,711][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:21,714][  INFO][PID:566882] VM allocation process starts
[2025-07-14 17:31:21,735][  INFO][PID:566882] Trying to allocate VM: ResallocHost, ticket_id=3923916, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-14 17:31:26,738][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:31,739][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:36,743][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:41,745][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:46,747][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:51,751][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:31:56,756][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:01,761][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:06,765][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:11,772][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:16,775][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:21,778][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:26,781][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:31,785][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:36,787][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:41,799][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:46,800][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:51,801][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:32:56,803][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:01,808][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:06,809][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:11,812][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:16,815][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:21,817][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:26,826][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:31,833][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:36,834][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:41,837][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:46,839][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:51,842][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:33:56,843][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:01,844][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:06,849][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:11,854][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:16,855][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:21,858][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:26,861][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:31,864][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:36,870][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:41,877][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:46,882][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:51,884][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:34:56,886][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:01,888][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:06,892][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:11,896][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:16,901][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:21,902][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:26,903][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:31,905][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:36,909][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:41,911][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:46,913][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:51,915][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:35:56,919][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:01,922][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:06,930][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:11,935][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:16,936][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:21,938][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:26,939][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:31,948][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:36,951][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:41,953][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:46,955][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:51,958][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:36:56,960][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:01,961][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:06,963][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:11,964][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:16,966][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:21,971][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:26,972][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:31,974][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:36,975][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:41,977][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:46,978][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:51,980][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:37:56,981][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:01,989][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:06,990][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:11,992][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:16,993][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:21,994][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:26,995][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:31,996][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:36,998][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:42,002][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:47,003][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:52,005][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:38:57,006][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:02,007][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:07,008][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:12,009][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:17,011][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:22,012][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:27,013][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:32,015][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:37,016][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:42,018][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:47,020][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:52,022][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:39:57,025][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:02,027][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:07,028][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:12,029][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:17,030][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:22,032][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:27,033][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:32,034][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:37,035][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:42,036][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:47,037][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:52,038][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:40:57,039][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:02,041][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:07,042][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:12,043][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:17,044][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:22,046][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:27,047][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:32,049][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:37,051][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:39,978][  INFO][PID:566882] Allocated host ResallocHost, ticket_id=3923916, hostname=13.218.27.167, name=aws_x86_64_normal_prod_05382874_20250714_172356, requested_tags=['copr_builder', 'arch_x86_64']
[2025-07-14 17:41:39,979][  INFO][PID:566882] Allocating ssh connection to builder
[2025-07-14 17:41:39,980][  INFO][PID:566882] Checking that builder machine is OK
[2025-07-14 17:41:40,412][  INFO][PID:566882] Running remote command: copr-builder-ready fedora-41-x86_64
[2025-07-14 17:41:40,629][  INFO][PID:566882] Red Hat subscription not needed for fedora-41-x86_64
Builder is ready to be used

[2025-07-14 17:41:40,630][  INFO][PID:566882] Filling build.info file with builder info
[2025-07-14 17:41:40,637][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:40,639][  INFO][PID:566882] Not re-notifying FE and msg buses for the new host.
[2025-07-14 17:41:40,640][  INFO][PID:566882] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9272681-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached
[2025-07-14 17:41:40,981][  INFO][PID:566882] Downloading the builder-live.log file, attempt 1
[2025-07-14 17:41:40,983][  INFO][PID:566882] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.218.27.167 copr-rpmbuild-log
[2025-07-14 17:41:45,989][  INFO][PID:566882] Periodic builder liveness probe: alive
[2025-07-14 17:41:45,990][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:50,992][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:41:55,998][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:42:01,000][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:42:06,002][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:42:11,004][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:42:16,006][  INFO][PID:566882] Checking for cancel request
[2025-07-14 17:42:20,252][  INFO][PID:566882] Downloading results from builder
[2025-07-14 17:42:20,253][  INFO][PID:566882] rsyncing of mockbuilder@13.218.27.167:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard started
[2025-07-14 17:42:20,254][  INFO][PID:566882] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.218.27.167:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/build-09272681.rsync.log
[2025-07-14 17:42:20,533][  INFO][PID:566882] rsyncing finished.
[2025-07-14 17:42:20,534][  INFO][PID:566882] Releasing VM back to pool
[2025-07-14 17:42:20,555][  INFO][PID:566882] Searching for 'success' file in resultdir
[2025-07-14 17:42:20,556][ ERROR][PID:566882] Build failed: Backend process error: No success file => build failure
[2025-07-14 17:42:20,557][  INFO][PID:566882] Finished build: id=9272681 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-41-x86_64 
[2025-07-14 17:42:20,559][ ERROR][PID:566882] Backend process error: No success file => build failure
[2025-07-14 17:42:20,560][  INFO][PID:566882] Worker failed build, took 39.9209930896759
[2025-07-14 17:42:20,561][  INFO][PID:566882] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23",
            "submitter": "https://src.fedoraproject.org/user/farchord",
            "ended_on": 1752514940.5603144,
            "started_on": 1752514900.6393213,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "9272681-fedora-41-x86_64",
            "build_id": 9272681,
            "package_name": "akonadi-import-wizard",
            "package_version": "25.07.80-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/akonadi-import-wizard",
            "git_hash": "5d67a68299152af822bae26462b1bd5377bcd110",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/farchord",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23",
            "result_dir": "09272681-akonadi-import-wizard",
            "built_packages": "",
            "id": 9272681,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-07-14 17:42:20,608][  INFO][PID:566882] Sending fedora-messaging bus message in build.end
[2025-07-14 17:42:20,636][  INFO][PID:566882] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/builder-live.log by gzip
[2025-07-14 17:42:20,639][  INFO][PID:566882] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/builder-live.log' as PID 755615
[2025-07-14 17:42:20,655][  INFO][PID:566882] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/builder-live.log)
[2025-07-14 17:42:20,656][  INFO][PID:566882] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/backend.log by gzip
[2025-07-14 17:42:20,657][  INFO][PID:566882] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-41-x86_64/09272681-akonadi-import-wizard/backend.log' as PID 755618