[2025-07-15 23:31:56,988][  INFO][PID:2565824] Marking build as starting
[2025-07-15 23:31:57,017][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:31:57,018][  INFO][PID:2565824] VM allocation process starts
[2025-07-15 23:31:57,083][  INFO][PID:2565824] Trying to allocate VM: ResallocHost, ticket_id=3948085, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 23:32:02,084][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:07,085][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:12,086][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:17,087][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:22,088][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:27,089][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:32,090][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:37,091][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:42,092][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:47,093][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:52,094][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:32:57,095][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:02,096][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:07,097][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:12,098][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:17,099][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:22,100][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:27,101][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:32,102][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:37,103][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:42,104][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:47,105][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:52,106][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:33:57,107][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:02,108][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:07,109][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:12,110][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:17,111][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:22,112][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:27,113][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:32,114][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:37,115][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:42,116][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:47,117][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:52,118][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:34:57,119][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:02,120][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:07,121][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:12,122][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:17,123][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:22,124][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:27,126][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:32,127][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:37,128][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:42,129][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:47,130][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:52,131][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:35:57,132][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:02,132][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:07,133][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:12,134][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:17,136][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:22,137][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:27,138][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:32,139][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:37,140][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:42,141][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:47,142][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:52,143][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:36:57,144][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:02,145][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:07,146][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:12,147][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:17,148][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:22,149][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:27,150][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:32,151][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:37,152][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:42,152][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:47,154][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:52,156][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:37:57,157][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:02,158][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:07,159][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:12,160][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:17,161][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:22,162][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:27,163][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:32,163][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:37,164][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:42,165][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:47,166][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:52,167][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:38:57,168][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:02,169][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:07,170][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:12,171][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:17,172][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:22,173][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:27,174][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:32,175][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:37,176][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:42,177][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:47,178][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:52,179][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:39:57,180][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:02,181][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:07,182][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:12,183][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:17,184][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:22,185][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:27,186][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:32,187][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:37,188][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:42,189][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:47,190][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:52,192][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:40:57,193][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:02,194][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:07,194][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:12,196][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:17,197][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:22,198][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:27,199][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:32,200][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:37,201][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:42,202][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:47,203][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:52,205][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:41:57,206][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:02,207][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:07,208][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:12,209][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:17,210][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:22,211][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:27,212][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:32,213][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:37,214][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:42,215][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:47,216][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:52,217][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:42:57,218][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:02,220][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:07,221][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:12,222][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:17,223][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:22,224][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:27,225][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:32,226][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:37,227][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:42,228][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:47,229][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:52,230][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:43:57,232][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:02,233][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:07,234][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:12,235][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:17,236][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:22,237][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:27,238][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:32,239][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:37,240][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:42,242][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:47,243][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:52,244][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:44:57,245][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:02,246][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:07,247][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:12,248][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:17,249][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:22,250][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:27,251][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:32,252][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:37,253][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:42,254][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:47,255][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:52,256][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:45:57,257][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:02,258][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:07,259][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:12,260][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:15,234][  INFO][PID:2565824] Allocated host ResallocHost, ticket_id=3948085, hostname=140.211.168.243, name=copr_osuosl_p09_prod_05438245_20250715_234141, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 23:46:15,234][  INFO][PID:2565824] Allocating ssh connection to builder
[2025-07-15 23:46:15,235][  INFO][PID:2565824] Checking that builder machine is OK
[2025-07-15 23:46:16,890][  INFO][PID:2565824] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-15 23:46:17,930][  INFO][PID:2565824] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-15 23:46:17,931][  INFO][PID:2565824] Filling build.info file with builder info
[2025-07-15 23:46:17,931][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:17,932][  INFO][PID:2565824] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "lecris",
            "project_name": "cmake-drop_vars",
            "project_dirname": "cmake-drop_vars",
            "submitter": "lecris",
            "ended_on": null,
            "started_on": 1752623177.932454,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9277299-fedora-rawhide-ppc64le",
            "build_id": 9277299,
            "package_name": "proxygen",
            "package_version": "2025.02.03.00-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lecris/cmake-drop_vars/proxygen",
            "git_hash": "2c6b57baf95133d32e7c005b83127f57bb91ecbf",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "lecris/cmake-drop_vars--lecris",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/lecris/cmake-drop_vars",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lecris/cmake-drop_vars",
            "result_dir": "09277299-proxygen",
            "built_packages": "",
            "id": 9277299,
            "mockchain_macros": {
                "copr_username": "lecris",
                "copr_projectname": "cmake-drop_vars",
                "vendor": "Fedora Project COPR (lecris/cmake-drop_vars)"
            }
        }
    ]
}
[2025-07-15 23:46:17,957][  INFO][PID:2565824] Sending fedora-messaging bus message in build.start
[2025-07-15 23:46:18,576][  INFO][PID:2565824] Sending fedora-messaging bus message in chroot.start
[2025-07-15 23:46:18,601][  INFO][PID:2565824] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9277299-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-15 23:46:19,992][  INFO][PID:2565824] Downloading the builder-live.log file, attempt 1
[2025-07-15 23:46:19,994][  INFO][PID:2565824] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-15 23:46:25,000][  INFO][PID:2565824] Periodic builder liveness probe: alive
[2025-07-15 23:46:25,000][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:30,002][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:35,004][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:40,006][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:45,007][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:50,008][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:46:55,009][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:00,010][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:05,011][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:10,013][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:15,014][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:20,015][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:25,016][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:30,017][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:35,018][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:40,019][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:45,020][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:50,021][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:47:55,023][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:00,025][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:05,026][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:10,027][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:15,028][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:20,029][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:25,030][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:30,031][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:35,033][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:40,034][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:45,035][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:50,036][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:48:55,037][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:00,038][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:05,039][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:10,040][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:15,041][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:20,043][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:25,044][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:30,045][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:35,046][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:40,047][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:45,048][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:50,049][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:49:52,140][ ERROR][PID:2565824] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 23:49:55,050][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:00,052][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:02,140][WARNING][PID:2565824] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 23:50:05,053][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:10,053][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:12,141][  INFO][PID:2565824] Downloading the builder-live.log file, attempt 2
[2025-07-15 23:50:12,142][  INFO][PID:2565824] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-15 23:50:15,055][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:20,056][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:25,057][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:30,058][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:35,059][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:40,060][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:45,061][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:50,062][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:50:55,063][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:00,065][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:05,066][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:10,067][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:12,277][ ERROR][PID:2565824] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 23:51:15,068][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:20,069][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:22,282][WARNING][PID:2565824] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 23:51:25,070][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:30,071][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:32,283][  INFO][PID:2565824] Downloading the builder-live.log file, attempt 3
[2025-07-15 23:51:32,284][  INFO][PID:2565824] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-15 23:51:35,072][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:40,073][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:45,074][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:50,075][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:51:55,076][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:00,077][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:05,078][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:10,080][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:15,081][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:20,082][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:25,083][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:30,084][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:32,419][ ERROR][PID:2565824] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 23:52:35,085][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:40,086][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:42,423][WARNING][PID:2565824] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-07-15 23:52:45,087][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:50,088][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:52:52,423][  INFO][PID:2565824] Downloading the builder-live.log file, attempt 4
[2025-07-15 23:52:52,425][  INFO][PID:2565824] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.243 copr-rpmbuild-log
[2025-07-15 23:52:55,089][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:00,090][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:05,091][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:10,092][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:15,093][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:20,094][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:25,095][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:30,096][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:35,097][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:40,098][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:45,099][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:50,100][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:53:52,561][ ERROR][PID:2565824] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-07-15 23:53:55,101][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:00,102][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:02,566][ ERROR][PID:2565824] Giving up for unstable SSH, failures: 1752623402.140843, 1752623482.2825885, 1752623562.423139, 1752623642.5661912
[2025-07-15 23:54:02,567][ ERROR][PID:2565824] Re-try request for task on 'ResallocHost, ticket_id=3948085, hostname=140.211.168.243, name=copr_osuosl_p09_prod_05438245_20250715_234141, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-07-15 23:54:02,567][  INFO][PID:2565824] Releasing VM back to pool
[2025-07-15 23:54:02,578][  INFO][PID:2565824] Retry #1 (on other host)
[2025-07-15 23:54:02,579][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:02,579][  INFO][PID:2565824] VM allocation process starts
[2025-07-15 23:54:02,592][  INFO][PID:2565824] Trying to allocate VM: ResallocHost, ticket_id=3948197, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 23:54:07,593][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:12,594][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:17,595][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:22,596][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:27,597][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:32,598][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:37,599][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:42,600][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:47,601][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:52,602][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:54:57,603][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:02,603][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:07,605][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:12,606][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:17,607][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:22,608][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:27,609][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:32,610][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:37,611][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:42,612][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:47,613][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:52,614][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:55:57,615][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:02,616][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:07,617][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:12,618][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:17,619][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:22,620][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:27,621][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:32,622][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:37,623][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:42,624][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:47,625][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:52,626][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:56:57,627][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:02,628][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:07,629][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:12,631][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:17,632][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:22,633][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:27,634][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:32,635][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:37,636][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:42,637][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:47,638][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:52,639][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:57:57,640][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:02,641][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:07,642][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:12,643][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:17,648][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:22,650][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:27,651][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:32,652][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:37,653][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:42,655][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:47,656][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:52,657][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:58:57,658][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:02,659][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:07,660][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:12,661][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:17,662][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:20,730][  INFO][PID:2565824] Allocated host ResallocHost, ticket_id=3948197, hostname=2620:52:3:1:dead:beef:cafe:c28f, name=copr_p09_01_prod_05438193_20250715_233909, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-07-15 23:59:20,731][  INFO][PID:2565824] Allocating ssh connection to builder
[2025-07-15 23:59:20,731][  INFO][PID:2565824] Checking that builder machine is OK
[2025-07-15 23:59:21,792][  INFO][PID:2565824] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-07-15 23:59:22,322][  INFO][PID:2565824] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-07-15 23:59:22,323][  INFO][PID:2565824] Filling build.info file with builder info
[2025-07-15 23:59:22,327][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:22,328][  INFO][PID:2565824] Not re-notifying FE and msg buses for the new host.
[2025-07-15 23:59:22,329][  INFO][PID:2565824] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9277299-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-07-15 23:59:23,543][  INFO][PID:2565824] Downloading the builder-live.log file, attempt 1
[2025-07-15 23:59:23,544][  INFO][PID:2565824] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28f copr-rpmbuild-log
[2025-07-15 23:59:28,550][  INFO][PID:2565824] Periodic builder liveness probe: alive
[2025-07-15 23:59:28,551][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:33,552][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:38,553][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:43,554][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:48,555][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:53,556][  INFO][PID:2565824] Checking for cancel request
[2025-07-15 23:59:58,557][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:03,558][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:08,559][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:13,560][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:18,561][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:23,562][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:28,563][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:33,564][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:38,566][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:43,567][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:48,568][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:53,569][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:00:58,570][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:01:03,571][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:01:08,572][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:01:13,573][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:01:18,574][  INFO][PID:2565824] Checking for cancel request
[2025-07-16 00:01:23,279][  INFO][PID:2565824] Downloading results from builder
[2025-07-16 00:01:23,280][  INFO][PID:2565824] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c28f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen started
[2025-07-16 00:01:23,281][  INFO][PID:2565824] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c28f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/ &> /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/build-09277299.rsync.log
[2025-07-16 00:01:23,819][  INFO][PID:2565824] rsyncing finished.
[2025-07-16 00:01:23,820][  INFO][PID:2565824] Releasing VM back to pool
[2025-07-16 00:01:23,832][  INFO][PID:2565824] Searching for 'success' file in resultdir
[2025-07-16 00:01:23,832][ ERROR][PID:2565824] Build failed: Backend process error: No success file => build failure
[2025-07-16 00:01:23,833][  INFO][PID:2565824] Finished build: id=9277299 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/lecris/cmake-drop_vars chroot=fedora-rawhide-ppc64le 
[2025-07-16 00:01:23,835][ ERROR][PID:2565824] Backend process error: No success file => build failure
[2025-07-16 00:01:23,835][  INFO][PID:2565824] Worker failed build, took 121.50676226615906
[2025-07-16 00:01:23,836][  INFO][PID:2565824] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "lecris",
            "project_name": "cmake-drop_vars",
            "project_dirname": "cmake-drop_vars",
            "submitter": "lecris",
            "ended_on": 1752624083.8355293,
            "started_on": 1752623962.328767,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9277299-fedora-rawhide-ppc64le",
            "build_id": 9277299,
            "package_name": "proxygen",
            "package_version": "2025.02.03.00-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lecris/cmake-drop_vars/proxygen",
            "git_hash": "2c6b57baf95133d32e7c005b83127f57bb91ecbf",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "lecris/cmake-drop_vars--lecris",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/lecris/cmake-drop_vars",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lecris/cmake-drop_vars",
            "result_dir": "09277299-proxygen",
            "built_packages": "",
            "id": 9277299,
            "mockchain_macros": {
                "copr_username": "lecris",
                "copr_projectname": "cmake-drop_vars",
                "vendor": "Fedora Project COPR (lecris/cmake-drop_vars)"
            }
        }
    ]
}
[2025-07-16 00:01:23,861][  INFO][PID:2565824] Sending fedora-messaging bus message in build.end
[2025-07-16 00:01:23,886][  INFO][PID:2565824] Compressing /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/builder-live.log by gzip
[2025-07-16 00:01:23,887][  INFO][PID:2565824] Running command 'gzip /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/builder-live.log' as PID 2683207
[2025-07-16 00:01:23,896][  INFO][PID:2565824] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/builder-live.log)
[2025-07-16 00:01:23,897][  INFO][PID:2565824] Compressing /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/backend.log by gzip
[2025-07-16 00:01:23,898][  INFO][PID:2565824] Running command 'gzip /var/lib/copr/public_html/results/lecris/cmake-drop_vars/fedora-rawhide-ppc64le/09277299-proxygen/backend.log' as PID 2683209