[2025-05-26 09:01:17,945][  INFO][PID:114500] Marking build as starting
[2025-05-26 09:01:18,160][  INFO][PID:114500] Trying to allocate VM: ResallocHost, ticket_id=3159810, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-05-26 09:01:21,274][  INFO][PID:114500] Allocated host ResallocHost, ticket_id=3159810, hostname=2620:52:3:1:dead:beef:cafe:c28a, name=copr_p09_01_prod_04297581_20250526_083315, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-05-26 09:01:21,276][  INFO][PID:114500] Allocating ssh connection to builder
[2025-05-26 09:01:21,278][  INFO][PID:114500] Checking that builder machine is OK
[2025-05-26 09:01:21,999][  INFO][PID:114500] Running remote command: copr-builder-ready centos-stream-10-ppc64le
[2025-05-26 09:01:22,525][  INFO][PID:114500] Red Hat subscription not needed for centos-stream-10-ppc64le
Builder is ready to be used

[2025-05-26 09:01:22,527][  INFO][PID:114500] Filling build.info file with builder info
[2025-05-26 09:01:22,530][  INFO][PID:114500] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "osloup",
            "project_name": "docbook5_style_xsl_license_and_jar_build",
            "project_dirname": "docbook5_style_xsl_license_and_jar_build",
            "submitter": "https://src.fedoraproject.org/user/jakub",
            "ended_on": null,
            "started_on": 1748250082.5303705,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9080077-centos-stream-10-ppc64le",
            "build_id": 9080077,
            "package_name": "gcc",
            "package_version": "14.3.1-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osloup/docbook5_style_xsl_license_and_jar_build/gcc",
            "git_hash": "97a2843822728a1d3d4dc8a77ec2fbb36deb4ff5",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "osloup/docbook5_style_xsl_license_and_jar_build--https://src.fedoraproject.org/user/jakub",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build",
            "result_dir": "09080077-gcc",
            "built_packages": "",
            "id": 9080077,
            "mockchain_macros": {
                "copr_username": "osloup",
                "copr_projectname": "docbook5_style_xsl_license_and_jar_build",
                "vendor": "Fedora Project COPR (osloup/docbook5_style_xsl_license_and_jar_build)"
            }
        }
    ]
}
[2025-05-26 09:01:22,590][  INFO][PID:114500] Sending fedora-messaging bus message in build.start
[2025-05-26 09:01:23,179][  INFO][PID:114500] Sending fedora-messaging bus message in chroot.start
[2025-05-26 09:01:23,196][  INFO][PID:114500] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9080077-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached
[2025-05-26 09:01:23,870][  INFO][PID:114500] Downloading the builder-live.log file, attempt 1
[2025-05-26 09:01:23,873][  INFO][PID:114500] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28a copr-rpmbuild-log
[2025-05-26 09:01:28,880][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 09:11:29,105][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 09:21:29,298][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 09:31:29,487][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 09:40:59,139][ ERROR][PID:114500] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-05-26 09:41:09,141][WARNING][PID:114500] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-05-26 09:41:19,143][  INFO][PID:114500] Downloading the builder-live.log file, attempt 2
[2025-05-26 09:41:19,155][  INFO][PID:114500] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28a copr-rpmbuild-log
[2025-05-26 09:41:29,674][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 09:42:19,210][ ERROR][PID:114500] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-05-26 09:42:29,212][WARNING][PID:114500] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-05-26 09:42:39,214][  INFO][PID:114500] Downloading the builder-live.log file, attempt 3
[2025-05-26 09:42:39,216][  INFO][PID:114500] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28a copr-rpmbuild-log
[2025-05-26 09:43:39,284][ ERROR][PID:114500] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-05-26 09:43:49,287][WARNING][PID:114500] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-05-26 09:43:59,288][  INFO][PID:114500] Downloading the builder-live.log file, attempt 4
[2025-05-26 09:43:59,290][  INFO][PID:114500] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28a copr-rpmbuild-log
[2025-05-26 09:44:59,358][ ERROR][PID:114500] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-05-26 09:45:09,361][ ERROR][PID:114500] Giving up for unstable SSH, failures: 1748252469.1410303, 1748252549.2126195, 1748252629.2872317, 1748252709.3614838
[2025-05-26 09:45:09,363][ ERROR][PID:114500] Re-try request for task on 'ResallocHost, ticket_id=3159810, hostname=2620:52:3:1:dead:beef:cafe:c28a, name=copr_p09_01_prod_04297581_20250526_083315, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-05-26 09:45:09,365][  INFO][PID:114500] Releasing VM back to pool
[2025-05-26 09:45:09,381][  INFO][PID:114500] Retry #1 (on other host)
[2025-05-26 09:45:09,447][  INFO][PID:114500] Trying to allocate VM: ResallocHost, ticket_id=3160133, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-05-26 09:45:12,534][  INFO][PID:114500] Allocated host ResallocHost, ticket_id=3160133, hostname=2620:52:3:1:dead:beef:cafe:c289, name=copr_p09_01_prod_04298925_20250526_093719, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']
[2025-05-26 09:45:12,536][  INFO][PID:114500] Allocating ssh connection to builder
[2025-05-26 09:45:12,539][  INFO][PID:114500] Checking that builder machine is OK
[2025-05-26 09:45:13,248][  INFO][PID:114500] Running remote command: copr-builder-ready centos-stream-10-ppc64le
[2025-05-26 09:45:13,732][  INFO][PID:114500] Red Hat subscription not needed for centos-stream-10-ppc64le
Builder is ready to be used

[2025-05-26 09:45:13,734][  INFO][PID:114500] Filling build.info file with builder info
[2025-05-26 09:45:13,740][  INFO][PID:114500] Not re-notifying FE and msg buses for the new host.
[2025-05-26 09:45:13,742][  INFO][PID:114500] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9080077-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached
[2025-05-26 09:45:14,422][  INFO][PID:114500] Downloading the builder-live.log file, attempt 1
[2025-05-26 09:45:14,424][  INFO][PID:114500] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c289 copr-rpmbuild-log
[2025-05-26 09:51:34,579][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 10:01:34,803][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 10:11:35,181][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 10:21:35,535][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 10:31:35,953][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 10:41:36,209][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 10:51:36,431][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 11:01:36,716][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 11:11:37,076][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 11:21:37,357][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 11:31:37,586][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 11:41:37,791][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 11:51:37,970][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 12:01:38,140][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 12:11:38,719][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 12:21:39,236][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 12:31:39,458][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 12:41:39,922][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 12:51:40,183][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 13:01:40,435][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 13:11:40,763][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 13:21:41,069][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 13:31:41,376][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 13:41:41,731][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 13:51:42,041][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 14:01:42,416][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 14:11:42,823][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 14:21:43,059][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 14:31:43,312][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 14:41:43,570][  INFO][PID:114500] Periodic builder liveness probe: alive
[2025-05-26 14:45:21,855][  INFO][PID:114500] Downloading results from builder
[2025-05-26 14:45:21,888][  INFO][PID:114500] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c289]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc started
[2025-05-26 14:45:21,916][  INFO][PID:114500] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c289]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/ &> /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/build-09080077.rsync.log
[2025-05-26 14:45:25,227][  INFO][PID:114500] rsyncing finished.
[2025-05-26 14:45:25,230][  INFO][PID:114500] Releasing VM back to pool
[2025-05-26 14:45:25,247][  INFO][PID:114500] Searching for 'success' file in resultdir
[2025-05-26 14:45:25,251][ ERROR][PID:114500] Build failed: Backend process error: No success file => build failure
[2025-05-26 14:45:25,354][  INFO][PID:114500] Finished build: id=9080077 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build chroot=centos-stream-10-ppc64le 
[2025-05-26 14:45:25,473][ ERROR][PID:114500] Backend process error: No success file => build failure
[2025-05-26 14:45:25,480][  INFO][PID:114500] Worker failed build, took 18011.738686561584
[2025-05-26 14:45:25,494][  INFO][PID:114500] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "osloup",
            "project_name": "docbook5_style_xsl_license_and_jar_build",
            "project_dirname": "docbook5_style_xsl_license_and_jar_build",
            "submitter": "https://src.fedoraproject.org/user/jakub",
            "ended_on": 1748270725.4790883,
            "started_on": 1748252713.7404017,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-10-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9080077-centos-stream-10-ppc64le",
            "build_id": 9080077,
            "package_name": "gcc",
            "package_version": "14.3.1-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/osloup/docbook5_style_xsl_license_and_jar_build/gcc",
            "git_hash": "97a2843822728a1d3d4dc8a77ec2fbb36deb4ff5",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "osloup/docbook5_style_xsl_license_and_jar_build--https://src.fedoraproject.org/user/jakub",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_ppc64le",
                "arch_power9"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/osloup/docbook5_style_xsl_license_and_jar_build",
            "result_dir": "09080077-gcc",
            "built_packages": "",
            "id": 9080077,
            "mockchain_macros": {
                "copr_username": "osloup",
                "copr_projectname": "docbook5_style_xsl_license_and_jar_build",
                "vendor": "Fedora Project COPR (osloup/docbook5_style_xsl_license_and_jar_build)"
            }
        }
    ]
}
[2025-05-26 14:45:26,201][  INFO][PID:114500] Sending fedora-messaging bus message in build.end
[2025-05-26 14:45:26,587][  INFO][PID:114500] Compressing /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/builder-live.log by gzip
[2025-05-26 14:45:26,620][  INFO][PID:114500] Running command 'gzip /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/builder-live.log' as PID 2462039
[2025-05-26 14:45:26,916][  INFO][PID:114500] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/builder-live.log)
[2025-05-26 14:45:26,926][  INFO][PID:114500] Compressing /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/backend.log by gzip
[2025-05-26 14:45:26,931][  INFO][PID:114500] Running command 'gzip /var/lib/copr/public_html/results/osloup/docbook5_style_xsl_license_and_jar_build/centos-stream-10-ppc64le/09080077-gcc/backend.log' as PID 2462054