[2026-01-13 02:07:48,951][  INFO][PID:9492] Marking build as starting
[2026-01-13 02:07:49,081][  INFO][PID:9492] Checking that /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/repodata/repomd.xml exists
[2026-01-13 02:07:49,160][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:07:49,162][  INFO][PID:9492] VM allocation process starts
[2026-01-13 02:07:49,189][  INFO][PID:9492] Trying to allocate VM: ResallocHost, ticket_id=786760, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 02:07:54,195][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:07:59,196][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:04,198][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:09,212][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:14,218][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:19,219][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:24,222][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:29,255][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:34,258][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:37,344][  INFO][PID:9492] Allocated host ResallocHost, ticket_id=786760, hostname=2620:52:6:1161:dead:beef:cafe:c196, name=vmhost_p09_04_prod_01172724_20260113_020322, requested_tags=['copr_builder', 'arch_ppc64le']
[2026-01-13 02:08:37,374][  INFO][PID:9492] Allocating ssh connection to builder
[2026-01-13 02:08:37,376][  INFO][PID:9492] Checking that builder machine is OK
[2026-01-13 02:08:38,396][  INFO][PID:9492] Running remote command: copr-builder-ready fedora-42-ppc64le
[2026-01-13 02:08:38,958][  INFO][PID:9492] Red Hat subscription not needed for fedora-42-ppc64le
Builder is ready to be used

[2026-01-13 02:08:38,959][  INFO][PID:9492] Filling build.info file with builder info
[2026-01-13 02:08:38,977][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:38,979][  INFO][PID:9492] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "amatej",
            "project_name": "dnf-nightly-sanitizers",
            "project_dirname": "dnf-nightly-sanitizers",
            "submitter": "amatej",
            "ended_on": null,
            "started_on": 1768270118.9788482,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10002620-fedora-42-ppc64le",
            "build_id": 10002620,
            "package_name": "libpkgmanifest",
            "package_version": "0.5.9-1.20260113020721220386.main.8.gf80d2d2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly-sanitizers/libpkgmanifest",
            "git_hash": "9b1cf6272facc2ec11e66e31f2c5c2cff32594ee",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "amatej/dnf-nightly-sanitizers--amatej",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers",
            "result_dir": "10002620-libpkgmanifest",
            "built_packages": "",
            "id": 10002620,
            "mockchain_macros": {
                "copr_username": "amatej",
                "copr_projectname": "dnf-nightly-sanitizers",
                "vendor": "Fedora Project COPR (amatej/dnf-nightly-sanitizers)"
            }
        }
    ]
}
[2026-01-13 02:08:39,121][  INFO][PID:9492] Sending fedora-messaging bus message in build.start
[2026-01-13 02:08:40,644][  INFO][PID:9492] Sending fedora-messaging bus message in chroot.start
[2026-01-13 02:08:40,677][  INFO][PID:9492] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10002620-fedora-42-ppc64le --chroot fedora-42-ppc64le --detached
[2026-01-13 02:08:41,722][  INFO][PID:9492] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts.


[2026-01-13 02:08:41,727][  INFO][PID:9492] Downloading the builder-live.log file, attempt 1
[2026-01-13 02:08:41,774][  INFO][PID:9492] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c196 copr-rpmbuild-log
[2026-01-13 02:08:46,743][  INFO][PID:9492] Periodic builder liveness probe: alive
[2026-01-13 02:08:46,744][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:51,747][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:08:56,749][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:01,751][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:06,752][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:11,756][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:16,758][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:21,765][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:26,766][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:31,767][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:36,771][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:41,785][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:46,793][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:51,798][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:09:56,800][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:01,804][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:06,808][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:11,809][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:16,814][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:21,828][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:26,831][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:31,834][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:36,838][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:41,842][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:46,918][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:52,087][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:10:57,089][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:02,090][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:07,372][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:12,585][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:17,592][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:22,593][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:27,594][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:32,606][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:37,607][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:42,619][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:47,621][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:52,711][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:11:57,713][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:02,714][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:07,715][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:12,716][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:17,718][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:22,719][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:27,720][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:32,721][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:37,722][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:42,723][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:47,724][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:52,725][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:12:57,726][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:02,727][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:07,728][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:12,748][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:18,182][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:23,184][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:28,185][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:33,186][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:38,187][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:43,241][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:48,242][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:53,258][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:13:58,260][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:03,450][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:08,451][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:13,452][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:18,453][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:23,454][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:28,455][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:33,456][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:38,668][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:43,669][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:48,670][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:53,671][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:14:58,706][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:03,707][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:08,708][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:13,709][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:18,709][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:23,710][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:28,711][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:33,712][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:38,713][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:43,714][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:48,714][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:53,715][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:15:58,716][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:03,717][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:08,718][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:13,719][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:18,720][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:23,720][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:28,876][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:33,877][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:38,878][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:43,879][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:48,880][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:53,881][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:16:58,881][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:03,882][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:08,883][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:13,884][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:18,885][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:23,923][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:28,924][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:33,925][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:38,926][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:43,927][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:48,990][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:53,991][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:17:58,992][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:03,993][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:08,994][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:13,995][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:18,996][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:23,997][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:28,998][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:34,147][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:39,148][  INFO][PID:9492] Checking for cancel request
[2026-01-13 02:18:44,162][  INFO][PID:9492] Checking for cancel request
[2026-01-13 08:24:18,760][  INFO][PID:9492] Periodic builder liveness probe: alive
[2026-01-13 08:24:18,823][  INFO][PID:9492] Checking for cancel request
[2026-01-13 08:24:18,828][  INFO][PID:9492] calling cancel callback, and waiting
[2026-01-13 08:24:20,222][  INFO][PID:9492] Cancel request succeeded
out:
PID 2734 not found
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c196' (ED25519) to the list of known hosts.

[2026-01-13 08:24:20,246][ ERROR][PID:9492] Backend process error: Build timeouted
[2026-01-13 08:24:20,267][  INFO][PID:9492] Releasing VM back to pool
[2026-01-13 08:24:20,306][WARNING][PID:9492] Switching not-finished job state to 'failed'
[2026-01-13 08:24:20,315][  INFO][PID:9492] Worker failed build, took 22541.327132940292
[2026-01-13 08:24:20,318][  INFO][PID:9492] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "amatej",
            "project_name": "dnf-nightly-sanitizers",
            "project_dirname": "dnf-nightly-sanitizers",
            "submitter": "amatej",
            "ended_on": 1768292660.3059812,
            "started_on": 1768270118.9788482,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-42-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "10002620-fedora-42-ppc64le",
            "build_id": 10002620,
            "package_name": "libpkgmanifest",
            "package_version": "0.5.9-1.20260113020721220386.main.8.gf80d2d2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly-sanitizers/libpkgmanifest",
            "git_hash": "9b1cf6272facc2ec11e66e31f2c5c2cff32594ee",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "amatej/dnf-nightly-sanitizers--amatej",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly-sanitizers",
            "result_dir": "10002620-libpkgmanifest",
            "built_packages": "",
            "id": 10002620,
            "mockchain_macros": {
                "copr_username": "amatej",
                "copr_projectname": "dnf-nightly-sanitizers",
                "vendor": "Fedora Project COPR (amatej/dnf-nightly-sanitizers)"
            }
        }
    ]
}
[2026-01-13 08:24:20,701][  INFO][PID:9492] Sending fedora-messaging bus message in build.end
[2026-01-13 08:24:20,816][  INFO][PID:9492] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/10002620-libpkgmanifest/builder-live.log by gzip
[2026-01-13 08:24:20,823][  INFO][PID:9492] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/10002620-libpkgmanifest/builder-live.log' as PID 546895
[2026-01-13 08:24:21,127][  INFO][PID:9492] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/10002620-libpkgmanifest/builder-live.log)
[2026-01-13 08:24:21,133][  INFO][PID:9492] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/10002620-libpkgmanifest/backend.log by gzip
[2026-01-13 08:24:21,143][  INFO][PID:9492] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly-sanitizers/fedora-42-ppc64le/10002620-libpkgmanifest/backend.log' as PID 546917