[2024-08-14 12:32:31,470][  INFO][PID:1005689] Marking build as starting
[2024-08-14 12:32:31,531][  INFO][PID:1005689] Trying to allocate VM
[2024-08-14 12:32:34,556][  INFO][PID:1005689] Allocated host ResallocHost, ticket_id=4416616, hostname=98.80.205.140
[2024-08-14 12:32:34,557][  INFO][PID:1005689] Allocating ssh connection to builder
[2024-08-14 12:32:34,558][  INFO][PID:1005689] Checking that builder machine is OK
[2024-08-14 12:32:34,931][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.205.140 '/usr/bin/test -f /etc/mock/fedora-rawhide-x86_64.cfg'
[2024-08-14 12:32:35,146][  INFO][PID:1005689] Filling build.info file with builder info
[2024-08-14 12:32:35,147][  INFO][PID:1005689] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "frantisekz",
            "project_name": "mozjs128",
            "project_dirname": "mozjs128",
            "submitter": "frantisekz",
            "ended_on": null,
            "started_on": 1723638755.1475322,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "7907589-fedora-rawhide-x86_64",
            "build_id": 7907589,
            "package_name": "mozjs128",
            "package_version": "128.1.0-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/frantisekz/mozjs128/mozjs128",
            "git_hash": "a81e332f76d0968a87a76571b558f8ba4bee9804",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "frantisekz/mozjs128--frantisekz",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/frantisekz/mozjs128/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/frantisekz/mozjs128",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/frantisekz/mozjs128",
            "result_dir": "07907589-mozjs128",
            "built_packages": "",
            "id": 7907589,
            "mockchain_macros": {
                "copr_username": "frantisekz",
                "copr_projectname": "mozjs128",
                "vendor": "Fedora Project COPR (frantisekz/mozjs128)"
            }
        }
    ]
}
[2024-08-14 12:32:35,212][  INFO][PID:1005689] Sending fedora-messaging bus message in build.start
[2024-08-14 12:32:35,796][  INFO][PID:1005689] Sending fedora-messaging bus message in chroot.start
[2024-08-14 12:32:35,817][  INFO][PID:1005689] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/7907589-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2024-08-14 12:32:36,217][  INFO][PID:1005689] Downloading the builder-live.log file, attempt 1
[2024-08-14 12:32:36,219][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.205.140 copr-rpmbuild-log
[2024-08-14 12:32:41,224][  INFO][PID:1005689] Status: False
[2024-08-14 12:42:41,306][  INFO][PID:1005689] Status: False
[2024-08-14 12:52:41,395][  INFO][PID:1005689] Status: False
[2024-08-14 12:53:04,212][ ERROR][PID:1005689] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-08-14 12:53:14,214][WARNING][PID:1005689] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-08-14 12:53:24,215][  INFO][PID:1005689] Downloading the builder-live.log file, attempt 2
[2024-08-14 12:53:24,258][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.205.140 copr-rpmbuild-log
[2024-08-14 12:54:24,326][ ERROR][PID:1005689] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-08-14 12:54:34,333][WARNING][PID:1005689] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-08-14 12:54:44,334][  INFO][PID:1005689] Downloading the builder-live.log file, attempt 3
[2024-08-14 12:54:44,346][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.205.140 copr-rpmbuild-log
[2024-08-14 12:55:44,432][ ERROR][PID:1005689] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-08-14 12:55:54,435][WARNING][PID:1005689] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-08-14 12:56:04,436][  INFO][PID:1005689] Downloading the builder-live.log file, attempt 4
[2024-08-14 12:56:04,438][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.205.140 copr-rpmbuild-log
[2024-08-14 12:57:04,506][ ERROR][PID:1005689] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-08-14 12:57:14,507][ ERROR][PID:1005689] Giving up for unstable SSH, failures: 1723639994.2143903, 1723640074.3336806, 1723640154.4358425, 1723640234.5070124
[2024-08-14 12:57:14,508][ ERROR][PID:1005689] Re-try request for task on 'ResallocHost, ticket_id=4416616, hostname=98.80.205.140': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2024-08-14 12:57:14,508][  INFO][PID:1005689] Releasing VM back to pool
[2024-08-14 12:57:14,521][  INFO][PID:1005689] Retry #1 (on other host)
[2024-08-14 12:57:14,522][  INFO][PID:1005689] Trying to allocate VM
[2024-08-14 13:01:32,639][  INFO][PID:1005689] Allocated host ResallocHost, ticket_id=4416919, hostname=44.221.85.29
[2024-08-14 13:01:32,639][  INFO][PID:1005689] Allocating ssh connection to builder
[2024-08-14 13:01:32,640][  INFO][PID:1005689] Checking that builder machine is OK
[2024-08-14 13:01:33,002][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.221.85.29 '/usr/bin/test -f /etc/mock/fedora-rawhide-x86_64.cfg'
[2024-08-14 13:01:33,217][  INFO][PID:1005689] Filling build.info file with builder info
[2024-08-14 13:01:33,226][  INFO][PID:1005689] Not re-notifying FE and msg buses for the new host.
[2024-08-14 13:01:33,227][  INFO][PID:1005689] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/7907589-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2024-08-14 13:01:33,613][  INFO][PID:1005689] Downloading the builder-live.log file, attempt 1
[2024-08-14 13:01:33,615][  INFO][PID:1005689] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.221.85.29 copr-rpmbuild-log
[2024-08-14 13:02:43,631][  INFO][PID:1005689] Status: False
[2024-08-14 13:12:43,815][  INFO][PID:1005689] Status: False
[2024-08-14 13:22:43,891][  INFO][PID:1005689] Status: False
[2024-08-14 13:32:43,985][  INFO][PID:1005689] Status: False
[2024-08-14 13:42:44,074][  INFO][PID:1005689] Status: False
[2024-08-14 13:52:44,167][  INFO][PID:1005689] Status: False
[2024-08-14 14:02:44,282][  INFO][PID:1005689] Status: False
[2024-08-14 14:12:44,410][  INFO][PID:1005689] Status: False
[2024-08-14 14:22:44,503][  INFO][PID:1005689] Status: False
[2024-08-14 14:32:44,589][  INFO][PID:1005689] Status: False
[2024-08-14 14:42:44,677][  INFO][PID:1005689] Status: False
[2024-08-14 14:48:51,477][  INFO][PID:1005689] Downloading results from builder
[2024-08-14 14:48:51,478][  INFO][PID:1005689] rsyncing of mockbuilder@44.221.85.29:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128 started
[2024-08-14 14:48:51,479][  INFO][PID:1005689] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.221.85.29:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/ &> /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/build-07907589.rsync.log
[2024-08-14 14:48:56,023][  INFO][PID:1005689] rsyncing finished.
[2024-08-14 14:48:56,024][  INFO][PID:1005689] Releasing VM back to pool
[2024-08-14 14:48:56,038][  INFO][PID:1005689] Searching for 'success' file in resultdir
[2024-08-14 14:48:56,039][  INFO][PID:1005689] Going to sign pkgs from source: 7907589-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64
[2024-08-14 14:48:56,040][  INFO][PID:1005689] Calling '/bin/sign -u frantisekz#mozjs128@copr.fedorahosted.org -p' (attempt #1)
[2024-08-14 14:48:56,336][  INFO][PID:1005689] Calling '/bin/sign -4 -h sha256 -u frantisekz#mozjs128@copr.fedorahosted.org -r /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-debuginfo-128.1.0-2.fc41.x86_64.rpm' (attempt #1)
[2024-08-14 14:48:57,937][  INFO][PID:1005689] signed rpm: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-debuginfo-128.1.0-2.fc41.x86_64.rpm
[2024-08-14 14:48:57,938][  INFO][PID:1005689] Calling '/bin/sign -4 -h sha256 -u frantisekz#mozjs128@copr.fedorahosted.org -r /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-devel-128.1.0-2.fc41.x86_64.rpm' (attempt #1)
[2024-08-14 14:48:59,047][  INFO][PID:1005689] signed rpm: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-devel-128.1.0-2.fc41.x86_64.rpm
[2024-08-14 14:48:59,048][  INFO][PID:1005689] Calling '/bin/sign -4 -h sha256 -u frantisekz#mozjs128@copr.fedorahosted.org -r /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-debugsource-128.1.0-2.fc41.x86_64.rpm' (attempt #1)
[2024-08-14 14:48:59,824][  INFO][PID:1005689] signed rpm: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-debugsource-128.1.0-2.fc41.x86_64.rpm
[2024-08-14 14:48:59,825][  INFO][PID:1005689] Calling '/bin/sign -4 -h sha256 -u frantisekz#mozjs128@copr.fedorahosted.org -r /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-devel-debuginfo-128.1.0-2.fc41.x86_64.rpm' (attempt #1)
[2024-08-14 14:49:01,537][  INFO][PID:1005689] signed rpm: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-devel-debuginfo-128.1.0-2.fc41.x86_64.rpm
[2024-08-14 14:49:01,538][  INFO][PID:1005689] Calling '/bin/sign -4 -h sha256 -u frantisekz#mozjs128@copr.fedorahosted.org -r /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-128.1.0-2.fc41.src.rpm' (attempt #1)
[2024-08-14 14:49:14,109][  INFO][PID:1005689] signed rpm: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-128.1.0-2.fc41.src.rpm
[2024-08-14 14:49:14,110][  INFO][PID:1005689] Calling '/bin/sign -4 -h sha256 -u frantisekz#mozjs128@copr.fedorahosted.org -r /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-128.1.0-2.fc41.x86_64.rpm' (attempt #1)
[2024-08-14 14:49:15,149][  INFO][PID:1005689] signed rpm: /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/mozjs128-128.1.0-2.fc41.x86_64.rpm
[2024-08-14 14:49:15,150][  INFO][PID:1005689] Sign done
[2024-08-14 14:49:15,150][  INFO][PID:1005689] Incremental createrepo run, adding 07907589-mozjs128 into https://download.copr.fedorainfracloud.org/results/frantisekz/mozjs128/fedora-rawhide-x86_64, (auto-create-repo=True)
[2024-08-14 14:49:15,151][  INFO][PID:1005689] Running command 'copr-repo --batched /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64 --add 07907589-mozjs128 --no-appstream-metadata' as PID 1816046
[2024-08-14 14:49:16,744][  INFO][PID:1005689] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64 --add 07907589-mozjs128 --no-appstream-metadata)
[2024-08-14 14:49:16,745][  INFO][PID:1005689] Getting build details
[2024-08-14 14:49:16,746][  INFO][PID:1005689] Listing built binary packages in /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128
[2024-08-14 14:49:16,746][  INFO][PID:1005689] Built packages:
['mozjs128-debuginfo 128.1.0', 'mozjs128 128.1.0', 'mozjs128-devel-debuginfo 128.1.0', 'mozjs128-devel 128.1.0', 'mozjs128-debugsource 128.1.0']
[2024-08-14 14:49:16,746][  INFO][PID:1005689] build details: {'built_packages': 'mozjs128-debuginfo 128.1.0\nmozjs128 128.1.0\nmozjs128-devel-debuginfo 128.1.0\nmozjs128-devel 128.1.0\nmozjs128-debugsource 128.1.0'}
[2024-08-14 14:49:16,747][  INFO][PID:1005689] Retrieving pubkey
[2024-08-14 14:49:16,747][  INFO][PID:1005689] Calling '/bin/sign -u frantisekz#mozjs128@copr.fedorahosted.org -p' (attempt #1)
[2024-08-14 14:49:17,042][  INFO][PID:1005689] Added pubkey for user frantisekz project mozjs128 into: /var/lib/copr/public_html/results/frantisekz/mozjs128/pubkey.gpg
[2024-08-14 14:49:17,042][  INFO][PID:1005689] Finished build: id=7907589 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/frantisekz/mozjs128 chroot=fedora-rawhide-x86_64 
[2024-08-14 14:49:17,044][  INFO][PID:1005689] Worker succeeded build, took 6463.818303108215
[2024-08-14 14:49:17,045][  INFO][PID:1005689] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "frantisekz",
            "project_name": "mozjs128",
            "project_dirname": "mozjs128",
            "submitter": "frantisekz",
            "ended_on": 1723646957.044611,
            "started_on": 1723640493.2263079,
            "submitted_on": null,
            "status": 1,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "7907589-fedora-rawhide-x86_64",
            "build_id": 7907589,
            "package_name": "mozjs128",
            "package_version": "128.1.0-2",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/frantisekz/mozjs128/mozjs128",
            "git_hash": "a81e332f76d0968a87a76571b558f8ba4bee9804",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "frantisekz/mozjs128--frantisekz",
            "results": {
                "packages": [
                    {
                        "name": "mozjs128",
                        "epoch": null,
                        "version": "128.1.0",
                        "release": "2.fc41",
                        "arch": "src"
                    },
                    {
                        "name": "mozjs128-debuginfo",
                        "epoch": null,
                        "version": "128.1.0",
                        "release": "2.fc41",
                        "arch": "x86_64"
                    },
                    {
                        "name": "mozjs128",
                        "epoch": null,
                        "version": "128.1.0",
                        "release": "2.fc41",
                        "arch": "x86_64"
                    },
                    {
                        "name": "mozjs128-devel-debuginfo",
                        "epoch": null,
                        "version": "128.1.0",
                        "release": "2.fc41",
                        "arch": "x86_64"
                    },
                    {
                        "name": "mozjs128-devel",
                        "epoch": null,
                        "version": "128.1.0",
                        "release": "2.fc41",
                        "arch": "x86_64"
                    },
                    {
                        "name": "mozjs128-debugsource",
                        "epoch": null,
                        "version": "128.1.0",
                        "release": "2.fc41",
                        "arch": "x86_64"
                    }
                ]
            },
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "background": false,
            "fedora_review": true,
            "isolation": "default",
            "repo_priority": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/frantisekz/mozjs128/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/frantisekz/mozjs128",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/frantisekz/mozjs128",
            "result_dir": "07907589-mozjs128",
            "built_packages": "mozjs128-debuginfo 128.1.0\nmozjs128 128.1.0\nmozjs128-devel-debuginfo 128.1.0\nmozjs128-devel 128.1.0\nmozjs128-debugsource 128.1.0",
            "id": 7907589,
            "mockchain_macros": {
                "copr_username": "frantisekz",
                "copr_projectname": "mozjs128",
                "vendor": "Fedora Project COPR (frantisekz/mozjs128)"
            }
        }
    ]
}
[2024-08-14 14:49:17,117][  INFO][PID:1005689] Sending fedora-messaging bus message in build.end
[2024-08-14 14:49:19,823][  INFO][PID:1005689] Compressing /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/builder-live.log by gzip
[2024-08-14 14:49:19,824][  INFO][PID:1005689] Running command 'gzip /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/builder-live.log' as PID 1816424
[2024-08-14 14:49:21,754][  INFO][PID:1005689] Finished after 1 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/builder-live.log)
[2024-08-14 14:49:21,754][  INFO][PID:1005689] Compressing /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/backend.log by gzip
[2024-08-14 14:49:21,756][  INFO][PID:1005689] Running command 'gzip /var/lib/copr/public_html/results/frantisekz/mozjs128/fedora-rawhide-x86_64/07907589-mozjs128/backend.log' as PID 1816615