[2025-07-08 18:04:37,389][ INFO][PID:3254853] Marking build as starting [2025-07-08 18:04:37,422][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:04:37,429][ INFO][PID:3254853] VM allocation process starts [2025-07-08 18:04:37,462][ INFO][PID:3254853] Trying to allocate VM: ResallocHost, ticket_id=3839605, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-08 18:04:40,511][ INFO][PID:3254853] Allocated host ResallocHost, ticket_id=3839605, hostname=174.129.150.100, name=aws_x86_64_spot_prod_05200720_20250708_175917, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-08 18:04:40,512][ INFO][PID:3254853] Allocating ssh connection to builder [2025-07-08 18:04:40,512][ INFO][PID:3254853] Checking that builder machine is OK [2025-07-08 18:05:40,585][ ERROR][PID:3254853] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 174.129.150.100 port 22: Connection timed out [2025-07-08 18:05:50,586][ ERROR][PID:3254853] Re-try request for task on 'ResallocHost, ticket_id=3839605, hostname=174.129.150.100, name=aws_x86_64_spot_prod_05200720_20250708_175917, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts [2025-07-08 18:05:50,586][ INFO][PID:3254853] Releasing VM back to pool [2025-07-08 18:05:50,612][ INFO][PID:3254853] Retry #1 (on other host) [2025-07-08 18:05:50,613][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:05:50,614][ INFO][PID:3254853] VM allocation process starts [2025-07-08 18:05:50,646][ INFO][PID:3254853] Trying to allocate VM: ResallocHost, ticket_id=3839661, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-08 18:05:55,647][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:00,648][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:05,650][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:10,653][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:15,657][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:20,658][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:25,661][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:30,668][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:35,670][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:40,671][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:45,673][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:50,678][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:06:55,680][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:00,684][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:05,687][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:10,693][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:15,694][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:20,699][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:25,702][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:30,704][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:35,707][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:40,709][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:45,720][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:50,721][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:07:55,723][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:00,724][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:05,729][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:10,743][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:15,745][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:20,749][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:25,753][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:30,755][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:35,759][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:40,803][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:45,804][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:50,807][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:08:55,811][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:00,816][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:05,821][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:09,936][ INFO][PID:3254853] Allocated host ResallocHost, ticket_id=3839661, hostname=44.202.55.96, name=aws_x86_64_normalreserved_prod_05201056_20250708_180657, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-08 18:09:09,937][ INFO][PID:3254853] Allocating ssh connection to builder [2025-07-08 18:09:09,938][ INFO][PID:3254853] Checking that builder machine is OK [2025-07-08 18:09:10,431][ INFO][PID:3254853] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-07-08 18:09:10,659][ INFO][PID:3254853] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-07-08 18:09:10,660][ INFO][PID:3254853] Filling build.info file with builder info [2025-07-08 18:09:10,661][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:10,662][ INFO][PID:3254853] Not re-notifying FE and msg buses for the new host. [2025-07-08 18:09:10,663][ INFO][PID:3254853] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9250397-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-07-08 18:09:11,051][ INFO][PID:3254853] Downloading the builder-live.log file, attempt 1 [2025-07-08 18:09:11,054][ INFO][PID:3254853] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@44.202.55.96 copr-rpmbuild-log [2025-07-08 18:09:16,078][ INFO][PID:3254853] Periodic builder liveness probe: alive [2025-07-08 18:09:16,081][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:21,082][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:26,084][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:31,086][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:36,088][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:41,089][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:46,093][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:51,094][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:09:56,104][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:10:01,112][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:10:06,125][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:10:11,126][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:10:16,130][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:10:21,138][ INFO][PID:3254853] Checking for cancel request [2025-07-08 18:10:23,183][ INFO][PID:3254853] Downloading results from builder [2025-07-08 18:10:23,186][ INFO][PID:3254853] rsyncing of mockbuilder@44.202.55.96:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client started [2025-07-08 18:10:23,194][ INFO][PID:3254853] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@44.202.55.96:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/ &> /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/build-09250397.rsync.log [2025-07-08 18:10:25,326][ INFO][PID:3254853] rsyncing finished. [2025-07-08 18:10:25,328][ INFO][PID:3254853] Releasing VM back to pool [2025-07-08 18:10:25,353][ INFO][PID:3254853] Searching for 'success' file in resultdir [2025-07-08 18:10:25,354][ ERROR][PID:3254853] Build failed: Backend process error: No success file => build failure [2025-07-08 18:10:25,355][ INFO][PID:3254853] Finished build: id=9250397 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56 chroot=fedora-rawhide-x86_64 [2025-07-08 18:10:25,357][ ERROR][PID:3254853] Backend process error: No success file => build failure [2025-07-08 18:10:25,357][ INFO][PID:3254853] Worker failed build, took 74.69508290290833 [2025-07-08 18:10:25,358][ INFO][PID:3254853] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "lbalhar", "project_name": "python-setuptools_rawhide", "project_dirname": "python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56", "submitter": "https://src.fedoraproject.org/user/packit", "ended_on": 1751998225.357619, "started_on": 1751998150.6625361, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9250397-fedora-rawhide-x86_64", "build_id": 9250397, "package_name": "google-api-python-client", "package_version": "2:2.176.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/google-api-python-client", "git_hash": "97e8f8f930ee387a5cdf3a7de6a39213da7c6b8f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "lbalhar/python-setuptools_rawhide--https://src.fedoraproject.org/user/packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/lbalhar/python-setuptools_rawhide/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56", "result_dir": "09250397-google-api-python-client", "built_packages": "", "id": 9250397, "mockchain_macros": { "copr_username": "lbalhar", "copr_projectname": "python-setuptools_rawhide", "vendor": "Fedora Project COPR (lbalhar/python-setuptools_rawhide)" } } ] } [2025-07-08 18:10:25,423][ INFO][PID:3254853] Sending fedora-messaging bus message in build.end [2025-07-08 18:10:26,486][ INFO][PID:3254853] Compressing /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/builder-live.log by gzip [2025-07-08 18:10:26,493][ INFO][PID:3254853] Running command 'gzip /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/builder-live.log' as PID 3308751 [2025-07-08 18:10:26,508][ INFO][PID:3254853] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/builder-live.log) [2025-07-08 18:10:26,510][ INFO][PID:3254853] Compressing /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/backend.log by gzip [2025-07-08 18:10:26,519][ INFO][PID:3254853] Running command 'gzip /var/lib/copr/public_html/results/lbalhar/python-setuptools_rawhide:pr:fork-packit-rpms-google-api-python-client-56/fedora-rawhide-x86_64/09250397-google-api-python-client/backend.log' as PID 3308755