[2025-07-21 09:39:12,385][ INFO][PID:330130] Marking build as starting [2025-07-21 09:39:12,438][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:12,442][ INFO][PID:330130] VM allocation process starts [2025-07-21 09:39:12,470][ INFO][PID:330130] Trying to allocate VM: ResallocHost, ticket_id=4008186, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-21 09:39:17,475][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:22,477][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:27,479][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:32,483][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:37,494][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:42,496][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:47,502][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:52,510][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:39:57,514][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:02,516][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:07,520][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:12,524][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:17,526][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:22,530][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:27,531][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:32,535][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:37,538][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:42,543][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:47,547][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:52,550][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:40:57,552][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:02,556][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:07,574][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:12,577][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:17,583][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:22,593][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:27,596][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:32,605][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:37,614][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:42,624][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:47,625][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:52,627][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:41:57,633][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:02,637][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:07,640][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:12,646][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:17,647][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:22,651][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:27,657][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:32,664][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:37,668][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:42,674][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:47,676][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:52,678][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:42:57,679][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:02,683][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:07,684][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:12,688][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:17,695][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:22,696][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:27,701][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:32,702][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:37,707][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:42,712][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:47,715][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:52,717][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:43:57,722][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:02,727][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:07,733][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:12,740][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:17,759][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:22,772][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:27,776][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:32,788][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:37,791][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:42,795][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:47,797][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:52,799][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:44:57,801][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:02,804][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:07,811][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:12,812][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:17,818][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:22,819][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:27,823][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:30,771][ INFO][PID:330130] Allocated host ResallocHost, ticket_id=4008186, hostname=3.236.243.202, name=aws_x86_64_spot_prod_05693058_20250721_094243, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-21 09:45:30,772][ INFO][PID:330130] Allocating ssh connection to builder [2025-07-21 09:45:30,772][ INFO][PID:330130] Checking that builder machine is OK [2025-07-21 09:45:31,216][ INFO][PID:330130] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-07-21 09:45:31,443][ INFO][PID:330130] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-07-21 09:45:31,444][ INFO][PID:330130] Filling build.info file with builder info [2025-07-21 09:45:31,447][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:31,449][ INFO][PID:330130] Sending build state back to frontend: { "builds": [ { "timeout": 180000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rezso", "project_name": "ML", "project_dirname": "ML", "submitter": "rezso", "ended_on": null, "started_on": 1753091131.4484868, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9294252-fedora-rawhide-x86_64", "build_id": 9294252, "package_name": "cuda-gcc-11", "package_version": "11.5.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/cuda-gcc-11", "git_hash": "5746f5d27be9c17285659c67b8af871d366c7a6a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rezso/ML--rezso", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/fedora-rawhide-x86_64/", "id": "copr_rezso_CUDA", "name": "Additional repo copr_rezso_CUDA" }, { "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64", "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64", "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64" }, { "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/sbsa", "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa", "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rezso/ML", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML", "result_dir": "09294252-cuda-gcc-11", "built_packages": "", "id": 9294252, "mockchain_macros": { "copr_username": "rezso", "copr_projectname": "ML", "vendor": "Fedora Project COPR (rezso/ML)" } } ] } [2025-07-21 09:45:31,479][ INFO][PID:330130] Sending fedora-messaging bus message in build.start [2025-07-21 09:45:32,395][ INFO][PID:330130] Sending fedora-messaging bus message in chroot.start [2025-07-21 09:45:32,423][ INFO][PID:330130] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9294252-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-07-21 09:45:32,809][ INFO][PID:330130] Downloading the builder-live.log file, attempt 1 [2025-07-21 09:45:32,813][ INFO][PID:330130] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.243.202 copr-rpmbuild-log [2025-07-21 09:45:37,822][ INFO][PID:330130] Periodic builder liveness probe: alive [2025-07-21 09:45:37,823][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:42,824][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:47,830][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:52,835][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:45:57,841][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:02,848][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:07,851][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:12,852][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:17,859][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:22,861][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:27,866][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:32,872][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:37,876][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:42,881][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:47,884][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:52,886][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:46:57,889][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:02,892][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:07,899][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:12,901][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:17,906][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:22,910][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:27,914][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:32,928][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:37,939][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:42,942][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:47,947][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:52,949][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:47:57,974][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:02,976][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:07,982][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:12,987][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:17,991][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:23,102][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:28,105][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:33,114][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:38,116][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:43,658][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:48,995][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:48:55,847][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:00,850][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:05,853][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:11,255][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:17,098][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:22,511][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:28,428][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:33,503][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:39,514][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:44,966][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:50,260][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:49:55,267][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:00,272][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:07,004][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:12,212][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:17,286][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:22,302][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:27,310][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:32,315][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:37,318][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:42,331][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:47,333][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:52,339][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:50:57,340][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:02,354][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:07,359][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:12,376][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:17,379][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:22,399][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:27,409][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:32,419][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:37,425][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:42,429][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:47,441][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:52,450][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:51:57,463][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:02,469][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:07,474][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:12,487][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:17,498][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:22,503][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:27,506][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:32,516][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:37,520][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:42,521][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:47,531][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:52,539][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:52:57,548][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:02,562][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:07,564][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:12,565][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:17,571][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:22,575][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:27,579][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:32,581][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:37,598][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:42,605][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:47,608][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:52,610][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:53:57,628][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:02,629][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:07,635][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:12,638][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:17,641][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:22,667][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:27,675][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:32,681][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:37,693][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:42,701][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:47,719][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:52,733][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:54:57,738][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:02,740][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:07,748][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:12,759][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:17,762][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:22,765][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:27,777][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:32,787][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:37,789][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:42,822][ INFO][PID:330130] Periodic builder liveness probe: alive [2025-07-21 09:55:42,825][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:47,837][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:52,841][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:55:57,844][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:02,849][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:07,854][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:12,876][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:17,878][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:22,882][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:27,885][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:32,905][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:37,910][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:42,915][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:47,927][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:52,948][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:56:57,950][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:02,958][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:07,966][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:12,967][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:17,971][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:22,980][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:27,994][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:32,999][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:38,003][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:43,016][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:48,018][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:53,020][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:57:58,033][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:03,059][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:08,065][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:13,067][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:18,070][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:23,071][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:28,095][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:33,097][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:38,104][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:43,108][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:48,124][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:53,128][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:58:58,157][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:03,158][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:08,164][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:13,166][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:18,179][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:23,192][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:28,198][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:33,203][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:38,209][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:43,213][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:48,221][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:53,546][ INFO][PID:330130] Checking for cancel request [2025-07-21 09:59:58,550][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:03,562][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:08,569][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:13,582][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:18,584][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:23,591][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:28,597][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:33,603][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:38,612][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:43,625][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:48,629][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:53,631][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:00:58,635][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:03,643][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:08,649][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:13,651][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:18,654][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:23,666][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:28,667][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:33,669][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:38,676][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:43,690][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:48,721][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:53,735][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:01:56,998][ ERROR][PID:330130] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-21 10:01:58,736][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:03,738][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:07,000][WARNING][PID:330130] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-21 10:02:08,746][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:13,749][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:17,005][ INFO][PID:330130] Downloading the builder-live.log file, attempt 2 [2025-07-21 10:02:17,034][ INFO][PID:330130] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.243.202 copr-rpmbuild-log [2025-07-21 10:02:18,754][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:23,760][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:28,770][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:33,775][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:38,779][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:43,783][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:48,791][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:53,793][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:02:58,795][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:03,798][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:08,801][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:13,807][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:17,133][ ERROR][PID:330130] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-21 10:03:18,810][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:23,814][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:27,140][WARNING][PID:330130] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-21 10:03:28,820][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:33,827][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:37,146][ INFO][PID:330130] Downloading the builder-live.log file, attempt 3 [2025-07-21 10:03:37,156][ INFO][PID:330130] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.243.202 copr-rpmbuild-log [2025-07-21 10:03:38,838][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:43,841][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:48,845][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:53,847][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:03:58,853][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:03,873][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:08,884][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:13,887][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:18,891][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:23,905][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:28,907][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:33,910][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:37,247][ ERROR][PID:330130] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-21 10:04:38,913][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:43,918][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:47,248][WARNING][PID:330130] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-21 10:04:48,923][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:53,932][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:04:57,251][ INFO][PID:330130] Downloading the builder-live.log file, attempt 4 [2025-07-21 10:04:57,254][ INFO][PID:330130] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.236.243.202 copr-rpmbuild-log [2025-07-21 10:04:58,937][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:03,940][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:08,945][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:13,946][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:18,948][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:23,959][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:28,967][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:33,973][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:38,975][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:44,008][ INFO][PID:330130] Periodic builder liveness probe: alive [2025-07-21 10:05:44,012][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:49,025][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:54,026][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:05:57,341][ ERROR][PID:330130] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-21 10:05:59,030][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:04,037][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:07,361][ ERROR][PID:330130] Giving up for unstable SSH, failures: 1753092127.0000618, 1753092207.1408534, 1753092287.2484646, 1753092367.3612273 [2025-07-21 10:06:07,375][ ERROR][PID:330130] Re-try request for task on 'ResallocHost, ticket_id=4008186, hostname=3.236.243.202, name=aws_x86_64_spot_prod_05693058_20250721_094243, requested_tags=['copr_builder', 'arch_x86_64']': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts [2025-07-21 10:06:07,381][ INFO][PID:330130] Releasing VM back to pool [2025-07-21 10:06:07,479][ INFO][PID:330130] Retry #1 (on other host) [2025-07-21 10:06:07,485][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:07,499][ INFO][PID:330130] VM allocation process starts [2025-07-21 10:06:07,560][ INFO][PID:330130] Trying to allocate VM: ResallocHost, ticket_id=4009860, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-21 10:06:12,574][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:17,577][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:19,681][ INFO][PID:330130] Allocated host ResallocHost, ticket_id=4009860, hostname=98.82.117.213, name=aws_x86_64_normalreserved_prod_05693542_20250721_100220, requested_tags=['copr_builder', 'arch_x86_64'] [2025-07-21 10:06:19,682][ INFO][PID:330130] Allocating ssh connection to builder [2025-07-21 10:06:19,683][ INFO][PID:330130] Checking that builder machine is OK [2025-07-21 10:06:20,147][ INFO][PID:330130] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-07-21 10:06:20,370][ INFO][PID:330130] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-07-21 10:06:20,371][ INFO][PID:330130] Filling build.info file with builder info [2025-07-21 10:06:20,376][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:20,378][ INFO][PID:330130] Not re-notifying FE and msg buses for the new host. [2025-07-21 10:06:20,380][ INFO][PID:330130] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9294252-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-07-21 10:06:20,759][ INFO][PID:330130] Downloading the builder-live.log file, attempt 1 [2025-07-21 10:06:20,764][ INFO][PID:330130] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.82.117.213 copr-rpmbuild-log [2025-07-21 10:06:25,770][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:30,771][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:35,776][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:40,778][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:45,780][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:50,782][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:06:55,786][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:00,795][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:05,800][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:10,803][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:15,812][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:20,821][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:25,823][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:30,828][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:35,832][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:40,839][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:45,840][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:50,843][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:07:55,845][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:00,851][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:05,863][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:10,864][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:15,868][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:20,871][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:25,879][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:30,888][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:35,891][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:40,897][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:45,901][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:50,903][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:08:55,914][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:00,923][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:05,933][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:10,943][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:15,953][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:20,955][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:25,961][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:30,965][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:35,982][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:40,986][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:45,988][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:50,993][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:09:55,998][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:01,010][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:06,017][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:11,045][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:16,054][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:21,066][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:26,107][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:31,113][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:36,121][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:41,130][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:46,136][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:51,144][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:10:56,155][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:01,157][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:06,163][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:11,170][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:16,185][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:21,194][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:26,198][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:31,212][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:36,216][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:41,221][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:46,225][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:51,227][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:11:56,229][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:01,233][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:06,245][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:11,249][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:16,251][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:21,258][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:26,262][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:31,263][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:36,269][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:41,272][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:46,276][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:51,280][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:12:56,282][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:01,286][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:06,290][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:11,297][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:16,305][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:21,307][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:26,313][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:31,319][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:36,321][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:41,324][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:46,325][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:51,330][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:13:56,336][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:01,346][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:06,350][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:11,354][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:16,360][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:21,364][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:26,374][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:31,377][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:36,389][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:41,402][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:46,413][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:51,414][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:14:56,425][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:01,429][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:06,438][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:11,443][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:16,448][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:21,458][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:26,468][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:31,478][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:36,485][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:41,490][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:46,555][ INFO][PID:330130] Periodic builder liveness probe: alive [2025-07-21 10:15:46,560][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:51,583][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:15:56,585][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:01,595][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:06,607][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:11,617][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:16,622][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:21,637][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:26,643][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:31,646][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:36,650][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:41,664][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:46,669][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:51,673][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:16:56,683][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:01,690][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:06,701][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:11,703][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:16,707][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:21,719][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:26,720][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:31,727][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:36,735][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:41,737][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:46,743][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:51,748][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:17:56,754][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:01,756][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:06,765][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:11,766][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:16,772][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:21,780][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:26,787][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:31,791][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:36,794][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:41,798][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:46,800][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:51,801][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:18:56,802][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:01,803][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:06,804][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:11,806][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:16,807][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:21,816][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:26,821][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:31,822][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:36,823][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:41,825][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:46,833][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:51,834][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:19:56,839][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:01,840][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:06,842][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:11,844][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:16,845][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:21,848][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:26,852][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:31,854][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:36,855][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:41,856][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:46,857][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:51,858][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:20:56,859][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:01,861][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:06,863][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:11,864][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:16,865][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:21,867][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:26,868][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:31,870][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:36,873][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:41,875][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:46,876][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:51,878][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:21:56,879][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:01,880][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:06,882][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:11,884][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:16,885][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:21,890][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:26,895][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:31,898][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:36,903][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:41,905][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:46,906][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:51,910][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:22:56,912][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:01,913][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:06,915][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:11,916][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:16,917][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:21,920][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:26,923][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:31,927][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:36,931][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:41,932][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:46,936][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:51,938][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:23:56,941][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:01,943][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:06,944][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:11,945][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:16,946][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:21,948][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:26,949][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:31,950][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:36,951][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:41,953][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:46,955][ INFO][PID:330130] Checking for cancel request [2025-07-21 10:24:49,966][ INFO][PID:330130] Downloading results from builder [2025-07-21 10:24:49,966][ INFO][PID:330130] rsyncing of mockbuilder@98.82.117.213:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11 started [2025-07-21 10:24:49,967][ INFO][PID:330130] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.82.117.213:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/ &> /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/build-09294252.rsync.log [2025-07-21 10:24:53,644][ INFO][PID:330130] rsyncing finished. [2025-07-21 10:24:53,644][ INFO][PID:330130] Releasing VM back to pool [2025-07-21 10:24:53,654][ INFO][PID:330130] Searching for 'success' file in resultdir [2025-07-21 10:24:53,655][ INFO][PID:330130] Going to sign pkgs from source: 9294252-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64 [2025-07-21 10:24:53,656][ INFO][PID:330130] Calling '/bin/sign -u rezso#ML@copr.fedorahosted.org -p' (attempt #1) [2025-07-21 10:24:53,981][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-gfortran-debuginfo-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:24:55,906][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-gfortran-debuginfo-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:24:55,907][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-debugsource-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:24:57,107][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-debugsource-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:24:57,107][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-gfortran-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:24:58,188][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-gfortran-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:24:58,188][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:24:59,630][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:24:59,631][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-c++-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:25:00,821][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-c++-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:25:00,822][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-11.5.0-1.fc43.src.rpm' (attempt #1) [2025-07-21 10:25:05,339][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-11.5.0-1.fc43.src.rpm [2025-07-21 10:25:05,340][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-debuginfo-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:25:09,847][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-debuginfo-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:25:09,848][ INFO][PID:330130] Calling '/bin/sign -4 -h sha256 -u rezso#ML@copr.fedorahosted.org -r /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-c++-debuginfo-11.5.0-1.fc43.x86_64.rpm' (attempt #1) [2025-07-21 10:25:11,580][ INFO][PID:330130] signed rpm: /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/cuda-gcc-11-c++-debuginfo-11.5.0-1.fc43.x86_64.rpm [2025-07-21 10:25:11,580][ INFO][PID:330130] Sign done [2025-07-21 10:25:11,581][ INFO][PID:330130] Incremental createrepo run, adding 09294252-cuda-gcc-11 into https://download.copr.fedorainfracloud.org/results/rezso/ML/fedora-rawhide-x86_64, (auto-create-repo=True) [2025-07-21 10:25:11,582][ INFO][PID:330130] Running command 'copr-repo --batched /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64 --add 09294252-cuda-gcc-11 --no-appstream-metadata' as PID 859606 [2025-07-21 10:25:13,636][ INFO][PID:330130] Finished after 2 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64 --add 09294252-cuda-gcc-11 --no-appstream-metadata) [2025-07-21 10:25:13,638][ INFO][PID:330130] Getting build details [2025-07-21 10:25:13,645][ INFO][PID:330130] Listing built binary packages in /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11 [2025-07-21 10:25:13,649][ INFO][PID:330130] Built packages: ['cuda-gcc-11-c++-debuginfo 11.5.0', 'cuda-gcc-11-gfortran 11.5.0', 'cuda-gcc-11-debugsource 11.5.0', 'cuda-gcc-11-c++ 11.5.0', 'cuda-gcc-11-debuginfo 11.5.0', 'cuda-gcc-11-gfortran-debuginfo 11.5.0', 'cuda-gcc-11 11.5.0'] [2025-07-21 10:25:13,655][ INFO][PID:330130] build details: {'built_packages': 'cuda-gcc-11-c++-debuginfo 11.5.0\ncuda-gcc-11-gfortran 11.5.0\ncuda-gcc-11-debugsource 11.5.0\ncuda-gcc-11-c++ 11.5.0\ncuda-gcc-11-debuginfo 11.5.0\ncuda-gcc-11-gfortran-debuginfo 11.5.0\ncuda-gcc-11 11.5.0'} [2025-07-21 10:25:13,662][ INFO][PID:330130] Retrieving pubkey [2025-07-21 10:25:13,669][ INFO][PID:330130] Calling '/bin/sign -u rezso#ML@copr.fedorahosted.org -p' (attempt #1) [2025-07-21 10:25:14,006][ INFO][PID:330130] Added pubkey for user rezso project ML into: /var/lib/copr/public_html/results/rezso/ML/pubkey.gpg [2025-07-21 10:25:14,007][ INFO][PID:330130] Finished build: id=9294252 failed=False timeout=180000 destdir=/var/lib/copr/public_html/results/rezso/ML chroot=fedora-rawhide-x86_64 [2025-07-21 10:25:14,016][ INFO][PID:330130] Worker succeeded build, took 1133.6372056007385 [2025-07-21 10:25:14,019][ INFO][PID:330130] Sending build state back to frontend: { "builds": [ { "timeout": 180000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "rezso", "project_name": "ML", "project_dirname": "ML", "submitter": "rezso", "ended_on": 1753093514.0161142, "started_on": 1753092380.3789086, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9294252-fedora-rawhide-x86_64", "build_id": 9294252, "package_name": "cuda-gcc-11", "package_version": "11.5.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rezso/ML/cuda-gcc-11", "git_hash": "5746f5d27be9c17285659c67b8af871d366c7a6a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rezso/ML--rezso", "results": { "packages": [ { "name": "cuda-gcc-11-c++-debuginfo", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" }, { "name": "cuda-gcc-11-gfortran", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" }, { "name": "cuda-gcc-11-debugsource", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" }, { "name": "cuda-gcc-11", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "src" }, { "name": "cuda-gcc-11-c++", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" }, { "name": "cuda-gcc-11-debuginfo", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" }, { "name": "cuda-gcc-11-gfortran-debuginfo", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" }, { "name": "cuda-gcc-11", "epoch": null, "version": "11.5.0", "release": "1.fc43", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/ML/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rezso/CUDA/fedora-rawhide-x86_64/", "id": "copr_rezso_CUDA", "name": "Additional repo copr_rezso_CUDA" }, { "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/x86_64", "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64", "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_x86_64" }, { "baseurl": "http://developer.download.nvidia.com/compute/cuda/repos/rhel9/sbsa", "id": "http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa", "name": "Additional repo http_developer_download_nvidia_com_compute_cuda_repos_rhel9_sbsa" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rezso/ML", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rezso/ML", "result_dir": "09294252-cuda-gcc-11", "built_packages": "cuda-gcc-11-c++-debuginfo 11.5.0\ncuda-gcc-11-gfortran 11.5.0\ncuda-gcc-11-debugsource 11.5.0\ncuda-gcc-11-c++ 11.5.0\ncuda-gcc-11-debuginfo 11.5.0\ncuda-gcc-11-gfortran-debuginfo 11.5.0\ncuda-gcc-11 11.5.0", "id": 9294252, "mockchain_macros": { "copr_username": "rezso", "copr_projectname": "ML", "vendor": "Fedora Project COPR (rezso/ML)" } } ] } [2025-07-21 10:25:14,067][ INFO][PID:330130] Sending fedora-messaging bus message in build.end [2025-07-21 10:25:14,112][ INFO][PID:330130] Compressing /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/builder-live.log by gzip [2025-07-21 10:25:14,117][ INFO][PID:330130] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/builder-live.log' as PID 860050 [2025-07-21 10:25:14,414][ INFO][PID:330130] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/builder-live.log) [2025-07-21 10:25:14,415][ INFO][PID:330130] Compressing /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/backend.log by gzip [2025-07-21 10:25:14,417][ INFO][PID:330130] Running command 'gzip /var/lib/copr/public_html/results/rezso/ML/fedora-rawhide-x86_64/09294252-cuda-gcc-11/backend.log' as PID 860088