# \[Chapel GA Tests\] 2026-10-13

**URL:** <https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133>\
**Category:** Nightly Testing\
**Created:** [October 13, 2026, 2:03pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133 "2026-10-13T14:03:14Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![chapelhpcBot](https://avatars.discourse-cdn.com/v4/letter/c/7feea3/32.png) [@chapelhpcBot](https://chapel.discourse.group/u/chapelhpcBot)\
**Post date:** [October 13, 2026, 2:03pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/1 "2026-10-13T14:03:14Z")

</div>

### The following GitHub Actions jobs failed:

- [full-checks / test-make-install-check](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189013507), step: "run test-make-install-check.bash"
- [extended-checks / arkouda-release-smoke-test / arkouda-smoke-test](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189013701), step: "install Arkouda deps (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.24)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079897), step: "build Apptainer image for config alpine-3.24 (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.23-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079909), step: "build Apptainer image for config alpine-3.23-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (fedora-44)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079936), step: "build Apptainer image for config fedora-44 (retrying)"
- [full-checks / portability-tests-apptainer (ubuntu-jammy-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079943), step: "build Apptainer image for config ubuntu-jammy-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (ubuntu-resolute)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079946), step: "build Apptainer image for config ubuntu-resolute (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.23)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079954), step: "build Apptainer image for config alpine-3.23 (retrying)"
- [full-checks / portability-tests-apptainer (rockylinux-10-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079961), step: "build Apptainer image for config rockylinux-10-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (arch)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079964), step: "build Apptainer image for config arch (retrying)"
- [full-checks / portability-tests-apptainer (almalinux-9-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079965), step: "build Apptainer image for config almalinux-9-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (ubuntu-noble-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079971), step: "build Apptainer image for config ubuntu-noble-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (debian-trixie-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079982), step: "build Apptainer image for config debian-trixie-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (fedora-43-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079984), step: "build Apptainer image for config fedora-43-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (ubuntu-jammy)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079987), step: "build Apptainer image for config ubuntu-jammy (retrying)"
- [full-checks / portability-tests-apptainer (arch-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079988), step: "build Apptainer image for config arch-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (almalinux-10)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079989), step: "build Apptainer image for config almalinux-10 (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.24-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079991), step: "build Apptainer image for config alpine-3.24-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (rockylinux-8-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189079996), step: "build Apptainer image for config rockylinux-8-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (debian-trixie)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080013), step: "build Apptainer image for config debian-trixie (retrying)"
- [full-checks / portability-tests-apptainer (almalinux-10-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080017), step: "build Apptainer image for config almalinux-10-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (amazonlinux-2023-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080019), step: "build Apptainer image for config amazonlinux-2023-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (fedora-44-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080024), step: "build Apptainer image for config fedora-44-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (rockylinux-8)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080042), step: "build Apptainer image for config rockylinux-8 (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.22-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080043), step: "build Apptainer image for config alpine-3.22-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (opensuse-leap-16.0-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080044), step: "build Apptainer image for config opensuse-leap-16.0-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (almalinux-9)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080050), step: "build Apptainer image for config almalinux-9 (retrying)"
- [full-checks / portability-tests-apptainer (opensuse-leap-16.0)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080060), step: "build Apptainer image for config opensuse-leap-16.0 (retrying)"
- [full-checks / portability-tests-apptainer (amazonlinux-2023)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080061), step: "build Apptainer image for config amazonlinux-2023 (retrying)"
- [full-checks / portability-tests-apptainer (debian-bookworm-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080066), step: "build Apptainer image for config debian-bookworm-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.21-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080069), step: "build Apptainer image for config alpine-3.21-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (centos-stream-9)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080072), step: "build Apptainer image for config centos-stream-9 (retrying)"
- [full-checks / portability-tests-apptainer (fedora-43)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080089), step: "build Apptainer image for config fedora-43 (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.21)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080096), step: "build Apptainer image for config alpine-3.21 (retrying)"
- [full-checks / portability-tests-apptainer (ubuntu-noble)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080098), step: "build Apptainer image for config ubuntu-noble (retrying)"
- [full-checks / portability-tests-apptainer (centos-stream-10-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080099), step: "build Apptainer image for config centos-stream-10-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (debian-bookworm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080101), step: "build Apptainer image for config debian-bookworm (retrying)"
- [full-checks / portability-tests-apptainer (centos-stream-10)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080118), step: "build Apptainer image for config centos-stream-10 (retrying)"
- [full-checks / portability-tests-apptainer (rockylinux-9)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080122), step: "build Apptainer image for config rockylinux-9 (retrying)"
- [full-checks / portability-tests-apptainer (almalinux-8-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080130), step: "build Apptainer image for config almalinux-8-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (almalinux-8)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080142), step: "build Apptainer image for config almalinux-8 (retrying)"
- [full-checks / portability-tests-apptainer (rockylinux-9-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080174), step: "build Apptainer image for config rockylinux-9-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (alpine-3.22)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080193), step: "build Apptainer image for config alpine-3.22 (retrying)"
- [full-checks / portability-tests-apptainer (centos-stream-9-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080199), step: "build Apptainer image for config centos-stream-9-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (ubuntu-resolute-nollvm)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080204), step: "build Apptainer image for config ubuntu-resolute-nollvm (retrying)"
- [full-checks / portability-tests-apptainer (rockylinux-10)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115189080250), step: "build Apptainer image for config rockylinux-10 (retrying)"
- [full-checks / Chapel paratest with AddressSanitizer / Aggregate results (asan)](https://github.com/chapel-lang/chapel/actions/runs/38365342772/job/115333041481), step: "aggregate and report results"

Ran 877 total jobs at commit a6741b8d86a075af6210afad51821975bb0529be "Try adding a '.gpu-timeout' file for the SHOC Triad test as well (#29514)".

##### GitHub Actions run info:

- SHA: [a6741b8d86a075af6210afad51821975bb0529be](https://github.com/chapel-lang/chapel/commit/a6741b8d86a075af6210afad51821975bb0529be)
- Run ID: [38365342772](https://github.com/chapel-lang/chapel/actions/runs/38365342772)
- Run attempt: 1
- Run number: 72
- Triggering event name: schedule

---

<div class="post-metadata">

**Author:** ![annarift](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/annarift/32/656_2.png) [@annarift](https://chapel.discourse.group/u/annarift)\
**Post date:** [October 13, 2026, 4:43pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/2 "2026-10-13T16:43:02Z")

</div>

- 

ASAN failure is: [Error: Timed out executing program library/packages/UnitTest/doc-examples/Runner (execopts: 5)]  
\*  
Arkouda timed out installing deps  
\*  
The sample of apptainer failures I checked are `Failed to create mount namespace: mount namespace requires privileges, check Apptainer installation`. Almost certainly from updating to Ubuntu 26.04 runners (a week ahead of when the ubuntu-latest alias will change to it) in [Update `ubuntu-latest` runners to `ubuntu-26.04` now by arifthpe · Pull Request #29452 · chapel-lang/chapel · GitHub](https://github.com/chapel-lang/chapel/pull/29452).

---

<div class="post-metadata">

**Author:** ![annarift](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/annarift/32/656_2.png) [@annarift](https://chapel.discourse.group/u/annarift)\
**Post date:** [October 13, 2026, 4:50pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/3 "2026-10-13T16:50:50Z")

</div>

Oh, and I missed this one:

- 

test-make-install-check failed with `Disk quota exceeded`. I suspect this is probably also due to the runner change.

---

<div class="post-metadata">

**Author:** ![bradcray](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/bradcray/32/72_2.png) [@bradcray](https://chapel.discourse.group/u/bradcray)\
**Post date:** [October 13, 2026, 4:51pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/4 "2026-10-13T16:51:22Z")

</div>

I thought I saw a number of "disk full" errors as well?

-Brad

---

<div class="post-metadata">

**Author:** ![annarift](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/annarift/32/656_2.png) [@annarift](https://chapel.discourse.group/u/annarift)\
**Post date:** [October 13, 2026, 5:04pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/5 "2026-10-13T17:04:34Z")

</div>

Jinx!

anna

---

<div class="post-metadata">

**Author:** ![dal](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/dal/32/94_2.png) [@dal](https://chapel.discourse.group/u/dal)\
**Post date:** [October 13, 2026, 5:45pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/6 "2026-10-13T17:45:45Z")

</div>

```Chapel
-- stdout output is:
  -- verifying file...
       file='/__w/chapel/chapel/arkouda/dep/build/arrow_dependencies/zlib-1.3.1.tar.gz'
  
  -- stderr output is:
  CMake Error at zlib_ep-stamp/verify-zlib_ep.cmake:29 (message):
    error: SHA256 hash of
  
      /__w/chapel/chapel/arkouda/dep/build/arrow_dependencies/zlib-1.3.1.tar.gz
  
    does not match expected value
  
      expected: '9a93b2b7dfdac77ceba5a558a580e74667dd6fede4585b91eefb60f03b72df23'
        actual: '5df433cfa0be756ef7eb2bc0973514fa7b0b7724762c62fd732e1cab53a4d330'
  
  
  
  CMake Error at zlib_ep-stamp/zlib_ep-download-RELEASE-impl.cmake:9 (message):
    Command failed (1):
  
     '/usr/bin/cmake' '-P' '/__w/chapel/chapel/arkouda/dep/build/arrow-apache-arrow-19.0.1/cpp/build-release/zlib_ep-prefix/src/zlib_ep-stamp/verify-zlib_ep.cmake'

```

Just being super cautious here - is this what we normally expect to see when Arkouda times out installing deps?

---

<div class="post-metadata">

**Author:** ![annarift](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/annarift/32/656_2.png) [@annarift](https://chapel.discourse.group/u/annarift)\
**Post date:** [October 13, 2026, 6:06pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/7 "2026-10-13T18:06:06Z")

</div>

It was a bit inaccurate of me to call it a timeout, but yes this is expected for a network issue.

IIUC the download is getting interrupted so the resulting partially-downloaded tarball differs from expected. Or it could be that the download attempt is getting served an error page instead of a tarball, obliviously downloading that and then ofc has a different hash.

---

<div class="post-metadata">

**Author:** ![dal](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/dal/32/94_2.png) [@dal](https://chapel.discourse.group/u/dal)\
**Post date:** [October 13, 2026, 6:14pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/8 "2026-10-13T18:14:15Z")

</div>

I went through all the failures just to make sure there wasn't one that we missed and I only see the three failure modes that Anna captured in her first post(s).

---

<div class="post-metadata">

**Author:** ![jabraham](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/jabraham/32/430_2.png) [@jabraham](https://chapel.discourse.group/u/jabraham)\
**Post date:** [October 13, 2026, 6:27pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/9 "2026-10-13T18:27:46Z")

</div>

The make install errors are certainly due to the tmp file system shrinking

26:

```Chapel
+ df -h /tmp /home/runner/work/_temp /home/runner
Filesystem Size Used Avail Use% Mounted on
tmpfs 7.9G 38M 7.8G 1% /tmp
/dev/root 145G 54G 91G 38% /
/dev/root 145G 54G 91G 38% /

```

24:

```Chapel
+ df -h /tmp /home/runner/work/_temp /home/runner
Filesystem Size Used Avail Use% Mounted on
/dev/root 145G 60G 85G 42% /
/dev/root 145G 60G 85G 42% /
/dev/root 145G 60G 85G 42% /

```

I have a simple fix to just use a different tmp location which I will PR shortly

The apptainer issue seems to be caused by an older apptainer being used. I have a few potential workarounds I am looking at

-Jade

---

<div class="post-metadata">

**Author:** ![annarift](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/annarift/32/656_2.png) [@annarift](https://chapel.discourse.group/u/annarift)\
**Post date:** [October 13, 2026, 8:11pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/10 "2026-10-13T20:11:37Z")

</div>

> The apptainer issue seems to be caused by an older apptainer being used. I have a few potential workarounds I am looking at

One option (which may have already occurred to you) is to pin to 24.04, since it's pretty much irrelevant as the actual chpl testing is containerized. The downside is still that ubuntu-24.04 will eventually go away, and then someone will be forced to do a proper fix in the future.

---

<div class="post-metadata">

**Author:** ![jabraham](https://yyz2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/jabraham/32/430_2.png) [@jabraham](https://chapel.discourse.group/u/jabraham)\
**Post date:** [October 13, 2026, 8:17pm UTC](https://chapel.discourse.group/t/chapel-ga-tests-2026-10-13/52133/11 "2026-10-13T20:17:58Z")

</div>

The fix I added in [Attempt to fix apptainer and make-install CI failures with Ubuntu 26 by jabraham17 · Pull Request #29522 · chapel-lang/chapel · GitHub](https://github.com/chapel-lang/chapel/pull/29522) seems to work, so no worries there

-Jade
