Branch: refs/heads/main
Revision: a364123
Author: ronawho
Log Message:
Merge pull request #18245 from ronawho/disable-gn-odp-by-default
Disable on-demand-paging for gasnet-ibv
[reviewed by @gbtitus]
We have run into Bug 4008 – testreadonly failure with ibv/odp,
which is an issue when using on-demand-paging (ODP) on readonly memory.
Most of the time communication occurs out of our registered heap where
registration is done statically under ibv-fast or dynamically with the
firehose registration library under ibv-large. For either of these
configurations if communication is outside the registered heap gasnet
may try to use ODP to satisfy the communication. As reported in the
gasnet bug, using ODP on readonly memory can lead to errors. In Chapel
this typically happens when GET'ing values from the static data segment
or something, which was the original motivation for gasnet's 'readonly'
test case mentioned in that bug.
Until the upstream bug is resolved disable ODP, which will result in
gasnet falling back to using firehose dynamic registration for out of
segment comm. We depend on firehose anyways for ibv-large so I don't
expect any performance regressions for this or anything.
Modified Files:
M third-party/gasnet/Makefile
M util/cron/common-slurm-gasnet-cray-cs.bash
M util/cron/test-gasnet-ibv.bash
M util/cron/test-perf.cray-cs-hdr.arkouda.bash
M util/cron/test-perf.cray-cs-hdr.arkouda.release.bash
M util/cron/test-perf.cray-cs-hdr.gasnet-ibv.large.bash
Compare: https://github.com/chapel-lang/chapel/compare/3c6d18a2dba4...a364123d2bd2