[Chapel Merge] Skip pytorch testing on darwin

chapelhpcBot · March 11, 2025, 12:13am

Branch: refs/heads/main
Revision: 03af736b7a0541c947912e28f4243215dad8afea
Author: jabraham17
Link: Skip pytorch testing on darwin by jabraham17 · Pull Request #26887 · chapel-lang/chapel · GitHub
Log Message:
Skip pytorch testing on darwin (#26887)

Skip pytorch testing on darwin due to

github.com/chapel-lang/chapel

[Bug]: Python module fails to work with pytorch on Mac after threading changing

opened 11:12PM - 10 Mar 25 UTC

jabraham17

type: Bug

After https://github.com/chapel-lang/chapel/pull/26857, tests for the Python mod…ule that interop with pytorch on Mac now fail sporadically. There seems to be a race/mishandling of threads *somewhere*. Its not clear to me yet where the race/issue is (in our module code or in pytorch), but its readily reproducible in the default config on MacOS. To reproduce ```bash # on mac source util/setchplenv.bash make make test-venv start_test test/library/packages/Python/examples/torch/myModel.chpl --respect-skipifs --num-trials 10 ``` This segfaults on the first call that tries to use pytorch. Notably, the module imports are fine, it is later calls that are fine ```chapel proc main() { var interp = new Interpreter(); // imports from mymodel var myModelModule = interp.importModule("mymodel"); var myModelClass = myModelModule.get("MyModel"); // imports from torch var torch = interp.importModule("torch"); var tensor = torch.get("tensor"); var nn = interp.importModule("torch.nn"); var MSELoss = nn.get("MSELoss"); // create the model var model = myModelClass(); // this line segfaults var input_tensor = tensor([[1.0,]], kwargs=["requires_grad" => false]); // if you remove the previous line, this line segfaults writeln("Input tensor: ", input_tensor); ``` I am unable to reproduce this on linux64. Also note, if you do `brew install jemalloc` and use `CHPL_TARGET_JEMALLOC=system` on Mac it is no longer reproducible. This is also a direct result of #26857, using a Chapel prior to this change works just fine

[Reviewed by @DanilaFe]

Compare: Comparing 99348721ca5ee8ef312ab7271c7e9bcd8d67ff29...9e55a2d4ff4f3a3ba9dad13bcd44f917119a3067 · chapel-lang/chapel · GitHub

Diff:
M test/library/packages/Python/examples/torch/myModel.skipif
https://github.com/chapel-lang/chapel/pull/26887.diff