source-building .NET 11 vmr crashes during fsharp build on ppc64le

[tmds]

I'm doing builds of the vmr main (.NET 11) branch on ppc64le with a cross-compiled ppc64le SDK.

The builds are overflowing the stack.

I ran into this situation on s390x too. Here changing Mono to allocate 8MB of stack instead of 2MB fixed the issue.

I tried the same on ppc64le, but that did not help. I increased the stack size to 16MB, but the stack overflow remains.

SP:

(gdb) print/x $r1                                                                                                                                     
$1 = 0x7fffe8e20010                                                                                                                                   

proc maps:

7fffe8e10000-7fffe8e20000 ---p   (guard page)
7fffe8e20000-7fffe9e20000 rw-p   (stack)

Per #19285 (comment), the F# compiler recently changed to use .NET's RuntimeHelpers to check that stack space is remaining. This logic is meant to prevent these overflows.

cc @dotnet/fsharp @majocha @jkotas @akoeplinger

[tmds]

Per #19285 (comment), the F# compiler recently changed to use .NET's RuntimeHelpers to check that stack space is remaining. This logic is meant to prevent these overflows.

I'll take a closer look at this next week.

[jkotas]

RuntimeHelpers to check that stack space is remaining. This logic is meant to prevent these overflows.

Sounds like a bug in Mono implementation of these APIs.