Vm-dev November 2023

vm-dev@lists.squeakfoundation.org

17 participants
42 discussions

[OpenSmalltalk/opensmalltalk-vm] mmap() sqUnixSpurMemory patch (Issue #665)
by David Stes 03 Mar '24

03 Mar '24

Hi, I have sent in the past email to Eliot Miranda about an issue which I discovered in August 2021 (two years ago), and I thought to raise an issue here. It is a Linux/UNIX patch issue with the behavior of the mmap() system call or library call as used by the OpenSmalltalk COG vm. When way back in 2021 some changes were made for Linux ARM8 to the file saUnixSpurMemory.c I reported that this was breaking the Solaris 11.3 build. Curiously the Solaris 11.4 build was still working fine. I think (I don't know) that perhaps the behavior of mmap() on Solaris 11.4 is slightly diferent than on 11.3, to match (perhaps) the Linux kernel behavior of mmap(). An idea that I have is to ask some UNIX guru's whether there exist a autoconf-archive (configure script) test or script to test the behavior of mmap() for portability. However here I will just report what the issue is : since august 2021 I am building succesfully on Solaris with the following patch ``` --- opensmalltalk-vm-sun-v5.0.34/platforms/unix/vm/sqUnixSpurMemory.c Fri Aug 13 19:54:42 2021 +++ p0/opensmalltalk-vm-sun-v5.0.34/platforms/unix/vm/sqUnixSpurMemory.c Sun Aug 15 14:11:58 2021 @@ -277,16 +277,21 @@ { void *hint = sbrk(0); // a hint of the lowest possible address for mmap void *result; + char *address; + unsigned long alignment; pageSize = getpagesize(); pageMask = ~(pageSize - 1); + alignment = max(pageSize,1024*1024); + address = (char *)(((usqInt)hint + alignment - 1) & ~(alignment - 1)); + #if !defined(MAP_JIT) # define MAP_JIT 0 #endif *desiredSize = roundUpToPage(*desiredSize); - result = mmap(hint, *desiredSize, + result = mmap(address, *desiredSize, #if DUAL_MAPPED_CODE_ZONE PROT_READ | PROT_EXEC, #else ``` I really need Eliot's help on this. Eliot : what I did was try to understand your code and you seem to make some alignment calculations on the desired memory location that you request through mmap(). I believe that the traditional UNIX mmap() or the Solaris 10 and Solaris 11.3 mmap() is reacting slightly differently to the requested memory "hint". By some experimentatoin and debugging I found the above patch, which I wrote based on looking at your code and try to mirror the calculations that you are doing, which are not fully symmetric. By copying some code, I discovered that with the above patch the build for both Solaris 11.3 and Solaris 11.4 are working fine again. I think this is a general UNIX issue that could be of interest to all UNIX software. If an autoconfigure autoconf-archive test would exist to test the behavior of mmap() then that could be dealt in all software that uses mmap() with anonymous memory mapping. As far as I know the history of the mmap() call is that it originated in the world of Sun and Solaris and is since a very long time present in Linux as well, and I think some improvements in Linux where then backported to Solaris 11.4. That would explain why the current OpenSmalltalk-VM code works fine on Solaris 11.4. For reasons of portability to all flavors of UNIX and Linux, I think a configure build test for the code could benefit portability of your Cog VM. Let us know please what you think. I could simply submit my patch as a patch to mainstream upstream OpenSmalltalk but I don't know your opinion about it. And the way I have been using it as a platform specific patch (that I apply prior to the build on Solaris) is fine for me as well. Regards, David Stes -- Reply to this email directly or view it on GitHub: https://github.com/OpenSmalltalk/opensmalltalk-vm/issues/665 You are receiving this because you are subscribed to this thread. Message ID: <OpenSmalltalk/opensmalltalk-vm/issues/665(a)github.com>

4 19

Unit Test Failures on VM Candidate
by ken.dickey＠whidbey.com 29 Dec '23

29 Dec '23

Raspberry Pi 4; Raspian Linux; Latest Cuis; squeak.cog.sput aarch64 VM built from opensmalltalk-vm-202311211431.tar.gz Current unit tests mostly show green, but repeated runs fail on _separate_ trials for 'ProcessTerminateUnwindNonLocalReturn>>#test3DResume' 'ProcessTerminateBug>>#testTerminationDuringNestedUnwind7' 'ProcessTerminateBug>>#testTerminationDuringNestedUnwind4' Any ideas on cause and how to fencepost? Thanks, -KenD

2 1

Please test | Relase candidate for OSVM 2023
by Taeumel, Marcel 21 Dec '23

21 Dec '23

Hi all -- Please test this VM version (includes a small change log): https://github.com/OpenSmalltalk/opensmalltalk-vm/releases/tag/202311211431 Choose your preferred platform. Focus on cog.spur flavors for 64-bit machines. Thank you! Best, Marcel

9 26

[OpenSmalltalk/opensmalltalk-vm] Crash in macOS ARM upon disabling primitive mixed-arithmetics handling (Issue #667)
by Cristián Pérez 08 Dec '23

08 Dec '23

Hi folks, First some context: - I'm working on an M1 Pro, macOS 14.1, **no Rosetta**, fully native. - This was first discovered on **Cuis** but I reproduced it in **Squeak** as well. - I'm using the latest release of the VM from this repository while using Cuis. For Squeak I'm using the latest AIO release. I've tried to disable primitive mixed-arithmetics handling by the two following ways, getting the same results. ```smalltalk Smalltalk vmParameterAt: 48 put: 64 ``` ```smalltalk Smalltalk vmParameterAt: 75 put: false ``` Here is the trace I get when it crashes ``` C stack backtrace & registers: x0 0x104908657 x1 0x10f7c1b70 x2 0x0 x3 0x104940010 x4 0x1b588bb3 x5 0x10492e940 x6 0x11345d358 x7 0x1126efcd8 x8 0x259 x9 0x10f795690 x10 0x10f7c1b00 x11 0x112200000 x12 0x50 x13 0x50 x14 0x10493f000 x15 0x10f7c1b00 x16 0x10492be50 x17 0x7 x18 0x10493fff0 x19 0x0 x20 0x0 x21 0x113389900 x22 0x10491f000 x23 0x10491f000 x24 0x10491f000 x25 0x10491f000 x26 0x10491f000 x27 0x10492bd38 x29 0x0 fp 0x10491f000 lr 0x16b598db0 sp 0x104815aa0 0 ??? 0x000000010f795690 0x0 + 4554577552 1 Squeak 0x0000000104898c9c reportStackState + 840 2 Squeak 0x0000000104899020 sigsegv + 240 3 libsystem_platform.dylib 0x0000000186b33a24 _sigtramp + 56 4 Squeak 0x0000000104815aa0 returntoExecutive + 128 5 Squeak 0x000000010481b0e8 ceSendsupertonumArgs + 1084 6 ??? 0x000000010f794178 0x0 + 4554572152 7 Squeak 0x0000000104809268 interpret + 660 8 Squeak 0x000000010489a488 -[sqSqueakMainApplication runSqueak] + 424 9 Foundation 0x0000000187d99aac __NSFirePerformWithOrder + 296 10 CoreFoundation 0x0000000186be10a0 __CFRUNLOOP_IS_CALLING_OUT_TO_AN_OBSERVER_CALLBACK_FUNCTION__ + 36 11 CoreFoundation 0x0000000186be0f8c __CFRunLoopDoObservers + 532 12 CoreFoundation 0x0000000186be05bc __CFRunLoopRun + 776 13 CoreFoundation 0x0000000186bdfc5c CFRunLoopRunSpecific + 608 14 HIToolbox 0x0000000191159448 RunCurrentEventLoopInMode + 292 15 HIToolbox 0x00000001911590d8 ReceiveNextEventCommon + 220 16 HIToolbox 0x0000000191158fdc _BlockUntilNextEventMatchingListInModeWithFilter + 76 17 AppKit 0x000000018a3bac54 _DPSNextEvent + 660 18 AppKit 0x000000018ab90ebc -[NSApplication(NSEventRouting) _nextEventMatchingEventMask:untilDate:inMode:dequeue:] + 716 19 AppKit 0x000000018a3ae100 -[NSApplication run] + 476 20 AppKit 0x000000018a3853cc NSApplicationMain + 880 21 dyld 0x00000001867890e0 start + 2360 ``` -- Reply to this email directly or view it on GitHub: https://github.com/OpenSmalltalk/opensmalltalk-vm/issues/667 You are receiving this because you are subscribed to this thread. Message ID: <OpenSmalltalk/opensmalltalk-vm/issues/667(a)github.com>

6 16

Re: [SqueakJS] Smalltalk Debugger support
by Thiede, Christoph 04 Dec '23

04 Dec '23

Hi Vanessa, I think this might be caused by a known issue that is tracked here: https://github.com/squeak-smalltalk/squeak-object-memory/issues/92 How exactly did you invoke the debugger? How does your process browser look before and after the invocation? Best, Christoph ________________________________ Von: vm-dev-request(a)lists.squeakfoundation.org <vm-dev-request(a)lists.squeakfoundation.org> Gesendet: Samstag, November 25, 2023 12:31:49 PM An: vm-dev(a)lists.squeakfoundation.org <vm-dev(a)lists.squeakfoundation.org> Betreff: Vm-dev Digest, Vol 209, Issue 21 Send Vm-dev mailing list submissions to vm-dev(a)lists.squeakfoundation.org To subscribe or unsubscribe via email, send a message with subject or body 'help' to vm-dev-request(a)lists.squeakfoundation.org You can reach the person managing the list at vm-dev-owner(a)lists.squeakfoundation.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Vm-dev digest..."

6 11

Fwd: inaccessible packages?
by Florin Mateoc 30 Nov '23

30 Nov '23

Sorry, I did not mean to only reply to Dave, forwarding to the list as well ---------- Forwarded message --------- From: Florin Mateoc <florin.mateoc(a)gmail.com> Date: Wed, Nov 29, 2023 at 11:02 PM Subject: Re: [Vm-dev] inaccessible packages? To: <lewis(a)mail.msen.com> Hi Dave, Thank you for the prompt reply and fix. It does not work yet, as the new address uses https and the code has a check "urlString beginsWith: 'http://'", can we use http instead? Best, Florin On Tue, Nov 28, 2023 at 10:09 PM <lewis(a)mail.msen.com> wrote: > Hi Florin, > > Thanks to Marcel for identifying the issue. The ss3.gemstone.com > repository has a new address at ss3.gemtalksystems.com, so I updated the > VMMaker 'update' configuration to point to this new address. > > The latest configuration map at > http://source.squeak.org/VMMaker/update-dtl.26.mcm should be working > again now. > > Please reply here if there are any further issues, and thank you very much > for reporting the problem. > > Dave > > > On 2023-11-25 21:47, lewis(a)mail.msen.com wrote: > > It looks like ss3.gemstone.com has gone off line for some reason, I can't > even ping it right now. > > If it does not come back we can put a copy of those packages somewhere > else for safe keeping. > > Dave > > > On 2023-11-25 21:15, Florin Mateoc wrote: > > > > Hi, > > For the last couple of weeks, I cannot load anymore Dave's "update" lineup > in VMMaker, because of some packages stored on ss3.gemstone.com (FreeType > and FreeTypeConstants). > I get a ConnectionRefused: Cannot connect to #[204 246 122 142] > > This used to work. Has something changed, or am I doing something wrong? > > Thank you, > Florin > >

2 2

Who needs *pre-built* binaries for Ubuntu 18 or similar? (i.e. GLIBC < 2.29)
by Taeumel, Marcel 30 Nov '23

30 Nov '23

Hi all -- For GLIBC < 2.29, we have currently no simple means to provide pre-built binaries for OSVM via GitHub Actions since the oldest possible runner runs with Ubuntu 20.04. My feeling is that those of you who still work with older systems are also able to build OSVM on their own machine? Am I correct? https://github.com/OpenSmalltalk/opensmalltalk-vm/releases/tag/202311211431 https://github.com/OpenSmalltalk/opensmalltalk-vm/actions/runs/6945426781/j… https://lists.squeakfoundation.org/archives/list/vm-dev@lists.squeakfoundat… Best, Marcel

3 2

inaccessible packages?
by Florin Mateoc 29 Nov '23

29 Nov '23

Hi, For the last couple of weeks, I cannot load anymore Dave's "update" lineup in VMMaker, because of some packages stored on ss3.gemstone.com (FreeType and FreeTypeConstants). I get a ConnectionRefused: Cannot connect to #[204 246 122 142] This used to work. Has something changed, or am I doing something wrong? Thank you, Florin

4 6

[OpenSmalltalk/opensmalltalk-vm] The VM is no longer passing command line arguments to the image (Issue #668)
by Ezequiel Birman 29 Nov '23

29 Nov '23

# How to replicate: Run `<path to release candidate.app> <image> one two three four`. In my case: ` Then evaluate: ```Smalltalk | i a | i := 0. a := Smalltalk getSystemAttribute: i. [a notNil] whileTrue: [ Transcript showln: { i. a}. i := i + 1. a := Smalltalk getSystemAttribute: i ]. ``` # Expected behaviour as in the latest stable relase (2022) The transcript logs all command line arguments: > #(0 '/Users/eze/.local/src/Smalltalk/OpenSmalltalk/SqueakStable.app/Contents/MacOS/Squeak') > #(1 '/Users/eze/.local/src/Smalltalk/Squeak/Squeak6.0-22104-64bit.image') > #(2 'one') > #(3 'two') > #(4 'three') > #(5 'four') # Behaviour using the current release candidate VM The transcript logs only the vm executable and the image >#(0 '/Users/eze/.local/src/Smalltalk/OpenSmalltalk/SqueakRC.app/Contents/MacOS/Squeak') >#(1 '/Users/eze/.local/src/Smalltalk/Squeak/Squeak6.0-22104-64bit.image') Tested in both Cuis and Squeak. Might be related to #655. -- Reply to this email directly or view it on GitHub: https://github.com/OpenSmalltalk/opensmalltalk-vm/issues/668 You are receiving this because you are subscribed to this thread. Message ID: <OpenSmalltalk/opensmalltalk-vm/issues/668(a)github.com>

2 6

[OpenSmalltalk/opensmalltalk-vm] 1b15c7: Revert stupid delete in 5b064fc
by Tobias Pape 29 Nov '23

29 Nov '23

Branch: refs/heads/Cog Home: https://github.com/OpenSmalltalk/opensmalltalk-vm Commit: 1b15c7e0654934898eec152d231f87ab704d7040 https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/1b15c7e0654934898e… Author: Tobias Pape <tobias(a)netshed.de> Date: 2023-11-29 (Wed, 29 Nov 2023) Changed paths: M platforms/iOS/vm/OSX/sqSqueakOSXApplication.m Log Message: ----------- Revert stupid delete in 5b064fc Fixes #668. No cookie for @krono today.

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev November 2023