Vm-dev June 2007

vm-dev@lists.squeakfoundation.org

20 participants
40 discussions

Profiling and delay accuracy
by Andreas Raab 06 Aug '11

06 Aug '11

Hi Folks - For a long time now I had this feeling that MessageTally reports pretty bogus results in many situations without being able to precisely track down why this would be the case. Today I was looking at primitiveResponse() and, much to my surprise, noticed that the checkForInterrupts() that used to be there for years is gone (see Squeak3.6 for example which still has it). The sole reason for this check was to get both high delay accuracy and good profiling behavior. Consider this example: fc := FormCanvas on: Display. MessageTally spyOn:[ 1 to: 100 do:[:i| fc fillColor: Color white. fc printString. ]. ]. Using 3.6 this will be measured correctly as: **Tree** 87.5% {243ms} FormCanvas>>fillColor: |87.5% {243ms} GrafPort>>fillRect:offset: | 87.5% {243ms} GrafPort>>copyBits 12.5% {35ms} FormCanvas(Object)>>printString 12.5% {35ms} FormCanvas(Object)>>printStringLimitedTo: whereas the 3.10 reports it as **Tree** 99.6% {670ms} FormCanvas(Object)>>printString 94.9% {639ms} primitives 4.6% {31ms} FormCanvas(Object)>>printStringLimitedTo: I think you can see the problem and just imagine what this does to any cumulative results. I also wonder what that change does to platforms that don't have high-resolution asynchronous timers. This used to be the one place where we would catch timer changes at high resolution and unless the platform forces high resolution timer interrupts asynchronously (by resetting the interrupt counter) we must be loosing a lot in terms of delay accuracy. (it just so happens that the Windows VM *does* do asynchronous timer interrupts so I never noticed this but I'm very curious about the difference on Linux which typically still has pretty bad timer granularity). Any opinions? My feeling is that the timer check should go back in for all of the above reasons. At the very least a quickCheckForInterrupt() is required but I actually think putting the full check back in is worth it. Cheers, - Andreas

3 3

Joys of Squeak-dev image, VM Compiling on MacIntel and Spoon remote OtherBrowsing
by Ken G. Brown 16 Nov '10

16 Nov '10

MacPro OS X 10.4.9 Xcode 2.4.1 Squeak-dev-114-2, VMMaker 2.8b6.1, Squeak 3.8.15beta6U.app, and version 1657 of svn MacOS VM sources, and Spoon v2a12. Downloaded http://www.squeakvm.org/cgi-bin/viewcvs.cgi/ trunk version 1657 for MacOS Ran squeak-dev-beta-114-2.image on Squeak 3.8.15beta6U.app Loaded VMMaker 3.8b6.1 from dev image Universes. Generated vm sources by following instructions in <http://www.squeakvm.org/cgi-bin/viewcvs.cgi/trunk/platforms/Mac%20OS/vm/Doc…> Fought with Xcode wanting to use MacOSX10.3.9.sdk for ppc which was giving an error which was known and documented in the Readme. Finally figured out what Xcode wanted so built universal app just using 10.4.9 sdk. Couple issues: Exupery references remain in sqnamedPrims.h and sqPlatformSpecific.h from svn version 1657, I just commented them out. Notes said: Info-NPSqueak__Upgraded_.plist was to be found in the Developer directory. I could not find it so scammed a info.plist out of John's Squeak 3.8.15beta6U.app vm. Not sure what impact this has. And much, much diddling about figuring out various things... Finally got a build. It's a lot smaller (3.9MB) than John McIntosh's Squeak 3.8.15beta6U.app (8.1MB), and it looks like it is a PowerPC one but at least it runs. I'll look into the Xcode build process some more. Then: Replaced interp.c with Craig's interp.c for Spoon, rebuilt and got a VM with Spoon client stuff. Downloaded Spoon release 2a12. Moved a copy of Flow plugin from within Craig's naiad.app package into a plugins subdirectory where the new spoon client compatible MacIntel universal VM was run from. Followed Craig's Spoon instructions for loading niaid.st and niaid.pr into the 3.10 image (Squeak-dev-114-2) running on the new VM. Did the run spoon.app thing from Spoon.dmg (version 2a12), needs to be done twice if Safari is not running. Got Spoon processor running. Followed instructions again in the Spoon client and lo! Got OtherBrowser browsing the Spoon memory running on processor. Yay Craig! Who do i get to sign my certificate? :) Ken

4 7

32bit clean VM work.
by John M McIntosh 15 Jul '07

15 Jul '07

Some of you might know that David T. Lewis has been working on changes to the VM source to make it work fully within 32 or 64 bit address spaces. As we know the Squeak VM treated memory address which are unsigned values as signed integer values. This wrong usage of signed math in compare statments or do loops which would cause the VM to make an incorrect decision resulting in corrupted memory and causing the VM to crash. This issue would usually occur if you wanted to use 1GB of memory for your VM and the host operating system would then allocate memory for you above the 2GB boundary, or at say the 1.5GB boundary. Resulting either in an instant crash, or a crash much later when your memory needs caused the VM to grow over the 2GB boundary. Some fixes were done in the past to make the VM mostly run when fully over the 2GB boundary but at best they were insufficient patches. Over the last couple of days I reviewed David Lewis' changes, plus made some fixes, and revised the macintosh os-x support files, plus worked up some general test cases to see what happens when you run the macro bench marks below the 2GB boundary, crossing the 2GB boundary, and when the image is allocated at the 3GB boundary. This afternoon I'm pleased to say the VM passed all runs of my trivial test cases, so I have check in the Mac OS carbon source code changes and David's changes to the Mac OS source tree for further review. People wanting to build a VM should review the Mac OS build instructions to build a Mac OS carbon VM, or review the required changes to VMMaker as per the Carbon VM build readme to build a 32bit clean VM. I have not: (a) build a 64 bit VM and tested it. VM developers should consider the mmap call in the memory allocation routine, you can specify a suggested starting position. On OS-X I was able to chose 1GB, 1.5GB, 2GB and 3GB. I have not tested 64bit VMs at the 0x8000000000000000 boundary. I suspect you could allocate at the 0x7FFFFFFFF0000000 Then ask for 600MB of memory for the image. That would set the end of memory at 0x8000000015800000, 344MB over the negative sign boundary. (b) I have not tested or reviewed any of the external plugins for improper use of usqInt. (c) I have not confirmed the changes work with the Unix VM, or the Windows VM, I have no plans to do so. -- ======================================================================== === John M. McIntosh <johnmci(a)smalltalkconsulting.com> Corporate Smalltalk Consulting Ltd. http://www.smalltalkconsulting.com ======================================================================== ===

7 16

linux 64bit vm running a 32 bit images - networking vm crash
by tom 01 Jul '07

01 Jul '07

hi, i am running a 64bit vm (elf64 / x86_64) linux, no i have no 32bit compat x11 libs and i dont want to have them... the vm crashes on any network operation, any clues? Program received signal SIGSEGV, Segmentation fault. 0x0000000000416711 in byteSizeOf (oop=-1398317376) at gnu-interp.c:2902 2902 header = longAt(oop); (gdb) bt #0 0x0000000000416711 in byteSizeOf (oop=-1398317376) at gnu-interp.c:2902 #1 0x00000000004a376d in primitiveResolverStartNameLookup () at .../platforms/unix/src/vm/intplugins/SocketPlugin/SocketPlugin.c:318 #2 0x0000000000416e76 in dispatchFunctionPointer (aFunctionPointer=0xaca75ec0) at gnu-interp.c:3953 #3 0x0000000000416e76 in dispatchFunctionPointer (aFunctionPointer=0xaca75ec0) at gnu-interp.c:3953 #4 0x000000000042abb1 in interpret () at gnu-interp.c:7761 #5 0x0000000000415609 in main (argc=<value optimized out>, argv=0x7fff3fd1cce8, envp=<value optimized out>) ...platforms/unix/vm/sqUnixMain.c:1379 Segmentation fault 23308044 [] in >addressForName:timeout: 23308136 [] in Semaphore>critical: 23307768 BlockContext>ensure: 23307676 Semaphore>critical: 23306908 >addressForName:timeout: 23299436 >httpGetDocument:args:accept:request: 23303844 >httpGet:args:accept:request: 23303380 >httpGet:args:user:passwd: 23303012 MCHttpRepository>allFileNames 23302896 MCFileBasedRepository>allFileNamesOrCache 23302788 MCFileBasedRepository>readableFileNames 23302696 MCFileRepositoryInspector>refresh 23302540 MCFileRepositoryInspector>setRepository:workingCopy: 23302356 >repository:workingCopy: 23302264 MCFileBasedRepository>morphicOpen: 23302448 [] in MCWorkingCopyBrowser>openRepository 23302172 Object>ifNotNilDo: 23302080 MCWorkingCopyBrowser>openRepository 23301620 PluggableButtonMorph>performAction 23301436 PluggableButtonMorphPlus>performAction 23301528 [] in PluggableButtonMorph>mouseUp: 23301344 SequenceableCollection>do: 23301252 PluggableButtonMorph>mouseUp: 23301120 PluggableButtonMorphPlus>mouseUp: 23301028 Morph>handleMouseUp: 23300936 MouseButtonEvent>sentTo: 23300568 Morph>handleEvent: 23300476 Morph>handleFocusEvent: 23300660 [] in HandMorph>sendFocusEvent:to:clear: 23300752 [] in PasteUpMorph>becomeActiveDuring: 23300384 BlockContext>on:do: 23300292 PasteUpMorph>becomeActiveDuring: 23300016 HandMorph>sendFocusEvent:to:clear: 23299924 HandMorph>sendEvent:focus:clear: 23299832 HandMorph>sendMouseEvent: 23299344 HandMorph>handleEvent: 23293552 HandMorph>processEvents 23293668 [] in WorldState>doOneCycleNowFor: 23293460 SequenceableCollection>do: 23293368 WorldState>handsDo: 23293276 WorldState>doOneCycleNowFor: 23291300 WorldState>doOneCycleFor: 23291208 PasteUpMorph>doOneCycle 14434012 [] in >spawnNewProcess 14434196 [] in BlockContext>newProcess thanks in andvance ;) __________________________________ Kennt man wirklich jeden über 3 Ecken? Die Antworten gibt's bei Yahoo! Clever. www.yahoo.de/clever

11 23

sever prohibits download of some 64bit VM files
by Joerg Beekmann 27 Jun '07

27 Jun '07

I wanted to explore the 64bit VM work at: http://www.squeakvm.org/squeak64/. I thought I would try and build a VM for my intel Mac. I started by trying to download all the files that seem to be necessary. However when trying to download the change set for VM Maker I get the following: Forbidden You don't have permission to access /squeak64/dist3/ChangeSets/VMMaker-tpr.14.mcz on this server. Is this intentional? Do I need this? Joerg

1 0

Unix UTF8 input
by Chris Petsos 26 Jun '07

26 Jun '07

I've read many reports on how one can add an utf8 input mechanism in the unix vm of Squeak... tried to do the trick with the -eventenc parameter but that didn't work in the latest release. Does anyone have a compiled VM that supports this parameter? Source code would also be desirable to see what's going on there... If i am getting this right, ideally we will want for characters to enter the image in UTF-8 representation and interpret them there... This should be done by setting -eventenc UTF-8 Thanks in advance... Christos.

3 12

Re: [Vm-dev] Howto invoke plugin primitive from Interpreter?
by André Wendt 25 Jun '07

25 Jun '07

John M McIntosh schrieb: > > Well as already noted I've code that does what you want if you want > to do it in the vm. > > via http://www.smalltalkconsulting.com/squeak.html > > look on my idisk, or ftp site (I think) in the experimental folder, > then the MessageLoggingVM folder. > > David T Lewis also gave me code to enable the use of SIGNALS via > OSProcess plugin to let you use the unix signal > logic to turn on/off tracing and modify what it was doing. I just realized it was quite rude of me to not thank for this help. I really appreciated all the hints! Thanks, André

1 0

Linux VM and Delay.
by Gary Chambers 25 Jun '07

25 Jun '07

Hello all. I have noticed some discrpancies in the Linux VM as opposed to the Win32 VM. Here is a summary (was on squeak-dev): ---------------------------- Hi all. Does anybody know why, on the Linux VM (3.9.8), short Delays (<500ms) wait for significantly longer than under Windows (3.10.4)? As an example for the average time spent waiting when requesting a 10ms wait: ((1 to: 100) collect: [:i | Time millisecondsToRun: [(Delay forMilliseconds: 10) wait]]) sum / 100.0 This yields (on my machine) 10.35 for Windows and 43.48 for Linux. For a 100ms wait: 100.5 (Windows) and 131.39 (Linux). For a 1000ms wait: 1000.36 (Windows) and 1013.16 (Linux). There seems to be a fixed overhead per call that is significantly larger under Linux. Any thoughts would be appreciated. ------------------------------ Even with a loadavg (via uptime) of around 0.01 it was still around 44ms (for a 10ms delay) for me. Found the culprit though... In sqUnixMain.c sqInt ioRelinquishProcessorForMicroseconds(sqInt us) { int now; dpy->ioRelinquishProcessorForMicroseconds(us); now= ioLowResMSecs(); if (now - lastInterruptCheck > (1000/25)) /* avoid thrashing intr checks from 1ms loop in idle proc */ { setInterruptCheckCounter(-1000); /* ensure timely poll for semaphore activity */ lastInterruptCheck= now; } return 0; } Note the (1000/25) which equals 40ms, around the same as the latency. Called from #relinquishProcessorForMicroseconds: in ProcessorScheduler, By the the idle process with a 1000 microsecond value. This reliquishes the processor for the 1000 microseconds then doesn't check for interrupts (including Pending delay semaphores) until at least 40ms have passed. Perhaps this could be made into a VM parameter?

4 7

primitiveResponse questions
by Andreas Raab 22 Jun '07

22 Jun '07

Hi There - I'm looking at the Croquet branch of VMMaker here (which is derived from 3.8b4 or so) and I have two questions about primitiveResponse: 1) The comment in primitiveResponse states that: "NB: tpr removed the timer checks here and moved them to the primitiveExternalCall method." I can't find the timer check, what am I missing? 2) The code in internalExecuteNewMethod says: "self primitiveResponse. <-replaced with manually inlined code" Why is this code manually inlined? I don't see anything particularly problematic in primitiveResponse. Thanks, - Andreas

1 0

First greek EToys image...
by Chris Petsos 19 Jun '07

19 Jun '07

Guys this is the first experimantal version of a greek EToys image... http://users.kef.sch.gr/chrispetsos/etoys-2.0-1315.zip Of course it bundles with the latest unicode VM... http://www.squeakvm.org/win32/release/SqueakVM-Win32-3.10.4-bin.zip Try it out if you want... The thing i want to answer is if anyone has a clue why every time i open the image it turns the locale back to english, despite the fact that i've saved it with the locale turned to greek ('el'). Christos.

2 1

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev June 2007