Vm-dev February 2012

vm-dev@lists.squeakfoundation.org

21 participants
54 discussions

ffi-test-main.c fails on FreeBSD
by Gary Dunn 12 Aug '16

12 Aug '16

In conjunction with getting Open Cobalt running on FreeBSD I have been looking into the problems with SqueakFFIPrims on FreeBSD and have reached a point that is beyond my understanding. I am not sure if the fix should come from the VM side or the FreeBSD port maintainer. I needed to get source code back into the ports tree so I did a make in /usr/ports/lang/squeak. I already had the 3.9 tarball, so that just repopulated the source and did the initial build. In the "files" folder I found patch files typical for a FreeBSD port. These patch source files from a generic tarball to work with FreeBSD. The one of interest was patch-platforms__unix__plugins__SqueakFFIPrims__ffi-config which contains ----x-----x----- --- platforms/unix/plugins/SqueakFFIPrims/ffi-config.org Wed Apr 26 20:27:53 2006 +++ platforms/unix/plugins/SqueakFFIPrims/ffi-config Wed Apr 26 20:29:00 2006 @@ -39,6 +39,7 @@ case ${abi} in linux) abi=sysv;; + freebsd*) abi=sysv;; darwin*) abi=darwin;; *) abi=libffi; lib="-lffi";; esac -----x-----x----- I then had the folder work/Squeak-3.9-7/platforms/unix/plugins/SqueakFFIPrims In it is a file 00README which explains how to test FFI. It says to run ffi-test-config but I have no such file. It says to type "make" to build a test suite but the build failed. It says to try with make CPU=any ABI=libffi LIB=-lffi which also failed. I traced the problem to the gcc search paths for includes and libraries -- turns out FreeBSD only searches /usr/include and /usr/lib when the required files are in /usr/local/include and /usr/local/lib. After some fiddling I finally had a "main" to test. It failed: ffi-test-main.c failed at line 361. Here is a bit from that file, ending with line 361: ffiInitialize(); for (ul= 0; ul < 15; ++ul) ffiPushSingleFloat(fa[ul]); GO(FFITypeSingleFloat, many); f= ffiReturnFloatValue(); ffiCleanup(); CHECK(f - ff < FLT_EPSILON); I worked out the CHECK macro but could not find what FLT_EPSILON is. At that point I decided to stop and come to you for help. Where do I go from here? -- Gary Dunn, Honolulu osp(a)aloha.com http://openslate.net/ http://e9erust.blogspot.com/ Sent from Slate001

5 8

Do we have the new primitive?? [WAS] Re: [Pharo-project] IdentitySet but using #hash rather than #identityHash ?
by Mariano Martinez Peck 16 Dec '15

16 Dec '15

> All I can say is that I am impressed by the numbers it is really much >> faster. >> I still don't understand why I send this email with a subject say >> IdentitySet because what I really need is a fast/large IdentityDictionary >> :( Anyway, there's a place where we can use this LargeIdentitySet in Fuel >> I think). >> >> So Levente, you say this is not possible to adapt this for dictionary? >> can >> we contact Eliot to provide such a primitive? >> > > As promised, I uploaded my LargeIdentityDictionary implementation to > http://leves.web.elte.hu/**squeak/**LargeIdentityDictionary.st<http://leves.web.elte.hu/squeak/LargeIdentityDictionary.st>. > The numbers will be a bit worse compared to LargeIdentitySet, because of > the lack of the primitive, but it's still 2-3x faster than other solutions > (IdentityDictionary, PluggableIdentityDictionary, subclassing, etc). I'm > about to propose this primitive with other improvements on the vm-dev list. > > Hi Eliot/Levente. What is the status of this? Do we have already the new primitive? If true, how can we adapt LargeIdentitySet to use such new primitive? Thanks! > > Levente > > >> thanks >> >> On Fri, Dec 16, 2011 at 3:28 PM, Levente Uzonyi <leves(a)elte.hu> wrote: >> >> On Fri, 16 Dec 2011, Henrik Sperre Johansen wrote: >>> >>> On 16.12.2011 03:26, Levente Uzonyi wrote: >>> >>>> >>>> >>>>> How about my numbers? :) >>>>> >>>>> "Preallocate objects, so we won't count gc time." >>>>> n := 1000000. >>>>> objects := Array new: n streamContents: [ :stream | >>>>> n timesRepeat: [ stream nextPut: Object new ] ]. >>>>> >>>>> set := IdentitySet new: n. >>>>> Smalltalk garbageCollect. >>>>> [1 to: n do: [ :i | set add: (objects at: i) ] ] timeToRun. "4949" >>>>> >>>>> set := LargeIdentitySet new. >>>>> Smalltalk garbageCollect. >>>>> [1 to: n do: [ :i | set add: (objects at: i) ] ] timeToRun. "331" >>>>> >>>>> set := (PluggableSet new: n) >>>>> hashBlock: [ :object | object identityHash * 4096 + object class >>>>> identityHash * 64 ]; "Change this to #basicIdentityHash in Pharo" >>>>> equalBlock: [ :a :b | a == b ]; >>>>> yourself. >>>>> Smalltalk garbageCollect. >>>>> [1 to: n do: [ :i | set add: (objects at: i) ] ] timeToRun. "5511" >>>>> >>>>> >>>>> I also have a LargeIdentityDictionary, which is relatively fast, but >>>>> not >>>>> as fast as LargeIdentitySet, because (for some unknown reason) we don't >>>>> have a primitive that could support it. If we had a primitive like >>>>> primitive 132 which would return the index of the element if found or >>>>> 0 if >>>>> not, then we could have a really fast LargeIdentityDictionary. >>>>> >>>>> >>>>> Levente >>>>> >>>>> Hehe yes, if writing a version fully exploiting the limited range, >>>> that's >>>> probably the approach I would go for as well. >>>> (IAssuming it's the version at http://leves.web.elte.hu/** >>>> squeak/LargeIdentitySet.st<htt**p://leves.web.elte.hu/squeak/** >>>> LargeIdentitySet.st<http://leves.web.elte.hu/squeak/LargeIdentitySet.st> >>>> > >>>> ) >>>> >>>> Mariano commented in the version at http://www.squeaksource.com/** >>>> FuelExperiments <http://www.squeaksource.com/**FuelExperiments<http://www.squeaksource.com/FuelExperiments>> >>>> that it's >>>> >>>> slow for them, which I guess is due to not adopting #identityHash calls >>>> to >>>> #basicIdentityHash calls for Pharo: >>>> ((0 to: 4095) collect: [:each | each << 22 \\ 4096 ]) asSet size -> 1 >>>> So it basically uses 1 bucket instead of 4096... Whoops. :) >>>> >>>> Uploaded a new version to the MC repository which is adapted for Pharo, >>>> on the same machine my numbers were taken from, it does the same test >>>> as I >>>> used above in 871 ms. (181 with preallocation). >>>> >>>> >>> Cool. One more thing: in Squeak the method using primitive 132 directly >>> was renamed to #instVarsInclude:, so now #pointsTo: works as expected. If >>> this was also added to Pharo, then the #pointsTo: sends should be changed >>> to #instVarsInclude:, otherwise Array can be reported as included even if >>> it wasn't added. >>> I'll upload my LargeIdentityDictionary implementation to the same place >>> this evening, since it's still 2-3 factor faster than other solutionts >>> and >>> there seem to be demand for it. >>> >>> >>> Levente >>> >>> >>> Cheers, >>>> Henry >>>> >>>> >>>> >>>> >>> >> >> -- >> Mariano >> http://marianopeck.wordpress.**com <http://marianopeck.wordpress.com> >> >> > -- Mariano http://marianopeck.wordpress.com

4 12

[CogVM-blessed] -headless stopped working
by Stefan Marr 02 May '12

02 May '12

Hi Esteban: I just downloaded a Cog-Mac-Cocoa-blessed from: https://ci.lille.inria.fr/pharo/job/Cog-Mac-Cocoa-blessed/ It tells me, it is currently 19days old. And it ignores the -headless parameter. The old VM I used so far is from Jul 6th and does execute headless without problems. I did not find the mail on the list that was naming the primitives to get more version infos out of the VMs, sorry. The latest StackVM also got that problem, but it works with the version from July. Is there actually something like -version on the command line to ask for the exact version infos? I checked -help, which also offers a lot less info then it used to. It still mentions -headless, but misses the options below. Best regards Stefan Missing help for commandline options: -breaksel selector set breakpoint on send of selector -eden <size>[mk] set eden memory to bytes -leakcheck num check for leaks in the heap -stackpages num use n stack pages -codesize <size>[mk] set machine code memory to bytes -sendtrace[=num] enable send tracing (optionally to a specific value) -tracestores enable store tracing (assert check stores) -cogmaxlits <n> set max number of literals for methods compiled to machine code -cogminjumps <n> set min number of backward jumps for interpreted methods to be considered for compilation to machine code -pathenc <enc> set encoding for pathnames (default: macintosh) -- Stefan Marr Software Languages Lab Vrije Universiteit Brussel Pleinlaan 2 / B-1050 Brussels / Belgium http://soft.vub.ac.be/~smarr Phone: +32 2 629 2974 Fax: +32 2 629 3525

4 5

New CogVM binaries as per VMMaker.oscog-eem.150/r2537
by Eliot Miranda 29 Feb '12

29 Feb '12

http://www.mirandabanda.org/files/Cog/VM/VM.r2537/ CogVM binaries as per VMMaker.oscog-eem.150/r2537 Disable filling of the weakRoots table during fullGC. Report remappable oop and weak root table overflows as errors. Make primitiveObjectAtPut fail if used to store other than a SmallInteger into the method header. Better error message for inability to thread. Load function pointer early in ThreadedFFIPlugin's invocation checking sequence. This must come early for compatibility with the old FFIPlugin. Image-level code may assume the function pointer is loaded eagerly. Add 1007,1008 & 1009 attribute info to version info on linux, & 1009 on Windows. Add -version option to Mac VM (with similar info to linux). Include vm-display-fbdev on linux. Exclude fbdev in the newspeak build. Simplify ticker for older linuxes. -- best, Eliot

1 0

VM Maker: VMMaker.oscog-eem.150.mcz
by commits＠source.squeak.org 29 Feb '12

29 Feb '12

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.150.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.150 Author: eem Time: 28 February 2012, 4:38:28.752 pm UUID: f2172fad-371a-4789-a4e6-cae3c679bcd2 Ancestors: VMMaker.oscog-eem.149 Disable filling of the weakRoots table during fullGC. Move the boinds check to the point of insertion. =============== Diff against VMMaker.oscog-eem.149 =============== Item was changed: ----- Method: NewObjectMemory>>fullGC (in category 'garbage collection') ----- fullGC "Do a mark/sweep garbage collection of the entire object memory. Free inaccessible objects but do not move them." <inline: false> fullGCLock > 0 ifTrue: [self warning: 'aborting fullGC because fullGCLock > 0'. ^self]. self initializeFreeBlocksPreSweep. self runLeakCheckerForFullGC: true. self preGCAction: GCModeFull. gcStartUsecs := self ioUTCMicrosecondsNow. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. self clearRootsTable. + self initWeakTableForIncrementalGC: false. youngStart := self startOfMemory. "process all of memory" self markPhase: true. "Sweep phase returns the number of survivors. Use the up-to-date version instead the one from startup." totalObjectCount := self sweepPhaseForFullGC. self runLeakCheckerForFullGC: true. self fullCompaction. statFullGCs := statFullGCs + 1. statGCEndUsecs := self ioUTCMicrosecondsNow. statFullGCUsecs := statFullGCUsecs + (statGCEndUsecs - gcStartUsecs). self capturePendingFinalizationSignals. youngStart := freeStart. "reset the young object boundary" self postGCAction. self runLeakCheckerForFullGC: true! Item was changed: ----- Method: NewObjectMemory>>incrementalGC (in category 'garbage collection') ----- incrementalGC "Do a mark/sweep garbage collection of just the young object area of object memory (i.e., objects above youngStart), using the root table to identify objects containing pointers to young objects from the old object area." | survivorCount weDidGrow | <inline: false> rootTableCount >= RootTableSize ifTrue: ["root table overflow; cannot do an incremental GC (this should be very rare)" statRootTableOverflows := statRootTableOverflows + 1. ^self fullGC]. self initializeFreeBlocksPreSweep. self runLeakCheckerForFullGC: false. self preGCAction: GCModeIncr. "incremental GC and compaction" gcStartUsecs := self ioUTCMicrosecondsNow. - weakRootCount := 0. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. + self initWeakTableForIncrementalGC: true. self markPhase: false. + self assert: weakRootCount <= WeakRootTableSize. - weakRootCount <= WeakRootTableSize ifFalse: - [self error: 'weakRoots table overflow']. 1 to: weakRootCount do: [:i| self finalizeReference: (weakRoots at: i)]. survivorCount := self sweepPhase. self runLeakCheckerForFullGC: false. self incrementalCompaction. statIncrGCs := statIncrGCs + 1. statGCEndUsecs := self ioUTCMicrosecondsNow. statIGCDeltaUsecs := statGCEndUsecs - gcStartUsecs. statIncrGCUsecs := statIncrGCUsecs + statIGCDeltaUsecs. self capturePendingFinalizationSignals. statRootTableCount := rootTableCount. statSurvivorCount := survivorCount. weDidGrow := false. (((survivorCount > tenuringThreshold) or: [rootTableCount >= RootTableRedZone]) or: [forceTenureFlag == true]) ifTrue: ["move up the young space boundary if * there are too many survivors: this limits the number of objects that must be processed on future incremental GC's * we're about to overflow the roots table: this limits the number of full GCs that may be caused by root table overflows in the near future" forceTenureFlag := false. statTenures := statTenures + 1. self clearRootsTable. ((self freeSize < growHeadroom) and: [gcBiasToGrow > 0]) ifTrue: [self biasToGrow. weDidGrow := true]. youngStart := freeStart]. self postGCAction. self runLeakCheckerForFullGC: false. weDidGrow ifTrue: [self biasToGrowCheckGCLimit]! Item was changed: ----- Method: NewObjectMemory>>lastPointerOf:recordWeakRoot: (in category 'object enumeration') ----- lastPointerOf: oop recordWeakRoot: recordWeakRoot "<Boolean>" "Return the byte offset of the last pointer field of the given object. Works with CompiledMethods, as well as ordinary objects. Can be used even when the type bits are not correct. This is a version of lastPointerOf: for markAndTrace:. Already overridden to trace stack pages for the StackInterpreter. Override to ask coInterpreter to determine literalCount of methods." | fmt sz header contextSize numLiterals | <inline: true> <asmLabel: false> header := self baseHeader: oop. fmt := self formatOfHeader: header. fmt <= 4 ifTrue: [fmt >= 3 ifTrue: [fmt = 4 ifTrue: + [(recordWeakRoot and: [weakRootCount >= 0]) ifTrue: - [recordWeakRoot ifTrue: ["And remember as weak root" + (weakRootCount := weakRootCount + 1) <= WeakRootTableSize ifFalse: + [self error: 'weakRoots table overflow']. - weakRootCount := weakRootCount + 1. - self assert: weakRootCount <= WeakRootTableSize. weakRoots at: weakRootCount put: oop]. "Do not trace the object's indexed fields if it's a weak class" ^(self nonWeakFieldsOf: oop) << ShiftForWord]. "So fmt is 3" (self isContextHeader: header) ifTrue: [coInterpreter setTraceFlagOnContextsFramesPageIfNeeded: oop. "contexts end at the stack pointer avoiding having to init fields beyond it" contextSize := coInterpreter fetchStackPointerOf: oop. self assert: ReceiverIndex + contextSize < (self lengthOf: oop baseHeader: header format: fmt). ^CtxtTempFrameStart + contextSize * BytesPerWord]]. sz := self sizeBitsOfSafe: oop. ^sz - BaseHeaderSize "all pointers" ]. fmt < 12 ifTrue: [^0]. "no pointers" "CompiledMethod: contains both pointers and bytes" numLiterals := coInterpreter literalCountOf: oop. ^numLiterals * BytesPerWord + BaseHeaderSize! Item was changed: ----- Method: ObjectMemory>>fullGC (in category 'garbage collection') ----- fullGC "Do a mark/sweep garbage collection of the entire object memory. Free inaccessible objects but do not move them." <inline: false> DoAssertionChecks ifTrue: [self reverseDisplayFrom: 0 to: 7. self clearLeakMapAndMapAccessibleObjects. self checkHeapIntegrity]. self preGCAction: GCModeFull. gcStartUsecs := self ioUTCMicrosecondsNow. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. self clearRootsTable. + self initWeakTableForIncrementalGC: false. youngStart := self startOfMemory. "process all of memory" self markPhase. "Sweep phase returns the number of survivors. Use the up-to-date version instead the one from startup." totalObjectCount := self sweepPhase. self fullCompaction. allocationCount := 0. statFullGCs := statFullGCs + 1. statGCEndTime := self ioMicroMSecs. statFullGCUsecs := statFullGCUsecs + (self ioUTCMicrosecondsNow - gcStartUsecs). self capturePendingFinalizationSignals. youngStart := freeBlock. "reset the young object boundary" self postGCAction. DoAssertionChecks ifTrue: [self clearLeakMapAndMapAccessibleObjects. self checkHeapIntegrity. self reverseDisplayFrom: 0 to: 7]! Item was changed: ----- Method: ObjectMemory>>incrementalGC (in category 'garbage collection') ----- incrementalGC "Do a mark/sweep garbage collection of just the young object area of object memory (i.e., objects above youngStart), using the root table to identify objects containing pointers to young objects from the old object area." | survivorCount weDidGrow | <inline: false> rootTableCount >= RootTableSize ifTrue: ["root table overflow; cannot do an incremental GC (this should be very rare)" statRootTableOverflows := statRootTableOverflows + 1. ^ self fullGC]. DoAssertionChecks ifTrue: [self reverseDisplayFrom: 8 to: 15. self checkHeapIntegrity. self checkInterpreterIntegrity. self validate]. self preGCAction: GCModeIncr. "incremental GC and compaction" gcStartUsecs := self ioUTCMicrosecondsNow. - weakRootCount := 0. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. + self initWeakTableForIncrementalGC: true. self markPhase. + self assert: weakRootCount <= WeakRootTableSize. - weakRootCount <= WeakRootTableSize ifFalse: - [self error: 'weakRoots table overflow']. 1 to: weakRootCount do:[:i| self finalizeReference: (weakRoots at: i)]. survivorCount := self sweepPhase. self incrementalCompaction. statAllocationCount := allocationCount. allocationCount := 0. statIncrGCs := statIncrGCs + 1. statGCEndTime := self ioMicroMSecs. statIGCDeltaUsecs := self ioUTCMicrosecondsNow - gcStartUsecs. statIncrGCUsecs := statIncrGCUsecs + statIGCDeltaUsecs. self capturePendingFinalizationSignals. self forceInterruptCheck. "Force an an interrupt check ASAP.We could choose to be clever here and only do this under certain time conditions. Keep it simple for now" statRootTableCount := rootTableCount. statSurvivorCount := survivorCount. weDidGrow := false. (((survivorCount > tenuringThreshold) or: [rootTableCount >= RootTableRedZone]) or: [forceTenureFlag == true]) ifTrue: ["move up the young space boundary if * there are too many survivors: this limits the number of objects that must be processed on future incremental GC's * we're about to overflow the roots table this limits the number of full GCs that may be caused by root table overflows in the near future" forceTenureFlag := false. statTenures := statTenures + 1. self clearRootsTable. (((self sizeOfFree: freeBlock) < growHeadroom) and: [gcBiasToGrow > 0]) ifTrue: [self biasToGrow. weDidGrow := true]. youngStart := freeBlock]. self postGCAction. DoAssertionChecks ifTrue: [self validate. self checkHeapIntegrity. self checkInterpreterIntegrity. self reverseDisplayFrom: 8 to: 15]. weDidGrow ifTrue: [self biasToGrowCheckGCLimit]! Item was added: + ----- Method: ObjectMemory>>initWeakTableForIncrementalGC: (in category 'gc -- mark and sweep') ----- + initWeakTableForIncrementalGC: trueIfIncrementalGC + "The weakRoots table is only used for incrementalGC. + Enable it by setting weakRootCount to 0. + Disable it by making it negative." + weakRootCount := trueIfIncrementalGC ifTrue: [0] ifFalse: [-1]! Item was changed: ----- Method: ObjectMemory>>lastPointerOf:recordWeakRoot: (in category 'gc -- mark and sweep') ----- lastPointerOf: oop recordWeakRoot: recordWeakRoot "<Boolean>" "Return the byte offset of the last pointer field of the given object. Works with CompiledMethods, as well as ordinary objects. Can be used even when the type bits are not correct. This is a version of lastPointerOf: for markAndTrace:." | fmt sz header contextSize | <inline: true> header := self baseHeader: oop. fmt := self formatOfHeader: header. fmt <= 4 ifTrue: [fmt >= 3 ifTrue: [fmt = 4 ifTrue: + [(recordWeakRoot and: [weakRootCount >= 0]) ifTrue: - [recordWeakRoot ifTrue: ["And remember as weak root" + (weakRootCount := weakRootCount + 1) <= WeakRootTableSize ifFalse: + [self error: 'weakRoots table overflow']. - weakRootCount := weakRootCount + 1. - self assert: weakRootCount <= WeakRootTableSize. weakRoots at: weakRootCount put: oop]. "Do not trace the object's indexed fields if it's a weak class" ^(self nonWeakFieldsOf: oop) << ShiftForWord]. "So fmt is 3" (self isContextHeader: header) ifTrue: ["contexts end at the stack pointer avoiding having to init fields beyond it" contextSize := self fetchStackPointerOf: oop. ^CtxtTempFrameStart + contextSize * BytesPerWord]]. sz := self sizeBitsOfSafe: oop. ^sz - BaseHeaderSize "all pointers" ]. fmt < 12 ifTrue: [^0]. "no pointers" "CompiledMethod: contains both pointers and bytes:" ^(self literalCountOf: oop) * BytesPerWord + BaseHeaderSize!

1 0

VM Maker: VMMaker.oscog-eem.149.mcz
by commits＠source.squeak.org 28 Feb '12

28 Feb '12

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.149.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.149 Author: eem Time: 28 February 2012, 10:15:02.63 am UUID: 48257b02-cacd-4cc2-b747-c9e6df6e2530 Ancestors: VMMaker.oscog-eem.148 Fix assert failures in mapVMRegisters due to new multiple bytecode set support. Report remappable oop and weak root table overflows as errors. Make the default VM generation scripts methods. =============== Diff against VMMaker.oscog-eem.148 =============== Item was changed: ----- Method: CoInterpreter>>mapVMRegisters (in category 'object memory support') ----- mapVMRegisters "Map the oops in the interpreter's vm ``registers'' to their new values during garbage collection or a become: operation." "Assume: All traced variables contain valid oops." | mapInstructionPointer | + "i.e. interpreter instructionPointer in method as opposed to machine code?" + (mapInstructionPointer := instructionPointer > method) ifTrue: - mapInstructionPointer := instructionPointer > method. - mapInstructionPointer ifTrue: [instructionPointer := instructionPointer - method]. "*rel to method" + method := (objectMemory remap: method). - self setMethod: (objectMemory remap: method). mapInstructionPointer ifTrue: [instructionPointer := instructionPointer + method]. "*rel to method" messageSelector := objectMemory remap: messageSelector. (objectMemory isIntegerObject: newMethod) ifFalse: [newMethod := objectMemory remap: newMethod]. lkupClass := objectMemory remap: lkupClass! Item was changed: ----- Method: NewObjectMemory>>incrementalGC (in category 'garbage collection') ----- incrementalGC "Do a mark/sweep garbage collection of just the young object area of object memory (i.e., objects above youngStart), using the root table to identify objects containing pointers to young objects from the old object area." | survivorCount weDidGrow | <inline: false> rootTableCount >= RootTableSize ifTrue: ["root table overflow; cannot do an incremental GC (this should be very rare)" statRootTableOverflows := statRootTableOverflows + 1. ^self fullGC]. self initializeFreeBlocksPreSweep. self runLeakCheckerForFullGC: false. self preGCAction: GCModeIncr. "incremental GC and compaction" gcStartUsecs := self ioUTCMicrosecondsNow. weakRootCount := 0. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. self markPhase: false. + weakRootCount <= WeakRootTableSize ifFalse: + [self error: 'weakRoots table overflow']. - self assert: weakRootCount <= WeakRootTableSize. 1 to: weakRootCount do: [:i| self finalizeReference: (weakRoots at: i)]. survivorCount := self sweepPhase. self runLeakCheckerForFullGC: false. self incrementalCompaction. statIncrGCs := statIncrGCs + 1. statGCEndUsecs := self ioUTCMicrosecondsNow. statIGCDeltaUsecs := statGCEndUsecs - gcStartUsecs. statIncrGCUsecs := statIncrGCUsecs + statIGCDeltaUsecs. self capturePendingFinalizationSignals. statRootTableCount := rootTableCount. statSurvivorCount := survivorCount. weDidGrow := false. (((survivorCount > tenuringThreshold) or: [rootTableCount >= RootTableRedZone]) or: [forceTenureFlag == true]) ifTrue: ["move up the young space boundary if * there are too many survivors: this limits the number of objects that must be processed on future incremental GC's * we're about to overflow the roots table: this limits the number of full GCs that may be caused by root table overflows in the near future" forceTenureFlag := false. statTenures := statTenures + 1. self clearRootsTable. ((self freeSize < growHeadroom) and: [gcBiasToGrow > 0]) ifTrue: [self biasToGrow. weDidGrow := true]. youngStart := freeStart]. self postGCAction. self runLeakCheckerForFullGC: false. weDidGrow ifTrue: [self biasToGrowCheckGCLimit]! Item was changed: ----- Method: ObjectMemory>>incrementalGC (in category 'garbage collection') ----- incrementalGC "Do a mark/sweep garbage collection of just the young object area of object memory (i.e., objects above youngStart), using the root table to identify objects containing pointers to young objects from the old object area." | survivorCount weDidGrow | <inline: false> rootTableCount >= RootTableSize ifTrue: ["root table overflow; cannot do an incremental GC (this should be very rare)" statRootTableOverflows := statRootTableOverflows + 1. ^ self fullGC]. DoAssertionChecks ifTrue: [self reverseDisplayFrom: 8 to: 15. self checkHeapIntegrity. self checkInterpreterIntegrity. self validate]. self preGCAction: GCModeIncr. "incremental GC and compaction" gcStartUsecs := self ioUTCMicrosecondsNow. weakRootCount := 0. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. self markPhase. + weakRootCount <= WeakRootTableSize ifFalse: + [self error: 'weakRoots table overflow']. - self assert: weakRootCount <= WeakRootTableSize. 1 to: weakRootCount do:[:i| self finalizeReference: (weakRoots at: i)]. survivorCount := self sweepPhase. self incrementalCompaction. statAllocationCount := allocationCount. allocationCount := 0. statIncrGCs := statIncrGCs + 1. statGCEndTime := self ioMicroMSecs. statIGCDeltaUsecs := self ioUTCMicrosecondsNow - gcStartUsecs. statIncrGCUsecs := statIncrGCUsecs + statIGCDeltaUsecs. self capturePendingFinalizationSignals. self forceInterruptCheck. "Force an an interrupt check ASAP.We could choose to be clever here and only do this under certain time conditions. Keep it simple for now" statRootTableCount := rootTableCount. statSurvivorCount := survivorCount. weDidGrow := false. (((survivorCount > tenuringThreshold) or: [rootTableCount >= RootTableRedZone]) or: [forceTenureFlag == true]) ifTrue: ["move up the young space boundary if * there are too many survivors: this limits the number of objects that must be processed on future incremental GC's * we're about to overflow the roots table this limits the number of full GCs that may be caused by root table overflows in the near future" forceTenureFlag := false. statTenures := statTenures + 1. self clearRootsTable. (((self sizeOfFree: freeBlock) < growHeadroom) and: [gcBiasToGrow > 0]) ifTrue: [self biasToGrow. weDidGrow := true]. youngStart := freeBlock]. self postGCAction. DoAssertionChecks ifTrue: [self validate. self checkHeapIntegrity. self checkInterpreterIntegrity. self reverseDisplayFrom: 8 to: 15]. weDidGrow ifTrue: [self biasToGrowCheckGCLimit]! Item was changed: ----- Method: ObjectMemory>>pushRemappableOop: (in category 'interpreter access') ----- pushRemappableOop: oop "Record the given object in a the remap buffer. Objects in this buffer are remapped when a compaction occurs. This facility is used by the interpreter to ensure that objects in temporary variables are properly remapped." <api> self assert: (self addressCouldBeOop: oop). + remapBuffer at: (remapBufferCount := remapBufferCount + 1) put: oop. + remapBufferCount <= RemapBufferSize ifFalse: + [self error: 'remapBuffer overflow'].! - remapBuffer at: (remapBufferCount := remapBufferCount + 1) put: oop.! Item was removed: - ----- Method: ObjectMemory>>remapBufferCount: (in category 'accessing') ----- - remapBufferCount: aValue - ^remapBufferCount := aValue! Item was changed: ----- Method: StackInterpreter>>mapVMRegisters (in category 'object memory support') ----- mapVMRegisters "Map the oops in the interpreter's vm ``registers'' to their new values during garbage collection or a become: operation." "Assume: All traced variables contain valid oops." instructionPointer := instructionPointer - method. "*rel to method" + method := (objectMemory remap: method). - self setMethod: (objectMemory remap: method). instructionPointer := instructionPointer + method. "*rel to method" (objectMemory isIntegerObject: messageSelector) ifFalse: [messageSelector := objectMemory remap: messageSelector]. (objectMemory isIntegerObject: newMethod) ifFalse: [newMethod := objectMemory remap: newMethod]. lkupClass := objectMemory remap: lkupClass! Item was added: + ----- Method: VMMaker class>>generateConfiguration (in category 'configurations') ----- + generateConfiguration + "VMMaker generateConfiguration" + | selectors | + selectors := ((self class organization listAtCategoryNamed: (self class whichCategoryIncludesSelector: thisContext selector)) copyWithout: thisContext selector) sort. + (UIManager default + chooseFrom: (selectors collect: + [:sel| (sel piecesCutWhere: [:a :b| a isLowercase and: [b isUppercase]]) allButFirst + fold: [:a :b| a, ' ', b]]) + values: selectors) ifNotNil: + [:choice| + self perform: choice]! Item was added: + ----- Method: VMMaker class>>generateNewspeakCogVM (in category 'configurations') ----- + generateNewspeakCogVM + ^VMMaker + generate: CoInterpreter + and: StackToRegisterMappingCogit"Cogit chooseCogitClass" + with: #(NewspeakVM true) + to: (FileDirectory default pathFromURI: 'oscogvm/nscogsrc') + platformDir: (FileDirectory default pathFromURI: '../Newspeak/newclosurevm/platforms') + including:#( AsynchFilePlugin BMPReadWriterPlugin BalloonEnginePlugin BitBltSimulation DSAPlugin DropPlugin + FileCopyPlugin FilePlugin FloatArrayPlugin FloatMathPlugin InflatePlugin JPEGReadWriter2Plugin + JPEGReaderPlugin LargeIntegersPlugin Matrix2x3Plugin MiscPrimitivePlugin NewsqueakIA32ABIPlugin + RePlugin SecurityPlugin SocketPlugin SoundPlugin SurfacePlugin ThreadedIA32FFIPlugin + UUIDPlugin UnixOSProcessPlugin VMProfileMacSupportPlugin Win32OSProcessPlugin)! Item was added: + ----- Method: VMMaker class>>generateNewspeakInterpreterVM (in category 'configurations') ----- + generateNewspeakInterpreterVM + ^VMMaker + generate: NewspeakInterpreter + to: (FileDirectory default pathFromURI: 'oscogvm/nssrc') + platformDir: (FileDirectory default pathFromURI: '../Newspeak/newclosurevm/platforms') + including:#( AsynchFilePlugin BMPReadWriterPlugin BalloonEnginePlugin BitBltSimulation DSAPlugin DropPlugin + FileCopyPlugin FilePlugin FloatArrayPlugin FloatMathPlugin InflatePlugin JPEGReadWriter2Plugin + JPEGReaderPlugin LargeIntegersPlugin Matrix2x3Plugin MiscPrimitivePlugin NewsqueakIA32ABIPlugin + RePlugin SecurityPlugin SocketPlugin SoundPlugin SurfacePlugin UUIDPlugin UnixOSProcessPlugin + VMProfileMacSupportPlugin Win32OSProcessPlugin)! Item was added: + ----- Method: VMMaker class>>generateNewspeakStackVM (in category 'configurations') ----- + generateNewspeakStackVM + ^VMMaker + generate: StackInterpreter + with: #(NewspeakVM true) + to: (FileDirectory default pathFromURI: 'oscogvm/nsstacksrc') + platformDir: (FileDirectory default pathFromURI: '../Newspeak/newclosurevm/platforms') + including:#( AsynchFilePlugin BMPReadWriterPlugin BalloonEnginePlugin BitBltSimulation DSAPlugin DropPlugin + FileCopyPlugin FilePlugin FloatArrayPlugin FloatMathPlugin InflatePlugin JPEGReadWriter2Plugin + JPEGReaderPlugin LargeIntegersPlugin Matrix2x3Plugin MiscPrimitivePlugin NewsqueakIA32ABIPlugin + RePlugin SecurityPlugin SocketPlugin SoundPlugin SurfacePlugin UUIDPlugin UnixOSProcessPlugin + VMProfileMacSupportPlugin Win32OSProcessPlugin)! Item was added: + ----- Method: VMMaker class>>generateSqueakCogSistaVM (in category 'configurations') ----- + generateSqueakCogSistaVM + ^VMMaker + generate: (Smalltalk at: ([:choices| choices at: (UIManager default chooseFrom: choices) ifAbsent: [^self]] + value: #(CoInterpreter CoInterpreterMT))) + and: SistaStackToRegisterMappingCogit + to: (FileDirectory default pathFromURI: 'cogvm/sistasrc') + platformDir: (FileDirectory default pathFromURI: 'cogvm/platforms') + excluding:#(BrokenPlugin DShowVideoDecoderPlugin NewsqueakIA32ABIPlugin NewsqueakIA32ABIPluginAttic + CroquetPlugin HostWindowPlugin SoundPlugin + QuicktimePlugin QVideoCodecPlugin QwaqMediaPlugin SlangTestPlugin TestOSAPlugin + FFIPlugin ThreadedARMFFIPlugin ThreadedFFIPlugin ThreadedPPCBEFFIPlugin + ReentrantARMFFIPlugin ReentrantFFIPlugin ReentrantIA32FFIPlugin ReentrantPPCBEFFIPlugin)! Item was added: + ----- Method: VMMaker class>>generateSqueakCogVM (in category 'configurations') ----- + generateSqueakCogVM + ^VMMaker + generate: (Smalltalk at: ([:choices| choices at: (UIManager default chooseFrom: choices) ifAbsent: [^self]] + value: #(CoInterpreter CoInterpreterMT))) + and: StackToRegisterMappingCogit + to: (FileDirectory default pathFromURI: 'oscogvm/src') + platformDir: (FileDirectory default pathFromURI: 'oscogvm/platforms') + including:#( ADPCMCodecPlugin AsynchFilePlugin BalloonEnginePlugin B3DAcceleratorPlugin + BMPReadWriterPlugin BitBltSimulation BochsIA32Plugin CroquetPlugin DSAPlugin + DeflatePlugin DropPlugin FT2Plugin FFTPlugin FileCopyPlugin FilePlugin FloatArrayPlugin + FloatMathPlugin GeniePlugin HostWindowPlugin IA32ABIPlugin InternetConfigPlugin + JPEGReadWriter2Plugin JPEGReaderPlugin JoystickTabletPlugin KlattSynthesizerPlugin + LargeIntegersPlugin LocalePlugin MIDIPlugin MacMenubarPlugin Matrix2x3Plugin + MiscPrimitivePlugin Mpeg3Plugin QuicktimePlugin RePlugin SecurityPlugin SerialPlugin + SocketPlugin SoundCodecPlugin SoundGenerationPlugin SoundPlugin ThreadedIA32FFIPlugin + StarSqueakPlugin UUIDPlugin UnixOSProcessPlugin Win32OSProcessPlugin VMProfileMacSupportPlugin)! Item was added: + ----- Method: VMMaker class>>generateSqueakStackVM (in category 'configurations') ----- + generateSqueakStackVM + "No primitives since we can use those for the Cog VM" + ^VMMaker + generate: StackInterpreter + to: (FileDirectory default pathFromURI: 'oscogvm/stacksrc') + platformDir: (FileDirectory default pathFromURI: 'cogvm/platforms') + excluding: (InterpreterPlugin withAllSubclasses collect: [:ea| ea name])!

1 0

Reproducible Cog crash from image startup
by Mariano Martinez Peck 28 Feb '12

28 Feb '12

Hi. I have faced a VM crash while using Nautilus browser. It took me a while, but I finally could make a reproducible crash from image startup. You can find the image here: https://gforge.inria.fr/frs/download.php/30280/Marea.104-Crash.1.image.zip What the image is running at startup that causes the crash is: | nautilus model ui| Nautilus instVarNamed: 'groups' put: nil. model := Nautilus open. ui := model ui. ui groupsButtonAction. If you need more about the "domain", we can ask Ben, Nautilus developer. >From what I can see in GDB, it crashes in #mapStackPages because it does a remap to an OOP that is 0 (zero) while (theSP <= frameRcvrOffset) { oop = longAt(theSP); if (!((oop & 1))) { longAtput(theSP, remap(oop)); } theSP += BytesPerWord; } Any ideas? Thanks, -- Mariano http://marianopeck.wordpress.com

4 13

New kid on the block: gcc 4.6.1 & windows
by Igor Stasenko 28 Feb '12

28 Feb '12

gcc -v Using built-in specs. COLLECT_GCC=C:\MinGW\bin\gcc.exe COLLECT_LTO_WRAPPER=c:/mingw/bin/../libexec/gcc/mingw32/4.6.1/lto-wrapper.exe Target: mingw32 Configured with: ../gcc-4.6.1/configure --enable-languages=c,c++,fortran,objc,obj-c++ --disable-sjlj-exceptions --with-dwarf2 --enable-shared --enable-libgomp --disable-win32-registry --enable-libstdcxx-debug --enable-version-specific-runtime-libs --build=mingw32 --prefix=/mingw Thread model: win32 gcc version 4.6.1 (GCC) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c: In function 'squeakExceptionHandler': c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_RC_NEAR' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: note: each undeclared identifier is reported only once for each function it appears in c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_PC_53' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_EM_INVALID' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_EM_ZERODIVIDE' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_EM_OVERFLOW' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_EM_UNDERFLOW' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_EM_INEXACT' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:18: error: '_EM_DENORMAL' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:31: error: '_MCW_EM' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:41: error: '_MCW_RC' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:51: error: '_MCW_PC' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:128:61: error: '_MCW_IC' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c: In function 'sqMain': c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_RC_NEAR' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_PC_53' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_EM_INVALID' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_EM_ZERODIVIDE' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_EM_OVERFLOW' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_EM_UNDERFLOW' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_EM_INEXACT' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:14: error: '_EM_DENORMAL' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:27: error: '_MCW_EM' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:37: error: '_MCW_RC' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:47: error: '_MCW_PC' undeclared (first use in this function) c:/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c:1249:57: error: '_MCW_IC' undeclared (first use in this function) make[2]: *** [CMakeFiles/CogVM.dir/C_/MinGW/msys/1.0/home/sig/cog/blessed/platforms/win32/vm/sqWin32Intel.c.obj] Error 1 make[1]: *** [CMakeFiles/CogVM.dir/all] Error 2 googled a bit and found swift solution: Modify the /mingw/lib/gcc/GCC-VERSION/mingw32/include/float.h file and add #ifndef _MINGW_FLOAT_H_ #include_next <float.h> #endif (yeah, literally copy and paste at the end of that file) Read here: http://sourceforge.net/mailarchive/message.php?msg_id=28824347 i wonder how to workaround this w/o modifying the file... -- Best regards, Igor Stasenko.

1 0

Re: [squeak-dev] Error making win32 vm
by David T. Lewis 27 Feb '12

27 Feb '12

I'm sorry, I don't know what the problem is, and I don't have access to a Windows system to try this right now. I am CCing the vm-dev list in case someone else can help. Has anyone recently built an interpreter VM on Windows and encountered the following problem with VM_VERSION not defined in the build? Thanks, Dave On Sun, Feb 26, 2012 at 05:26:19PM +0900, ?????? wrote: > I correctedd the VM platform path by editing MakeFile. I generated sources > by latest VMMaker and latest platform files. And I ' m building interpreter > VM first. > 2012. 2. 25. ???? 11:03?? "David T. Lewis" <lewis(a)mail.msen.com>???? ????: > > > On Sat, Feb 25, 2012 at 12:10:31PM +0900, ?????? wrote: > > > ---------------- Makefile settings ------------------ > > > VPATH=./src/vm ../platforms/win32/vm ../platforms/Cross/vm > > > ../platforms/win32/misc > > > INCLUDES=-I. -I./src/vm -I../platforms/win32/vm -I../platforms/Cross/vm > > > -Ic:/dx7sdk/include > > > CFLAGS=-g -mpentium -mwindows -fomit-frame-pointer -funroll-loops > > > -fschedule-insns2 -O2 > > > ----------------------------------------------------- > > > mkdir .\obj\vm > > > gawk -f ../platforms/win32/misc/gnuify ./src/vm/interp.c > > > > ./src/vm/gnu-interp.c > > > copying first section of file > > > interpret: adding static register assignments > > > interpret: adding bytecode dispatch table > > > interpret: rewriting case labels and outer breaks > > > gcc -o ./obj/vm/sqWin32Alloc.o -g -mpentium -mwindows > > -fomit-frame-pointer > > > -funroll-loops -fschedule-insns2 -O2 -I. -I./src/vm > > -I../platforms/win32/vm > > > -I../platforms/Cross/vm -Ic:/dx7sdk/include -DWIN32_FILE_SUPPORT > > > -DNO_SERVICE -DNO_STD_FILE_SUPPORT -DNDEBUG -DLSB_FIRST > > > -DVM_NAME=\"Squeak\" -DVM_VERSIONINFO=\""3.10.6 (release)"\" -DX86 > > > -DSQUEAK_BUILTIN_PLUGIN -c ../platforms/win32/vm/sqWin32Alloc.c > > > In file included from ..\platforms\win32\vm\sqConfig.h:21, > > > from ..\platforms\Cross\vm\sq.h:18, > > > from ../platforms/win32/vm/sqWin32Alloc.c:14: > > > ..\platforms\win32\vm\sqWin32.h:246: #error "VM_VERSION is undefined" > > > make: *** [sqWin32Alloc.o] Error 1 > > > I'm tired about this. What is the problem? > > > > This looks to me like a mismatch between your platforms source > > directory and the generated sources from VMMaker. Can you please > > say specifically what sources you are using? Did you generate > > your own sources with VMMaker and use the latest platform sources > > form Subversion? Or are you compiling from a tarball downloaded > > from squeakvm.org? Is this Cog or an interpreter VM? > > > > Thanks, > > Dave > > > > > > >

2 1

feature request: set Mac window title/icon via command-line argument
by Craig Latta 24 Feb '12

24 Feb '12

Hi-- I frequently run multiple Squeaks on my Mac, and it would be handy to be able to tell them apart in the Dock. How about setting the application window title and icon from command-line arguments? thanks! -C -- Craig Latta www.netjam.org/resume +31 6 2757 7177 + 1 415 287 3547

4 7

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev February 2012