Vm-dev May 2012

vm-dev@lists.squeakfoundation.org

37 participants
74 discussions

OSProcess chdir
by Sean P. DeNigris 26 May '12

26 May '12

UnixOSProcessPlugin>>primitiveChdir ... (self chdir: path) ifTrue: [interpreterProxy pop: 2; push: interpreterProxy nilObject] ifFalse: [interpreterProxy pop: 2; pushInteger: errno]. Shouldn't the conditional branches be reversed (or the test be "(self chdir: path) == 0" - however you would write that in Slang)? chdir returns 0 on success and -1 on error. In c, the above becomes: if (chdir(path)) {...interpreterProxy->push(interpreterProxy->nilObject());} else {...interpreterProxy->pushInteger(errno);} So success takes the else branch and returns the irrelevant errno, which I guess is why I'm getting confusing error codes in Pharo 2.0 even though the chdir has taken effect. b.t.w. if the above is correct, how would I submit a patch (i.e. changes to the UnixOSProcessPlugin class)? Thanks, Sean -- View this message in context: http://forum.world.st/OSProcess-chdir-tp4631844.html Sent from the Squeak VM mailing list archive at Nabble.com.

2 3

VM Maker: VMMaker-dtl.272.mcz
by commits＠source.squeak.org 23 May '12

23 May '12

David T. Lewis uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker-dtl.272.mcz ==================== Summary ==================== Name: VMMaker-dtl.272 Author: dtl Time: 22 May 2012, 11:29:58.621 pm UUID: 5eeb4798-b79f-4599-aa4e-eaa57e32b4a2 Ancestors: VMMaker-dtl.271 VMMaker 4.9.2 Fix slang browsing for inlined methods in ObjectMemory. The interpreter now collaborates with an object memory, so arrange for Interpreter methods that are inlined into ObjectMemory methods to be properly inlined for #asInlinedCString: code generation. =============== Diff against VMMaker-dtl.271 =============== Item was added: + ----- Method: Interpreter class>>initializeCodeGenerator: (in category 'translation') ----- + initializeCodeGenerator: cg + "Load a code generator with classes in a manner suitable for generating + code for this class." + + super initializeCodeGenerator: cg. + ^ self initializeClassicObjectMemoryInCodeGenerator: cg + "^ self initializeNewObjectMemoryInCodeGenerator: cg" + ! Item was removed: - ----- Method: InterpreterPrimitives class>>initializeCodeGenerator: (in category 'translation') ----- - initializeCodeGenerator: cg - "Load a code generator with classes in a manner suitable for generating - code for this class." - - super initializeCodeGenerator: cg. - ^ self initializeClassicObjectMemoryInCodeGenerator: cg - "^ self initializeNewObjectMemoryInCodeGenerator: cg" - ! Item was added: + ----- Method: Object>>buildCodeGeneratorInlined: (in category '*VMMaker-translation support') ----- + buildCodeGeneratorInlined: doInlining + "Build a CCodeGenerator for this class. By default, generate only the + the methods for aClass. Classes that are normally translated along with + other collaborating classes, such as an object memory and its interpreter, + may include the collaborating classes when doInlining is true, allowing methods + in those classes to be included in the inlining process." + + ^self buildCodeGenerator + ! Item was added: + ----- Method: ObjectMemory class>>buildCodeGeneratorInlined: (in category 'translation') ----- + buildCodeGeneratorInlined: doInlining + "Build a CCodeGenerator for this class. By default, generate only the + the methods for aClass. Classes that are normally translated along with + other collaborating classes, such as an object memory and its interpreter, + may include the collaborating classes when doInlining is true, allowing methods + in those classes to be included in the inlining process." + + | cg | + cg := VMMaker new createCodeGenerator. + cg declareMethodsStatic: false. + cg permitMethodPruning: true. + doInlining + ifTrue: ["Include methods from associated classes so that inlining for each + method is performed as in normal interp.c generation" + ^self interpreterClass initializeCodeGenerator: cg] + ifFalse: [^self initializeCodeGenerator: cg] + ! Item was added: + ----- Method: ObjectMemory class>>interpreterClass (in category 'translation') ----- + interpreterClass + "Answer the interpreter class that is commonly used in collaboration with + this type of object memory. When generating inlined methods, some methods + from the interpreter class may be inlined into methods in the object memory." + + ^Interpreter + ! Item was added: + ----- Method: StackInterpreter class>>initializeCodeGenerator: (in category 'translation') ----- + initializeCodeGenerator: cg + "Load a code generator with classes in a manner suitable for generating + code for this class." + + super initializeCodeGenerator: cg. + ^ self initializeNewObjectMemoryInCodeGenerator: cg + ! Item was changed: ----- Method: VMMaker class>>versionString (in category 'version testing') ----- versionString "VMMaker versionString" + ^'4.9.2'! - ^'4.9.1'!

1 0

StackVM on general Unix ARM
by Pavel Krivanek 22 May '12

22 May '12

Hi, I'm trying to compile StackVM for Raspberry Pi but I face some problems. The biggest one seems to be the absence of High Res Timer Ticker. CogDroid and iOS builds are for ARM too. How did you solve this? Cheers, -- Pavel

2 1

Re: [Vm-dev] StackVM on general Unix ARM
by Igor Stasenko 22 May '12

22 May '12

On 22 May 2012 15:42, Dmitry Golubovsky <golubovsky(a)gmail.com> wrote: > Igor, > > On Tue, May 22, 2012 at 9:35 AM, Igor Stasenko <siguctua(a)gmail.com> wrote: >> >> Right, now i remember. >> >> So, do you generating these files from image or use hand-written files? > > From the image of course. In fact, all I generate is a list of object > files, much like CMake lists. That was not very complicated > transformation of the makefile writer methods. > > These lists later get included into the toplevel project makefile, > yielding a large list of names. I do not have per-file or per-plugin > compliation options tuning though. But in Android this is achieved via > some pattern matching in local makefiles, but I did not need to get > into this. > Ah, great. Actually i could check CMakeAndroidGenerator instead of asking :) But i didn't because i had no chance to check if it works or not. > Thanks. > > -- > Dmitry Golubovsky > > Anywhere on the Web -- Best regards, Igor Stasenko.

1 0

StackVM on general Unix ARM
by Dmitry Golubovsky 22 May '12

22 May '12

Hi, Igor Stasenko wrote: >> I believe it is still a CMake project (as opposed to the Android build >> where CMake stuff was eliminated). >> > I remember you mentioned that, but don't remember the details. > Can you please tell, why you decided to do that? Because of Android build system (NDK) - a thing very much unto itself ;) The way they use regular Make is rather contrived; having CMake adopted for that seemed an unnecessary trouble. -- Dmitry Golubovsky Anywhere on the Web

1 0

StackVM on general Unix ARM
by Dmitry Golubovsky 22 May '12

22 May '12

Pavel, Pavel Krivanek wrote: > I'm trying to compile StackVM for Raspberry Pi but I face some problems. > The biggest one seems to be the absence of High Res Timer Ticker. CogDroid > and iOS builds are for ARM too. How did you solve this? By eliminating all asynchronicity from Cog and turning it into an event-driven VM. See this for the general discussion: http://permalink.gmane.org/gmane.comp.lang.smalltalk.squeak.vm.devel/6910 The message referred mentions StackEvtUnixConfig which may be your starting point. You may follow the recommendations from http://lists.squeakfoundation.org/pipermail/vm-dev/2012-May/010632.html where your last (per these recommendations) step will be sh ./generate.sh -headless StackEvtUnixConfig ### (instead of AndroidConfig) I never polished this configuration, however it somehow ran on Linux. I believe it is still a CMake project (as opposed to the Android build where CMake stuff was eliminated). You may also find this helpful: http://lists.squeakfoundation.org/pipermail/vm-dev/2011-August/009209.html which discusses some aspects of Morphic algorithms suitability for event driven VMs (although some of them may have been already fixed). Hope this helps. Feel free to ask more questions. Thanks. -- Dmitry Golubovsky Anywhere on the Web

3 2

VM Maker: CMakeVMMaker-EstebanLorenzano.160.mcz
by commits＠source.squeak.org 22 May '12

22 May '12

Esteban Lorenzano uploaded a new version of CMakeVMMaker to project VM Maker: http://source.squeak.org/VMMaker/CMakeVMMaker-EstebanLorenzano.160.mcz ==================== Summary ==================== Name: CMakeVMMaker-EstebanLorenzano.160 Author: EstebanLorenzano Time: 22 May 2012, 2:47:17.738 pm UUID: 37450971-39f9-4ead-86bc-e8c0522383f5 Ancestors: CMakeVMMaker-EstebanLorenzano.159 -added some flags for iphone -added force gcc-4.2 to mac builds =============== Diff against CMakeVMMaker-EstebanLorenzano.159 =============== Item was changed: ----- Method: CogFamilyCocoaIOSConfig>>setExtraTargetProperties: (in category 'settings') ----- setExtraTargetProperties: maker | plist | maker addFrameworks: self frameworks. " generated and add Info.plist file " plist := self plistFile. (maker buildDir forceNewFileNamed: 'Info.plist') nextPutAll: plist; close. maker addProperty: 'MACOSX_BUNDLE_INFO_PLIST' value: '${buildDir}/Info.plist'. (maker buildDir forceNewFileNamed: self prefixHeaderFileName) nextPutAll: self precompiledHeaders; close. maker addXCodeProperty: 'GCC_PREFIX_HEADER' value: '${buildDir}/', self prefixHeaderFileName. maker addXCodeProperty: 'PER_ARCH_CFLAGS_i386' value: '-DLSB_FIRST -mfpmath=sse -finline-functions -fno-cse-follow-jumps -fno-gcse -mtune=prescott -march=pentium-m -falign-functions=16'. "maker addXCodeProperty: 'GCC_VERSION' value: '4.3'." maker cmd: 'set_target_properties' params: self executableName, ' PROPERTIES COMPILE_FLAGS "-include \"', (self buildDir / self prefixHeaderFileName) fullName, '\""'. + + maker set: 'CMAKE_C_COMPILER' to: '/usr/bin/gcc-4.2'. + maker set: 'CMAKE_CXX_COMPILER' to: '/usr/bin/g++-4.2'. maker set: 'EXECUTABLE_OUTPUT_PATH' toString: self outputDir. maker set: 'RUNTIME_OUTPUT_DIRECTORY' toString: self outputDir.! Item was changed: ----- Method: StackIPhoneConfig>>commonCompilerFlags (in category 'settings') ----- commonCompilerFlags "Common compiler flags" ^{ "'-miphoneos-version-min=4.3'. " '-isysroot /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS', self sdkVersion, '.sdk'. '-x objective-c'. '-std=gnu99'. '-falign-functions=16'. '-fno-gcse'. '-fno-cse-follow-jumps'. '-fvisibility=hidden'. '-funroll-loops'. '-finline-functions'. '-mno-thumb'. '-DSTACKVM=1'. '-DCOGMTVM=0'. '-DUSE_GLOBAL_STRUCT=0'. '-DBASE_HEADER_SIZE=4'. '-DTARGET_OS_IS_IPHONE'. '-DHAVE_UUID_GENERATE'. '-DUSE_INLINE_MEMORY_ACCESSORS'. '-DHAVE_SYS_TIME_H'. '-DLSB_FIRST'. '-DHAVE_NANOSLEEP'. "'-DXXXUSE_INLINE_MEMORY_ACCESSORS'." '-DISQUEAK_IMAGE=', self imageName. '-DISQUEAK_SOURCES=PharoV10'}! Item was added: + ----- Method: StackIPhoneConfig>>compilerFlagsDebug (in category 'settings') ----- + compilerFlagsDebug + ^#('-g3' '-O2' '-DDEBUGVM=1')! Item was changed: ----- Method: StackIPhoneConfig>>compilerFlagsRelease (in category 'settings') ----- compilerFlagsRelease ^#('-g0' '-O2' '-fomit-frame-pointer' '-DNDEBUG' '-DDEBUGVM=0' '-DSTACKVM')! Item was changed: ----- Method: StackIPhoneConfig>>setExtraTargetProperties: (in category 'settings') ----- setExtraTargetProperties: maker "super setExtraTargetProperties: maker." | precompiledHeaders plist | precompiledHeaders := (self executableName, '_Prefix.pch'). (maker buildDir forceNewFileNamed: precompiledHeaders) nextPutAll: self precompiledHeaders; close. maker addXCodeProperty: 'GCC_PREFIX_HEADER' value: '${buildDir}/', precompiledHeaders. self setCommonProperties: maker. " generated and add Info.plist file " plist := self plistFile. (maker buildDir forceNewFileNamed: 'Info.plist') nextPutAll: plist; close. maker addProperty: 'MACOSX_BUNDLE_INFO_PLIST' value: '${buildDir}/Info.plist'. maker cmd: 'set_target_properties' params: self executableName, ' PROPERTIES COMPILE_FLAGS "-include \"', (self buildDir / self prefixHeaderFileName) fullName, '\""'. + maker set: 'CMAKE_XCODE_ATTRIBUTE_CODE_SIGN_IDENTITY' + toString: self codeSignIdentity. + maker set: 'CMAKE_XCODE_ATTRIBUTE_TARGETED_DEVICE_FAMILY' + toString: self targetedDeviceFamilyAsString. + maker set: 'CMAKE_XCODE_ATTRIBUTE_IPHONEOS_DEPLOYMENT_TARGET' + to: self deploymentTargetVersion. + maker set: 'CMAKE_XCODE_ATTRIBUTE_CONFIGURATION_BUILD_DIR' + toString: '$(BUILD_DIR)/$(CONFIGURATION)'. + maker set: 'CMAKE_XCODE_ATTRIBUTE_CONFIGURATION_TEMP_DIR' + toString: '$(BUILD_DIR)/$(CONFIGURATION)'. + - maker set: 'CMAKE_XCODE_ATTRIBUTE_CODE_SIGN_IDENTITY' toString: self codeSignIdentity. - maker set: 'CMAKE_XCODE_ATTRIBUTE_TARGETED_DEVICE_FAMILY' toString: self targetedDeviceFamilyAsString. - maker set: 'CMAKE_XCODE_ATTRIBUTE_IPHONEOS_DEPLOYMENT_TARGET' to: self deploymentTargetVersion. maker set: 'EXECUTABLE_OUTPUT_PATH' toString: self outputDir. maker puts: 'set_source_files_properties(${srcVMDir}/gcc3x-cointerp.c PROPERTIES COMPILE_FLAGS -O0)' !

1 0

Linux 4.4.7.2357 VM crash under memory pressure
by Bert Freudenberg 21 May '12

21 May '12

Hilaire discovered that his newest DrGeo segfaults on the XO-1. It works fine elsewhere, including the XO-1.5, which has pretty much the same OS. We narrowed down the problem to the XO-1 having only 256 MB of RAM and no swap space. I can reproduce the crash in a virtual Ubuntu 12 with 768 MB RAM (!) but no swap. Top reports: Mem: 766204k total, 601588k used, 164616k free, 45624k buffers Swap: 0k total, 0k used, 0k free, 277024k cached but DrGeo still crashes. Etoys runs fine using the same Squeak VM on the same system (and on XO-1). DrGeo is based on Pharo 1.4, using a closure image. Etoys still is pre-closure. I ran the DrGeo under GDB. Here is the backtrace after the SEGFAULT, "gnu-interp.c:27272" maps to the "newOop = longAt(fwdBlock);" line in updatePointersInRootObjectsFromto(): ============= (gdb) bt #0 0x0807acdb in updatePointersInRootObjectsFromto (memStart=-1314145112, memEnd=-1312574048) at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:27272 #1 0x08068586 in mapPointersInObjectsFromto (memStart=-1314145112, memEnd=-1312574048) at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:13495 #2 0x0805b53f in incCompBody () at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:5068 #3 0x0805bbe8 in incrementalGC () at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:5405 #4 0x0805c9c7 in instantiateContextsizeInBytes (classPointer=-1324064796, sizeInBytes=92) at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:6099 #5 0x080575b8 in allocateOrRecycleContext (needsLarge=0) at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:2050 #6 0x08061898 in interpret () at /home/olpc/Squeak-4.4.7.2357-src/bld/gnu-interp.c:9310 #7 0x0807f107 in main (argc=2, argv=0xbffff494, envp=0xbffff4a0) at /home/olpc/Squeak-4.4.7.2357-src/unix/vm/sqUnixMain.c:1444 (gdb) p/x memory $3 = 0xb1094000 (gdb) p/x foo->endOfMemory $4 = 0xb1c3b5a0 (gdb) p/x memStart $5 = 0xb1abbca8 (gdb) p/x memEnd $6 = 0xb1c3b5a0 (gdb) p/x fwdBlock $7 = 0x63577a08 ============= fwdBlock appears to be clearly outside the object memory, that can't be right? Any idea how to fix it? - Bert -

2 5

[commit] r2553 - Add a Squeak trunk 4.3 derived VMMaker image for building and simulating.
by David T. Lewis 20 May '12

20 May '12

On Sun, May 20, 2012 at 08:00:40AM +0000, vm-dev-bounces(a)lists.squeakfoundation.org wrote: > The Vm-dev(a)lists.squeakfoundation.org mailing list has 1 request(s) > > Pending posts: > From: commits(a)squeakvm.org on Sat May 19 21:44:13 2012 > Subject: [commit] r2553 - Add a Squeak trunk 4.3 derived VMMaker image for building and simulating. > Cause: Message body is too big: 26668080 bytes with a limit of 400 KB Commit message too large for the list, forwarding truncated version: -------- Author: eliot Date: 2012-05-19 14:41:17 -0700 (Sat, 19 May 2012) New Revision: 2553 Added: branches/Cog/image/CogTrunk43.changes branches/Cog/image/CogTrunk43.image branches/Cog/platforms/unix/plugins/BochsIA32Plugin/ branches/Cog/platforms/unix/plugins/BochsIA32Plugin/Makefile.inc Removed: branches/Cog/image/VMMaker-Squeak4.1.changes branches/Cog/image/VMMaker-Squeak4.1.image Modified: branches/Cog/image/Slang Test Workspace.text branches/Cog/image/VM Simulation Workspace.text branches/Cog/image/Workspace.text branches/Cog/platforms/unix/vm-sound-Sun/sqUnixSoundSun.c branches/Cog/platforms/unix/vm/aio.c branches/Cog/platforms/unix/vm/sqUnixITimerHeartbeat.c branches/Cog/platforms/unix/vm/sqUnixMain.c branches/Cog/processors/IA32/bochs/bochs.h branches/Cog/processors/IA32/linuxbochs/conf.COG branches/Cog/unixbuild/bld/plugins.ext branches/Cog/unixbuild/mtbld/plugins.ext Log: Add a Squeak trunk 4.3 derived VMMaker image for building and simulating. Nuke the ancient Squeak 4.1 derived image. Add Colin Putney's changes to build on illumos. Add the BochsIA32Plugin to the unix build. Added: branches/Cog/image/CogTrunk43.changes =================================================================== --- branches/Cog/image/CogTrunk43.changes (rev 0) +++ branches/Cog/image/CogTrunk43.changes 2012-05-19 21:41:17 UTC (rev 2553) @@ -0,0 +1,496092 @@ +'From Squeak4.1 of 17 April 2010 [latest update: #9957] on 17 April 2010 at 5:22:05 pm'! + + +----STARTUP----{17 April 2010 . 5:21:54 pm} as C:\Squeak\4.0\4.1- <snip>

1 0

VM Maker: VMMaker-dtl.271.mcz
by commits＠source.squeak.org 20 May '12

20 May '12

David T. Lewis uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker-dtl.271.mcz ==================== Summary ==================== Name: VMMaker-dtl.271 Author: dtl Time: 19 May 2012, 6:43:01.788 pm UUID: 570b9903-ef97-4a2a-9159-086175f5fbfb Ancestors: VMMaker-dtl.270 VMMaker 4.9.1 Additional factoring to merge Interpreter/ObjectMemory with StackInterpreter/NewObjectMemory. No change to generated code for the interpreter VM. Inlining note: Moved #postGCAction: from StackInterpreter to object memory because NewObjectMemory is the only sender, and the presence of both #postGCAction and #postGCAction: in the Intepreter would prevent inlining of #postGCAction when translating class Interpreter (relevant for the case of an Interpreter using a NewObjectMemory). =============== Diff against VMMaker-dtl.270 =============== Item was added: + ----- Method: Interpreter>>checkCodeIntegrity: (in category 'stack interpreter support') ----- + checkCodeIntegrity: fullGCFlag + "This is a no-op in the Interpreter and the StackVM" + ^true! Item was added: + ----- Method: Interpreter>>checkInterpreterIntegrity (in category 'stack interpreter support') ----- + checkInterpreterIntegrity + "Perform an integrity/leak check using the heapMap. Assume + clearLeakMapAndMapAccessibleObjects has set a bit at each + object's header. Check that all oops in the interpreter's state + points to a header. Answer if all checks pass." + + ^true! Item was added: + ----- Method: Interpreter>>checkStackIntegrity (in category 'stack interpreter support') ----- + checkStackIntegrity + "Perform an integrity/leak check using the heapMap. Assume + clearLeakMapAndMapAccessibleObjects has set a bit at each + object's header. Scan all objects accessible from the stack + checking that every pointer points to a header. Answer if no + dangling pointers were detected." + + ^true! Item was added: + ----- Method: Interpreter>>interpreterAllocationReserveBytes (in category 'stack interpreter support') ----- + interpreterAllocationReserveBytes + "Extra allocation space in the object memory required by StackInterpreter" + ^ 0 + ! Item was added: + ----- Method: Interpreter>>isMarriedOrWidowedContext: (in category 'stack interpreter support') ----- + isMarriedOrWidowedContext: aContext + ^false! Item was added: + ----- Method: Interpreter>>markAndTraceAndMaybeFreeStackPages: (in category 'stack interpreter support') ----- + markAndTraceAndMaybeFreeStackPages: fullGCFlag + "This is a no-op in Interpreter" + ! Item was added: + ----- Method: Interpreter>>markAndTraceOrFreeMachineCode: (in category 'stack interpreter support') ----- + markAndTraceOrFreeMachineCode: fullGCFlag + "This is a no-op in Interpreter" + ! Item was changed: ----- Method: NewObjectMemory>>fullGC (in category 'garbage collection') ----- fullGC "Do a mark/sweep garbage collection of the entire object memory. Free inaccessible objects but do not move them." <inline: false> fullGCLock > 0 ifTrue: [self warning: 'aborting fullGC because fullGCLock > 0'. ^false]. self initializeFreeBlocksPreSweep. self runLeakCheckerForFullGC: true. + interpreter preGCAction: true. + gcStartUsecs := self ioMicroSecondClock. - self preGCAction: true. - gcStartUsecs := self ioUTCMicrosecondsNow. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. self clearRootsTable. youngStart := self startOfMemory. "process all of memory" self markPhase: true. "Sweep phase returns the number of survivors. Use the up-to-date version instead the one from startup." totalObjectCount := self sweepPhaseForFullGC. self runLeakCheckerForFullGC: true. self fullCompaction. statFullGCs := statFullGCs + 1. + statGCEndUsecs := self ioMicroSecondClock. - statGCEndUsecs := self ioUTCMicrosecondsNow. statFullGCUsecs := statFullGCUsecs + (statGCEndUsecs - gcStartUsecs). self capturePendingFinalizationSignals. youngStart := freeStart. "reset the young object boundary" self postGCAction: true. self runLeakCheckerForFullGC: true! Item was added: + ----- Method: NewObjectMemory>>heapMapAtWord: (in category 'debug printing') ----- + heapMapAtWord: wordPointer + "Implemented in support code for Cog branch in Cross/vm/sqHeapMap.c and + stubbed out here for use with trunk platform sources" + + self flag: #FIXME. "remove this method and add sqHeapMap.c to Cross when 64 bit address space can be supported" + ^ 1 + + " + /* + * Answer non-zero if the heapMap is set at wordPointer, 0 otherwise + */ + int heapMapAtWord(void *wordPointer) + { . . . } + "! Item was added: + ----- Method: NewObjectMemory>>heapMapAtWord:Put: (in category 'debug printing') ----- + heapMapAtWord: wordPointer Put: bit + "Implemented in support code for Cog branch in Cross/vm/sqHeapMap.c and + stubbed out here for use with trunk platform sources" + + self flag: #FIXME. "remove this method and add sqHeapMap.c to Cross when 64 bit address space can be supported" + + " + /* + * Set the value in the map at wordPointer to bit. + */ + void heapMapAtWordPut(void *wordPointer, int bit) + { . . . } + "! Item was changed: ----- Method: NewObjectMemory>>incrementalGC (in category 'garbage collection') ----- incrementalGC "Do a mark/sweep garbage collection of just the young object area of object memory (i.e., objects above youngStart), using the root table to identify objects containing pointers to young objects from the old object area." | survivorCount weDidGrow | <inline: false> rootTableCount >= RootTableSize ifTrue: ["root table overflow; cannot do an incremental GC (this should be very rare)" statRootTableOverflows := statRootTableOverflows + 1. ^self fullGC]. self initializeFreeBlocksPreSweep. self runLeakCheckerForFullGC: false. + interpreter preGCAction: false. - self preGCAction: false. "incremental GC and compaction" + gcStartUsecs := self ioMicroSecondClock. - gcStartUsecs := self ioUTCMicrosecondsNow. weakRootCount := 0. statSweepCount := statMarkCount := statMkFwdCount := statCompMoveCount := 0. self markPhase: false. self assert: weakRootCount <= WeakRootTableSize. 1 to: weakRootCount do: [:i| self finalizeReference: (weakRoots at: i)]. survivorCount := self sweepPhase. self runLeakCheckerForFullGC: false. self incrementalCompaction. statIncrGCs := statIncrGCs + 1. + statGCEndUsecs := self ioMicroSecondClock. - statGCEndUsecs := self ioUTCMicrosecondsNow. statIGCDeltaUsecs := statGCEndUsecs - gcStartUsecs. statIncrGCUsecs := statIncrGCUsecs + statIGCDeltaUsecs. self capturePendingFinalizationSignals. statRootTableCount := rootTableCount. statSurvivorCount := survivorCount. weDidGrow := false. (((survivorCount > tenuringThreshold) or: [rootTableCount >= RootTableRedZone]) or: [forceTenureFlag == true]) ifTrue: ["move up the young space boundary if * there are too many survivors: this limits the number of objects that must be processed on future incremental GC's * we're about to overflow the roots table: this limits the number of full GCs that may be caused by root table overflows in the near future" forceTenureFlag := false. statTenures := statTenures + 1. self clearRootsTable. ((self freeSize < growHeadroom) and: [gcBiasToGrow > 0]) ifTrue: [self biasToGrow. weDidGrow := true]. youngStart := freeStart]. self postGCAction: false. self runLeakCheckerForFullGC: false. weDidGrow ifTrue: [self biasToGrowCheckGCLimit]! Item was changed: ----- Method: NewObjectMemory>>lastPointerWhileForwarding: (in category 'gc -- compaction') ----- lastPointerWhileForwarding: oop "The given object may have its header word in a forwarding block. Find the offset of the last pointer in the object in spite of this obstacle." | header fmt size contextSize | <inline: true> header := self headerWhileForwardingOf: oop. fmt := self formatOfHeader: header. fmt <= 4 ifTrue: [(fmt = 3 and: [interpreter isContextHeader: header]) ifTrue: ["contexts end at the stack pointer" + contextSize := self nacFetchStackPointerOf: oop. - contextSize := coInterpreter nacFetchStackPointerOf: oop. self assert: ReceiverIndex + contextSize < (self lengthOf: oop baseHeader: header format: fmt). ^CtxtTempFrameStart + contextSize * self bytesPerWord]. "do sizeBitsOf: using the header we obtained" size := (header bitAnd: TypeMask) = HeaderTypeSizeAndClass ifTrue: [(self sizeHeader: oop) bitAnd: self allButTypeMask] ifFalse: [header bitAnd: self sizeMask]. ^size - self baseHeaderSize]. fmt < 12 ifTrue: [^0]. "no pointers" "CompiledMethod: contains both pointers and bytes" ^(coInterpreter literalCountOf: oop) * self bytesPerWord + self baseHeaderSize! Item was changed: ----- Method: NewObjectMemory>>markPhase: (in category 'gc -- mark and sweep') ----- markPhase: fullGCFlag "Mark phase of the mark and sweep garbage collector. Set the mark bits of all reachable objects. Free chunks are untouched by this process." "Assume: All non-free objects are initially unmarked. Root objects were unmarked when they were made roots. (Make sure this stays true!!!!)." | oop statMarkCountPriorToStackPageFreeing | <inline: false> "trace the interpreter's objects, including the active stacks and special objects array" self markAndTraceInterpreterOops: fullGCFlag. statSpecialMarkCount := statMarkCount. "trace the roots" 1 to: rootTableCount do: [:i | oop := rootTable at: i. self markAndTrace: oop]. 1 to: extraRootCount do: [:i| oop := (extraRoots at: i) at: 0. (self isIntegerObject: oop) ifFalse: [self markAndTrace: oop]]. statMarkCountPriorToStackPageFreeing := statMarkCount. "Only safe to free stack pages after all roots have been traced." + interpreter markAndTraceAndMaybeFreeStackPages: fullGCFlag. - self markAndTraceAndMaybeFreeStackPages: fullGCFlag. "Only safe to free any machine code methods after all stack pages have been traced." + coInterpreter markAndTraceOrFreeMachineCode: fullGCFlag. - self markAndTraceOrFreeMachineCode: fullGCFlag. statSpecialMarkCount := statSpecialMarkCount + (statMarkCount - statMarkCountPriorToStackPageFreeing)! Item was added: + ----- Method: NewObjectMemory>>nacFetchStackPointerOf: (in category 'gc -- compaction') ----- + nacFetchStackPointerOf: aContext + "A version of fetchStackPointerOf: for use when objects may be forwarded. + Does not do an assert-check of the stack pointer being in bounds." + | sp | + sp := self fetchPointer: StackPointerIndex ofObject: aContext. + (self isIntegerObject: sp) ifFalse: [^0]. + ^self integerValueOf: sp! Item was added: + ----- Method: NewObjectMemory>>postGCAction: (in category 'garbage collection') ----- + postGCAction: fullGCFlag + "Shrink free memory and signal the gc semaphore." + | freeSizeNow | + + freeSizeNow := self freeSize. + (freeSizeNow > self shrinkThreshold + and: [freeSizeNow > self growHeadroom]) ifTrue: + ["Attempt to shrink memory after successfully reclaiming lots of memory" + self shrinkObjectMemory: freeSizeNow - self growHeadroom]. + + interpreter signalSemaphoreWithIndex: self gcSemaphoreIndex! Item was changed: ----- Method: NewObjectMemory>>printMemField:name:size: (in category 'debug printing') ----- printMemField: memField name: name size: length <var: #memField type: #usqInt> <var: #name type: #'char *'> self print: name; tab; printHexPtr: (self cCoerce: memField to: 'char *'); printChar: $/; + printNum: memField - (self cCode: '(usqInt) sqMemoryBase'); - printNum: memField - (self cCoerce: self sqMemoryBaseAddress to: 'usqInt'); print: ' sz: '; printHex: length. length ~= 0 ifTrue: [self printChar: $/; printNum: length]. self cr! Item was added: + ----- Method: ObjectMemory>>checkHeapIntegrity (in category 'memory access') ----- + checkHeapIntegrity + "Perform an integrity/leak check using the heapMap. Assume + clearLeakMapAndMapAccessibleObjects has set a bit at each + object's header. Scan all objects in the heap checking that every + pointer points to a header. Scan the rootTable, remapBuffer and + extraRootTable checking that every entry is a pointer to a header. + Check that the number of roots is correct and that all rootTable + entries have their rootBit set. Answer if all checks pass." + | ok obj sz hdr fmt fi fieldOop numRootsInHeap | + <inline: false> + ok := true. + numRootsInHeap := 0. + obj := self firstObject. + [self oop: obj isLessThan: self startOfFreeSpace] whileTrue: + [(self isFreeObject: obj) + ifTrue: + [sz := self sizeOfFree: obj] + ifFalse: + [hdr := self baseHeader: obj. + (hdr bitAnd: self rootBit) ~= 0 ifTrue: + [numRootsInHeap := numRootsInHeap + 1]. + (self compactClassIndexOfHeader: hdr) = 0 ifTrue: + [fieldOop := (self classHeader: obj) bitAnd: self allButTypeMask. + ((self isIntegerObject: fieldOop) + or: [(self heapMapAtWord: (self pointerForOop: fieldOop)) = 0]) ifTrue: + [self print: 'object leak in '; printHex: obj; print: ' class = '; printHex: fieldOop; cr. + ok := false]]. + fmt := self formatOfHeader: hdr. + (fmt <= 4 "pointers" or: [fmt >= 12 "compiled method"]) ifTrue: + [fmt >= 12 + ifTrue: [fi := (self literalCountOf: obj) + 1 "+ 1 = methodHeader slot"] + ifFalse: [(fmt = 3 and: [self isContextHeader: hdr]) + ifTrue: [fi := CtxtTempFrameStart + (self fetchStackPointerOf: obj)] + ifFalse: [fi := self lengthOf: obj]]. + [(fi := fi - 1) >= 0] whileTrue: + [fieldOop := self fetchPointer: fi ofObject: obj. + (self isNonIntegerObject: fieldOop) ifTrue: + [(fieldOop bitAnd: self bytesPerWord - 1) ~= 0 + ifTrue: + [self print: 'misaligned oop in '; printHex: obj; print: ' @ '; printNum: fi; print: ' = '; printHex: fieldOop; cr. + ok := false] + ifFalse: + [(self heapMapAtWord: (self pointerForOop: fieldOop)) = 0 ifTrue: + [self print: 'object leak in '; printHex: obj; print: ' @ '; printNum: fi; print: ' = '; printHex: fieldOop; cr. + ok := false]]]]]. + sz := self sizeBitsOf: obj]. + obj := self oopFromChunk: obj + sz]. + numRootsInHeap ~= rootTableCount ifTrue: + [self print: 'root count mismatch. #heap roots '; printNum: numRootsInHeap; print: '; #roots '; printNum: rootTableCount; cr. + ok := false]. + 1 to: rootTableCount do: + [:ri| + obj := rootTable at: ri. + (obj bitAnd: self bytesPerWord - 1) ~= 0 + ifTrue: + [self print: 'misaligned oop in rootTable @ '; printNum: ri; print: ' = '; printHex: obj; cr. + ok := false] + ifFalse: + [(self heapMapAtWord: (self pointerForOop: obj)) = 0 + ifTrue: + [self print: 'object leak in rootTable @ '; printNum: ri; print: ' = '; printHex: obj; cr. + ok := false] + ifFalse: + [hdr := self baseHeader: obj. + (hdr bitAnd: self rootBit) = 0 ifTrue: + [self print: 'non-root in rootTable @ '; printNum: ri; print: ' = '; printHex: obj; cr. + ok := false]]]]. + 1 to: remapBufferCount do: + [:ri| + obj := remapBuffer at: ri. + (obj bitAnd: self bytesPerWord - 1) ~= 0 + ifTrue: + [self print: 'misaligned remapRoot @ '; printNum: ri; print: ' = '; printHex: obj; cr. + ok := false] + ifFalse: + [(self heapMapAtWord: (self pointerForOop: obj)) = 0 + ifTrue: + [self print: 'object leak in remapRoots @ '; printNum: ri; print: ' = '; printHex: obj; cr. + ok := false]]]. + 1 to: extraRootCount do: + [:ri| + obj := (extraRoots at: ri) at: 0. + (obj bitAnd: self bytesPerWord - 1) ~= 0 + ifTrue: + [self print: 'misaligned extraRoot @ '; printNum: ri; print: ' => '; printHex: obj; cr. + ok := false] + ifFalse: + [(self heapMapAtWord: (self pointerForOop: obj)) = 0 + ifTrue: + [self print: 'object leak in extraRoots @ '; printNum: ri; print: ' => '; printHex: obj; cr. + ok := false]]]. + ^ok! Item was added: + ----- Method: ObjectMemory>>containOnlyOops: (in category 'become') ----- + containOnlyOops: array + "Return true if the array contains a small integer. You + can't become: SmallIntegers!!" + | fieldOffset | + fieldOffset := self lastPointerOf: array. + "same size as array2" + [fieldOffset >= self baseHeaderSize] whileTrue: + [(self isIntegerObject: (self longAt: array + fieldOffset)) ifTrue: [^ false]. + fieldOffset := fieldOffset - self bytesPerWord]. + ^true! Item was changed: ----- Method: ObjectMemory>>containOnlyOops:and: (in category 'become') ----- containOnlyOops: array1 and: array2 "Return true if neither array contains a small integer. You can't become: integers!!" | fieldOffset | fieldOffset := self lastPointerOf: array1. "same size as array2" [fieldOffset >= self baseHeaderSize] whileTrue: [(self isIntegerObject: (self longAt: array1 + fieldOffset)) ifTrue: [^ false]. (self isIntegerObject: (self longAt: array2 + fieldOffset)) ifTrue: [^ false]. fieldOffset := fieldOffset - self bytesPerWord]. ^ true! Item was added: + ----- Method: ObjectMemory>>forwardingPointerOf: (in category 'gc -- compaction') ----- + forwardingPointerOf: forwardedObj + "Answer the pointer to the given forwardedOop's forwarding block." + + ^((self longAt: forwardedObj) bitAnd: self allButMarkBitAndTypeMask) << 1! Item was added: + ----- Method: ObjectMemory>>fwdBlockValid: (in category 'gc -- compaction') ----- + fwdBlockValid: addr + "Answer if the given address is a valid forward table entry." + ^(self oop: addr isGreaterThan: endOfMemory) + and: [(self oop: addr isLessThanOrEqualTo: fwdTableNext) + and: [(addr bitAnd: 3) = 0]]! Item was added: + ----- Method: ObjectMemory>>headerWhileForwardingOf: (in category 'gc -- compaction') ----- + headerWhileForwardingOf: oop + "Answer the header of the argument even though + it may have its header word in a forwarding block." + | header fwdBlock | + <inline: true> + header := self longAt: oop. + (header bitAnd: self markBit) ~= 0 ifTrue: + ["oop is forwarded; get its real header from its forwarding table entry" + fwdBlock := (header bitAnd: self allButMarkBitAndTypeMask) << 1. + self assert: (self fwdBlockValid: fwdBlock). + header := self longAt: fwdBlock + self bytesPerWord]. + ^header! Item was added: + ----- Method: ObjectMemory>>oop:isGreaterThan:andLessThan: (in category 'oop comparison') ----- + oop: anOop isGreaterThan: baseOop andLessThan: limitOop + "Compare two oop values, treating them as object memory locations. + Use #cCoerce:to: to ensure comparison of unsigned magnitudes. This + method will be inlined during C translation." + + ^(self cCoerce: anOop to: #usqInt) > (self cCoerce: baseOop to: #usqInt) + and: [(self cCoerce: anOop to: #usqInt) < (self cCoerce: limitOop to: #usqInt)]! Item was added: + ----- Method: ObjectMemory>>setEndOfMemory: (in category 'initialization') ----- + setEndOfMemory: newEndOfMemory + self assert: (newEndOfMemory bitAnd: self bytesPerWord - 1) = 0. + endOfMemory := newEndOfMemory! Item was added: + ----- Method: ObjectMemory>>setMemoryLimit: (in category 'initialization') ----- + setMemoryLimit: newMemoryLimit + self assert: (newMemoryLimit bitAnd: self bytesPerWord - 1) = 0. + memoryLimit := newMemoryLimit! Item was changed: ----- Method: StackInterpreter>>interpreterAllocationReserveBytes (in category 'stack pages') ----- interpreterAllocationReserveBytes "At a rough approximation we may need to allocate up to a couple of page's worth of contexts when switching stack pages, assigning to senders, etc. But the snapshot primitive voids all stack pages. So a safe margin is the size of a large context times the maximum number of frames per page times the number of pages." | availableBytesPerPage maxFramesPerPage | availableBytesPerPage := self stackPageByteSize - self stackLimitOffset - self stackPageHeadroom. maxFramesPerPage := availableBytesPerPage / self bytesPerWord // FrameSlots. ^2 raisedTo: (maxFramesPerPage * LargeContextSize * numStackPages) highBit! Item was removed: - ----- Method: StackInterpreter>>nacFetchStackPointerOf: (in category 'internal interpreter access') ----- - nacFetchStackPointerOf: aContext - "A version of fetchStackPointerOf: for use when objects may be forwarded. - Does not do an assert-check of the stack pointer being in bounds." - | sp | - <inline: true> - sp := objectMemory fetchPointer: StackPointerIndex ofObject: aContext. - (objectMemory isIntegerObject: sp) ifFalse: [^0]. - ^objectMemory integerValueOf: sp! Item was removed: - ----- Method: StackInterpreter>>postGCAction: (in category 'object memory support') ----- - postGCAction: fullGCFlag - "Shrink free memory and signal the gc semaphore" - | freeSizeNow | - - freeSizeNow := objectMemory freeSize. - (freeSizeNow > objectMemory shrinkThreshold - and: [freeSizeNow > objectMemory growHeadroom]) ifTrue: - ["Attempt to shrink memory after successfully reclaiming lots of memory" - objectMemory shrinkObjectMemory: freeSizeNow - objectMemory growHeadroom]. - - self signalSemaphoreWithIndex: objectMemory gcSemaphoreIndex! Item was changed: ----- Method: VMMaker class>>versionString (in category 'version testing') ----- versionString "VMMaker versionString" + ^'4.9.1'! - ^'4.9'!

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev May 2012