Vm-dev October 2013

vm-dev@lists.squeakfoundation.org

30 participants
145 discussions

VM Maker: VMMaker.oscog-eem.466.mcz
by commits＠source.squeak.org 18 Oct '13

18 Oct '13

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.466.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.466 Author: eem Time: 17 October 2013, 5:32:24.704 pm UUID: dc4753dd-5258-42e3-9e41-35f8f037cd01 Ancestors: VMMaker.oscog-eem.465 Commit a barely functional markAndTrace: using a mark stack. Introduce an obj stack datatype, a stack composed of pages that grows but does not release memory back on shrink (when should it do that?). Use this for the mark stack and the ephemeron queue. Add SpurContiguousObjStack and use it for the unscanned ephemerons during global and/or incremental gc. Re-categorize the GC methods to group global, scavenging and incremental GC together. =============== Diff against VMMaker.oscog-eem.465 =============== Item was changed: ----- Method: Spur32BitMemoryManager>>setIsMarkedOf:to: (in category 'header access') ----- setIsMarkedOf: objOop to: aBoolean self flag: #endianness. self longAt: objOop + 4 put: (aBoolean + ifTrue: [(self longAt: objOop + 4) bitOr: 1 << self markedBitHalfShift] + ifFalse: [(self longAt: objOop + 4) bitAnd: (1 << self markedBitHalfShift) bitInvert32])! - ifTrue: [(self longAt: objOop) bitOr: 1 << self markedBitHalfShift] - ifFalse: [(self longAt: objOop) bitAnd: (1 << self markedBitHalfShift) bitInvert32])! Item was added: + SpurNewSpaceSpace subclass: #SpurContiguousObjStack + instanceVariableNames: 'top' + classVariableNames: '' + poolDictionaries: '' + category: 'VMMaker-SpurMemoryManager'! Item was added: + ----- Method: SpurContiguousObjStack>>top (in category 'accessing') ----- + top + "Answer the value of top" + + ^ top! Item was added: + ----- Method: SpurContiguousObjStack>>top: (in category 'accessing') ----- + top: anObject + "Set the value of top" + + ^top := anObject! Item was changed: CogClass subclass: #SpurMemoryManager (excessive size, no diff calculated) Item was changed: ----- Method: SpurMemoryManager class>>ancilliaryClasses: (in category 'translation') ----- ancilliaryClasses: options ^{ SpurGenerationScavenger. SpurNewSpaceSpace. + SpurSegmentManager. SpurSegmentInfo. + SpurContiguousObjStack }! - SpurSegmentManager. SpurSegmentInfo }! Item was changed: ----- Method: SpurMemoryManager class>>declareCVarsIn: (in category 'translation') ----- declareCVarsIn: aCCodeGenerator self declareCAsOop: #( memory freeStart scavengeThreshold newSpaceLimit pastSpaceStart lowSpaceThreshold freeOldSpaceStart endOfMemory sortedFreeChunks) in: aCCodeGenerator. self declareCAsUSqLong: (self allInstVarNames select: [:ivn| ivn endsWith: 'Usecs']) in: aCCodeGenerator. aCCodeGenerator var: #freeLists type: #'sqInt *'; + var: #classTableBitmap type: #'unsigned char *'; + var: #unscannedEphemerons type: #SpurContiguousObjStack. - var: #classTableBitmap type: #'unsigned char *'. aCCodeGenerator var: #remapBuffer declareC: 'sqInt remapBuffer[RemapBufferSize + 1 /* ', (RemapBufferSize + 1) printString, ' */]'. aCCodeGenerator var: #extraRoots declareC: 'sqInt *extraRoots[ExtraRootsSize + 1 /* ', (ExtraRootsSize + 1) printString, ' */]'.! Item was changed: ----- Method: SpurMemoryManager class>>initialize (in category 'class initialization') ----- initialize + "SpurMemoryManager initialize" BitsPerByte := 8. + "An obj stack is a stack of objects stored in a hidden root slot, such as + the markStack or the ephemeronQueue. It is a linked list of segments, + with the hot end at the head of the list. It is a word object. The stack + pointer is in ObjStackTopx and 0 means empty. The list goes through + ObjStackNextx. We don't want to shrink objStacks, since they're used + in GC and its good to keep their memory around. So unused pages + created by popping emptying pages are kept on the ObjStackFreex list." + ObjStackPageSlots := 4092. "+ double header = 16k bytes per page in 32-bits" + ObjStackFixedSlots := 3. + ObjStackTopx := 0. + ObjStackFreex := 1. + ObjStackNextx := 2. + ObjStackLimit := ObjStackPageSlots - ObjStackFixedSlots. + "There are currently two obj stacks, the mark stack and the ephemeron queue." + MarkStackRootIndex := self basicNew classTableRootSlots. + EphemeronQueueRootIndex := MarkStackRootIndex + 1. + - "SpurMemoryManager initialize" CheckObjectOverwrite := true. "The remap buffer support is for compatibility; Spur doesn't GC during allocation. Eventually this should die." RemapBufferSize := 25. "Extra roots are for plugin support." ExtraRootsSize := 2048 "max. # of external roots"! Item was added: + ----- Method: SpurMemoryManager>>ensureAllMarkBitsAreZero (in category 'gc - incremental') ----- + ensureAllMarkBitsAreZero + "If the incremental collector is running mark bits may be set; stop it and clear them if necessary." + self shouldBeImplemented! Item was added: + ----- Method: SpurMemoryManager>>ensureRoomOnObjStackAtIndex: (in category 'obj stacks') ----- + ensureRoomOnObjStackAtIndex: objStackRootIndex + "An obj stack is a stack of objects stored in a hidden root slot, such as + the markStack or the ephemeronQueue. It is a linked list of segments, + with the hot end at the head of the list. It is a word object. The stack + pointer is in ObjStackTopx and 0 means empty. The list goes through + ObjStackNextx. We don't want to shrink objStacks, since they're used + in GC and its good to keep their memory around. So unused pages + created by popping emptying pages are kept on the ObjStackFreex list." + | stackOrNil freeOrNewPage | + stackOrNil := self fetchPointer: objStackRootIndex ofObject: hiddenRootsObj. + (stackOrNil = nilObj + or: [(self fetchPointer: ObjStackTopx ofObject: stackOrNil) >= ObjStackLimit]) ifTrue: + [freeOrNewPage := self fetchPointer: ObjStackFreex ofObject: stackOrNil. + freeOrNewPage ~= 0 + ifTrue: "the free page list is always on the new page." + [self storePointerUnchecked: ObjStackFreex ofObject: stackOrNil withValue: 0] + ifFalse: + [freeOrNewPage := self allocateSlotsInOldSpace: ObjStackPageSlots + format: self wordIndexableFormat + classIndex: self wordSizeClassIndexPun. + freeOrNewPage ifNil: [self error: 'no memory to allocate or extend obj stack']. + self storePointerUnchecked: ObjStackFreex ofObject: freeOrNewPage withValue: 0]. + marking ifTrue: [self setIsMarkedOf: freeOrNewPage to: true]. + self storePointerUnchecked: ObjStackNextx ofObject: freeOrNewPage withValue: stackOrNil; + storePointerUnchecked: ObjStackTopx ofObject: freeOrNewPage withValue: 0; + storePointerUnchecked: objStackRootIndex ofObject: hiddenRootsObj withValue: freeOrNewPage. + self assert: (self isValidObjStackAt: objStackRootIndex). + ^freeOrNewPage]. + self assert: (self isValidObjStackAt: objStackRootIndex). + ^stackOrNil! Item was changed: + ----- Method: SpurMemoryManager>>ephemeronQueue (in category 'gc - global') ----- - ----- Method: SpurMemoryManager>>ephemeronQueue (in category 'garbage collection') ----- ephemeronQueue + ^self fetchPointer: EphemeronQueueRootIndex ofObject: hiddenRootsObj! - "The ephemeron queue is the first hidden root after the class table pages." - ^self fetchPointer: self numClassTablePages ofObject: hiddenRootsObj! Item was changed: + ----- Method: SpurMemoryManager>>ephemeronQueue: (in category 'gc - global') ----- - ----- Method: SpurMemoryManager>>ephemeronQueue: (in category 'garbage collection') ----- ephemeronQueue: anObject + self storePointer: EphemeronQueueRootIndex ofObject: hiddenRootsObj withValue: anObject! - "The ephemeron queue is the first hidden root after the class table pages." - self storePointer: self numClassTablePages ofObject: hiddenRootsObj withValue: anObject! Item was added: + ----- Method: SpurMemoryManager>>findLargestFreeChunk (in category 'free space') ----- + findLargestFreeChunk + "Answer, but do not remove, the largest free chunk in the free lists." + | treeNode childNode | + treeNode := freeLists at: 0. + treeNode = 0 ifTrue: + [^nil]. + [self assert: (self isValidFreeObject: treeNode). + childNode := self fetchPointer: self freeChunkLargerIndex ofFreeChunk: treeNode. + childNode ~= 0] whileTrue: + [treeNode := childNode]. + ^treeNode! Item was changed: + ----- Method: SpurMemoryManager>>flushNewSpace (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>flushNewSpace (in category 'generation scavenging') ----- flushNewSpace | savedTenuringThreshold | savedTenuringThreshold := scavenger getRawTenuringThreshold. scavenger setRawTenuringThreshold: newSpaceLimit. self scavengingGCTenuringIf: TenureByAge. scavenger setRawTenuringThreshold: savedTenuringThreshold. self assert: scavenger rememberedSetSize = 0. self assert: pastSpaceStart = scavenger pastSpace start. self assert: freeStart = scavenger eden start! Item was changed: + ----- Method: SpurMemoryManager>>flushNewSpaceInstancesOf: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>flushNewSpaceInstancesOf: (in category 'generation scavenging') ----- flushNewSpaceInstancesOf: aClass | classIndex | classIndex := self rawHashBitsOf: aClass. classIndex = 0 ifTrue: "no instances; nothing to do" [^self]. scavenger tenuringClassIndex: classIndex. self scavengingGCTenuringIf: TenureByClass. self assert: (self existInstancesInNewSpaceOf: aClass) not! Item was added: + ----- Method: SpurMemoryManager>>fullGC (in category 'gc - global') ----- + fullGC + ^self globalGarbageCollect! Item was changed: + ----- Method: SpurMemoryManager>>fullGCLock (in category 'gc - global') ----- - ----- Method: SpurMemoryManager>>fullGCLock (in category 'garbage collection') ----- fullGCLock "Spur never has a need to lock GC because it does not move pinned objects." ^0! Item was added: + ----- Method: SpurMemoryManager>>globalGarbageCollect (in category 'gc - global') ----- + globalGarbageCollect + self markObjects. + self freeUnmarkedObjects. + self exactFitCompact! Item was changed: ----- Method: SpurMemoryManager>>hiddenRootsObj: (in category 'class table') ----- hiddenRootsObj: anOop hiddenRootsObj := anOop. - classTableFirstPage := self fetchPointer: 0 ofObject: hiddenRootsObj. - self assert: (self numSlotsOf: hiddenRootsObj) = (self classTableRootSlots + self hiddenRootSlots). - self assert: (self numSlotsOf: classTableFirstPage) - 1 = self classTableMinorIndexMask. self cCode: [self assert: self validClassTableRootPages] inSmalltalk: [numClassTablePages ifNotNil: [self assert: self validClassTableRootPages]].. + classTableFirstPage := self fetchPointer: 0 ofObject: hiddenRootsObj. + self assert: (self numSlotsOf: classTableFirstPage) - 1 = self classTableMinorIndexMask. "Set classTableIndex to the start of the last used page (excepting first page). Set numClassTablePages to the number of used pages." numClassTablePages := self classTableRootSlots. 2 to: numClassTablePages - 1 do: [:i| (self fetchPointer: i ofObject: hiddenRootsObj) = nilObj ifTrue: [numClassTablePages := i. classTableIndex := (numClassTablePages - 1 max: 1) << self classTableMajorIndexShift. ^self]]. "no unused pages; set it to the start of the second page." classTableIndex := 1 << self classTableMajorIndexShift! Item was changed: + ----- Method: SpurMemoryManager>>incrementalGC (in category 'gc - global') ----- - ----- Method: SpurMemoryManager>>incrementalGC (in category 'garbage collection') ----- incrementalGC self shouldNotImplement! Item was changed: ----- Method: SpurMemoryManager>>initialize (in category 'initialization') ----- initialize "We can put all initializations that set something to 0 or to false here. In C all global variables are initialized to 0, and 0 is false." remapBuffer := Array new: RemapBufferSize. remapBufferCount := extraRootCount := 0. "see below" freeListsMask := totalFreeOldSpace := lowSpaceThreshold := 0. checkForLeaks := 0. + needGCFlag := signalLowSpace := scavengeInProgress := marking := false. - needGCFlag := signalLowSpace := scavengeInProgress := false. becomeEffectsFlags := 0. statScavenges := statIncrGCs := statFullGCs := 0. statScavengeGCUsecs := statIncrGCUsecs := statFullGCUsecs := statGCEndUsecs := 0. statSGCDeltaUsecs := statIGCDeltaUsecs := statFGCDeltaUsecs := 0. statGrowMemory := statShrinkMemory := statRootTableCount := statTenures := statSurvivorCount := 0. statRootTableOverflows := statSweepCount := statMarkCount := statSpecialMarkCount := statMkFwdCount := 0. + "We can initialize things that are allocated but are lazily initialized." + unscannedEphemerons := SpurContiguousObjStack new. + "we can initialize things that are virtual in C." scavenger := SpurGenerationScavengerSimulator new manager: self; yourself. segmentManager := SpurSegmentManager new manager: self; yourself. "We can also initialize here anything that is only for simulation." heapMap := self wordSize = 4 ifTrue: [CogCheck32BitHeapMap new]. "N.B. We *don't* initialize extraRoots because we don't simulate it."! Item was added: + ----- Method: SpurMemoryManager>>initializeMarkStack (in category 'gc - global') ----- + initializeMarkStack + self ensureRoomOnObjStackAtIndex: MarkStackRootIndex! Item was changed: + ----- Method: SpurMemoryManager>>initializeNewSpaceVariables (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>initializeNewSpaceVariables (in category 'generation scavenging') ----- initializeNewSpaceVariables startOfMemory ifNotNil: "true in bootstrap" [^self]. freeStart := scavenger eden start. pastSpaceStart := scavenger pastSpace start. scavengeThreshold := scavenger eden limit - (scavenger edenBytes / 64) - coInterpreter interpreterAllocationReserveBytes. startOfMemory := scavenger pastSpace start min: scavenger futureSpace start. self assert: startOfMemory < scavenger eden start. self initSpaceForAllocationCheck: (self addressOf: scavenger eden)! Item was changed: ----- Method: SpurMemoryManager>>initializeObjectMemory: (in category 'initialization') ----- initializeObjectMemory: bytesToShift "Initialize object memory variables at startup time. Assume endOfMemory is initially set (by the image-reading code) to the end of the last object in the image. Initialization redefines endOfMemory to be the end of the object allocation area based on the total available memory, but reserving some space for forwarding blocks." "Assume: image reader initializes the following variables: memory memoryLimit specialObjectsOop lastHash " <inline: false> | freeListObj | "Catch mis-initializations leading to bad translations to C" self assert: BaseHeaderSize = self baseHeaderSize. segmentManager adjustSegmentSwizzlesBy: bytesToShift. "image may be at a different address; adjust oops for new location" self adjustAllOopsBy: bytesToShift. segmentManager numSegments > 0 "false if Spur image bootstrap" ifTrue: [specialObjectsOop := segmentManager swizzleObj: specialObjectsOop] ifFalse: [self assert: bytesToShift = 0]. "heavily used special objects" nilObj := self splObj: NilObject. falseObj := self splObj: FalseObject. trueObj := self splObj: TrueObject. "In Cog we insist that nil, true & false are next to each other (Cogit generates tighter conditional branch code as a result). In addition, Spur places the free lists and class table root page immediately following them." self assert: nilObj = newSpaceLimit. self assert: falseObj = (self objectAfter: nilObj). self assert: trueObj = (self objectAfter: falseObj). freeListObj := self objectAfter: trueObj. self reInitializeClassTablePostLoad: (self objectAfter: freeListObj). self initializeFreeSpacePostLoad: freeListObj. + self swizzleObjStack: MarkStackRootIndex. + self swizzleObjStack: EphemeronQueueRootIndex. segmentManager collapseSegmentsPostSwizzle. self initializeNewSpaceVariables. self initializeOldSpaceFirstFree: freeOldSpaceStart. "initializes endOfMemory, freeStart" "These defaults should depend on machine size; e.g. too small on a powerful laptop, too big on a Pi." growHeadroom := 8*1024*1024. "headroom when growing" shrinkThreshold := 16*1024*1024. "free space before shrinking"! Item was added: + ----- Method: SpurMemoryManager>>initializeUnscannedEphemerons (in category 'gc - global') ----- + initializeUnscannedEphemerons + "Initialize unscannedEphemerons to use the largest free chunk + or unused eden space, which ever is the larger." + + | largestFree sizeOfUnusedEden | + largestFree := self findLargestFreeChunk. + sizeOfUnusedEden := scavenger eden limit - freeStart. + (largestFree notNil + and: [(self numSlotsOfAny: largestFree) > (sizeOfUnusedEden / self wordSize)]) + ifTrue: + [unscannedEphemerons + start: largestFree + self baseHeaderSize; + limit: (self addressAfter: largestFree)] + ifFalse: + [unscannedEphemerons + start: freeStart; + limit: scavenger eden limit]. + unscannedEphemerons top: unscannedEphemerons start! Item was changed: + ----- Method: SpurMemoryManager>>isScavengeSurvivor: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>isScavengeSurvivor: (in category 'generation scavenging') ----- isScavengeSurvivor: oop <doNotGenerate> ^scavenger isScavengeSurvivor: oop! Item was added: + ----- Method: SpurMemoryManager>>isValidObjStackAt: (in category 'obj stacks') ----- + isValidObjStackAt: objStackRootIndex + "Answer if the obj stack at objStackRootIndex is valid." + | stackOrNil | + stackOrNil := self fetchPointer: objStackRootIndex ofObject: hiddenRootsObj. + ^stackOrNil = nilObj + or: [self isValidObjStackPage: stackOrNil firstPage: true]! Item was added: + ----- Method: SpurMemoryManager>>isValidObjStackPage:firstPage: (in category 'obj stacks') ----- + isValidObjStackPage: objStackPage firstPage: isFirstPage + "Answer if the obj stack at stackRootIndex is valid." + | freeOrNextPage index | + <inline: false> + (self numSlotsOfAny: objStackPage) ~= ObjStackPageSlots ifTrue: [^false]. + freeOrNextPage := self fetchPointer: ObjStackFreex ofObject: objStackPage. + freeOrNextPage ~= 0 ifTrue: + [isFirstPage ifFalse: [^false]. + (self isValidObjStackPage: freeOrNextPage firstPage: false) ifFalse: + [^false]]. + index := self fetchPointer: ObjStackTopx ofObject: objStackPage. + (index between: 0 and: ObjStackLimit) ifFalse: [^false]. + freeOrNextPage := self fetchPointer: ObjStackNextx ofObject: objStackPage. + ^freeOrNextPage = 0 + or: [self isValidObjStackPage: objStackPage firstPage: false]! Item was changed: + ----- Method: SpurMemoryManager>>mapExtraRoots (in category 'gc - global') ----- - ----- Method: SpurMemoryManager>>mapExtraRoots (in category 'garbage collection') ----- mapExtraRoots self assert: remapBufferCount = 0. 1 to: extraRootCount do: [:i | | oop | oop := (extraRoots at: i) at: 0. ((self isImmediate: oop) or: [self isFreeObject: oop]) ifFalse: [(self shouldRemapObj: oop) ifTrue: [(extraRoots at: i) at: 0 put: (self remapObj: oop)]]]! Item was added: + ----- Method: SpurMemoryManager>>markAccessibleObjects (in category 'gc - global') ----- + markAccessibleObjects + self assert: self validClassTableRootPages. + marking := true. + self markAndTraceObjStack: self markStack andContents: false. + self assert: self validClassTableRootPages. + self markAndTraceObjStack: self ephemeronQueue andContents: true. + self assert: self validClassTableRootPages. + self markAndTrace: hiddenRootsObj. + self markAndTrace: self specialObjectsOop. + coInterpreter markAndTraceInterpreterOops: true. + self markAndFireEphemerons. + marking := false! Item was added: + ----- Method: SpurMemoryManager>>markAndTrace: (in category 'gc - global') ----- + markAndTrace: objOop + "Mark the argument, and all objects reachable from it, and any remaining objects on the mark stack." + <returnTypeC: #void> + | objToScan index key | + self assert: (self isNonImmediate: objOop). + (self isMarked: objOop) ifTrue: + [^nil]. + "self setIsMarkedOf: objOop to: false" "for debugging" + self setIsMarkedOf: objOop to: true. + ((self isEphemeron: objOop) + and: [(self isNonImmediate: (key := self keyOfEphemeron: objOop)) + and: [(self isMarked: key) not + and: [self pushOnUnscannedEphemeronStack: objOop]]]) ifTrue: + [^self]. + + "Now scan the object, and any remaining objects on the mark stack." + objToScan := objOop. + index := 0. + "It is a bad idea to scan big objects early in the mark phase; pushing all their + referents onto the mark stack is inviting overflow. Instead, defer until later." + [| numSlots | + numSlots := self numStrongSlotsOf: objToScan ephemeronInactiveIf: nil. + numSlots > self traceImmediatelySlotLimit ifTrue: + [(self swapLargeObject: objToScan + ofSlots: numSlots + withSmallerOnObjStackAt: MarkStackRootIndex) ifNotNil: + [:top| + (self isImmediate: top) + ifTrue: "index,large object pair" + [index := self integerValueOf: top. + objToScan := self popObjStackAt: MarkStackRootIndex] + ifFalse: + [objToScan := top]]]. + self assert: (index between: 0 and: (self numStrongSlotsOf: objToScan ephemeronInactiveIf: nil) - 1). + "The opportunity here is to scan a large object only so far, and push it back on the + stack when the stack appears full. But for the moment we don't code this; it's tricky." + [index < numSlots] whileTrue: + [| field | + field := self fetchPointer: index ofObject: objToScan. + ((self isImmediate: field) or: [self isMarked: field]) ifFalse: + [self setIsMarkedOf: field to: true. + ((self isEphemeron: field) + and: [(self isNonImmediate: (key := self keyOfEphemeron: field)) + and: [(self isMarked: key) not + and: [self pushOnUnscannedEphemeronStack: field]]]) ifFalse: + [self push: field onObjStackAt: MarkStackRootIndex]]. + index := index + 1]. + objToScan := self popObjStackAt: MarkStackRootIndex. + objToScan ifNil: [^self]. + (self isImmediate: objToScan) + ifTrue: + [index := self integerValueOf: objToScan. + objToScan := self popObjStackAt: MarkStackRootIndex] + ifFalse: + [index := 0]] repeat! Item was added: + ----- Method: SpurMemoryManager>>markAndTraceObjStack:andContents: (in category 'obj stacks') ----- + markAndTraceObjStack: stackOrNil andContents: markAndTraceContents + "An obj stack is a stack of objects stored in a hidden root slot, such + as the markStack or the ephemeronQueue. It is a linked list of + segments, with the hot end at the head of the list. It is a word object. + The stack pointer is in ObjStackTopx and 0 means empty." + <returnTypeC: #void> + | index field | + stackOrNil = nilObj ifTrue: + [^self]. + self assert: (self numSlotsOfAny: stackOrNil) = ObjStackPageSlots. + field := self fetchPointer: ObjStackNextx ofObject: stackOrNil. + self markAndTraceObjStack: field andContents: markAndTraceContents. + markAndTraceContents ifFalse: + [^self]. + "There are two fixed slots in an obj stack, and a Topx of 0 indicates empty, so + if there were 4 slots in an oop stack, full would be 2, and the last 0-rel index is 3. + Hence the last index is topx + fixed slots - 1, or topx + ObjStackNextx" + index := (self fetchPointer: ObjStackTopx ofObject: stackOrNil) + ObjStackNextx. + [index > ObjStackNextx] whileTrue: + [field := self fetchPointer: index ofObject: stackOrNil. + (self isImmediate: field) ifFalse: + [self markAndTrace: field]. + index := index - 1]! Item was added: + ----- Method: SpurMemoryManager>>markObjects (in category 'gc - global') ----- + markObjects + "Mark all accessible objects." + "If the incremental collector is running mark bits may be set; stop it and clear them if necessary." + self ensureAllMarkBitsAreZero. + self initializeUnscannedEphemerons. + self initializeMarkStack. + self markAccessibleObjects! Item was added: + ----- Method: SpurMemoryManager>>markStack (in category 'gc - global') ----- + markStack + ^self fetchPointer: MarkStackRootIndex ofObject: hiddenRootsObj! Item was added: + ----- Method: SpurMemoryManager>>markStack: (in category 'gc - global') ----- + markStack: anObject + self storePointer: MarkStackRootIndex ofObject: hiddenRootsObj withValue: anObject! Item was changed: + ----- Method: SpurMemoryManager>>newSpaceIsEmpty (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>newSpaceIsEmpty (in category 'generation scavenging') ----- newSpaceIsEmpty ^freeStart = scavenger eden start and: [pastSpaceStart = scavenger pastSpace start]! Item was changed: + ----- Method: SpurMemoryManager>>newSpaceRefCountMask (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>newSpaceRefCountMask (in category 'generation scavenging') ----- newSpaceRefCountMask "The three bit field { isGrey, isPinned, isRemembered } is for bits that are never set in young objects. This allows the remembered table to be pruned when full by using these bits as a reference count of newSpace objects from the remembered table. Objects with a high count should be tenured to prune the remembered table." ^ (1 << self greyBitShift) | (1 << self pinnedBitShift) | (1 << self rememberedBitShift)! Item was changed: ----- Method: SpurMemoryManager>>numStrongSlotsOf:ephemeronInactiveIf: (in category 'object access') ----- numStrongSlotsOf: objOop ephemeronInactiveIf: criterion "Answer the number of strong pointer fields in the given object. Works with CompiledMethods, as well as ordinary objects." <api> <var: 'criterion' declareC: 'int (*criterion)(sqInt key)'> <inline: true> <asmLabel: false> | fmt numSlots contextSize numLiterals | fmt := self formatOf: objOop. fmt <= self lastPointerFormat ifTrue: [numSlots := self numSlotsOf: objOop. fmt <= self arrayFormat ifTrue: [^numSlots]. fmt = self indexablePointersFormat ifTrue: [(self isContextNonImm: objOop) ifTrue: ["contexts end at the stack pointer" contextSize := coInterpreter fetchStackPointerOf: objOop. ^CtxtTempFrameStart + contextSize]. ^numSlots]. fmt = self weakArrayFormat ifTrue: [^self fixedFieldsOfClass: (self fetchClassOfNonImm: objOop)]. self assert: fmt = self ephemeronFormat. + ^(criterion isNil or: [self perform: criterion with: (self keyOfEphemeron: objOop)]) - ^(self perform: criterion with: (self keyOfEphemeron: objOop)) ifTrue: [numSlots] ifFalse: [0]]. fmt = self forwardedFormat ifTrue: [^1]. fmt < self firstCompiledMethodFormat ifTrue: [^0]. "no pointers" "CompiledMethod: contains both pointers and bytes" numLiterals := coInterpreter literalCountOf: objOop. ^numLiterals + LiteralStart! Item was added: + ----- Method: SpurMemoryManager>>popObjStackAt: (in category 'obj stacks') ----- + popObjStackAt: objStackRootIndex + self shouldBeImplemented! Item was added: + ----- Method: SpurMemoryManager>>push:onObjStackAt: (in category 'obj stacks') ----- + push: objOop onObjStackAt: objStackRootIndex + | page numEntries | + page := self ensureRoomOnObjStackAtIndex: objStackRootIndex. + numEntries := self fetchPointer: ObjStackTopx ofObject: page. + self assert: numEntries < ObjStackLimit. + numEntries := numEntries + 1. + self storePointerUnchecked: numEntries + ObjStackNextx ofObject: page withValue: objOop; + storePointerUnchecked: ObjStackTopx ofObject: page withValue: numEntries! Item was added: + ----- Method: SpurMemoryManager>>pushOnUnscannedEphemeronStack: (in category 'weakness and ephemerality') ----- + pushOnUnscannedEphemeronStack: anEphemeron + "Attempt to push anEphemeron on the unscanned ephemerons stack + and answer if the attempt succeeded. Note that the ephemeron + stack overflowing isn't a disaster; it simply means treating the + ephemeron as strong in this GC cycle." + self assert: (self isEphemeron: anEphemeron). + unscannedEphemerons top >= unscannedEphemerons limit ifTrue: + [^false]. + self longAt: unscannedEphemerons top put: anEphemeron. + unscannedEphemerons top: unscannedEphemerons top + self wordSize. + ^true! Item was added: + ----- Method: SpurMemoryManager>>queueEphemeron: (in category 'weakness and ephemerality') ----- + queueEphemeron: anEphemeron + self assert: ((self isNonImmediate: anEphemeron) + and: [(self formatOf: anEphemeron) = self ephemeronFormat]). + self push: anEphemeron onObjStackAt: EphemeronQueueRootIndex! Item was changed: + ----- Method: SpurMemoryManager>>remap: (in category 'gc - global') ----- - ----- Method: SpurMemoryManager>>remap: (in category 'garbage collection') ----- remap: oop self shouldNotImplement! Item was changed: + ----- Method: SpurMemoryManager>>remapObj: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>remapObj: (in category 'generation scavenging') ----- remapObj: objOop "Scavenge or simply follow objOop. Answer the new location of objOop. The send should have been guarded by a send of shouldRemapOop: or shouldScavengeObj:. The method is called remapObj: for compatibility with ObjectMemory." <inline: false> | resolvedObj | self assert: (self shouldRemapOop: objOop). (self isForwarded: objOop) ifTrue: [resolvedObj := self followForwarded: objOop. (self isYoung: resolvedObj) ifFalse: "a becommed object whose target is in old space" [^resolvedObj]. (self isInFutureSpace: resolvedObj) ifTrue: "already scavenged" [^resolvedObj]] ifFalse: [resolvedObj := objOop]. ^scavenger copyAndForward: resolvedObj! Item was changed: + ----- Method: SpurMemoryManager>>scavengingGC (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>scavengingGC (in category 'generation scavenging') ----- scavengingGC "Run the scavenger." self scavengingGCTenuringIf: TenureByAge! Item was changed: + ----- Method: SpurMemoryManager>>scavengingGCTenuringIf: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>scavengingGCTenuringIf: (in category 'generation scavenging') ----- scavengingGCTenuringIf: tenuringCriterion "Run the scavenger." self assert: remapBufferCount = 0. self assert: (segmentManager numSegments = 0 "true in the spur image bootstrap" or: [scavenger eden limit - freeStart > coInterpreter interpreterAllocationReserveBytes]). self checkFreeSpace. "coInterpreter printCallStackFP: coInterpreter framePointer" self runLeakCheckerForFullGC: false. coInterpreter preGCAction: GCModeIncr; "would prefer this to be in mapInterpreterOops, but compatibility with ObjectMemory dictates it goes here." flushMethodCacheFrom: startOfMemory to: newSpaceLimit. needGCFlag := false. gcStartUsecs := coInterpreter ioUTCMicrosecondsNow. scavengeInProgress := true. pastSpaceStart := scavenger scavenge: tenuringCriterion. self assert: (self oop: pastSpaceStart isGreaterThanOrEqualTo: scavenger pastSpace start andLessThanOrEqualTo: scavenger pastSpace limit). freeStart := scavenger eden start. self initSpaceForAllocationCheck: (self addressOf: scavenger eden). scavengeInProgress := false. statScavenges := statScavenges + 1. statGCEndUsecs := coInterpreter ioUTCMicrosecondsNow. statSGCDeltaUsecs := statGCEndUsecs - gcStartUsecs. statScavengeGCUsecs := statScavengeGCUsecs + statSGCDeltaUsecs. statRootTableCount := scavenger rememberedSetSize. coInterpreter postGCAction. self runLeakCheckerForFullGC: false. self checkFreeSpace! Item was changed: + ----- Method: SpurMemoryManager>>scheduleScavenge (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>scheduleScavenge (in category 'generation scavenging') ----- scheduleScavenge needGCFlag := true. coInterpreter forceInterruptCheck! Item was changed: + ----- Method: SpurMemoryManager>>shouldRemapObj: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>shouldRemapObj: (in category 'generation scavenging') ----- shouldRemapObj: objOop "Answer if the obj should be scavenged (or simply followed). The method is called shouldRemapObj: for compatibility with ObjectMemory." ^(self isForwarded: objOop) or: [self isYoung: objOop]! Item was changed: + ----- Method: SpurMemoryManager>>shouldRemapOop: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>shouldRemapOop: (in category 'generation scavenging') ----- shouldRemapOop: oop <api> "Answer if the oop should be scavenged.. The method is called shouldRemapOop: for compatibility with ObjectMemory." <inline: true> ^(self isNonImmediate: oop) and: [self shouldRemapObj: oop]! Item was added: + ----- Method: SpurMemoryManager>>stackValue:ofObjStack: (in category 'obj stacks') ----- + stackValue: offset ofObjStack: objStackPage + | numEntries nextPage | + self assert: offset >= 0. + numEntries := self fetchPointer: ObjStackTopx ofObject: objStackPage. + offset < numEntries ifTrue: + [^self fetchPointer: ObjStackTopx + offset ofObject: objStackPage]. + nextPage := self fetchPointer: ObjStackNextx ofObject: objStackPage. + nextPage = 0 ifTrue: + [^nil]. + ^self stackValue: offset - numEntries ofObjStack: nextPage! Item was added: + ----- Method: SpurMemoryManager>>stackValue:ofObjStackAt: (in category 'obj stacks') ----- + stackValue: offset ofObjStackAt: objStackRootIndex + ^self + stackValue: offset + ofObjStack: (self fetchPointer: objStackRootIndex ofObject: hiddenRootsObj)! Item was changed: + ----- Method: SpurMemoryManager>>sufficientSpaceAfterGC: (in category 'gc - scavenging') ----- - ----- Method: SpurMemoryManager>>sufficientSpaceAfterGC: (in category 'generation scavenging') ----- sufficientSpaceAfterGC: numBytes "This is ObjectMemory's funky entry-point into its incremental GC, which is a stop-the-world a young generation reclaimer. In Spur we run the scavenger. Answer if space is not low." self assert: numBytes = 0. self scavengingGCTenuringIf: TenureByAge. lowSpaceThreshold > totalFreeOldSpace ifTrue: "space is low" [lowSpaceThreshold := 0. "avoid signalling low space twice" ^false]. ^true! Item was added: + ----- Method: SpurMemoryManager>>swapLargeObject:ofSlots:withSmallerOnObjStackAt: (in category 'obj stacks') ----- + swapLargeObject: objOop ofSlots: numStrongSlots withSmallerOnObjStackAt: objStackRootIndex + "Assuming objOop is large, answer a smaller object, if it is available, otherwise answer nil." + | objStackPage top topObj | + objStackPage := self fetchPointer: objStackRootIndex ofObject: hiddenRootsObj. + top := self stackValue: 0 ofObjStack: objStackPage. + top ifNil: [^nil]. + (self isImmediate: top) ifTrue: "index,large obj pair on top. is it smaller?" + [(self integerValueOf: top) >= numStrongSlots ifTrue: + [^nil]. "no. go with the one we've already got" + "yes. push 0, objOop, answer index, leaving large obj on top to be popped." + topObj := self stackValue: 1 ofObjStack: objStackPage. + self stackValue: 0 ofObjStackAt: objStackRootIndex put: ConstZero. + self stackValue: 1 ofObjStackAt: objStackRootIndex put: objOop. + self push: topObj onObjStackAt: objStackRootIndex. + ^top]. + "push numStrongSlots, objOop and answer top" + self stackValue: 0 ofObjStackAt: objStackRootIndex put: objOop. + self push: ConstZero onObjStackAt: objStackRootIndex. + ^top! Item was added: + ----- Method: SpurMemoryManager>>swizzleObjStack: (in category 'obj stacks') ----- + swizzleObjStack: objStackRootIndex + <returnTypeC: #void> + "On load, swizzle the pointers in an obj stack." + | firstPage stackOrNil index field | + firstPage := stackOrNil := self fetchPointer: objStackRootIndex ofObject: hiddenRootsObj. + stackOrNil = nilObj ifTrue: + [^self]. + [self assert: (self numSlotsOfAny: stackOrNil) = ObjStackPageSlots. + "There are three fixed slots in an obj stack, and a Topx of 0 indicates empty, so + if there were 5 slots in an oop stack, full would be 2, and the last 0-rel index is 4. + Hence the last index is topx + fixed slots - 1, or topx + ObjStackNextx" + index := (self fetchPointer: ObjStackTopx ofObject: stackOrNil) + ObjStackNextx. + [field := self fetchPointer: index ofObject: stackOrNil. + (self isImmediate: field) ifFalse: + [field := segmentManager swizzleObj: field. + self storePointerUnchecked: ObjStackNextx ofObject: stackOrNil withValue: field]. + (index := index - 1) > ObjStackTopx] whileTrue. + (stackOrNil := field) ~= 0] whileTrue. + [stackOrNil := self fetchPointer: ObjStackFreex ofObject: firstPage. + stackOrNil ~= 0] whileTrue: + [field := segmentManager swizzleObj: stackOrNil. + self storePointerUnchecked: ObjStackFreex ofObject: firstPage withValue: field. + firstPage := stackOrNil]. + self assert: (self isValidObjStackAt: objStackRootIndex) + ! Item was added: + ----- Method: SpurMemoryManager>>traceImmediatelySlotLimit (in category 'gc - global') ----- + traceImmediatelySlotLimit + "Arbitrary level at which to defer tracing large objects until later. + The average slot size of Smalltalk objects is typically near 8." + ^16! Item was changed: ----- Method: SpurMemoryManager>>validClassTableRootPages (in category 'class table') ----- validClassTableRootPages + "Answer if hiddenRootsObj is of the right size with the + expected contents, and if numClassTablePages is correct." - "Answer if numClassTablePages is correct." + (self numSlotsOf: hiddenRootsObj) = (self classTableRootSlots + self hiddenRootSlots) ifFalse: + [^false]. + "is it in range?" (numClassTablePages > 1 and: [numClassTablePages <= self classTableRootSlots]) ifFalse: [^false]. "are all pages the right size?" 0 to: numClassTablePages - 1 do: [:i| | obj | obj := self fetchPointer: i ofObject: hiddenRootsObj. ((self addressCouldBeObj: obj) and: [(self numSlotsOf: obj) = self classTablePageSize]) ifFalse: [^false]]. "are all entries beyond numClassTablePages nil?" numClassTablePages to: self classTableRootSlots - 1 do: [:i| (self fetchPointer: i ofObject: hiddenRootsObj) ~= nilObj ifTrue: [^false]]. ^true! Item was changed: ----- Method: StackInterpreter>>fireEphemeron: (in category 'finalization') ----- fireEphemeron: ephemeron + <option: #SpurObjectMemory> + objectMemory queueEphemeron: ephemeron. + self forceInterruptCheck! - self shouldBeImplemented!

1 0

VM Maker: VMMaker.oscog-eem.465.mcz
by commits＠source.squeak.org 17 Oct '13

17 Oct '13

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.465.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.465 Author: eem Time: 17 October 2013, 6:59:21.625 am UUID: 76822de3-f107-4e28-93d6-f49bfdf3bbb8 Ancestors: VMMaker.oscog-eem.464 Add room for a small number of hidden roots for things like the ephemeron queue to the class table root object. Hence rename classTableRootObj to hiddenRootsObj & classTableRootObj: to hiddenRootsObj:. Fix bugs in allocateOldSpaceChunkOfBytes:, ofObject: => ofFreeChunk:, when adding back into root both children can be null. Change call of sqAllocateMemorySegmentOfSize:Above:AllocatedSizeInto: to use end of first segment as minAddress instead of newSpaceLimit. Hopefully will play better with mmap et al. Fix comment in initializeSpecialObjectIndices. =============== Diff against VMMaker.oscog-eem.464 =============== Item was changed: ----- Method: ObjectMemory class>>initializeSpecialObjectIndices (in category 'initialization') ----- initializeSpecialObjectIndices "Initialize indices into specialObjects array." NilObject := 0. FalseObject := 1. TrueObject := 2. SchedulerAssociation := 3. ClassBitmap := 4. ClassInteger := 5. ClassByteString := ClassString := 6. "N.B. Actually class ByteString" ClassArray := 7. "SmalltalkDictionary := 8." "Do not delete!!" ClassFloat := 9. ClassMethodContext := 10. ClassBlockContext := 11. ClassPoint := 12. ClassLargePositiveInteger := 13. TheDisplay := 14. ClassMessage := 15. "ClassCompiledMethod := 16. unused by the VM" TheLowSpaceSemaphore := 17. ClassSemaphore := 18. ClassCharacter := 19. SelectorDoesNotUnderstand := 20. SelectorCannotReturn := 21. ProcessSignalingLowSpace := 22. "was TheInputSemaphore" SpecialSelectors := 23. CharacterTable := 24. SelectorMustBeBoolean := 25. ClassByteArray := 26. "ClassProcess := 27. unused" CompactClasses := 28. TheTimerSemaphore := 29. TheInterruptSemaphore := 30. SelectorCannotInterpret := 34. "Was MethodContextProto := 35." ClassBlockClosure := 36. "Was BlockContextProto := 37." ExternalObjectsArray := 38. ClassMutex := 39. "Was: ClassTranslatedMethod := 40." ProcessInExternalCodeTag := 40. TheFinalizationSemaphore := 41. ClassLargeNegativeInteger := 42. ClassExternalAddress := 43. ClassExternalStructure := 44. ClassExternalData := 45. ClassExternalFunction := 46. ClassExternalLibrary := 47. SelectorAboutToReturn := 48. SelectorRunWithIn := 49. SelectorAttemptToAssign := 50. + "PrimErrTableIndex := 51. in VMClass class>>initializePrimitiveErrorCodes" - "PrimErrTableIndex := 51. in Interpreter class>>initializePrimitiveErrorCodes" ClassAlien := 52. SelectorInvokeCallback := 53. ClassUnsafeAlien := 54. ClassWeakFinalizer := 55. ForeignCallbackProcess := 56. SelectorUnknownBytecode := 57. SelectorCounterTripped := 58 ! Item was changed: CogClass subclass: #SpurMemoryManager (excessive size, no diff calculated) Item was changed: ----- Method: SpurMemoryManager class>>initializeSpecialObjectIndices (in category 'class initialization') ----- initializeSpecialObjectIndices "Initialize indices into specialObjects array." NilObject := 0. FalseObject := 1. TrueObject := 2. SchedulerAssociation := 3. ClassBitmap := 4. ClassInteger := 5. ClassByteString := ClassString := 6. "N.B. Actually class ByteString" ClassArray := 7. "SmalltalkDictionary := 8." "Do not delete!!" ClassFloat := 9. ClassMethodContext := 10. "ClassBlockContext := 11. unused by the VM" ClassPoint := 12. ClassLargePositiveInteger := 13. TheDisplay := 14. ClassMessage := 15. "ClassCompiledMethod := 16. unused by the VM" TheLowSpaceSemaphore := 17. ClassSemaphore := 18. ClassCharacter := 19. SelectorDoesNotUnderstand := 20. SelectorCannotReturn := 21. ProcessSignalingLowSpace := 22. "was TheInputSemaphore" SpecialSelectors := 23. CharacterTable := nil. "Must be unused by the VM" SelectorMustBeBoolean := 25. ClassByteArray := 26. "ClassProcess := 27. unused" CompactClasses := 28. TheTimerSemaphore := 29. TheInterruptSemaphore := 30. SelectorCannotInterpret := 34. "Was MethodContextProto := 35." ClassBlockClosure := 36. "Was BlockContextProto := 37." ExternalObjectsArray := 38. ClassMutex := 39. "Was: ClassTranslatedMethod := 40." ProcessInExternalCodeTag := 40. TheFinalizationSemaphore := 41. ClassLargeNegativeInteger := 42. ClassExternalAddress := 43. ClassExternalStructure := 44. ClassExternalData := 45. ClassExternalFunction := 46. ClassExternalLibrary := 47. SelectorAboutToReturn := 48. SelectorRunWithIn := 49. SelectorAttemptToAssign := 50. + "PrimErrTableIndex := 51. in VMClass class>>initializePrimitiveErrorCodes" - "PrimErrTableIndex := 51. in Interpreter class>>initializePrimitiveErrorCodes" ClassAlien := 52. SelectorInvokeCallback := 53. ClassUnsafeAlien := 54. ClassWeakFinalizer := 55. ForeignCallbackProcess := 56. SelectorUnknownBytecode := 57. SelectorCounterTripped := 58! Item was changed: + ----- Method: SpurMemoryManager>>allocateMemoryOfSize:newSpaceSize:stackSize:codeSize: (in category 'spur bootstrap') ----- - ----- Method: SpurMemoryManager>>allocateMemoryOfSize:newSpaceSize:stackSize:codeSize: (in category 'simulation') ----- allocateMemoryOfSize: memoryBytes newSpaceSize: newSpaceBytes stackSize: stackBytes codeSize: codeBytes "Intialize the receiver for bootsraping an image. Set up a large oldSpace and an empty newSpace and set-up freeStart and scavengeThreshold to allocate in oldSpace. Later on (in initializePostBootstrap) freeStart and scavengeThreshold will be set to sane values." <doNotGenerate> | endBridgeBytes | self assert: (memoryBytes \\ self allocationUnit = 0 and: [newSpaceBytes \\ self allocationUnit = 0 and: [codeBytes \\ self allocationUnit = 0]]). endBridgeBytes := 2 * self baseHeaderSize. memory := (self endianness == #little ifTrue: [LittleEndianBitmap] ifFalse: [Bitmap]) new: (memoryBytes + newSpaceBytes + codeBytes + stackBytes + endBridgeBytes) // 4. startOfMemory := codeBytes + stackBytes. endOfMemory := freeOldSpaceStart := memoryBytes + newSpaceBytes + codeBytes + stackBytes. "leave newSpace empty for the bootstrap" freeStart := newSpaceBytes + startOfMemory. newSpaceLimit := newSpaceBytes + startOfMemory. scavengeThreshold := memory size * 4. "Bitmap is a 4-byte per word array" scavenger := SpurGenerationScavengerSimulator new manager: self newSpaceStart: startOfMemory newSpaceBytes: newSpaceBytes edenBytes: newSpaceBytes * self scavengerDenominator - self numSurvivorSpaces // self scavengerDenominator! Item was changed: ----- Method: SpurMemoryManager>>allocateOldSpaceChunkOfBytes: (in category 'free space') ----- allocateOldSpaceChunkOfBytes: chunkBytes "Answer a chunk of oldSpace from the free lists, if available, otherwise answer nil. Break up a larger chunk if one of the exact size does not exist. N.B. the chunk is simply a pointer, it has no valid header. The caller *must* fill in the header correctly." | initialIndex chunk index nodeBytes parent child smaller larger | "for debugging:" "totalFreeOldSpace := self totalFreeListBytes" totalFreeOldSpace := totalFreeOldSpace - chunkBytes. "be optimistic (& don't wait for the write)" initialIndex := chunkBytes / self allocationUnit. (initialIndex < self numFreeLists and: [1 << initialIndex <= freeListsMask]) ifTrue: [(freeListsMask anyMask: 1 << initialIndex) ifTrue: [(chunk := freeLists at: initialIndex) ~= 0 ifTrue: [self assert: chunk = (self startOfObject: chunk). self assert: (self isValidFreeObject: chunk). ^self unlinkFreeChunk: chunk atIndex: initialIndex]. freeListsMask := freeListsMask - (1 << initialIndex)]. "first search for free chunks of a multiple of chunkBytes in size" index := initialIndex. [(index := index + index) < self numFreeLists and: [1 << index <= freeListsMask]] whileTrue: [((freeListsMask anyMask: 1 << index) and: [(chunk := freeLists at: index) ~= 0]) ifTrue: [self assert: chunk = (self startOfObject: chunk). self assert: (self isValidFreeObject: chunk). self unlinkFreeChunk: chunk atIndex: index. self assert: (self bytesInObject: chunk) = (index * self allocationUnit). self freeChunkWithBytes: index * self allocationUnit - chunkBytes at: (self startOfObject: chunk) + chunkBytes. ^chunk]]. "now get desperate and use the first that'll fit. Note that because the minimum free size is 16 bytes (2 * allocationUnit), to leave room for the forwarding pointer/next free link, we can only break chunks that are at least 16 bytes larger, hence start at initialIndex + 2." index := initialIndex + 1. [(index := index + 1) < self numFreeLists and: [1 << index <= freeListsMask]] whileTrue: [(freeListsMask anyMask: 1 << index) ifTrue: [(chunk := freeLists at: index) ~= 0 ifTrue: [self assert: chunk = (self startOfObject: chunk). self assert: (self isValidFreeObject: chunk). self unlinkFreeChunk: chunk atIndex: index. self assert: (self bytesInObject: chunk) = (index * self allocationUnit). self freeChunkWithBytes: index * self allocationUnit - chunkBytes at: (self startOfObject: chunk) + chunkBytes. ^chunk]. freeListsMask := freeListsMask - (1 << index)]]]. "Large chunk, or no space on small free lists. Search the large chunk list. Large chunk list organized as a tree, each node of which is a list of chunks of the same size. Beneath the node are smaller and larger blocks. When the search ends parent should hold the smallest chunk at least as large as chunkBytes, or 0 if none." parent := 0. child := freeLists at: 0. [child ~= 0] whileTrue: [| childBytes | self assert: (self isValidFreeObject: child). childBytes := self bytesInObject: child. childBytes = chunkBytes ifTrue: "size match; try to remove from list at node." [chunk := self fetchPointer: self freeChunkNextIndex ofFreeChunk: child. chunk ~= 0 ifTrue: [self assert: (self isValidFreeObject: chunk). self storePointer: self freeChunkNextIndex ofFreeChunk: child withValue: (self fetchPointer: self freeChunkNextIndex ofFreeChunk: chunk). ^self startOfObject: chunk]. child := 0] "break out of loop to remove interior node" ifFalse: ["Note that because the minimum free size is 16 bytes (2 * allocationUnit), to leave room for the forwarding pointer/next free link, we can only break chunks that are at least 16 bytes larger, hence reject chunks < 2 * allocationUnit larger." childBytes <= (chunkBytes + self allocationUnit) ifTrue: "node too small; walk down the larger size of the tree" [child := self fetchPointer: self freeChunkLargerIndex ofFreeChunk: child] ifFalse: [parent := child. "parent will be smallest node >= chunkBytes + allocationUnit" nodeBytes := childBytes. child := self fetchPointer: self freeChunkSmallerIndex ofFreeChunk: child]]]. parent = 0 ifTrue: [totalFreeOldSpace := totalFreeOldSpace + chunkBytes. "optimism was unfounded" ^nil]. "self printFreeChunk: parent" self assert: (nodeBytes = chunkBytes or: [nodeBytes >= (chunkBytes + (2 * self allocationUnit))]). self assert: (self bytesInObject: parent) = nodeBytes. "attempt to remove from list" chunk := self fetchPointer: self freeChunkNextIndex ofFreeChunk: parent. chunk ~= 0 ifTrue: [self assert: (chunkBytes = nodeBytes or: [chunkBytes + self allocationUnit < nodeBytes]). self storePointer: self freeChunkNextIndex ofFreeChunk: parent withValue: (self fetchPointer: self freeChunkNextIndex ofFreeChunk: chunk). chunkBytes ~= nodeBytes ifTrue: [self freeChunkWithBytes: nodeBytes - chunkBytes at: (self startOfObject: chunk) + chunkBytes]. ^self startOfObject: chunk]. "no list; remove an interior node; reorder tree simply. two cases (which have mirrors, for four total): case 1. interior node has one child, P = parent, N = node, S = subtree (mirrored for large vs small) ___ ___ | P | | P | _/_ _/_ | N | => | S | _/_ | S | case 2: interior node has two children, , P = parent, N = node, L = smaller, left subtree, R = larger, right subtree. add the left subtree to the bottom left of the right subtree (mirrored for large vs small) ___ ___ | P | | P | _/_ _/_ | N | => | R | _/_ _\_ _/_ | L | | R | | L |" chunk := parent. smaller := self fetchPointer: self freeChunkSmallerIndex ofFreeChunk: chunk. larger := self fetchPointer: self freeChunkLargerIndex ofFreeChunk: chunk. parent := self fetchPointer: self freeChunkParentIndex ofFreeChunk: chunk. parent = 0 ifTrue: "no parent; stitch the subnodes back into the root" [smaller = 0 ifTrue: [self storePointer: self freeChunkParentIndex ofFreeChunk: larger withValue: 0. freeLists at: 0 put: larger] ifFalse: [self storePointer: self freeChunkParentIndex ofFreeChunk: smaller withValue: 0. freeLists at: 0 put: smaller. larger ~= 0 ifTrue: [self addFreeSubTree: larger]]] ifFalse: "parent; stitch back into appropriate side of parent." [smaller = 0 + ifTrue: + [self storePointer: (chunk = (self fetchPointer: self freeChunkSmallerIndex ofFreeChunk: parent) + ifTrue: [self freeChunkSmallerIndex] + ifFalse: [self freeChunkLargerIndex]) - ifTrue: [self storePointer: (chunk = (self fetchPointer: self freeChunkSmallerIndex ofFreeChunk: parent) - ifTrue: [self freeChunkSmallerIndex] - ifFalse: [self freeChunkLargerIndex]) ofFreeChunk: parent withValue: larger. + larger ~= 0 ifTrue: + [self storePointer: self freeChunkParentIndex + ofFreeChunk: larger + withValue: parent]] - self storePointer: self freeChunkParentIndex - ofObject: larger - withValue: parent] ifFalse: [self storePointer: (chunk = (self fetchPointer: self freeChunkSmallerIndex ofFreeChunk: parent) ifTrue: [self freeChunkSmallerIndex] ifFalse: [self freeChunkLargerIndex]) ofFreeChunk: parent withValue: smaller. self storePointer: self freeChunkParentIndex + ofFreeChunk: smaller - ofObject: smaller withValue: parent. larger ~= 0 ifTrue: [self addFreeSubTree: larger]]]. "if there's space left over, add the fragment back." chunkBytes ~= nodeBytes ifTrue: [self freeChunkWithBytes: nodeBytes - chunkBytes at: (self startOfObject: chunk) + chunkBytes]. ^self startOfObject: chunk! Item was changed: ----- Method: SpurMemoryManager>>classAtIndex: (in category 'class table') ----- classAtIndex: classIndex | classTablePage | self assert: (classIndex <= self tagMask or: [classIndex >= self arrayClassIndexPun]). classTablePage := self fetchPointer: classIndex >> self classTableMajorIndexShift + ofObject: hiddenRootsObj. - ofObject: classTableRootObj. classTablePage = nilObj ifTrue: [^nil]. ^self fetchPointer: (classIndex bitAnd: self classTableMinorIndexMask) ofObject: classTablePage! Item was changed: ----- Method: SpurMemoryManager>>classAtIndex:put: (in category 'class table') ----- classAtIndex: classIndex put: objOop "for become & GC of classes" | classTablePage | self assert: (classIndex <= self tagMask or: [classIndex >= self arrayClassIndexPun]). self assert: (objOop = nilObj or: [(self rawHashBitsOf: objOop) = classIndex]). classTablePage := self fetchPointer: classIndex >> self classTableMajorIndexShift + ofObject: hiddenRootsObj. - ofObject: classTableRootObj. classTablePage = nilObj ifTrue: [self error: 'attempt to add class to empty page']. ^self storePointer: (classIndex bitAnd: self classTableMinorIndexMask) ofObject: classTablePage withValue: objOop! Item was changed: + ----- Method: SpurMemoryManager>>classTableIndex: (in category 'spur bootstrap') ----- - ----- Method: SpurMemoryManager>>classTableIndex: (in category 'accessing') ----- classTableIndex: n classTableIndex := n! Item was changed: + ----- Method: SpurMemoryManager>>classTableObjectsDo: (in category 'spur bootstrap') ----- - ----- Method: SpurMemoryManager>>classTableObjectsDo: (in category 'object enumeration') ----- classTableObjectsDo: aBlock + "for the bootstrap..." + <doNotGenerate> + 0 to: self classTableRootSlots - 1 do: - 0 to: (self numSlotsOf: classTableRootObj) - 1 do: [:i| | page | + page := self fetchPointer: i ofObject: hiddenRootsObj. - page := self fetchPointer: i ofObject: classTableRootObj. 0 to: (self numSlotsOf: page) - 1 do: [:j| | classOrNil | classOrNil := self fetchPointer: j ofObject: page. classOrNil ~= nilObj ifTrue: [aBlock value: classOrNil]]]! Item was changed: ----- Method: SpurMemoryManager>>classTableRootObj (in category 'accessing') ----- classTableRootObj + "For Cogit & bootstrap" + ^hiddenRootsObj! - "For mapInterpreterOops & bootstrap" - ^classTableRootObj! Item was removed: - ----- Method: SpurMemoryManager>>classTableRootObj: (in category 'class table') ----- - classTableRootObj: anOop - classTableRootObj := anOop. - classTableFirstPage := self fetchPointer: 0 ofObject: classTableRootObj. - self assert: (self numSlotsOf: classTableRootObj) = self classTableRootSlots. - self assert: (self numSlotsOf: classTableFirstPage) - 1 = self classTableMinorIndexMask. - "Set classTableIndex to the start of the last used page (excepting first page). - Set numClassTablePages to the number of used pages." - numClassTablePages := self numSlotsOf: classTableRootObj. - 2 to: numClassTablePages - 1 do: - [:i| - (self fetchPointer: i ofObject: classTableRootObj) = nilObj ifTrue: - [numClassTablePages := i. - classTableIndex := (numClassTablePages - 1 max: 1) << self classTableMajorIndexShift. - ^self]]. - "no unused pages; set it to the start of the second page." - classTableIndex := 1 << self classTableMajorIndexShift! Item was changed: ----- Method: SpurMemoryManager>>classTableRootSlots (in category 'class table') ----- classTableRootSlots + "Answer the number of slots for class table pages in the hidden root object." - "Answer the number of slots in the root of the class table." ^1 << (self classIndexFieldWidth - self classTableMajorIndexShift)! Item was changed: ----- Method: SpurMemoryManager>>countNumClassPagesPreSwizzle: (in category 'class table') ----- countNumClassPagesPreSwizzle: bytesToShift "Compute the used size of the class table before swizzling. Needed to initialize the classTableBitmap which is populated during adjustAllOopsBy:" <returnTypeC: #void> | firstObj classTableRoot nilObjPreSwizzle | firstObj := self objectStartingAt: newSpaceLimit. "a.k.a. nilObj" "first five objects are nilObj, falseObj, trueObj, freeListsObj, classTableRootObj" classTableRoot := self objectAfter: (self objectAfter: (self objectAfter: (self objectAfter: firstObj limit: freeOldSpaceStart) limit: freeOldSpaceStart) limit: freeOldSpaceStart) limit: freeOldSpaceStart. nilObjPreSwizzle := newSpaceLimit - bytesToShift. numClassTablePages := self numSlotsOf: classTableRoot. + self assert: numClassTablePages = (self classTableRootSlots + self hiddenRootSlots). - self assert: numClassTablePages = self classTableRootSlots. 2 to: numClassTablePages - 1 do: [:i| (self fetchPointer: i ofObject: classTableRoot) = nilObjPreSwizzle ifTrue: [numClassTablePages := i. ^self]] ! Item was changed: ----- Method: SpurMemoryManager>>enterIntoClassTable: (in category 'class table') ----- enterIntoClassTable: aBehavior "Enter aBehavior into the class table and answer 0. Otherwise answer a primitive failure code." <inline: false> | initialMajorIndex majorIndex minorIndex page | majorIndex := classTableIndex >> self classTableMajorIndexShift. initialMajorIndex := majorIndex. "classTableIndex should never index the first page; it's reserved for known classes" self assert: initialMajorIndex > 0. minorIndex := classTableIndex bitAnd: self classTableMinorIndexMask. + [page := self fetchPointer: majorIndex ofObject: hiddenRootsObj. - [page := self fetchPointer: majorIndex ofObject: classTableRootObj. page = nilObj ifTrue: [page := self allocateSlotsInOldSpace: self classTablePageSize format: self arrayFormat classIndex: self arrayClassIndexPun. page ifNil: [^PrimErrNoMemory]. self fillObj: page numSlots: self classTablePageSize with: nilObj. self storePointer: majorIndex + ofObject: hiddenRootsObj - ofObject: classTableRootObj withValue: page. numClassTablePages := numClassTablePages + 1. minorIndex := 0]. minorIndex to: self classTablePageSize - 1 do: [:i| (self fetchPointer: i ofObject: page) = nilObj ifTrue: [classTableIndex := majorIndex << self classTableMajorIndexShift + i. self storePointer: i ofObject: page withValue: aBehavior. self setHashBitsOf: aBehavior to: classTableIndex. self assert: (self classAtIndex: (self rawHashBitsOf: aBehavior)) = aBehavior. "now fault-in method lookup chain." self scanClassPostBecome: aBehavior effects: BecamePointerObjectFlag+BecameCompiledMethodFlag. self ensureAdequateClassTableBitmap. ^0]]. majorIndex := (majorIndex + 1 bitAnd: self classIndexMask) max: 1. majorIndex = initialMajorIndex ifTrue: "wrapped; table full" [^PrimErrLimitExceeded]] repeat! Item was added: + ----- Method: SpurMemoryManager>>ephemeronQueue (in category 'garbage collection') ----- + ephemeronQueue + "The ephemeron queue is the first hidden root after the class table pages." + ^self fetchPointer: self numClassTablePages ofObject: hiddenRootsObj! Item was added: + ----- Method: SpurMemoryManager>>ephemeronQueue: (in category 'garbage collection') ----- + ephemeronQueue: anObject + "The ephemeron queue is the first hidden root after the class table pages." + self storePointer: self numClassTablePages ofObject: hiddenRootsObj withValue: anObject! Item was changed: ----- Method: SpurMemoryManager>>expungeDuplicateClasses (in category 'class table') ----- expungeDuplicateClasses "Bits have been set in the classTableBitmap corresponding to used classes. Any class in the class table that does not have a bit set has no instances with that class index. However, becomeForward: can create duplicate entries, and these duplicate entries a) won't have a bit set on load (because there are no forwarders on load), b) wont match their identityHash. So expunge duplicates by eliminating unmarked entries that don't occur at their identityHash." 1 to: numClassTablePages - 1 do: [:i| | classTablePage | "optimize scan by only scanning bitmap in regions that have pages." + classTablePage := self fetchPointer: i ofObject: hiddenRootsObj. - classTablePage := self fetchPointer: i ofObject: classTableRootObj. classTablePage ~= nilObj ifTrue: [i << self classTableMajorIndexShift to: i << self classTableMajorIndexShift + self classTableMinorIndexMask by: 8 do: [:majorBitIndex| | byteIndex byte classIndex classOrNil | "optimize scan by scanning a byte of indices (8 indices) at a time" byteIndex := majorBitIndex / BitsPerByte. byte := classTableBitmap at: byteIndex. byte ~= 255 ifTrue: [0 to: 7 do: [:minorBitIndex| (byte noMask: 1 << minorBitIndex) ifTrue: [classIndex := majorBitIndex + minorBitIndex. classOrNil := self fetchPointer: (classIndex bitAnd: self classTableMinorIndexMask) ofObject: classTablePage. self assert: (self classAtIndex: classIndex) = classOrNil. "only remove a class if it is at a duplicate entry" (classOrNil ~= nilObj and: [(self rawHashBitsOf: classOrNil) ~= classIndex]) ifTrue: [self storePointerUnchecked: (classIndex bitAnd: self classTableMinorIndexMask) ofObject: classTablePage withValue: nilObj. "but it should still be in the table at its correct index." self assert: ((self classAtIndex: (self rawHashBitsOf: classOrNil)) = classOrNil)]]]]]]]! Item was changed: ----- Method: SpurMemoryManager>>expungeFromClassTable: (in category 'class table') ----- expungeFromClassTable: aBehavior "Remove aBehavior from the class table." <inline: false> | classIndex majorIndex minorIndex classTablePage | self assert: (self isInClassTable: aBehavior). classIndex := self rawHashBitsOf: aBehavior. majorIndex := classIndex >> self classTableMajorIndexShift. minorIndex := classIndex bitAnd: self classTableMinorIndexMask. + classTablePage := self fetchPointer: majorIndex ofObject: hiddenRootsObj. - classTablePage := self fetchPointer: majorIndex ofObject: classTableRootObj. self assert: classTablePage ~= classTableFirstPage. self assert: (self numSlotsOf: classTablePage) = self classTablePageSize. self assert: (self fetchPointer: minorIndex ofObject: classTablePage) = aBehavior. self storePointerUnchecked: minorIndex ofObject: classTablePage withValue: nilObj. "If the removed class is before the classTableIndex, set the classTableIndex to point to the empty slot so as to reuse it asap." classIndex < classTableIndex ifTrue: [classTableIndex := classIndex]! Item was added: + ----- Method: SpurMemoryManager>>hiddenRootSlots (in category 'class table') ----- + hiddenRootSlots + "Answer the number of extra root slots in the root of the hidden root object." + ^8! Item was added: + ----- Method: SpurMemoryManager>>hiddenRootsObj: (in category 'class table') ----- + hiddenRootsObj: anOop + hiddenRootsObj := anOop. + classTableFirstPage := self fetchPointer: 0 ofObject: hiddenRootsObj. + self assert: (self numSlotsOf: hiddenRootsObj) = (self classTableRootSlots + self hiddenRootSlots). + self assert: (self numSlotsOf: classTableFirstPage) - 1 = self classTableMinorIndexMask. + self cCode: [self assert: self validClassTableRootPages] + inSmalltalk: [numClassTablePages ifNotNil: + [self assert: self validClassTableRootPages]].. + "Set classTableIndex to the start of the last used page (excepting first page). + Set numClassTablePages to the number of used pages." + numClassTablePages := self classTableRootSlots. + 2 to: numClassTablePages - 1 do: + [:i| + (self fetchPointer: i ofObject: hiddenRootsObj) = nilObj ifTrue: + [numClassTablePages := i. + classTableIndex := (numClassTablePages - 1 max: 1) << self classTableMajorIndexShift. + ^self]]. + "no unused pages; set it to the start of the second page." + classTableIndex := 1 << self classTableMajorIndexShift! Item was changed: + ----- Method: SpurMemoryManager>>initializePostBootstrap (in category 'spur bootstrap') ----- - ----- Method: SpurMemoryManager>>initializePostBootstrap (in category 'simulation') ----- initializePostBootstrap "The heap has just been bootstrapped into a modified newSpace occupying all of memory above newSpace (and the codeZone). Put things back to some kind of normalcy." freeOldSpaceStart := freeStart. freeStart := scavenger eden start. pastSpaceStart := scavenger pastSpace start. scavengeThreshold := scavenger eden limit - (scavenger edenBytes / 64)! Item was changed: ----- Method: SpurMemoryManager>>lookupAddress: (in category 'simulation only') ----- lookupAddress: address "If address appears to be that of a Symbol or a few well-known objects (such as classes) answer it, otherwise answer nil. For code disassembly" <doNotGenerate> | fmt size string class classSize maybeThisClass classNameIndex thisClassIndex | (self addressCouldBeObj: address) ifFalse: [^nil]. + address - self baseHeaderSize = hiddenRootsObj ifTrue: + [^'(hiddenRootsObj+baseHeaderSize)']. - address - self baseHeaderSize = classTableRootObj ifTrue: - [^'(classTableRoot+baseHeaderSize)']. fmt := self formatOf: address. size := self lengthOf: address baseHeader: (self baseHeader: address) format: fmt. size = 0 ifTrue: [^address caseOf: { [nilObj] -> ['nil']. [trueObj] -> ['true']. [falseObj] -> ['false'] } otherwise: []]. ((fmt between: self firstByteFormat and: self firstCompiledMethodFormat - 1) "indexable byte fields" and: [(size between: 1 and: 64) and: [Scanner isLiteralSymbol: (string := (0 to: size - 1) collect: [:i| Character value: (self fetchByte: i ofObject: address)])]]) ifTrue: [^'#', (ByteString withAll: string)]. class := self fetchClassOfNonImm: address. (class isNil or: [class = nilObj]) ifTrue: [^nil]. "address is either a class or a metaclass, or an instance of a class or invalid. determine which." classNameIndex := coInterpreter classNameIndex. thisClassIndex := coInterpreter thisClassIndex. ((classSize := self numSlotsOf: class) <= (classNameIndex max: thisClassIndex) or: [classSize > 255]) ifTrue: [^nil]. "Address could be a class or a metaclass" (fmt = 1 and: [size >= classNameIndex]) ifTrue: ["Is address a class? If so class's thisClass is address." (self lookupAddress: (self fetchPointer: classNameIndex ofObject: address)) ifNotNil: [:maybeClassName| (self fetchPointer: thisClassIndex ofObject: class) = address ifTrue: [^maybeClassName allButFirst]]. "Is address a Metaclass? If so class's name is Metaclass and address's thisClass holds the class name" ((self isBytes: (self fetchPointer: classNameIndex ofObject: class)) and: [(self lookupAddress: (self fetchPointer: classNameIndex ofObject: class)) = '#Metaclass' and: [size >= thisClassIndex]]) ifTrue: [maybeThisClass := self fetchPointer: thisClassIndex ofObject: address. (self lookupAddress: (self fetchPointer: classNameIndex ofObject: maybeThisClass)) ifNotNil: [:maybeThisClassName| ^maybeThisClassName allButFirst, ' class']]]. ^(self lookupAddress: (self fetchPointer: classNameIndex ofObject: class)) ifNotNil: [:maybeClassName| 'a(n) ', maybeClassName allButFirst]! Item was changed: ----- Method: SpurMemoryManager>>postBecomeScanClassTable (in category 'become implementation') ----- postBecomeScanClassTable "Scan the class table post-become (iff a pointer object or compiled method was becommed). Note that one-way become can cause duplications in the class table. When can these be eliminated? We use the classtableBitmap to mark classTable entries (not the classes themselves, since marking a class doesn't help in knowing if its index is used). On image load, and during incrememtal scan-mark and full GC, classIndices are marked. We can somehow avoid following classes from the classTable until after this mark phase." + + self assert: self validClassTableRootPages. + (becomeEffectsFlags anyMask: BecamePointerObjectFlag+BecameCompiledMethodFlag) ifFalse: [^self]. + 0 to: numClassTablePages - 1 do: - 0 to: (self numSlotsOf: classTableRootObj) - 1 do: [:i| | page | + page := self fetchPointer: i ofObject: hiddenRootsObj. - page := self fetchPointer: i ofObject: classTableRootObj. 0 to: (self numSlotsOf: page) - 1 do: [:j| | classOrNil | classOrNil := self fetchPointer: j ofObject: page. classOrNil ~= nilObj ifTrue: [(self isForwarded: classOrNil) ifTrue: [classOrNil := self followForwarded: classOrNil. self storePointer: j ofObject: page withValue: classOrNil]. self scanClassPostBecome: classOrNil effects: becomeEffectsFlags]]]! Item was changed: ----- Method: SpurMemoryManager>>reInitializeClassTablePostLoad: (in category 'class table') ----- + reInitializeClassTablePostLoad: hiddenRoots + self hiddenRootsObj: hiddenRoots. - reInitializeClassTablePostLoad: classTableRoot - self classTableRootObj: classTableRoot. self expungeDuplicateClasses! Item was changed: + ----- Method: SpurMemoryManager>>scavenger (in category 'spur bootstrap') ----- - ----- Method: SpurMemoryManager>>scavenger (in category 'debug support') ----- scavenger <doNotGenerate> ^scavenger! Item was changed: + ----- Method: SpurMemoryManager>>setCheckForLeaks: (in category 'spur bootstrap') ----- - ----- Method: SpurMemoryManager>>setCheckForLeaks: (in category 'debug support') ----- setCheckForLeaks: anInteger " 0 = do nothing. 1 = check for leaks on fullGC. 2 = check for leaks on scavenger. 4 = check for leaks on become 8 = check for leaks on truly incremental. 15 = check for leaks on all four." checkForLeaks := anInteger! Item was added: + ----- Method: SpurMemoryManager>>validClassTableRootPages (in category 'class table') ----- + validClassTableRootPages + "Answer if numClassTablePages is correct." + + "is it in range?" + (numClassTablePages > 1 and: [numClassTablePages <= self classTableRootSlots]) ifFalse: + [^false]. + "are all pages the right size?" + 0 to: numClassTablePages - 1 do: + [:i| | obj | + obj := self fetchPointer: i ofObject: hiddenRootsObj. + ((self addressCouldBeObj: obj) + and: [(self numSlotsOf: obj) = self classTablePageSize]) ifFalse: + [^false]]. + "are all entries beyond numClassTablePages nil?" + numClassTablePages to: self classTableRootSlots - 1 do: + [:i| + (self fetchPointer: i ofObject: hiddenRootsObj) ~= nilObj ifTrue: + [^false]]. + ^true! Item was changed: ----- Method: SpurSegmentManager>>addSegmentOfSize: (in category 'growing/shrinking memory') ----- addSegmentOfSize: ammount <returnTypeC: #'SpurSegmentInfo *'> | allocatedSize | <var: #newSeg type: #'SpurSegmentInfo *'> (manager "sent to the manager so that the simulator can increase memory to simulate a new segment" sqAllocateMemorySegmentOfSize: ammount + Above: (segments at: 0) segStart + (segments at: 0) segSize - Above: manager newSpaceLimit AllocatedSizeInto: (self cCode: [self addressOf: allocatedSize] inSmalltalk: [[:sz| allocatedSize := sz]])) ifNotNil: [:segAddress| | newSegIndex newSeg | newSegIndex := self insertSegmentFor: segAddress. newSeg := self addressOf: (segments at: newSegIndex). newSeg segStart: segAddress; segSize: allocatedSize. self bridgeFrom: (self addressOf: (segments at: newSegIndex - 1)) to: newSeg. self bridgeFrom: newSeg to: (newSegIndex = (numSegments - 1) ifFalse: [self addressOf: (segments at: newSegIndex + 1)]). "and add the new free chunk to the free list; done here instead of in assimilateNewSegment: for the assert" manager addFreeChunkWithBytes: allocatedSize - manager bridgeSize at: newSeg segStart. self assert: (manager addressAfter: (manager objectStartingAt: newSeg segStart)) = (newSeg segStart + newSeg segSize - manager bridgeSize). ^newSeg]. ^nil!

1 0

VM Maker: Cog-eem.117.mcz
by commits＠source.squeak.org 17 Oct '13

17 Oct '13

Eliot Miranda uploaded a new version of Cog to project VM Maker: http://source.squeak.org/VMMaker/Cog-eem.117.mcz ==================== Summary ==================== Name: Cog-eem.117 Author: eem Time: 17 October 2013, 6:51:05.682 am UUID: babcf3c3-d91f-4e7c-b215-f8ae97f200e2 Ancestors: Cog-eem.116 Update Sour bootstrap now classTableRootObj => hiddenRootsObj. =============== Diff against Cog-eem.116 =============== Item was changed: ----- Method: SpurBootstrap>>allocateClassTable (in category 'bootstrap image') ----- allocateClassTable "Allocate the root of the classTable plus enough pages to accomodate all classes in the classToIndex map. Don't fill in the entries yet; the classes have yet to be cloned." + | tableRoot page maxSize numPages | - | tableRootSize tableRoot page maxSize numPages | - tableRootSize := self classTableSize / newHeap classTablePageSize. tableRoot := newHeap + allocateSlots: newHeap classTableRootSlots + newHeap hiddenRootSlots - allocateSlots: tableRootSize format: newHeap arrayFormat classIndex: newHeap arrayClassIndexPun. + self assert: (newHeap numSlotsOf: tableRoot) = (newHeap classTableRootSlots + newHeap hiddenRootSlots). - self assert: (newHeap numSlotsOf: tableRoot) = tableRootSize. self assert: (newHeap formatOf: tableRoot) = newHeap arrayFormat. self assert: (newHeap classIndexOf: tableRoot) = newHeap arrayClassIndexPun. newHeap nilFieldsOf: tableRoot. "first page is strong" page := newHeap allocateSlots: newHeap classTablePageSize format: newHeap arrayFormat classIndex: newHeap arrayClassIndexPun. self assert: (newHeap numSlotsOf: page) = newHeap classTablePageSize. self assert: (newHeap formatOf: tableRoot) = newHeap arrayFormat. self assert: (newHeap classIndexOf: tableRoot) = newHeap arrayClassIndexPun. self assert: (newHeap objectAfter: tableRoot limit: newHeap freeStart) = page. lastClassTablePage := page. newHeap nilFieldsOf: page. newHeap storePointer: 0 ofObject: tableRoot withValue: page. + newHeap hiddenRootsObj: tableRoot. - newHeap classTableRootObj: tableRoot. maxSize := classToIndex inject: 0 into: [:a :b| a max: b]. numPages := (maxSize + newHeap classTableMinorIndexMask / newHeap classTablePageSize) truncated. 2 to: numPages do: [:i| page := newHeap allocateSlots: newHeap classTablePageSize format: newHeap arrayFormat classIndex: newHeap arrayClassIndexPun. self assert: (newHeap numSlotsOf: page) = newHeap classTablePageSize. self assert: (newHeap formatOf: page) = newHeap arrayFormat. self assert: (newHeap classIndexOf: page) = newHeap arrayClassIndexPun. newHeap fillObj: page numSlots: newHeap classTablePageSize with: newHeap nilObject. newHeap storePointer: i - 1 ofObject: tableRoot withValue: page. self assert: (newHeap objectAfter: (newHeap fetchPointer: i - 2 ofObject: tableRoot) limit: newHeap freeStart) = page. lastClassTablePage := page]!

1 0

postponing tempVector creation
by Clément Bera 17 Oct '13

17 Oct '13

Hello, Recently I realized that the tempVector is always created at the beginning of the method. In the case of: foo | temp | true ifTrue: [ ^ self ]. [ temp := 1 ] value. It means that even if the execution flow goes to the quick return direction, the tempVector is created even if it is not used. I hacked a bit the compiler to lazily create the tempVector when needed (access to temp Vector variable or block closure creation), which means here the tempVector would be created just before the pushClosure bytecode and not at the beginning of the method. I got as result that this specific method was executed 50,000,000 times per second instead of 21,000,000 times per second. Probably because of some useless garbage collection avoided. The problem of this lazy tempVector initialization is that I never know where I am in the control flow graph. This means than in the case: bar | temp | false ifTrue: [ temp := 1 ]. [ temp := 2 ]. It is hard to detect where to add the extra bytecode for lazy tempVector initialization, because the first time you need it is in a branch, so if you create the tempVector in the branch and the execution flow goes in the other direction then the tempVector will not have been initialized. Has any of you already investigated in this direction ? Does it worth it to implement that ? Thanks for any answers.

4 4

VM Maker: VMMaker.oscog-eem.464.mcz
by commits＠source.squeak.org 17 Oct '13

17 Oct '13

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.464.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.464 Author: eem Time: 16 October 2013, 4:47:53.641 pm UUID: 83064fda-58cb-45ea-b816-0fffd26ff50f Ancestors: VMMaker.oscog-eem.463 Slang: only output VM_LABELs in interpret. =============== Diff against VMMaker.oscog-eem.463 =============== Item was changed: ----- Method: TLabeledCommentNode>>emitCCodeOn:level:generator: (in category 'C code generation') ----- emitCCodeOn: aStream level: level generator: aCodeGen "Emit a C comment with optional label." self printOptionalLabelOn: aStream. aStream nextPutAll: '/* '. aStream nextPutAll: comment. aStream nextPutAll: ' */'. + (asmLabel notNil "only output labels in the interpret function." + and: [aCodeGen currentMethod selector == #interpret]) ifTrue: - asmLabel notNil ifTrue: [aStream crtab: level. aCodeGen outputAsmLabel: asmLabel on: aStream]!

1 0

VM Maker: VMMaker.oscog-eem.463.mcz
by commits＠source.squeak.org 17 Oct '13

17 Oct '13

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.463.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.463 Author: eem Time: 16 October 2013, 4:30:50.194 pm UUID: d0c77ca3-8fb8-41d8-886b-f40fa4555b88 Ancestors: VMMaker.oscog-eem.462 Don't assume new segment is above all other segments. Fix arg count bug in primitiveGrowMemoryByAtLeast. Add assimilateNewSegment: to avoid overriding so much in Spur32BitCoMemoryManager & hence nuke its growOldSpaceByAtLeast:. Add a fudge factor (2 * baseHeaderSize + bridgeSize) to growOldSpaceByAtLeast: and round p the request to a power-of-two. =============== Diff against VMMaker.oscog-eem.462 =============== Item was changed: ----- Method: InterpreterPrimitives>>primitiveGrowMemoryByAtLeast (in category 'memory space primitives') ----- primitiveGrowMemoryByAtLeast <option: #SpurObjectMemory> | ammount | ammount := self stackTop. (objectMemory isIntegerObject: ammount) ifFalse: [^self primitiveFailFor: PrimErrBadArgument]. - self halt. (objectMemory growOldSpaceByAtLeast: (objectMemory integerValueOf: ammount)) ifNil: [self primitiveFailFor: PrimErrNoMemory] + ifNotNil: [:segSize| self pop: 2 thenPushInteger: segSize]! - ifNotNil: [:segSize| self pop: 1 thenPushInteger: segSize]! Item was added: + ----- Method: Spur32BitCoMemoryManager>>assimilateNewSegment: (in category 'growing/shrinking memory') ----- + assimilateNewSegment: segInfo + "Update after adding a segment. + Here we make sure the new segment is not executable." + <var: #segInfo type: #'SpurSegmentInfo *'> + coInterpreter + sqMakeMemoryNotExecutableFrom: segInfo segStart + To: segInfo segStart + segInfo segSize! Item was removed: - ----- Method: Spur32BitCoMemoryManager>>growOldSpaceByAtLeast: (in category 'growing/shrinking memory') ----- - growOldSpaceByAtLeast: minAmmount - "Attempt to grow memory by at least minAmmount. - Answer the size of the new segment, or nil if the attempt failed. - Override to remove execute permission from the new segment." - | ammount | - <var: #segInfo type: #'SpurSegmentInfo *'> - statGrowMemory := statGrowMemory + 1. - ammount := minAmmount max: growHeadroom. - ^(segmentManager addSegmentOfSize: ammount) ifNotNil: - [:segInfo| - freeOldSpaceStart := - endOfMemory := segInfo segStart + segInfo segSize - self bridgeSize. - coInterpreter sqMakeMemoryNotExecutableFrom: segInfo segStart To: segInfo segStart + segInfo segSize. - segInfo segSize]! Item was added: + ----- Method: SpurMemoryManager>>assimilateNewSegment: (in category 'growing/shrinking memory') ----- + assimilateNewSegment: segInfo + "Update after adding a segment. + Here we set freeOldSpaceStart & endOfMemory if required." + <var: #segInfo type: #'SpurSegmentInfo *'> + segInfo segStart >= endOfMemory ifTrue: + [freeOldSpaceStart := + endOfMemory := segInfo segStart + segInfo segSize - self bridgeSize]! Item was changed: ----- Method: SpurMemoryManager>>growOldSpaceByAtLeast: (in category 'growing/shrinking memory') ----- growOldSpaceByAtLeast: minAmmount "Attempt to grow memory by at least minAmmount. Answer the size of the new segment, or nil if the attempt failed." | ammount | <var: #segInfo type: #'SpurSegmentInfo *'> + "statGrowMemory counts attempts, not successes." statGrowMemory := statGrowMemory + 1. + "we need to include overhead for a new object header plus the segment bridge." + ammount := minAmmount + (self baseHeaderSize * 2 + self bridgeSize). + "round up to the nearest power of two." + ammount := 1 << (ammount - 1) highBit. + "and grow by at least growHeadroom." + ammount := ammount max: growHeadroom. - ammount := minAmmount max: growHeadroom. ^(segmentManager addSegmentOfSize: ammount) ifNotNil: [:segInfo| + self assimilateNewSegment: segInfo. + segInfo segSize]! - freeOldSpaceStart := - endOfMemory := segInfo segStart + segInfo segSize - self bridgeSize]! Item was changed: ----- Method: SpurSegmentManager>>addSegmentOfSize: (in category 'growing/shrinking memory') ----- addSegmentOfSize: ammount <returnTypeC: #'SpurSegmentInfo *'> | allocatedSize | - <var: #oldSeg type: #'SpurSegmentInfo *'> <var: #newSeg type: #'SpurSegmentInfo *'> - numSegments = numSegInfos ifTrue: - [self allocateOrExtendSegmentInfos]. - self assert: numSegments < numSegInfos. (manager "sent to the manager so that the simulator can increase memory to simulate a new segment" sqAllocateMemorySegmentOfSize: ammount Above: manager newSpaceLimit AllocatedSizeInto: (self cCode: [self addressOf: allocatedSize] inSmalltalk: [[:sz| allocatedSize := sz]])) ifNotNil: + [:segAddress| | newSegIndex newSeg | + newSegIndex := self insertSegmentFor: segAddress. + newSeg := self addressOf: (segments at: newSegIndex). - [:segAddress| | newSeg oldSeg segEnd bridgeSpan clifton | - oldSeg := self addressOf: (segments at: numSegments - 1). - newSeg := self addressOf: (segments at: numSegments). - numSegments := numSegments + 1. newSeg segStart: segAddress; segSize: allocatedSize. + self bridgeFrom: (self addressOf: (segments at: newSegIndex - 1)) to: newSeg. + self bridgeFrom: newSeg to: (newSegIndex = (numSegments - 1) ifFalse: + [self addressOf: (segments at: newSegIndex + 1)]). + "and add the new free chunk to the free list; done here + instead of in assimilateNewSegment: for the assert" - segEnd := oldSeg segStart + oldSeg segSize. - bridgeSpan := segAddress - segEnd + manager bridgeSize. - clifton := segEnd - manager bridgeSize. "clifton is where the Avon bridge begins..." - "the old bridge should be the terminator." - self assert: (manager numSlotsOfAny: (manager objectStartingAt: clifton)) = 0. - manager initSegmentBridgeWithBytes: bridgeSpan at: clifton. - "the bridge should get us to the next segment" - self assert: (manager addressAfter: (manager objectStartingAt: clifton)) = newSeg segStart. - "and add the new free chunk to the free list" manager addFreeChunkWithBytes: allocatedSize - manager bridgeSize at: newSeg segStart. + self assert: (manager addressAfter: (manager objectStartingAt: newSeg segStart)) + = (newSeg segStart + newSeg segSize - manager bridgeSize). - self assert: (manager addressAfter: (manager objectStartingAt: newSeg segStart)) = (newSeg segStart + newSeg segSize - manager bridgeSize). ^newSeg]. ^nil! Item was changed: ----- Method: SpurSegmentManager>>allocateOrExtendSegmentInfos (in category 'private') ----- allocateOrExtendSegmentInfos "Increase the number of allocated segInfos by 16." + <returnTypeC: #void> | newNumSegs | numSegInfos = 0 ifTrue: [numSegInfos := 16. segments := self cCode: [self c: numSegInfos alloc: (self sizeof: SpurSegmentInfo)] inSmalltalk: [CArrayAccessor on: ((1 to: numSegInfos) collect: [:i| SpurSegmentInfo new])]. ^self]. newNumSegs := numSegInfos + 16. segments := self cCode: [self re: newNumSegs * (self sizeof: SpurSegmentInfo) alloc: segments] inSmalltalk: [CArrayAccessor on: segments object, ((numSegInfos to: newNumSegs) collect: [:i| SpurSegmentInfo new])]. self cCode: [segments = 0 ifTrue: [self error: 'out of memory; cannot allocate more segments']. self me: segments + numSegInfos ms: 0 et: newNumSegs - numSegInfos * (self sizeof: SpurSegmentInfo)]. numSegInfos := newNumSegs! Item was added: + ----- Method: SpurSegmentManager>>bridgeFrom:to: (in category 'growing/shrinking memory') ----- + bridgeFrom: aSegment to: nextSegmentOrNil + "Create a bridge from aSegment to the next segment, + or create a terminating bridge if there is no next segment." + <var: #aSegment type: #'SpurSegmentInfo *'> + <var: #nextSegmentOrNil type: #'SpurSegmentInfo *'> + | segEnd clifton bridgeSpan | + segEnd := aSegment segStart + aSegment segSize. + clifton := segEnd - manager bridgeSize. "clifton is where the Avon bridge begins..." + bridgeSpan := nextSegmentOrNil + ifNil: [manager bridgeSize] + ifNotNil: [nextSegmentOrNil segStart - segEnd + manager bridgeSize]. + manager initSegmentBridgeWithBytes: bridgeSpan at: clifton. + "the revised bridge should get us to the new segment" + self assert: (nextSegmentOrNil isNil + or: [(manager addressAfter: (manager objectStartingAt: clifton)) = nextSegmentOrNil segStart]) + ! Item was added: + ----- Method: SpurSegmentManager>>insertSegmentFor: (in category 'growing/shrinking memory') ----- + insertSegmentFor: segAddress + "Reserve a new segInfo for segAddress. If segAddress + is in the middle of the existing segments, shuffle them + up to make room. Answer the new segment's index." + | segIndex lastSegIndex | + self assert: segAddress > ((segments at: 0) segStart + (segments at: 0) segSize). + numSegments = numSegInfos ifTrue: + [self allocateOrExtendSegmentInfos]. + self assert: numSegments < numSegInfos. + segIndex := lastSegIndex := numSegments - 1. + numSegments := numSegments + 1. + [segAddress > ((segments at: segIndex) segStart + + (segments at: segIndex) segSize) ifTrue: + [segIndex := segIndex + 1. + lastSegIndex to: segIndex by: -1 do: + [:idx| segments at: idx + 1 put: (segments at: idx)]. + ^segIndex]. + segIndex := segIndex - 1] + repeat!

1 0

VM Maker: Cog-eem.116.mcz
by commits＠source.squeak.org 17 Oct '13

17 Oct '13

Eliot Miranda uploaded a new version of Cog to project VM Maker: http://source.squeak.org/VMMaker/Cog-eem.116.mcz ==================== Summary ==================== Name: Cog-eem.116 Author: eem Time: 16 October 2013, 4:28:35.19 pm UUID: 397c862f-6130-4235-9229-b9a8490617e6 Ancestors: Cog-eem.115 Spur bootstrap: Add Behavior>>elementSize so grow request can be scaled by size of elements. =============== Diff against Cog-eem.115 =============== Item was added: + ----- Method: SpurBootstrap class>>BehaviorPROTOTYPEelementSize (in category 'method prototypes') ----- + BehaviorPROTOTYPEelementSize + "Answer the size in bytes of an element in the receiver. The formats are + 0 = 0 sized objects (UndefinedObject True False et al) + 1 = non-indexable objects with inst vars (Point et al) + 2 = indexable objects with no inst vars (Array et al) + 3 = indexable objects with inst vars (MethodContext AdditionalMethodState et al) + 4 = weak indexable objects with inst vars (WeakArray et al) + 5 = weak non-indexable objects with inst vars (ephemerons) (Ephemeron) + 6 unused, reserved for exotic pointer objects? + 7 reserved by the VM + 8 unused, reserved for exotic non-pointer objects? + 9 (?) 64-bit indexable + 10 - 11 32-bit indexable + 12 - 15 16-bit indexable + 16 - 23 byte indexable + 24 - 31 compiled method" + | instSpec | + instSpec := self instSpec. + instSpec < 9 ifTrue: [^Smalltalk wordSize]. + instSpec >= 16 ifTrue: [^1]. + instSpec >= 12 ifTrue: [^2]. + instSpec >= 10 ifTrue: [^4]. + ^8! Item was changed: ----- Method: SpurBootstrap class>>BehaviorPROTOTYPEhandleFailingBasicNew: (in category 'method prototypes') ----- BehaviorPROTOTYPEhandleFailingBasicNew: sizeRequested "This basicNew: gets sent after basicNew: has failed and allowed a scavenging garbage collection to occur. The scavenging collection will have happened as the VM is activating the (failing) basicNew:. If handleFailingBasicNew: fails then the scavenge failed to reclaim sufficient space and a global garbage collection is required. Primitive. Answer an instance of this class with the number of indexable variables specified by the argument, sizeRequested. Fail if this class is not indexable or if the argument is not a positive Integer, or if there is not enough memory available. Essential. See Object documentation whatIsAPrimitive." <primitive: 71> self isVariable ifFalse: [self error: self printString, ' cannot have variable sized instances']. (sizeRequested isInteger and: [sizeRequested >= 0]) ifTrue: [Smalltalk garbageCollect < sizeRequested ifTrue: + [Smalltalk growMemoryByAtLeast: sizeRequested * self elementSize]. - [Smalltalk growMemoryByAtLeast: sizeRequested]. ^self handleFailingFailingBasicNew: sizeRequested "retry after global garbage collect and possible grow"]. self primitiveFailed!

1 0

VM Maker: VMMaker.oscog-eem.462.mcz
by commits＠source.squeak.org 16 Oct '13

16 Oct '13

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.462.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.462 Author: eem Time: 16 October 2013, 2:05:55.934 pm UUID: 0a25a2ac-0a88-48d3-9300-17cd4c915f57 Ancestors: VMMaker.oscog-eem.461 Implement heap growth by allocated segment in Spur: Add SpurSegmentManager>>addSegmentOfSize:, SpurMemoryManager>>growOldSpaceByAtLeast:, sqAllocateMemorySegmentOfSize:Above:AllocatedSizeInto: & InterpreterPrimitives>>primitiveGrowMemoryByAtLeast. Initialize growHeadroom & shrinkThreshold in SpurMemMgr. Fix slips in collapseSegmentsPostSwizzle. Simplify scavengeReferentsOf:; the halt couldn't happen. =============== Diff against VMMaker.oscog-eem.461 =============== Item was added: + ----- Method: InterpreterPrimitives>>primitiveGrowMemoryByAtLeast (in category 'memory space primitives') ----- + primitiveGrowMemoryByAtLeast + <option: #SpurObjectMemory> + | ammount | + ammount := self stackTop. + (objectMemory isIntegerObject: ammount) ifFalse: + [^self primitiveFailFor: PrimErrBadArgument]. + self halt. + (objectMemory growOldSpaceByAtLeast: (objectMemory integerValueOf: ammount)) + ifNil: [self primitiveFailFor: PrimErrNoMemory] + ifNotNil: [:segSize| self pop: 1 thenPushInteger: segSize]! Item was added: + ----- Method: Spur32BitCoMemoryManager>>growOldSpaceByAtLeast: (in category 'growing/shrinking memory') ----- + growOldSpaceByAtLeast: minAmmount + "Attempt to grow memory by at least minAmmount. + Answer the size of the new segment, or nil if the attempt failed. + Override to remove execute permission from the new segment." + | ammount | + <var: #segInfo type: #'SpurSegmentInfo *'> + statGrowMemory := statGrowMemory + 1. + ammount := minAmmount max: growHeadroom. + ^(segmentManager addSegmentOfSize: ammount) ifNotNil: + [:segInfo| + freeOldSpaceStart := + endOfMemory := segInfo segStart + segInfo segSize - self bridgeSize. + coInterpreter sqMakeMemoryNotExecutableFrom: segInfo segStart To: segInfo segStart + segInfo segSize. + segInfo segSize]! Item was changed: ----- Method: Spur32BitMMLESimulator>>isIntegerObject: (in category 'object testing') ----- isIntegerObject: oop "This list records the valid senders of isIntegerObject: as we replace uses of isIntegerObject: by isImmediate: where appropriate." | sel | sel := thisContext sender method selector. (#( DoIt DoItIn: on:do: "from the debugger" makeBaseFrameFor: quickFetchInteger:ofObject: frameOfMarriedContext: objCouldBeClassObj: isMarriedOrWidowedContext: shortPrint: bytecodePrimAt bytecodePrimAtPut commonAt: commonAtPut: loadFloatOrIntFrom: positive32BitValueOf: primitiveExternalCall checkedIntegerValueOf: bytecodePrimAtPut commonAtPut: primitiveVMParameter checkIsStillMarriedContext:currentFP: displayBitsOf:Left:Top:Right:Bottom: fetchStackPointerOf: primitiveContextAt primitiveContextAtPut subscript:with:storing:format: printContext: compare31or32Bits:equal: signed64BitValueOf: primDigitMultiply:negative: digitLength: isNegativeIntegerValueOf: magnitude64BitValueOf: primitiveMakePoint primitiveAsCharacter primitiveInputSemaphore baseFrameReturn primitiveExternalCall primDigitCompare: isLiveContext: numPointerSlotsOf: fileValueOf: loadBitBltDestForm fetchIntOrFloat:ofObject:ifNil: fetchIntOrFloat:ofObject: loadBitBltSourceForm loadPoint:from: primDigitAdd: primDigitSubtract: positive64BitValueOf: digitBitLogic:with:opIndex: signed32BitValueOf: isNormalized: primDigitDiv:negative: bytesOrInt:growTo: primitiveNewMethod isCogMethodReference: functionForPrimitiveExternalCall: genSpecialSelectorArithmetic genSpecialSelectorComparison ensureContextHasBytecodePC: instVar:ofContext: ceBaseFrameReturn: inlineCacheTagForInstance: primitiveObjectAtPut commonVariable:at:put:cacheIndex: primDigitBitShiftMagnitude: + externalInstVar:ofContext: + primitiveGrowMemoryByAtLeast) includes: sel) ifFalse: - externalInstVar:ofContext:) includes: sel) ifFalse: [self halt]. ^super isIntegerObject: oop! Item was added: + ----- Method: Spur32BitMMLESimulator>>numClassTablePages (in category 'spur bootstrap') ----- + numClassTablePages + ^numClassTablePages! Item was changed: ----- Method: SpurGenerationScavenger>>scavengeReferentsOf: (in category 'scavenger') ----- scavengeReferentsOf: referrer "scavengeReferentsOf: referrer inspects all the pointers in referrer. If any are new objects, it has them moved to FutureSurvivorSpace, and answers truth. If there are no new referents, it answers falsity. To handle weak arrays, if the referrer is weak only scavenge strong slots and answer true so that it won't be removed from the remembered set until later." | foundNewReferent | "forwarding objects should be followed by callers, unless the forwarder is a root in the remembered table." self assert: ((manager isForwarded: referrer) not or: [manager isRemembered: referrer]). "unscanned ephemerons should be scanned later." self assert: ((manager isEphemeron: referrer) not or: [(self isScavengeSurvivor: (manager keyOfEphemeron: referrer)) or: [self is: referrer onWeaklingList: ephemeronList]]). foundNewReferent := false. 0 to: (manager numStrongSlotsOf: referrer ephemeronInactiveIf: #isScavengeSurvivor:) - 1 do: [:i| | referent newLocation | referent := manager fetchPointer: i ofMaybeForwardedObject: referrer. (manager isNonImmediate: referent) ifTrue: ["a forwarding pointer could be because of become: or scavenging." (manager isForwarded: referent) ifTrue: [referent := manager followForwarded: referent]. ((manager isNonImmediate: referent) and: [manager isYoung: referent]) + ifTrue: "if target is already in future space forwarding pointer was due to a become:." + [(manager isInFutureSpace: referent) + ifTrue: [newLocation := referent. foundNewReferent := true] - ifTrue: - ["if target is already in future space forwarding pointer was due to a become:." - (manager isInFutureSpace: referent) - ifTrue: [newLocation := referent] ifFalse: + [newLocation := self copyAndForward: referent. + (manager isYoung: newLocation) ifTrue: + [foundNewReferent := true]]. - [(manager isForwarded: referent) - ifTrue: [self halt. "can this even happen?" - newLocation := manager followForwarded: referent] - ifFalse: [newLocation := self copyAndForward: referent]]. - (manager isYoung: newLocation) ifTrue: - [foundNewReferent := true]. manager storePointerUnchecked: i ofMaybeForwardedObject: referrer withValue: newLocation] ifFalse: [manager storePointerUnchecked: i ofMaybeForwardedObject: referrer withValue: referent]]]. ^foundNewReferent or: [manager isWeakNonImm: referrer]! Item was changed: CogClass subclass: #SpurMemoryManager (excessive size, no diff calculated) Item was added: + ----- Method: SpurMemoryManager>>addFreeChunkWithBytes:at: (in category 'free space') ----- + addFreeChunkWithBytes: bytes at: address + self freeChunkWithBytes: bytes at: address. + totalFreeOldSpace := totalFreeOldSpace + bytes! Item was changed: ----- Method: SpurMemoryManager>>bytesLeft: (in category 'free space') ----- bytesLeft: includeSwapSpace "Answer the amount of available free space. If includeSwapSpace is true, include possibly available swap space. If includeSwapSpace is false, include possibly available physical memory. For a report on the largest free block currently availabe within Squeak memory but not counting extra memory use #primBytesLeft." ^totalFreeOldSpace + (scavenger eden limit - freeStart) + (scavenger pastSpace limit - pastSpaceStart) + + (scavenger futureSpace limit - scavenger futureSpace limit) + - coInterpreter interpreterAllocationReserveBytes! - + (scavenger futureSpace limit - scavenger futureSpace limit)! Item was added: + ----- Method: SpurMemoryManager>>bytesLeftInOldSpace (in category 'free space') ----- + bytesLeftInOldSpace + "Answer the amount of available free old space. Used by primitiveFullGC + to answer the current available memory." + ^totalFreeOldSpace! Item was added: + ----- Method: SpurMemoryManager>>growHeadroom (in category 'accessing') ----- + growHeadroom + ^growHeadroom! Item was added: + ----- Method: SpurMemoryManager>>growHeadroom: (in category 'accessing') ----- + growHeadroom: aValue + ^growHeadroom := aValue! Item was added: + ----- Method: SpurMemoryManager>>growOldSpaceByAtLeast: (in category 'growing/shrinking memory') ----- + growOldSpaceByAtLeast: minAmmount + "Attempt to grow memory by at least minAmmount. + Answer the size of the new segment, or nil if the attempt failed." + | ammount | + <var: #segInfo type: #'SpurSegmentInfo *'> + statGrowMemory := statGrowMemory + 1. + ammount := minAmmount max: growHeadroom. + ^(segmentManager addSegmentOfSize: ammount) ifNotNil: + [:segInfo| + freeOldSpaceStart := + endOfMemory := segInfo segStart + segInfo segSize - self bridgeSize]! Item was changed: ----- Method: SpurMemoryManager>>initialize (in category 'initialization') ----- initialize "We can put all initializations that set something to 0 or to false here. In C all global variables are initialized to 0, and 0 is false." remapBuffer := Array new: RemapBufferSize. remapBufferCount := extraRootCount := 0. "see below" freeListsMask := totalFreeOldSpace := lowSpaceThreshold := 0. checkForLeaks := 0. needGCFlag := signalLowSpace := scavengeInProgress := false. becomeEffectsFlags := 0. statScavenges := statIncrGCs := statFullGCs := 0. statScavengeGCUsecs := statIncrGCUsecs := statFullGCUsecs := statGCEndUsecs := 0. statSGCDeltaUsecs := statIGCDeltaUsecs := statFGCDeltaUsecs := 0. statGrowMemory := statShrinkMemory := statRootTableCount := statTenures := statSurvivorCount := 0. statRootTableOverflows := statSweepCount := statMarkCount := statSpecialMarkCount := statMkFwdCount := 0. - self flag: #temporary. - shrinkThreshold := 16r10000000. "something huge for now" "we can initialize things that are virtual in C." scavenger := SpurGenerationScavengerSimulator new manager: self; yourself. segmentManager := SpurSegmentManager new manager: self; yourself. "We can also initialize here anything that is only for simulation." heapMap := self wordSize = 4 ifTrue: [CogCheck32BitHeapMap new]. "N.B. We *don't* initialize extraRoots because we don't simulate it."! Item was changed: ----- Method: SpurMemoryManager>>initializeObjectMemory: (in category 'initialization') ----- initializeObjectMemory: bytesToShift "Initialize object memory variables at startup time. Assume endOfMemory is initially set (by the image-reading code) to the end of the last object in the image. Initialization redefines endOfMemory to be the end of the object allocation area based on the total available memory, but reserving some space for forwarding blocks." "Assume: image reader initializes the following variables: memory memoryLimit specialObjectsOop lastHash " <inline: false> | freeListObj | "Catch mis-initializations leading to bad translations to C" self assert: BaseHeaderSize = self baseHeaderSize. segmentManager adjustSegmentSwizzlesBy: bytesToShift. "image may be at a different address; adjust oops for new location" self adjustAllOopsBy: bytesToShift. segmentManager numSegments > 0 "false if Spur image bootstrap" ifTrue: [specialObjectsOop := segmentManager swizzleObj: specialObjectsOop] ifFalse: [self assert: bytesToShift = 0]. "heavily used special objects" nilObj := self splObj: NilObject. falseObj := self splObj: FalseObject. trueObj := self splObj: TrueObject. "In Cog we insist that nil, true & false are next to each other (Cogit generates tighter conditional branch code as a result). In addition, Spur places the free lists and class table root page immediately following them." self assert: nilObj = newSpaceLimit. self assert: falseObj = (self objectAfter: nilObj). self assert: trueObj = (self objectAfter: falseObj). freeListObj := self objectAfter: trueObj. self reInitializeClassTablePostLoad: (self objectAfter: freeListObj). self initializeFreeSpacePostLoad: freeListObj. segmentManager collapseSegmentsPostSwizzle. self initializeNewSpaceVariables. self initializeOldSpaceFirstFree: freeOldSpaceStart. "initializes endOfMemory, freeStart" + "These defaults should depend on machine size; e.g. too small on a powerful laptop, too big on a Pi." + growHeadroom := 8*1024*1024. "headroom when growing" + shrinkThreshold := 16*1024*1024. "free space before shrinking"! - "lowSpaceThreshold := 0. - signalLowSpace := false. - remapBufferCount := 0. - tenuringThreshold := 2000. ""tenure all suriving objects if survivor count is over this threshold"" - growHeadroom := 4*1024*1024. ""four megabytes of headroom when growing"" - shrinkThreshold := 8*1024*1024. ""eight megabytes of free space before shrinking"" - - ""garbage collection statistics"" - statFullGCs := 0. - statFullGCUsecs := 0. - statIncrGCs := 0. - statIncrGCUsecs := 0. - statTenures := 0. - statRootTableOverflows := 0. - statGrowMemory := 0. - statShrinkMemory := 0. - forceTenureFlag := 0. - gcBiasToGrow := 0. - gcBiasToGrowGCLimit := 0. - extraRootCount := 0."! Item was added: + ----- Method: SpurMemoryManager>>shrinkObjectMemory: (in category 'growing/shrinking memory') ----- + shrinkObjectMemory: delta + "Attempt to shrink the object memory by the given delta amount." + self shouldBeImplemented! Item was added: + ----- Method: SpurMemoryManager>>sqAllocateMemorySegmentOfSize:Above:AllocatedSizeInto: (in category 'simulation only') ----- + sqAllocateMemorySegmentOfSize: segmentSize Above: minAddress AllocatedSizeInto: allocSizePtrOrBlock + <doNotGenerate> + "Simulate heap growth by growing memory by segmentSize + 1Meg. + 1Meg will be the distance between segments to be bridged." + | oneMeg newMemory start | + oneMeg := 1024 * 1024. + start := memory size * 4 + oneMeg. + newMemory := memory class new: memory size + (segmentSize + oneMeg / 4). + newMemory replaceFrom: 1 to: memory size with: memory startingAt: 1. + memory := newMemory. + allocSizePtrOrBlock value: segmentSize. + ^start! Item was added: + ----- Method: SpurSegmentManager>>addSegmentOfSize: (in category 'growing/shrinking memory') ----- + addSegmentOfSize: ammount + <returnTypeC: #'SpurSegmentInfo *'> + | allocatedSize | + <var: #oldSeg type: #'SpurSegmentInfo *'> + <var: #newSeg type: #'SpurSegmentInfo *'> + numSegments = numSegInfos ifTrue: + [self allocateOrExtendSegmentInfos]. + self assert: numSegments < numSegInfos. + (manager "sent to the manager so that the simulator can increase memory to simulate a new segment" + sqAllocateMemorySegmentOfSize: ammount + Above: manager newSpaceLimit + AllocatedSizeInto: (self cCode: [self addressOf: allocatedSize] + inSmalltalk: [[:sz| allocatedSize := sz]])) ifNotNil: + [:segAddress| | newSeg oldSeg segEnd bridgeSpan clifton | + oldSeg := self addressOf: (segments at: numSegments - 1). + newSeg := self addressOf: (segments at: numSegments). + numSegments := numSegments + 1. + newSeg + segStart: segAddress; + segSize: allocatedSize. + segEnd := oldSeg segStart + oldSeg segSize. + bridgeSpan := segAddress - segEnd + manager bridgeSize. + clifton := segEnd - manager bridgeSize. "clifton is where the Avon bridge begins..." + "the old bridge should be the terminator." + self assert: (manager numSlotsOfAny: (manager objectStartingAt: clifton)) = 0. + manager initSegmentBridgeWithBytes: bridgeSpan at: clifton. + "the bridge should get us to the next segment" + self assert: (manager addressAfter: (manager objectStartingAt: clifton)) = newSeg segStart. + "and add the new free chunk to the free list" + manager addFreeChunkWithBytes: allocatedSize - manager bridgeSize at: newSeg segStart. + self assert: (manager addressAfter: (manager objectStartingAt: newSeg segStart)) = (newSeg segStart + newSeg segSize - manager bridgeSize). + ^newSeg]. + ^nil! Item was changed: ----- Method: SpurSegmentManager>>collapseSegmentsPostSwizzle (in category 'snapshot') ----- collapseSegmentsPostSwizzle "The image has been loaded, old segments reconstructed, and the loaded image swizzled into a single contiguous segment. Collapse the segments intio one." | bridge | canSwizzle := false. firstSegmentSize ifNil: "true when used by SpurBootstrap to transform an image" [^self]. numSegments := 1. (self addressOf: (segments at: 0)) segStart: manager newSpaceLimit; + segSize: manager endOfMemory - manager newSpaceLimit. - segSize: manager endOfMemory. "finally plant a bridge at the end of the coallesced segment and cut back the + manager's notion of the end of memory to immediately before the bridge." - manager's ntion of the end of memory to immediately before the bridge." bridge := manager endOfMemory - manager bridgeSize. manager initSegmentBridgeWithBytes: manager bridgeSize at: bridge; setEndOfMemory: bridge! Item was changed: ----- Method: SpurSegmentManager>>initializeFromFreeChunks: (in category 'simulation only') ----- initializeFromFreeChunks: freeChunks "For testing, create a set of segments using the freeChunks as bridges." numSegments := freeChunks size. freeChunks do: [:f| manager initSegmentBridgeWithBytes: (manager bytesInObject: f) at: (manager startOfObject: f). self assert: (manager isSegmentBridge: f)]. segments := (1 to: numSegments) collect: [:i| | bridge start size | bridge := freeChunks at: i. start := i = 1 ifTrue: [manager newSpaceLimit] ifFalse: [manager addressAfter: (freeChunks at: i - 1)]. size := bridge + manager baseHeaderSize - start. SpurSegmentInfo new + segStart: start; - start: start; segSize: size; yourself]. segments := CArrayAccessor on: segments. freeChunks allButLast do: [:bridge| self assert: (manager isValidSegmentBridge: bridge)]! Item was changed: ----- Method: SpurSegmentManager>>totalBytesInSegments (in category 'snapshot') ----- totalBytesInSegments | total | total := 0. 0 to: numSegments - 1 do: [:i| + total := total + (segments at: i) segSize]. - total := total + (segments at: i) segSize - manager bridgeSize]. ^total! Item was changed: ----- Method: StackInterpreter class>>initializePrimitiveTable (in category 'initialization') ----- (excessive size, no diff calculated) Item was changed: ----- Method: StackInterpreterPrimitives>>primitiveFullGC (in category 'memory space primitives') ----- primitiveFullGC + "Do a full garbage collection and return the number of bytes available. + If on SqueakV3ObjectMemory include swap space if dynamic memory + management is supported." - "Do a full garbage collection and return the number of bytes available (including swap space if dynamic memory management is supported)." objectMemory fullGCLock > 0 ifTrue: [^self primitiveFailFor: PrimErrInappropriate]. self externalWriteBackHeadFramePointers. objectMemory hasSpurMemoryManagerAPI ifFalse: [objectMemory incrementalGC]. "maximimize space for forwarding table" objectMemory fullGC. + "In Spur we exclude swap space." + self pop: 1 + thenPushInteger: (objectMemory hasSpurMemoryManagerAPI + ifTrue: [objectMemory bytesLeftInOldSpace] + ifFalse: [objectMemory bytesLeft: true])! - self pop: 1 thenPushInteger: (objectMemory bytesLeft: true).!

1 0

VM Maker: Cog-eem.115.mcz
by commits＠source.squeak.org 16 Oct '13

16 Oct '13

Eliot Miranda uploaded a new version of Cog to project VM Maker: http://source.squeak.org/VMMaker/Cog-eem.115.mcz ==================== Summary ==================== Name: Cog-eem.115 Author: eem Time: 16 October 2013, 2:00:16.525 pm UUID: dca22737-f388-4220-8acf-a37421113258 Ancestors: Cog-eem.114 Fix the handleFailingBasicNew[:] prototypes (they were calling failingFailingBasicNew[:], not handleFailingFailingBasicNew[:]. Make them call an explicit grow primitive after GC if free space is insufficient for the allocation request. Still need to add a fudge factor for object header size, but where, in the image or in the VM? Fix the rehashMap size. =============== Diff against Cog-eem.114 =============== Item was changed: ----- Method: SpurBootstrap class>>BehaviorPROTOTYPEhandleFailingBasicNew (in category 'method prototypes') ----- BehaviorPROTOTYPEhandleFailingBasicNew "This basicNew gets sent after basicNew has failed and allowed a scavenging garbage collection to occur. The scavenging collection will have happened as the VM is activating the (failing) basicNew. If failingBasicNew fails then the scavenge failed to reclaim sufficient space and a global garbage collection is required. Primitive. Answer an instance of this class with the number of indexable variables specified by the argument, sizeRequested. Fail if this class is not indexable or if the argument is not a positive Integer, or if there is not enough memory available. Essential. See Object documentation whatIsAPrimitive." <primitive: 70> self isVariable ifTrue: [^self basicNew: 0]. + Smalltalk garbageCollect < 1048576 ifTrue: + [Smalltalk growMemoryByAtLeast: 1048576]. + ^self handleFailingFailingBasicNew "retry after global garbage collect"! - Smalltalk garbageCollect. - ^self failingFailingBasicNew "retry after global garbage collect"! Item was changed: ----- Method: SpurBootstrap class>>BehaviorPROTOTYPEhandleFailingBasicNew: (in category 'method prototypes') ----- BehaviorPROTOTYPEhandleFailingBasicNew: sizeRequested "This basicNew: gets sent after basicNew: has failed and allowed a scavenging garbage collection to occur. The scavenging collection will have happened as the VM is activating the (failing) basicNew:. + If handleFailingBasicNew: fails then the scavenge failed to reclaim + sufficient space and a global garbage collection is required. - If failingBasicNew: fails then the scavenge failed to reclaim sufficient - space and a global garbage collection is required. Primitive. Answer an instance of this class with the number of indexable variables specified by the argument, sizeRequested. Fail if this class is not indexable or if the argument is not a positive Integer, or if there is not enough memory available. Essential. See Object documentation whatIsAPrimitive." <primitive: 71> self isVariable ifFalse: [self error: self printString, ' cannot have variable sized instances']. (sizeRequested isInteger and: [sizeRequested >= 0]) ifTrue: + [Smalltalk garbageCollect < sizeRequested ifTrue: + [Smalltalk growMemoryByAtLeast: sizeRequested]. + ^self handleFailingFailingBasicNew: sizeRequested "retry after global garbage collect and possible grow"]. - [Smalltalk garbageCollect. - ^self failingFailingBasicNew: sizeRequested "retry after global garbage collect"]. self primitiveFailed! Item was added: + ----- Method: SpurBootstrap class>>SmalltalkImagePROTOTYPEgrowMemoryByAtLeast: (in category 'method prototypes') ----- + SmalltalkImagePROTOTYPEgrowMemoryByAtLeast: numBytes + "Grow memory by at least the requested number of bytes. + Fail if no memory is available." + <primitive: 180> + ^self primitiveFailed! Item was added: + ----- Method: SpurBootstrap class>>SystemDictionaryPROTOTYPEgrowMemoryByAtLeast: (in category 'method prototypes') ----- + SystemDictionaryPROTOTYPEgrowMemoryByAtLeast: numBytes + "Grow memory by at least the requested number of bytes. + Fail if no memory is available." + <primitive: 180> + ^self primitiveFailed! Item was changed: ----- Method: SpurBootstrap>>rehashImage (in category 'bootstrap image') ----- rehashImage "Rehash all collections in newHeap. Find out which classes implement rehash, entering a 1 against their classIndex in rehashFlags. Enumerate all objects, rehashing those whose class has a bit set in rehashFlags." | n sim rehashFlags | sim := StackInterpreterSimulator onObjectMemory: newHeap. newHeap coInterpreter: sim. sim initializeInterpreter: 0. sim instVarNamed: 'methodDictLinearSearchLimit' put: SmallInteger maxVal. newHeap setHashBitsOf: newHeap nilObject to: 1; setHashBitsOf: newHeap falseObject to: 2; setHashBitsOf: newHeap trueObject to: 3. + rehashFlags := ByteArray new: newHeap numClassTablePages * newHeap classTablePageSize. - rehashFlags := ByteArray new: newHeap classTableIndex + 7 // 8. n := 0. newHeap classTableObjectsDo: [:class| | classIndex | sim messageSelector: (map at: rehashSym). "Lookup rehash but don't be fooled by ProtoObject>>rehash, which is just ^self." ((sim lookupMethodNoMNUEtcInClass: class) = 0 and: [(sim isQuickPrimitiveIndex: (sim primitiveIndexOf: (sim instVarNamed: 'newMethod'))) not]) ifTrue: [n := n + 1. classIndex := newHeap rawHashBitsOf: class. rehashFlags at: classIndex >> 3 + 1 put: ((rehashFlags at: classIndex >> 3 + 1) bitOr: (1 << (classIndex bitAnd: 7)))]]. Transcript cr; print: n; nextPutAll: ' classes understand rehash. rehashing instances...'; flush. n := 0. self withExecutableInterpreter: sim do: [sim setBreakSelector: 'error:'. "don't rehash twice (actually without limit), so don't rehash any new objects created." newHeap allExistingOldSpaceObjectsDo: [:o| | classIndex | classIndex := newHeap classIndexOf: o. ((rehashFlags at: classIndex >> 3 + 1) anyMask: 1 << (classIndex bitAnd: 7)) ifTrue: [(n := n + 1) \\ 8 = 0 ifTrue: [Transcript nextPut: $.; flush]. "2845 = n ifTrue: [self halt]." "Rehash an object if its size is > 0. Symbol implements rehash, but let's not waste time rehashing it; in Squeak up to 2013 symbols are kept in a set which will get reashed anyway.. Don't rehash empty collections; they may be large for a reason and rehashing will shrink them." ((sim addressCouldBeClassObj: o) or: [(self interpreter: sim object: o perform: (map at: sizeSym) withArguments: #()) = (newHeap integerObjectOf: 0)]) ifFalse: [self interpreter: sim object: o perform: (map at: rehashSym) withArguments: #()]]]]!

1 0

definition of vm parameter 25?
by Eliot Miranda 16 Oct '13

16 Oct '13

Hi All, can anyone give me a specification of parameter 25's behaviour? 25 is the grow headroom: "25 memory headroom when growing object memory (read-write)" what does this mean? That growth should be at least this much? That growth should be in multiples of this? That growth should not be done if free memory exceeds this? Or...? -- best, Eliot

2 1

← Newer
1
2
3
4
5
6
7
8
...
15
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev October 2013