Vm-dev August 2018

vm-dev@lists.squeakfoundation.org

20 participants
87 discussions

VM Maker: VMMaker.oscog-eem.2434.mcz
by commits＠source.squeak.org 25 Aug '18

25 Aug '18

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.2434.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.2434 Author: eem Time: 24 August 2018, 3:44:40.951049 pm UUID: a39ae1c6-6a72-43d6-9deb-873785768a82 Ancestors: VMMaker.oscog-eem.2433 Add the missing implementation in InterpreterProxy, and correct the comment of primitiveFailForFFIException:at:. Also activateFailingPrimitiveMethod is not an api method; primitiveFailForFFIException:at: is. =============== Diff against VMMaker.oscog-eem.2433 =============== Item was changed: ----- Method: InterpreterPrimitives>>primitiveFailForFFIException:at: (in category 'primitive support') ----- primitiveFailForFFIException: exceptionCode at: pc <var: 'exceptionCode' type: #usqLong> <var: 'pc' type: #usqInt> + "Set PrimErrFFIException primitive failure and associated exceptionCode (a.k.a. + osErrorCode) and exceptionPC. Under control of the ffiExceptionResponse flag, + if in a primitive with an error code and the inFFIFlags indicate we're in an FFI call, + then fail the primitive. - "Set PrimErrOSError primitive failure and associated osErrorCode. Under - control of the ffiExceptionResponse flag, if in a primitive with an error code - and the inFFIFlags indicate we're in an FFI call, then fail the primitive. ffiExceptionResponse < 0 never fail ffiExceptionResponse = 0 fail if method has a primitive error code (default) ffiExceptionResponse > 0 always fail" <api> ((inFFIFlags noMask: DisownVMForFFICall) "i.e. not in an FFI call" or: [ffiExceptionResponse < 0]) ifTrue: "i.e. never fail" [^self]. osErrorCode := self cCoerceSimple: exceptionCode to: #sqLong. exceptionPC := pc. primFailCode := PrimErrFFIException. (ffiExceptionResponse > 0 "always fail..." or: [(objectMemory isOopCompiledMethod: newMethod) and: [self methodUsesPrimitiveErrorCode: newMethod]]) ifTrue: [self ownVM: DisownVMForFFICall. "To take ownership but importantly to reset inFFIFlags" self activateFailingPrimitiveMethod]! Item was changed: Object subclass: #InterpreterProxy + instanceVariableNames: 'primFailCode remapBuffer stack method argumentCount bb thisSessionID osErrorCode exceptionPC' - instanceVariableNames: 'primFailCode remapBuffer stack method argumentCount bb thisSessionID osErrorCode' classVariableNames: '' poolDictionaries: 'VMBasicConstants' category: 'VMMaker-InterpreterSimulation'! + !InterpreterProxy commentStamp: 'eem 8/24/2018 15:43' prior: 0! - !InterpreterProxy commentStamp: 'eem 12/7/2017 19:37' prior: 0! This class should provide the definition of what interpreter support plugins need and can have access to. Note that the proxy related files platforms - Cross - vm - sqVirtualMachine.[ch] are kept under the git tree at http://www.github.com/opensmalltalk/vm. + The main use of the class is to support the vm simulator and the RSqueak VM, which implements as many primitives as possible in Smalltalk.! - The main use of the class is to support the vm simulator! Item was added: + ----- Method: InterpreterProxy>>primitiveFailForFFIException:at: (in category 'other') ----- + primitiveFailForFFIException: exceptionCode at: pc + <var: 'exceptionCode' type: #usqLong> + <var: 'pc' type: #usqInt> + "Set PrimErrFFIException primitive failure and associated exceptionCode (a.k.a. + osErrorCode) and exceptionPC." + <primitive: 255> + osErrorCode := exceptionCode. + exceptionPC := pc. + ^primFailCode := PrimErrFFIException! Item was changed: ----- Method: StackInterpreter>>activateFailingPrimitiveMethod (in category 'primitive support') ----- activateFailingPrimitiveMethod "Assuming the primFailCode (and any other relevant failure state) has been set, switch the VM to the interpreter if necessary (if in the CoInterpreter executing machine code), and activate the newMethod (which is expected to have a primitive)." - <api> self assert: primFailCode ~= 0. self assert: (objectMemory addressCouldBeObj: newMethod). self assert: (objectMemory isCompiledMethod: newMethod). self assert: (self primitiveIndexOf: newMethod) ~= 0. self justActivateNewMethod: true. "Frame must be interpreted" self siglong: reenterInterpreter jmp: ReturnToInterpreter. "NOTREACHED" ^nil!

1 0

VM Maker: VMMaker.oscog-eem.2433.mcz
by commits＠source.squeak.org 24 Aug '18

24 Aug '18

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.2433.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.2433 Author: eem Time: 24 August 2018, 2:55:51.817366 pm UUID: 185078c8-fd93-4414-9053-5a495f3762a6 Ancestors: VMMaker.oscog-eem.2432 Fix a slip in primitiveFailForFFIException:at:. If it fails the primitive, short cutting the return side of an FFI call it is its responsibility to own the VM and clear inFFIFlags. =============== Diff against VMMaker.oscog-eem.2432 =============== Item was changed: ----- Method: InterpreterPrimitives>>primitiveFailForFFIException:at: (in category 'primitive support') ----- primitiveFailForFFIException: exceptionCode at: pc <var: 'exceptionCode' type: #usqLong> <var: 'pc' type: #usqInt> "Set PrimErrOSError primitive failure and associated osErrorCode. Under control of the ffiExceptionResponse flag, if in a primitive with an error code and the inFFIFlags indicate we're in an FFI call, then fail the primitive. ffiExceptionResponse < 0 never fail ffiExceptionResponse = 0 fail if method has a primitive error code (default) ffiExceptionResponse > 0 always fail" <api> ((inFFIFlags noMask: DisownVMForFFICall) "i.e. not in an FFI call" or: [ffiExceptionResponse < 0]) ifTrue: "i.e. never fail" [^self]. osErrorCode := self cCoerceSimple: exceptionCode to: #sqLong. exceptionPC := pc. primFailCode := PrimErrFFIException. (ffiExceptionResponse > 0 "always fail..." or: [(objectMemory isOopCompiledMethod: newMethod) and: [self methodUsesPrimitiveErrorCode: newMethod]]) ifTrue: + [self ownVM: DisownVMForFFICall. "To take ownership but importantly to reset inFFIFlags" + self activateFailingPrimitiveMethod]! - [self activateFailingPrimitiveMethod]!

1 0

VM Maker: VMMaker.oscog-eem.2432.mcz
by commits＠source.squeak.org 24 Aug '18

24 Aug '18

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.2432.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.2432 Author: eem Time: 24 August 2018, 1:18:16.336121 pm UUID: 7b14d114-0e04-4e46-b8a7-4b5e6d87f5fe Ancestors: VMMaker.oscog-eem.2431 Finish the VMMaker side of the failing of FFI callouts on exceptions. Have the ThreadedFFIPlugin always call disownVM: and ownVM:, providing a flag that states if this is a threaded callout or not, and another flag that states that this is an FFI call. Provide ffiExceptionResponse as a global variable the VM command line argument processors can set. By default this is 0 and whether an FFI exception is caught or not depends on there being an error code in the FFI callout. If there is one any exception will be caught; if there isn't a crash will occur as always. If ffiExceptionResponse is < 0 FFI exceptions will never be caught and never delivered as primitive failures (which will be selected by -nofailonffiexception). If ffiExceptionResponse is > 0 then FFI exceptions will always be caught and always delivered as primitive failures (which will be selected by -failonffiexception). primitiveFailForFFIException:at: now fails if - in an FFI call as indicated by DisownVMForFFICall being set in inFFIFlags - ffiExceptionResponse > 0 or ffiExceptionResponse = 0 and newMethod has an error code So it should always be called from the platform exception handlers such as sigsegv on Unix platforms. =============== Diff against VMMaker.oscog-eem.2431 =============== Item was changed: ----- Method: CoInterpreter class>>writeVMHeaderTo:bytesPerWord:generator: (in category 'translation') ----- writeVMHeaderTo: aStream bytesPerWord: bytesPerWord generator: aCCodeGenerator super writeVMHeaderTo: aStream bytesPerWord: bytesPerWord generator: aCCodeGenerator. aCCodeGenerator putDefineOf: #COGVM as: 1 on: aStream; putConditionalDefineOf: #COGMTVM as: 0 comment: nil on: aStream. + aStream cr! - aStream cr. - "This constant is a hack for the MT VM on SqueakV3. Eventually it will disappear. - But having it here rather than in CoInterpreterMT means that the interp.h header - doesn't get regenerated every time the sources are, which is a good thing." - aCCodeGenerator - putDefineOf: #DisownVMLockOutFullGC as: DisownVMLockOutFullGC on: aStream! Item was changed: ----- Method: CoInterpreterMT class>>initializeMiscConstants (in category 'initialization') ----- initializeMiscConstants super initializeMiscConstants. "N.B. some of these DisownFlags are replicated in platforms/Cross/vm/sqVirtualMachine.h. Hence they should always be initialized." + DisownVMForProcessorRelinquish := 8. - DisownVMLockOutFullGC := 1. - DisownVMForProcessorRelinquish := 2. (InitializationOptions at: #COGMTVM ifAbsent: [false]) == false ifTrue: [^self]. COGMTVM := true. ReturnToThreadSchedulingLoop := 2 "setjmp/longjmp code."! Item was changed: ----- Method: CoInterpreterMT>>disownVM: (in category 'vm scheduling') ----- disownVM: flags "Release the VM to other threads and answer the current thread's index. Currently valid flags: + DisownVMLockOutFullGC - prevent fullGCs while this thread disowns the VM + DisownVMForFFICall - informs the VM that it is entering an FFI call + DisownVMForThreading - informs the VM that it is entering an FFI call etc during which threading should be permitted - DisownVMLockOutFullGC - prevent fullGCs while this thread disowns the VM. OwnVMForeignThreadFlag - indicates lowest-level entry from a foreign thread - not to be used explicitly by clients - only set by ownVMFromUnidentifiedThread VMAlreadyOwnedHenceDoNotDisown - indicates an ownVM from a callback was made when the vm was still owned. - not to be used explicitly by clients - only set by ownVMFromUnidentifiedThread This is the entry-point for plugins and primitives that wish to release the VM while performing some operation that may potentially block, and for callbacks returning back to some blocking operation. If this thread does not reclaim the VM before- hand then when the next heartbeat occurs the thread manager will schedule a thread to acquire the VM which may start running the VM in place of this thread. N.B. Most of the state needed to resume after preemption is set in preemptDisowningThread." <api> <inline: false> | vmThread result | <var: #vmThread type: #'CogVMThread *'> self assert: self successful. cogit recordEventTrace ifTrue: [self recordTrace: TraceDisownVM thing: (objectMemory integerObjectOf: flags) source: 0]. processHasThreadId ifFalse: [willNotThreadWarnCount < 10 ifTrue: [self print: 'warning: VM parameter 48 indicates Process doesn''t have threadId; VM will not thread'; cr. willNotThreadWarnCount := willNotThreadWarnCount + 1]]. vmThread := cogThreadManager currentVMThread. (flags anyMask: VMAlreadyOwnedHenceDoNotDisown) ifTrue: [disowningVMThread := vmThread. vmThread state: CTMUnavailable. ^0]. self cCode: '' inSmalltalk: [| range | range := self cStackRangeForThreadIndex: vmThread index. self assert: (range includes: cogit getCStackPointer). self assert: (range includes: cogit getCFramePointer)]. (flags anyMask: DisownVMForProcessorRelinquish) ifTrue: [| proc | (proc := objectMemory splObj: foreignCallbackProcessSlot) ~= objectMemory nilObject ifTrue: [foreignCallbackPriority := self quickFetchInteger: PriorityIndex ofObject: proc]. relinquishing := true. self sqLowLevelMFence]. (flags anyMask: DisownVMLockOutFullGC) ifTrue: [objectMemory incrementFullGCLock]. (noThreadingOfGUIThread and: [self inGUIThread]) ifTrue: [^vmThread index + LockGUIThreadFlag + (activeProcessAffined ifTrue: [0] ifFalse: [ProcessUnaffinedOnDisown]) + (flags << DisownFlagsShift)]. disownCount := disownCount + 1. disowningVMThread := vmThread. "self cr; cr; print: 'disownVM Csp: '; printHex: vmThread cStackPointer; cr. (0 to: 16 by: 4) do: [:offset| self print: ' *(esp+'; printNum: offset; print: ': '; printHex: (stackPages longAt: cogit processor sp + offset); cr]. cogit processor printIntegerRegistersOn: Transcript." "OwnVMForeignThreadFlag indicates lowest-level of entry by a foreign thread. If that's where we are then release the vmThread. Otherwise indicate the vmThread is off doing something outside of the VM." (flags anyMask: OwnVMForeignThreadFlag) ifTrue: ["I don't think this is quite right. Josh's use case is creating some foreign thread and then registering it with the VM. That's not the same as binding a process to a foreign thread given that the foreign callback process is about to terminate anyway (it is returning from a callback here). So do we need an additional concept, that of a vmThread being either of the set known to the VM or floating?" self flag: 'issue with registering foreign threads with the VM'. (self isBoundProcess: self activeProcess) ifFalse: [cogThreadManager unregisterVMThread: vmThread]] ifFalse: [vmThread state: CTMUnavailable]. result := vmThread index + (activeProcessAffined ifTrue: [0] ifFalse: [ProcessUnaffinedOnDisown]) + (flags << DisownFlagsShift). cogThreadManager releaseVM. ^result! Item was changed: VMClass subclass: #InterpreterPrimitives + instanceVariableNames: 'objectMemory messageSelector argumentCount newMethod primFailCode osErrorCode exceptionPC inFFIFlags profileMethod profileProcess profileSemaphore nextProfileTick preemptionYields newFinalization sHEAFn ffiExceptionResponse' - instanceVariableNames: 'objectMemory messageSelector argumentCount newMethod primFailCode osErrorCode exceptionPC profileMethod profileProcess profileSemaphore nextProfileTick preemptionYields newFinalization sHEAFn' classVariableNames: 'CrossedX EndOfRun MillisecondClockMask' poolDictionaries: 'VMBasicConstants VMBytecodeConstants VMMethodCacheConstants VMObjectIndices VMSqueakClassIndices VMStackFrameOffsets' category: 'VMMaker-Interpreter'! + !InterpreterPrimitives commentStamp: 'eem 8/24/2018 11:05' prior: 0! - !InterpreterPrimitives commentStamp: 'eem 12/7/2017 18:44' prior: 0! InterpreterPrimitives implements most of the VM's core primitives. It is the root of the interpreter hierarchy so as to share the core primitives amongst the varioius interpreters. Instance Variables + argumentCount <Integer> + ffiExceptionResponse <Integer> + inFFIFlags <Integer> + messageSelector <Integer> + newMethod <Integer> + nextProfileTick <Integer> + objectMemory <ObjectMemory> (simulation only) + preemptionYields <Boolean> + primFailCode <Integer> + osErrorCode <Integer> + profileMethod <Integer> + profileProcess <Integer> + profileSemaphore <Integer> - argumentCount: <Integer> - messageSelector: <Integer> - newMethod: <Integer> - nextProfileTick: <Integer> - objectMemory: <ObjectMemory> (simulation only) - preemptionYields: <Boolean> - primFailCode: <Integer> - osErrorCode: <Integer> - profileMethod: <Integer> - profileProcess: <Integer> - profileSemaphore: <Integer> secHasEnvironmentAccess <Integer> argumentCount - the number of arguments of the current message + ffiExceptionResponse + - controls system response to exceptions during FFI calls. See primitiveFailForFFIException:at: + + inFFIFlags + - flags recording currently only whether the system is in an FFI call + messageSelector - the oop of the selector of the current message newMethod - the oop of the result of looking up the current message nextProfileTick - the millisecond clock value of the next profile tick (if profiling is in effect) objectMemory - the memory manager and garbage collector that manages the heap preemptionYields - a boolean controlling the process primitives. If true (old, incorrect, blue-book semantics) a preempted process is sent to the back of its run-queue. If false, a process preempted by a higher-priority process is put back at the head of its run queue, hence preserving cooperative scheduling within priorities. primFailCode - primitive success/failure flag, 0 for success, otherwise the reason code for failure osErrorCode - a 64-bit value settable by external primitives conveying arbitrary error codes from the operating system and/or system libraries profileMethod - the oop of the method at the time nextProfileTick was reached profileProcess - the oop of the activeProcess at the time nextProfileTick was reached profileSemaphore - the oop of the semaphore to signal when nextProfileTick is reached secHasEnvironmentAccess - the function to call to check if access to the envronment should be granted to primitiveGetenv ! Item was changed: ----- Method: InterpreterPrimitives class>>declareCVarsIn: (in category 'C translation') ----- declareCVarsIn: aCCodeGen aCCodeGen var: 'osErrorCode' type: #sqLong; + var: 'exceptionPC' type: #usqInt; var: 'sHEAFn' declareC: 'int (*sHEAFn)() = 0' "the hasEnvironmentAccess function"! Item was added: + ----- Method: InterpreterPrimitives>>initialize (in category 'initialization') ----- + initialize + "Here we can initialize the variables C initializes to zero. #initialize methods do /not/ get translated." + argumentCount := primFailCode := nextProfileTick := osErrorCode := exceptionPC := inFFIFlags := ffiExceptionResponse := 0. + newFinalization := false! Item was changed: ----- Method: InterpreterPrimitives>>primitiveFailForFFIException:at: (in category 'primitive support') ----- primitiveFailForFFIException: exceptionCode at: pc + <var: 'exceptionCode' type: #usqLong> + <var: 'pc' type: #usqInt> + "Set PrimErrOSError primitive failure and associated osErrorCode. Under + control of the ffiExceptionResponse flag, if in a primitive with an error code + and the inFFIFlags indicate we're in an FFI call, then fail the primitive. + ffiExceptionResponse < 0 never fail + ffiExceptionResponse = 0 fail if method has a primitive error code (default) + ffiExceptionResponse > 0 always fail" - <var: 'exceptionCode' type: #sqLong> - "Set PrimErrOSError primitive failure and associated osErrorCode." <api> + ((inFFIFlags noMask: DisownVMForFFICall) "i.e. not in an FFI call" + or: [ffiExceptionResponse < 0]) ifTrue: "i.e. never fail" + [^self]. + osErrorCode := self cCoerceSimple: exceptionCode to: #sqLong. - osErrorCode := exceptionCode. exceptionPC := pc. + primFailCode := PrimErrFFIException. + (ffiExceptionResponse > 0 "always fail..." + or: [(objectMemory isOopCompiledMethod: newMethod) + and: [self methodUsesPrimitiveErrorCode: newMethod]]) ifTrue: + [self activateFailingPrimitiveMethod]! - ^primFailCode := PrimErrFFIException! Item was changed: ----- Method: StackInterpreter class>>initializeMiscConstants (in category 'initialization') ----- initializeMiscConstants super initializeMiscConstants. STACKVM := true. "These flags function to identify a GC operation, or to specify what operations the leak checker should be run for." GCModeFull := 1. "stop-the-world global GC" GCModeNewSpace := 2. "Spur's scavenge, or V3's incremental" GCModeIncremental := 4. "incremental global gc (Dijkstra tri-colour marking); as yet unimplemented" GCModeBecome := 8. "v3 post-become sweeping/Spur forwarding" GCModeImageSegment := 16. "just a flag for leak checking image segments" GCModeFreeSpace := 32. "just a flag for leak checking free space; Spur only" GCCheckPrimCall := 64. "just a flag for leak checking external primitive calls" StackPageTraceInvalid := -1. StackPageUnreached := 0. StackPageReachedButUntraced := 1. StackPageTraced := 2. DumpStackOnLowSpace := 0. MillisecondClockMask := 16r1FFFFFFF. "Note: The external primitive table should actually be dynamically sized but for the sake of inferior platforms (e.g., Mac :-) who cannot allocate memory in any reasonable way, we keep it static (and cross our fingers...)" MaxExternalPrimitiveTableSize := 4096. "entries" MaxJumpBuf := 32. "max. callback depth" FailImbalancedPrimitives := InitializationOptions at: #FailImbalancedPrimitives ifAbsentPut: [true]. EnforceAccessControl := InitializationOptions at: #EnforceAccessControl ifAbsent: [true]. + ReturnToInterpreter := 1. "setjmp/longjmp code." + + "N.B. some of these DisownFlags are replicated in platforms/Cross/vm/sqVirtualMachine.h. + Hence they should always be initialized." + DisownVMLockOutFullGC := 1. + DisownVMForFFICall := 2. + DisownVMForThreading := 4 + ! - ReturnToInterpreter := 1 "setjmp/longjmp code."! Item was changed: ----- Method: StackInterpreter class>>mustBeGlobal: (in category 'translation') ----- mustBeGlobal: var "Answer if a variable must be global and exported. Used for inst vars that are accessed from VM support code." ^(super mustBeGlobal: var) or: [(self objectMemoryClass mustBeGlobal: var) or: [(#('interpreterProxy' 'interpreterVersion' 'inIOProcessEvents' 'deferDisplayUpdates' 'extraVMMemory' 'showSurfaceFn' 'displayBits' 'displayWidth' 'displayHeight' 'displayDepth' 'desiredNumStackPages' 'desiredEdenBytes' 'breakLookupClassTag' 'breakSelector' 'breakSelectorLength' 'sendTrace' 'checkAllocFiller' 'checkedPluginName' + 'reenterInterpreter' 'suppressHeartbeatFlag' 'ffiExceptionResponse' - 'reenterInterpreter' 'suppressHeartbeatFlag' 'debugCallbackInvokes' 'debugCallbackPath' 'debugCallbackReturns') includes: var) or: [ "This allows slow machines to define bytecodeSetSelector as 0 to avoid the interpretation overhead." MULTIPLEBYTECODESETS not and: [var = 'bytecodeSetSelector']]]]! Item was changed: ----- Method: StackInterpreter class>>writeVMHeaderTo:bytesPerWord:generator: (in category 'translation') ----- writeVMHeaderTo: aStream bytesPerWord: bytesPerWord generator: aCCodeGenerator super writeVMHeaderTo: aStream bytesPerWord: bytesPerWord generator: aCCodeGenerator. SistaVM ifTrue: [aCCodeGenerator putDefineOf: #SistaVM as: 1 on: aStream]. NewspeakVM ifTrue: [aCCodeGenerator putDefineOf: #NewspeakVM as: 1 on: aStream]. MULTIPLEBYTECODESETS ifTrue: [aCCodeGenerator putDefineOf: #MULTIPLEBYTECODESETS as: 1 on: aStream]. IMMUTABILITY ifTrue: [aCCodeGenerator putConditionalDefineOf: #IMMUTABILITY as: 1 comment: 'Allow this to be overridden on the compiler command line' on: aStream]. SistaVM | NewspeakVM | MULTIPLEBYTECODESETS | IMMUTABILITY ifTrue: [aStream cr]. aCCodeGenerator putDefineOf: #STACKVM as: 1 on: aStream. (InitializationOptions at: #SpurObjectMemory ifAbsent: false) ifTrue: + [aCCodeGenerator putDefineOf: #SPURVM as: 1 on: aStream]. + + aCCodeGenerator + putDefineOf: #DisownVMLockOutFullGC as: DisownVMLockOutFullGC on: aStream; + putDefineOf: #DisownVMForFFICall as: DisownVMForFFICall on: aStream; + putDefineOf: #DisownVMForThreading as: DisownVMForThreading on: aStream! - [aCCodeGenerator putDefineOf: #SPURVM as: 1 on: aStream]! Item was changed: ----- Method: StackInterpreter>>cloneOSErrorObj:numSlots: (in category 'message sending') ----- cloneOSErrorObj: errObj numSlots: numSlots "If errObj is a pointer object with at least two slots, then answer a clone of the error object with the second slot set to the value of osErrorCode, and if an PrimErrFFIException, then the third slow with the exceptionPC." | clone | <inline: true> clone := objectMemory hasSpurMemoryManagerAPI ifTrue: [objectMemory eeInstantiateSmallClassIndex: (objectMemory classIndexOf: errObj) format: objectMemory nonIndexablePointerFormat numSlots: numSlots] ifFalse: [objectMemory eeInstantiateSmallClass: (objectMemory fetchClassOfNonImm: errObj) numSlots: numSlots]. 0 to: numSlots - 1 do: [:i| objectMemory storePointerUnchecked: i ofObject: clone withValue: (objectMemory fetchPointer: i ofObject: errObj)]. (numSlots > 2 and: [primFailCode = PrimErrFFIException]) ifTrue: [objectMemory storePointerUnchecked: 1 ofObject: clone + withValue: (self positive64BitIntegerFor: (self cCoerceSimple: osErrorCode to: #usqLong)); - withValue: (self positive64BitIntegerFor: osErrorCode); storePointerUnchecked: 2 ofObject: clone + withValue: (self positiveMachineIntegerFor: exceptionPC)] - withValue: (self positive64BitIntegerFor: exceptionPC)] ifFalse: [objectMemory storePointerUnchecked: 1 ofObject: clone withValue: (self signed64BitIntegerFor: osErrorCode)]. ^clone! Item was changed: ----- Method: StackInterpreter>>disownVM: (in category 'vm scheduling') ----- disownVM: flags <api> <inline: false> "Release the VM to other threads and answer the current thread's index. + Currently valid flags for the non-threaded VM are: + DisownVMLockOutFullGC - prevent fullGCs while this thread disowns the VM + DisownVMForFFICall - informs the VM that it is entering an FFI call This is the entry-point for plugins and primitives that wish to release the VM while performing some operation that may potentially block, and for callbacks returning back to some blocking operation. While this exists for the threaded FFI VM we use it to reset newMethod and the argumentCount after a callback." self assert: ((objectMemory isIntegerObject: flags) and: [(objectMemory integerValueOf: flags) between: 0 and: (self argumentCountOfMethodHeader: -1)]). self assert: primFailCode = 0. + + "If DisownVMForFFICall this is from the FFI plugin and we're making a callout; remember the fact." + (flags anyMask: DisownVMForFFICall) ifTrue: + [self assert: ((objectMemory isOopCompiledMethod: newMethod) + and: [(self argumentCountOf: newMethod) = argumentCount]). + inFFIFlags := DisownVMForFFICall. + ^flags]. + + "Otherwise this is a callback return; restore argumentCount and newMethod as per the ownVM: on callback." argumentCount := objectMemory integerValueOf: flags. newMethod := self popStack. self assert: ((objectMemory isOopCompiledMethod: newMethod) and: [(self argumentCountOf: newMethod) = argumentCount]). ^0! Item was changed: ----- Method: StackInterpreter>>initialize (in category 'initialization') ----- initialize "Here we can initialize the variables C initializes to zero. #initialize methods do /not/ get translated." + super initialize. checkAllocFiller := false. "must precede initializeObjectMemory:" - primFailCode := 0. stackLimit := 0. "This is also the initialization flag for the stack system." stackPage := overflowedPage := 0. extraFramesToMoveOnOverflow := 0. bytecodeSetSelector := 0. highestRunnableProcessPriority := 0. - nextProfileTick := 0. nextPollUsecs := 0. nextWakeupUsecs := 0. tempOop := tempOop2 := theUnknownShort := 0. interruptPending := false. inIOProcessEvents := 0. fullScreenFlag := 0. deferDisplayUpdates := false. displayBits := displayWidth := displayHeight := displayDepth := 0. pendingFinalizationSignals := statPendingFinalizationSignals := 0. globalSessionID := 0. jmpDepth := 0. longRunningPrimitiveStartUsecs := longRunningPrimitiveStopUsecs := 0. maxExtSemTabSizeSet := false. debugCallbackInvokes := debugCallbackPath := debugCallbackReturns := 0. statForceInterruptCheck := statStackOverflow := statCheckForEvents := statProcessSwitch := statIOProcessEvents := statStackPageDivorce := statIdleUsecs := 0! Item was added: + ----- Method: StackInterpreter>>methodUsesPrimitiveErrorCode: (in category 'primitive support') ----- + methodUsesPrimitiveErrorCode: aMethodObj + "Answer if aMethodObj contains a primitive and uses the primitive error code." + <inline: true> + | methodHeader | + methodHeader := objectMemory methodHeaderOf: aMethodObj. + ^(self primitiveIndexOfMethod: aMethodObj header: methodHeader) > 0 + and: [(self longStoreBytecodeForHeader: methodHeader) + = (objectMemory + fetchByte: (self startPCOfMethod: aMethodObj) + (self sizeOfCallPrimitiveBytecode: methodHeader) + ofObject: aMethodObj)]! Item was changed: ----- Method: StackInterpreter>>ownVM: (in category 'vm scheduling') ----- ownVM: threadIndexAndFlags <api> <inline: false> "This is the entry-point for plugins and primitives that wish to reacquire the VM after having released it via disownVM or callbacks that want to acquire it without knowing their ownership status. While this exists for the threaded FFI VM we use it to reset newMethod and the argumentCount after a callback. - Answer the argumentCount encoded as a SmallInteger if the current thread is the VM thread. Answer -1 if the current thread is unknown to the VM and fails to take ownership." <var: 'amInVMThread' declareC: 'extern sqInt amInVMThread(void)'> self amInVMThread ifFalse: [^-1]. self assert: primFailCode = 0. self assert: ((objectMemory isOopCompiledMethod: newMethod) and: [(self argumentCountOf: newMethod) = argumentCount]). + + "If DisownVMForFFICall this is from the FFI plugin and we're returning from a callout." + (threadIndexAndFlags anyMask: DisownVMForFFICall) ifTrue: + [inFFIFlags := 0. + ^0]. + + "Otherwise this is a callback; stash newMethod on the stack and argumentCount in the flags + we'll get back when the calback calls disownVM:." self push: newMethod. ^objectMemory integerObjectOf: argumentCount! Item was changed: ----- Method: ThreadedARMFFIPlugin>>ffiCalloutTo:SpecOnStack:in: (in category 'callout support') ----- ffiCalloutTo: procAddr SpecOnStack: specOnStack in: calloutState <var: #procAddr type: #'void *'> <var: #calloutState type: #'CalloutState *'> <var: #loadFloatRegs declareC: 'extern void loadFloatRegs(double, double, double, double, double, double, double, double)'> "Go out, call this guy and create the return value. This *must* be inlined because of the alloca of the outgoing stack frame in ffiCall:WithFlags:NumArgs:Args:AndTypes:" | myThreadIndex atomicType floatRet intRet | <var: #floatRet type: #double> <var: #intRet type: #usqLong> <inline: true> + myThreadIndex := interpreterProxy disownVM: (self disownFlagsFor: calloutState). - self maybeDisownVM: calloutState threadIndexInto: [:threadIndex| myThreadIndex := threadIndex]. calloutState floatRegisterIndex > 0 ifTrue: [self load: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 0)) to: 'double *') at: 0) Flo: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 2)) to: 'double *') at: 0) a: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 4)) to: 'double *') at: 0) t: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 6)) to: 'double *') at: 0) R: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 8)) to: 'double *') at: 0) e: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 10)) to: 'double *') at: 0) g: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 12)) to: 'double *') at: 0) s: ((self cCoerceSimple: (self addressOf: (calloutState floatRegisters at: 14)) to: 'double *') at: 0)]. (self allocaLiesSoSetSpBeforeCall or: [self mustAlignStack]) ifTrue: [self setsp: calloutState argVector]. atomicType := self atomicTypeOf: calloutState ffiRetHeader. (atomicType >> 1) = (FFITypeSingleFloat >> 1) ifTrue: [atomicType = FFITypeSingleFloat ifTrue: [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'float (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3)] ifFalse: "atomicType = FFITypeDoubleFloat" [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'double (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3)]. "undo any callee argument pops because it may confuse stack management with the alloca." (self isCalleePopsConvention: calloutState callFlags) ifTrue: [self setsp: calloutState argVector]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. ^interpreterProxy floatObjectOf: floatRet]. intRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'usqIntptr_t (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3). "undo any callee argument pops because it may confuse stack management with the alloca." (self isCalleePopsConvention: calloutState callFlags) ifTrue: [self setsp: calloutState argVector]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. (calloutState ffiRetHeader anyMask: FFIFlagPointer+FFIFlagStructure) ifTrue: ["Note: Order is important here since FFIFlagPointer + FFIFlagStructure is used to represent 'typedef void* VoidPointer' and VoidPointer must be returned as pointer *not* as struct." (calloutState ffiRetHeader anyMask: FFIFlagPointer) ifTrue: [^self ffiReturnPointer: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiReturnStruct: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiCreateIntegralResultOop: intRet ofAtomicType: atomicType in: calloutState! Item was added: + ----- Method: ThreadedFFIPlugin>>disownFlagsFor: (in category 'primitive support') ----- + disownFlagsFor: calloutState + <var: #calloutState type: #'CalloutState *'> + <inline: #always> + ^self cppIf: COGMTVM + ifTrue: [(calloutState callFlags anyMask: FFICallFlagThreaded) + ifTrue: [DisownVMForFFICall+DisownVMForThreading] + ifFalse: [DisownVMForFFICall]] + ifFalse: [DisownVMForFFICall]! Item was changed: ----- Method: ThreadedFFIPlugin>>dispatchFunctionPointer: (in category 'callout support') ----- dispatchFunctionPointer: aFunctionPointer "In C aFunctionPointer is void (*aFunctionPointer)()" <cmacro: '(aFunctionPointer) (aFunctionPointer)()'> "To write the FFI call failure code we simulate invoking the production VM's fatal exception handlers (sigsegv on Unix, squeakExceptionHandler on WIN32, et al)." ^[self perform: aFunctionPointer] on: Error do: [:ex| interpreterProxy + primitiveFailForFFIException: PrimErrFFIException + at: aFunctionPointer asInteger. + ex pass "NOTREACHED if VM is handling FFI exceptions"]! - primitiveFailForFFIException: PrimErrFFIException at: aFunctionPointer asInteger; - activateFailingPrimitiveMethod]! Item was changed: ----- Method: ThreadedFFIPlugin>>dispatchFunctionPointer:with:with:with:with: (in category 'callout support') ----- dispatchFunctionPointer: aFunctionPointer with: int1 with: int2 with: int3 with: int4 "In C aFunctionPointer is void (*aFunctionPointer)(int, int, int, int)" <cmacro: '(aFunctionPointer, int1, int2, int3, int4) (aFunctionPointer)(int1, int2, int3, int4)'> "To write the FFI call failure code we simulate invoking the production VM's fatal exception handlers (sigsegv on Unix, squeakExceptionHandler on WIN32, et al)." ^[self perform: aFunctionPointer with: int1 with: int2 with: int3 with: int4] on: Error do: [:ex| interpreterProxy + primitiveFailForFFIException: PrimErrFFIException + at: aFunctionPointer asInteger. + ex pass "NOTREACHED if VM is handling FFI exceptions"]! - primitiveFailForFFIException: PrimErrFFIException at: aFunctionPointer asInteger; - activateFailingPrimitiveMethod]! Item was changed: ----- Method: ThreadedFFIPlugin>>dispatchFunctionPointer:with:with:with:with:with:with: (in category 'callout support') ----- dispatchFunctionPointer: aFunctionPointer with: int1 with: int2 with: int3 with: int4 with: int5 with: int6 "In C aFunctionPointer is void (*aFunctionPointer)(int, int, int, int, int, int)" + <cmacro: '(aFunctionPointer, int1, int2, int3, int4, int5, int6) (aFunctionPointer)(int1, int2, int3, int4, int5, int6)'> - <cmacro: '(aFunctionPointer, int1, int2, int3, int4) (aFunctionPointer)(int1, int2, int3, int4, int5, int6)'> "To write the FFI call failure code we simulate invoking the production VM's fatal exception handlers (sigsegv on Unix, squeakExceptionHandler on WIN32, et al)." ^[self perform: aFunctionPointer with: int1 with: int2 with: int3 with: int4 with: int5 with: int6] on: Error do: [:ex| interpreterProxy + primitiveFailForFFIException: PrimErrFFIException + at: aFunctionPointer asInteger. + ex pass "NOTREACHED if VM is handling FFI exceptions"]! - primitiveFailForFFIException: PrimErrFFIException at: aFunctionPointer asInteger; - activateFailingPrimitiveMethod]! Item was removed: - ----- Method: ThreadedFFIPlugin>>maybeDisownVM:threadIndexInto: (in category 'primitive support') ----- - maybeDisownVM: calloutState threadIndexInto: aBlock - <var: #calloutState type: #'CalloutState *'> - <inline: #always> - self cppIf: COGMTVM - ifTrue: - [(calloutState callFlags anyMask: FFICallFlagThreaded) ifTrue: - [aBlock value: (interpreterProxy disownVM: 0)]]! Item was removed: - ----- Method: ThreadedFFIPlugin>>maybeOwnVM:threadIndex: (in category 'primitive support') ----- - maybeOwnVM: calloutState threadIndex: myThreadIndex - <var: #calloutState type: #'CalloutState *'> - <inline: #always> - self cppIf: COGMTVM ifTrue: - [(calloutState callFlags anyMask: FFICallFlagThreaded) ifTrue: - [interpreterProxy ownVM: myThreadIndex]]! Item was changed: ----- Method: ThreadedIA32FFIPlugin>>ffiCalloutTo:SpecOnStack:in: (in category 'callout support') ----- ffiCalloutTo: procAddr SpecOnStack: specOnStack in: calloutState <var: #procAddr type: #'void *'> <var: #calloutState type: #'CalloutState *'> "Go out, call this guy and create the return value. This *must* be inlined because of the alloca of the outgoing stack frame in ffiCall:WithFlags:NumArgs:Args:AndTypes:" | myThreadIndex atomicType floatRet intRet | <var: #floatRet type: #double> <var: #intRet type: #usqLong> <inline: true> + myThreadIndex := interpreterProxy disownVM: (self disownFlagsFor: calloutState). - self maybeDisownVM: calloutState threadIndexInto: [:threadIndex| myThreadIndex := threadIndex]. (self allocaLiesSoSetSpBeforeCall or: [self mustAlignStack]) ifTrue: [self setsp: calloutState argVector]. atomicType := self atomicTypeOf: calloutState ffiRetHeader. (atomicType >> 1) = (FFITypeSingleFloat >> 1) ifTrue: [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'double (*)()'). "undo any callee argument pops because it may confuse stack management with the alloca." (self isCalleePopsConvention: calloutState callFlags) ifTrue: [self setsp: calloutState argVector]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. ^interpreterProxy floatObjectOf: floatRet]. intRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'usqLong (*)()'). "undo any callee argument pops because it may confuse stack management with the alloca." (self isCalleePopsConvention: calloutState callFlags) ifTrue: [self setsp: calloutState argVector]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. (calloutState ffiRetHeader anyMask: FFIFlagPointer+FFIFlagStructure) ifTrue: ["Note: Order is important here since FFIFlagPointer + FFIFlagStructure is used to represent 'typedef void* VoidPointer' and VoidPointer must be returned as pointer *not* as struct." (calloutState ffiRetHeader anyMask: FFIFlagPointer) ifTrue: [^self ffiReturnPointer: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiReturnStruct: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiCreateIntegralResultOop: intRet ofAtomicType: atomicType in: calloutState! Item was changed: ----- Method: ThreadedX64SysVFFIPlugin>>ffiCalloutTo:SpecOnStack:in: (in category 'callout support') ----- ffiCalloutTo: procAddr SpecOnStack: specOnStack in: calloutState <var: #procAddr type: #'void *'> <var: #calloutState type: #'CalloutState *'> <var: #loadFloatRegs declareC: 'extern void loadFloatRegs(double, double, double, double, double, double, double, double)'> "Go out, call this guy and create the return value. This *must* be inlined because of the alloca of the outgoing stack frame in ffiCall:WithFlags:NumArgs:Args:AndTypes:" | myThreadIndex atomicType floatRet intRet | <var: #floatRet type: #double> <var: #intRet type: #SixteenByteReturn> <inline: true> + myThreadIndex := interpreterProxy disownVM: (self disownFlagsFor: calloutState). - self maybeDisownVM: calloutState threadIndexInto: [:threadIndex| myThreadIndex := threadIndex]. calloutState floatRegisterIndex > 0 ifTrue: [self load: (calloutState floatRegisters at: 0) Flo: (calloutState floatRegisters at: 1) a: (calloutState floatRegisters at: 2) t: (calloutState floatRegisters at: 3) R: (calloutState floatRegisters at: 4) e: (calloutState floatRegisters at: 5) g: (calloutState floatRegisters at: 6) s: (calloutState floatRegisters at: 7)]. (self allocaLiesSoSetSpBeforeCall or: [self mustAlignStack]) ifTrue: [self setsp: calloutState argVector]. atomicType := self atomicTypeOf: calloutState ffiRetHeader. (atomicType >> 1) = (FFITypeSingleFloat >> 1) ifTrue: [atomicType = FFITypeSingleFloat ifTrue: [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'float (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3) with: (calloutState integerRegisters at: 4) with: (calloutState integerRegisters at: 5)] ifFalse: "atomicType = FFITypeDoubleFloat" [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'double (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3) with: (calloutState integerRegisters at: 4) with: (calloutState integerRegisters at: 5)]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. ^interpreterProxy floatObjectOf: floatRet]. intRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'SixteenByteReturn (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3) with: (calloutState integerRegisters at: 4) with: (calloutState integerRegisters at: 5). + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. (calloutState ffiRetHeader anyMask: FFIFlagPointer+FFIFlagStructure) ifTrue: ["Note: Order is important here since FFIFlagPointer + FFIFlagStructure is used to represent 'typedef void* VoidPointer' and VoidPointer must be returned as pointer *not* as struct." (calloutState ffiRetHeader anyMask: FFIFlagPointer) ifTrue: [^self ffiReturnPointer: intRet a ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiReturnStruct: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiCreateIntegralResultOop: intRet a ofAtomicType: atomicType in: calloutState! Item was changed: ----- Method: ThreadedX64Win64FFIPlugin>>ffiCalloutTo:SpecOnStack:in: (in category 'callout support') ----- ffiCalloutTo: procAddr SpecOnStack: specOnStack in: calloutState <var: #procAddr type: #'void *'> <var: #calloutState type: #'CalloutState *'> <var: #loadFloatRegs declareC: 'extern void loadFloatRegs(double, double, double, double)'> "Go out, call this guy and create the return value. This *must* be inlined because of the alloca of the outgoing stack frame in ffiCall:WithFlags:NumArgs:Args:AndTypes:" | myThreadIndex atomicType floatRet intRet | <var: #floatRet type: #double> <var: #intRet type: #usqLong> <inline: true> + myThreadIndex := interpreterProxy disownVM: (self disownFlagsFor: calloutState). - self maybeDisownVM: calloutState threadIndexInto: [:threadIndex| myThreadIndex := threadIndex]. calloutState floatRegisterSignature > 0 ifTrue: [self load: (calloutState floatRegisters at: 0) Flo: (calloutState floatRegisters at: 1) atR: (calloutState floatRegisters at: 2) egs: (calloutState floatRegisters at: 3)]. (self allocaLiesSoSetSpBeforeCall or: [self mustAlignStack]) ifTrue: [self setsp: calloutState argVector]. atomicType := self atomicTypeOf: calloutState ffiRetHeader. (atomicType >> 1) = (FFITypeSingleFloat >> 1) ifTrue: [atomicType = FFITypeSingleFloat ifTrue: [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'float (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3)] ifFalse: "atomicType = FFITypeDoubleFloat" [floatRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'double (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3)]. "undo any callee argument pops because it may confuse stack management with the alloca." (self isCalleePopsConvention: calloutState callFlags) ifTrue: [self setsp: calloutState argVector]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. ^interpreterProxy floatObjectOf: floatRet]. intRet := self dispatchFunctionPointer: (self cCoerceSimple: procAddr to: 'usqIntptr_t (*)(sqIntptr_t, sqIntptr_t, sqIntptr_t, sqIntptr_t)') with: (calloutState integerRegisters at: 0) with: (calloutState integerRegisters at: 1) with: (calloutState integerRegisters at: 2) with: (calloutState integerRegisters at: 3). "undo any callee argument pops because it may confuse stack management with the alloca." (self isCalleePopsConvention: calloutState callFlags) ifTrue: [self setsp: calloutState argVector]. + interpreterProxy ownVM: myThreadIndex. - self maybeOwnVM: calloutState threadIndex: myThreadIndex. (calloutState ffiRetHeader anyMask: FFIFlagPointer+FFIFlagStructure) ifTrue: ["Note: Order is important here since FFIFlagPointer + FFIFlagStructure is used to represent 'typedef void* VoidPointer' and VoidPointer must be returned as pointer *not* as struct." (calloutState ffiRetHeader anyMask: FFIFlagPointer) ifTrue: [^self ffiReturnPointer: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiReturnStruct: intRet ofType: (self ffiReturnType: specOnStack) in: calloutState]. ^self ffiCreateIntegralResultOop: intRet ofAtomicType: atomicType in: calloutState! Item was changed: SharedPool subclass: #VMBasicConstants instanceVariableNames: '' + classVariableNames: 'BaseHeaderSize BytecodeSetHasExtensions BytesPerOop BytesPerWord COGMTVM COGVM CloneOnGC CloneOnScavenge DisownVMForFFICall DisownVMForThreading DisownVMLockOutFullGC DoAssertionChecks DoExpensiveAssertionChecks GCCheckPrimCall GCModeBecome GCModeFreeSpace GCModeFull GCModeImageSegment GCModeIncremental GCModeNewSpace HashMultiplyConstant HashMultiplyMask IMMUTABILITY LowcodeVM MULTIPLEBYTECODESETS NewspeakVM PharoVM PrimErrBadArgument PrimErrBadIndex PrimErrBadMethod PrimErrBadNumArgs PrimErrBadReceiver PrimErrCallbackError PrimErrFFIException PrimErrGenericFailure PrimErrInappropriate PrimErrLimitExceeded PrimErrNamedInternal PrimErrNoCMemory PrimErrNoMemory PrimErrNoModification PrimErrNotFound PrimErrOSError PrimErrObjectIsPinned PrimErrObjectMayMove PrimErrObjectMoved PrimErrObjectNotPinned PrimErrUnsupported PrimErrWritePastObject PrimNoErr SPURVM STACKVM SistaVM TempVectReadBarrier VMBIGENDIAN' - classVariableNames: 'BaseHeaderSize BytecodeSetHasExtensions BytesPerOop BytesPerWord COGMTVM COGVM CloneOnGC CloneOnScavenge DisownVMLockOutFullGC DoAssertionChecks DoExpensiveAssertionChecks GCCheckPrimCall GCModeBecome GCModeFreeSpace GCModeFull GCModeImageSegment GCModeIncremental GCModeNewSpace HashMultiplyConstant HashMultiplyMask IMMUTABILITY LowcodeVM MULTIPLEBYTECODESETS NewspeakVM PharoVM PrimErrBadArgument PrimErrBadIndex PrimErrBadMethod PrimErrBadNumArgs PrimErrBadReceiver PrimErrCallbackError PrimErrFFIException PrimErrGenericFailure PrimErrInappropriate PrimErrLimitExceeded PrimErrNamedInternal PrimErrNoCMemory PrimErrNoMemory PrimErrNoModification PrimErrNotFound PrimErrOSError PrimErrObjectIsPinned PrimErrObjectMayMove PrimErrObjectMoved PrimErrObjectNotPinned PrimErrUnsupported PrimErrWritePastObject PrimNoErr SPURVM STACKVM SistaVM TempVectReadBarrier VMBIGENDIAN' poolDictionaries: '' category: 'VMMaker-Interpreter'! !VMBasicConstants commentStamp: '<historical>' prior: 0! I am a shared pool for basic constants upon which the VM as a whole depends. self ensureClassPool. self classPool declare: #BytesPerWord from: VMSqueakV3ObjectRepresentationConstants classPool. self classPool declare: #BaseHeaderSize from: VMSqueakV3ObjectRepresentationConstants classPool (ObjectMemory classPool keys select: [:k| k beginsWith: 'Byte']) do: [:k| self classPool declare: k from: ObjectMemory classPool]!

1 0

64-bit MacOS VM dmg is fine. 32-bit one doesn't mount.
by Eliot Miranda 24 Aug '18

24 Aug '18

Hi All, whoever is building the dmg files on binary, the 64-bit dmg file is fine and mounts OK. The 32-bit one isn't and refuses to mount on my 10.10.5 Yosemite Mac Mini. To reproduce, use the getGoodSpurVM.sh and getGoodSpur64VM.sh scripts in the image directory on MacOS. The former produces "LSOpenURLsWithRole() failed with error -600 for the file /Users/eliot/oscogvm/image/squeak.cog.spur_macos32_x86_201808230550.dmg." _,,,^..^,,,_ best, Eliot

2 1

VM Maker: VMMaker.oscog-eem.2431.mcz
by commits＠source.squeak.org 23 Aug '18

23 Aug '18

Eliot Miranda uploaded a new version of VMMaker to project VM Maker: http://source.squeak.org/VMMaker/VMMaker.oscog-eem.2431.mcz ==================== Summary ==================== Name: VMMaker.oscog-eem.2431 Author: eem Time: 23 August 2018, 12:31:54.020173 pm UUID: 2771de4d-ef66-4fd5-ab42-bbb4709819ec Ancestors: VMMaker.oscog-eem.2430 Core VM: Kernel of support for failing FFI calls that raise exceptions. This provides simulation support for catching the signal and activating the invoking method as a primitive failure. The platform exception handlers still need of course to be modified to invoke this support. Refactoring: Move reenterInterpreter up to StackInterpreter from CoInterpreter, along with all relevant methods. Add mustBeInterpreterFrame agument to justActivateNewMethod: to that the Cog VM can insist on activating the failing FFI invoking method in the interpreter, which simplifies the machinery in activateFailingPrimitiveMethod, which is the api entry-point that does the work of failing the primitive and long-jumping to the interpreter. Fix a bug in CoInterpreter's justActivateNewMethod: which left the instructionPointer one ahead if activating a faiiing primitive method. Add primitiveFailForFFIException:at: as a setter for the exception state. Add PrimErrFFIException. Update cloneOSErrorObj:numSlots: to deal with a three slot subclass of PrimitiveError that adds a pc at which an exception took place (exception can be represented by errorCode). Plugins: Have the ThreadedFFIPlugin create a valid stack allocation so it can simulate a callout. Have its dispatchFunctionPointer:[with:*] methods catch MessageNotUnderstood and invoke primitiveFailForFFIException:at: and then activateFailingPrimitiveMethod. Update morphIntoConcreteSubclass: to run any relevant class initialization if required. Misc: Initializing extensions should occur before fetching a bytecode, in case the bytecode is itself extended. Add the 5 & 6 argument perform: methopds to this package, instead of relying on a file-in that ends up causing me to accidentally commit them to Kernel. Have attemptToComputeTempNamesFor: use newFrom: instead of withAll: to work in Pharo. Hopefully temporary. =============== Diff against VMMaker.oscog-eem.2430 =============== Item was changed: StackInterpreterPrimitives subclass: #CoInterpreter + instanceVariableNames: 'cogit cogMethodZone gcMode cogCodeSize desiredCogCodeSize heapBase lastCoggableInterpretedBlockMethod deferSmash deferredSmash primTraceLog primTraceLogIndex traceLog traceLogIndex traceSources cogCompiledCodeCompactionCalledFor statCodeCompactionCount statCodeCompactionUsecs lastUncoggableInterpretedBlockMethod flagInterpretedMethods maxLiteralCountForCompile minBackwardJumpCountForCompile' + classVariableNames: 'CSCallbackEnter CSCallbackLeave CSCheckEvents CSEnterCriticalSection CSExitCriticalSection CSOwnVM CSResume CSSignal CSSuspend CSSwitchIfNeccessary CSThreadBind CSThreadSchedulingLoop CSWait CSYield HasBeenReturnedFromMCPC HasBeenReturnedFromMCPCOop MFMethodFlagFrameIsMarkedFlag MinBackwardJumpCountForCompile PrimNumberHashMultiply PrimTraceLogSize RumpCStackSize TraceBlockActivation TraceBlockCreation TraceBufferSize TraceCodeCompaction TraceContextSwitch TraceDisownVM TraceFullGC TraceIncrementalGC TraceIsFromInterpreter TraceIsFromMachineCode TraceOwnVM TracePreemptDisowningThread TracePrimitiveFailure TracePrimitiveRetry TraceSources TraceStackOverflow TraceThreadSwitch TraceVMCallback TraceVMCallbackReturn' - instanceVariableNames: 'cogit cogMethodZone gcMode cogCodeSize desiredCogCodeSize heapBase lastCoggableInterpretedBlockMethod reenterInterpreter deferSmash deferredSmash primTraceLog primTraceLogIndex traceLog traceLogIndex traceSources cogCompiledCodeCompactionCalledFor statCodeCompactionCount statCodeCompactionUsecs lastUncoggableInterpretedBlockMethod flagInterpretedMethods maxLiteralCountForCompile minBackwardJumpCountForCompile' - classVariableNames: 'CSCallbackEnter CSCallbackLeave CSCheckEvents CSEnterCriticalSection CSExitCriticalSection CSOwnVM CSResume CSSignal CSSuspend CSSwitchIfNeccessary CSThreadBind CSThreadSchedulingLoop CSWait CSYield HasBeenReturnedFromMCPC HasBeenReturnedFromMCPCOop MFMethodFlagFrameIsMarkedFlag MinBackwardJumpCountForCompile PrimNumberHashMultiply PrimTraceLogSize ReturnToInterpreter RumpCStackSize TraceBlockActivation TraceBlockCreation TraceBufferSize TraceCodeCompaction TraceContextSwitch TraceDisownVM TraceFullGC TraceIncrementalGC TraceIsFromInterpreter TraceIsFromMachineCode TraceOwnVM TracePreemptDisowningThread TracePrimitiveFailure TracePrimitiveRetry TraceSources TraceStackOverflow TraceThreadSwitch TraceVMCallback TraceVMCallbackReturn' poolDictionaries: 'CogMethodConstants VMStackFrameOffsets' category: 'VMMaker-JIT'! !CoInterpreter commentStamp: 'eem 12/7/2017 11:19' prior: 0! I am a variant of the StackInterpreter that can co-exist with the Cog JIT. I interpret unjitted methods, either because they have been found for the first time or because they are judged to be too big to JIT. See CogMethod class's comment for method interoperability. cogCodeSize - the current size of the machine code zone cogCompiledCodeCompactionCalledFor - a variable set when the machine code zone runs out of space, causing a machine code zone compaction at the next available opportunity cogMethodZone - the manager for the machine code zone (instance of CogMethodZone) cogit - the JIT (co-jit) (instance of SimpleStackBasedCogit, StackToRegisterMappoingCogit, etc) deferSmash - a flag causing deferral of smashes of the stackLimit around the call of functionSymbol (for assert checks) deferredSmash - a flag noting deferral of smashes of the stackLimit around the call of functionSymbol (for assert checks) desiredCogCodeSize - the desred size of the machine code zone, set at startup or via primitiveVMParameter to be written at snapshot time flagInterpretedMethods - true if methods that are interpreted shoudl have their flag bit set (used to identity methods that are interpreted because they're unjittable for some reason) gcMode - the variable holding the gcMode, used to inform the cogit of how to scan the machine code zone for oops on GC heapBase - the address in memory of the base of the objectMemory's heap, which is immediately above the machine code zone lastCoggableInterpretedBlockMethod - a variable used to invoke the cogit for a block mehtod being invoked repeatedly in the interpreter lastUncoggableInterpretedBlockMethod - a variable used to avoid invoking the cogit for an unjittable method encountered on block evaluation maxLiteralCountForCompile - the variable controlling which methods to jit. methods with a literal count above this value will not be jitted (on the grounds that large methods are typically used for initialization, and take up a lot of space in the code zone) minBackwardJumpCountForCompile - the variable controlling when to attempt to jit a method being interpreted. If as many backward jumps as this occur, the current method will be jitted primTraceLog - a small array implementing a crcular buffer logging the last N primitive invocations, GCs, code compactions, etc used for crash reporting primTraceLogIndex - the index into primTraceLog of the next entry reenterInterpreter - the jmpbuf used to jmp back into the interpreter when transitioning from machine code to the interpreter statCodeCompactionCount - the count of machine code zone compactions statCodeCompactionUsecs - the total microseconds spent in machine code zone compactions traceLog - a log of various events, used in debugging traceLogIndex - the index into traceLog of the next entry traceSources - the names associated with the codes of events in traceLog! Item was changed: ----- Method: CoInterpreter class>>declareCVarsIn: (in category 'translation') ----- declareCVarsIn: aCCodeGenerator "Override to avoid repeating StackInterpreter's declarations and add our own extensions" self class == thisContext methodClass ifFalse: [^self]. "Don't duplicate decls in subclasses" aCCodeGenerator addHeaderFile:'"sqCogStackAlignment.h"'; addHeaderFile:'"cogmethod.h"'. NewspeakVM ifTrue: [aCCodeGenerator addHeaderFile:'"nssendcache.h"']. aCCodeGenerator addHeaderFile: (aCCodeGenerator vmClass isThreadedVM ifTrue: ['"cointerpmt.h"'] ifFalse: ['"cointerp.h"']); addHeaderFile:'"cogit.h"'. aCCodeGenerator vmClass declareInterpreterVersionIn: aCCodeGenerator defaultName: aCCodeGenerator interpreterVersion. aCCodeGenerator var: #heapBase type: #usqInt; var: #statCodeCompactionUsecs type: #usqLong; var: #maxLiteralCountForCompile declareC: 'sqInt maxLiteralCountForCompile = MaxLiteralCountForCompile /* ', MaxLiteralCountForCompile printString, ' */'; var: #minBackwardJumpCountForCompile declareC: 'sqInt minBackwardJumpCountForCompile = MinBackwardJumpCountForCompile /* ', MinBackwardJumpCountForCompile printString, ' */'. + aCCodeGenerator removeVariable: 'atCache'. "Way too much trouble than it's worth in the Cog VM" - aCCodeGenerator removeVariable: 'atCache'. aCCodeGenerator - var: #reenterInterpreter - declareC: 'jmp_buf reenterInterpreter; /* private export */'. - aCCodeGenerator var: #primTraceLogIndex type: #'unsigned char'; var: #primTraceLog declareC: 'sqInt primTraceLog[256]'; var: #traceLog declareC: 'sqInt traceLog[TraceBufferSize /* ', TraceBufferSize printString, ' */]'; var: #traceSources type: #'char *' array: TraceSources! Item was changed: ----- Method: CoInterpreter class>>initializeMiscConstants (in category 'initialization') ----- initializeMiscConstants super initializeMiscConstants. COGVM := true. MinBackwardJumpCountForCompile := 40. MaxNumArgs := 15. PrimCallNeedsNewMethod := 1. PrimCallNeedsPrimitiveFunction := 2. PrimCallMayCallBack := 4. PrimCallOnSmalltalkStack := 8. PrimCallCollectsProfileSamples := 16. CheckAllocationFillerAfterPrimCall := 32. PrimCallDoNotJIT := 64. - ReturnToInterpreter := 1. "setjmp/longjmp code." - PrimTraceLogSize := 256. "Room for 256 selectors. Must be 256 because we use a byte to hold the index" TraceBufferSize := 256 * 3. "Room for 256 events" TraceContextSwitch := self objectMemoryClass basicNew integerObjectOf: 1. TraceBlockActivation := self objectMemoryClass basicNew integerObjectOf: 2. TraceBlockCreation := self objectMemoryClass basicNew integerObjectOf: 3. TraceIncrementalGC := self objectMemoryClass basicNew integerObjectOf: 4. TraceFullGC := self objectMemoryClass basicNew integerObjectOf: 5. TraceCodeCompaction := self objectMemoryClass basicNew integerObjectOf: 6. TraceOwnVM := self objectMemoryClass basicNew integerObjectOf: 7. TraceDisownVM := self objectMemoryClass basicNew integerObjectOf: 8. TraceThreadSwitch := self objectMemoryClass basicNew integerObjectOf: 9. TracePreemptDisowningThread := self objectMemoryClass basicNew integerObjectOf: 10. TraceVMCallback := self objectMemoryClass basicNew integerObjectOf: 11. TraceVMCallbackReturn := self objectMemoryClass basicNew integerObjectOf: 12. TraceStackOverflow := self objectMemoryClass basicNew integerObjectOf: 13. TracePrimitiveFailure := self objectMemoryClass basicNew integerObjectOf: 14. TracePrimitiveRetry := self objectMemoryClass basicNew integerObjectOf: 15. TraceIsFromMachineCode := 1. TraceIsFromInterpreter := 2. CSCallbackEnter := 3. CSCallbackLeave := 4. CSEnterCriticalSection := 5. CSExitCriticalSection := 6. CSResume := 7. CSSignal := 8. CSSuspend := 9. CSWait := 10. CSYield := 11. CSCheckEvents := 12. CSThreadSchedulingLoop := 13. CSOwnVM := 14. CSThreadBind := 15. CSSwitchIfNeccessary := 16. TraceSources := CArrayAccessor on: #('?' 'm' 'i' 'callbackEnter' 'callbackLeave' 'enterCritical' 'exitCritical' 'resume' 'signal' 'suspend' 'wait' 'yield' 'eventcheck' 'threadsched' 'ownVM' 'bindToThread' 'switchIfNecessary'). "this is simulation only" RumpCStackSize := 4096! Item was changed: ----- Method: CoInterpreter class>>mustBeGlobal: (in category 'translation') ----- mustBeGlobal: var "Answer if a variable must be global and exported. Used for inst vars that are accessed from VM support code." ^(super mustBeGlobal: var) or: [#('desiredCogCodeSize' 'heapBase' + 'maxLiteralCountForCompile' 'minBackwardJumpCountForCompile') includes: var]! - 'maxLiteralCountForCompile' 'minBackwardJumpCountForCompile' - 'reenterInterpreter') includes: var]! Item was removed: - ----- Method: CoInterpreter class>>prepareToBeAddedToCodeGenerator: (in category 'translation') ----- - prepareToBeAddedToCodeGenerator: aCodeGen - "It is either this or scan cmacro methods for selectors." - aCodeGen retainMethods: #(enterSmalltalkExecutiveImplementation)! Item was removed: - ----- Method: CoInterpreter>>enterSmalltalkExecutive (in category 'initialization') ----- - enterSmalltalkExecutive - "Main entry-point into the interpreter at each execution level, where an - execution level is either the start of execution or reentry for a callback." - <cmacro: '() enterSmalltalkExecutiveImplementation()'> - "Simulation of the setjmp in enterSmalltalkExecutiveImplementation for reentry into interpreter." - [([self enterSmalltalkExecutiveImplementation] - on: ReenterInterpreter - do: [:ex| ex return: ex returnValue]) = ReturnToInterpreter] whileTrue! Item was removed: - ----- Method: CoInterpreter>>enterSmalltalkExecutiveFromCallback (in category 'callback support') ----- - enterSmalltalkExecutiveFromCallback - <inline: true> - self enterSmalltalkExecutive! Item was removed: - ----- Method: CoInterpreter>>initialEnterSmalltalkExecutive (in category 'initialization') ----- - initialEnterSmalltalkExecutive - "Main entry-point into the interpreter at system start-up. - In the non-threaded VM this is identical to enterSmalltalkExecutive" - <cmacro: '() enterSmalltalkExecutiveImplementation()'> - "Simulation of the setjmp in enterSmalltalkExecutiveImplementation for reentry into interpreter." - [([self enterSmalltalkExecutiveImplementation] - on: ReenterInterpreter - do: [:ex| ex return: ex returnValue]) = ReturnToInterpreter] whileTrue! Item was removed: - ----- Method: CoInterpreter>>justActivateNewMethod (in category 'message sending') ----- - justActivateNewMethod - | methodHeader activateCogMethod cogMethod numArgs numTemps rcvr initialIP | - <var: #cogMethod type: #'CogMethod *'> - <var: #initialIP type: #usqInt> - <inline: true> - methodHeader := self rawHeaderOf: newMethod. - (activateCogMethod := self isCogMethodReference: methodHeader) ifTrue: - [cogMethod := self cCoerceSimple: methodHeader to: #'CogMethod *'. - methodHeader := cogMethod methodHeader]. - numTemps := self temporaryCountOfMethodHeader: methodHeader. - numArgs := self argumentCountOfMethodHeader: methodHeader. - - rcvr := self stackValue: numArgs. "could new rcvr be set at point of send?" - self assert: (objectMemory isOopForwarded: rcvr) not. - - (activateCogMethod - and: [instructionPointer asUnsignedInteger >= objectMemory startOfMemory]) ifTrue: - [self iframeSavedIP: framePointer put: instructionPointer. - instructionPointer := cogit ceReturnToInterpreterPC]. - self push: instructionPointer. - self push: framePointer. - framePointer := stackPointer. - initialIP := self initialIPForHeader: methodHeader method: newMethod. - activateCogMethod - ifTrue: - [self push: cogMethod asUnsignedInteger. - self push: objectMemory nilObject. "FoxThisContext field" - instructionPointer := cogMethod asUnsignedInteger + cogMethod stackCheckOffset] - ifFalse: - [self push: newMethod. - self setMethod: newMethod methodHeader: methodHeader. - self push: objectMemory nilObject. "FoxThisContext field" - self push: (self encodeFrameFieldHasContext: false isBlock: false numArgs: numArgs). - self push: 0. "FoxIFSavedIP" - instructionPointer := initialIP - 1]. - self push: rcvr. - - "clear remaining temps to nil" - numArgs+1 to: numTemps do: - [:i | self push: objectMemory nilObject]. - - (self methodHeaderHasPrimitive: methodHeader) ifTrue: - ["Skip the CallPrimitive bytecode, if it's there, and store the error code if the method starts - with a long store temp. Strictly no need to skip the store because it's effectively a noop." - activateCogMethod ifFalse: - [instructionPointer := initialIP + (self sizeOfCallPrimitiveBytecode: methodHeader)]. - primFailCode ~= 0 ifTrue: - [self reapAndResetErrorCodeTo: stackPointer header: methodHeader]]. - - ^methodHeader! Item was added: + ----- Method: CoInterpreter>>justActivateNewMethod: (in category 'message sending') ----- + justActivateNewMethod: mustBeInterpreterFrame + | methodHeader cogMethod numArgs numTemps rcvr initialIP | + <var: #cogMethod type: #'CogMethod *'> + <var: #initialIP type: #usqInt> + <inline: true> + methodHeader := self rawHeaderOf: newMethod. + (mustBeInterpreterFrame not + and: [self isCogMethodReference: methodHeader]) ifTrue: + [cogMethod := self cCoerceSimple: methodHeader to: #'CogMethod *'. + methodHeader := cogMethod methodHeader]. + numTemps := self temporaryCountOfMethodHeader: methodHeader. + numArgs := self argumentCountOfMethodHeader: methodHeader. + + rcvr := self stackValue: numArgs. "could new rcvr be set at point of send?" + self assert: (objectMemory isOopForwarded: rcvr) not. + + (cogMethod notNil + and: [instructionPointer asUnsignedInteger >= objectMemory startOfMemory]) ifTrue: + [self iframeSavedIP: framePointer put: instructionPointer. + instructionPointer := cogit ceReturnToInterpreterPC]. + self push: instructionPointer. + self push: framePointer. + framePointer := stackPointer. + initialIP := self initialIPForHeader: methodHeader method: newMethod. + cogMethod + ifNotNil: + [self push: cogMethod asUnsignedInteger. + self push: objectMemory nilObject. "FoxThisContext field" + instructionPointer := cogMethod asUnsignedInteger + cogMethod stackCheckOffset] + ifNil: + [self push: newMethod. + self setMethod: newMethod methodHeader: methodHeader. + self push: objectMemory nilObject. "FoxThisContext field" + self push: (self encodeFrameFieldHasContext: false isBlock: false numArgs: numArgs). + self push: 0. "FoxIFSavedIP" + instructionPointer := initialIP - 1]. + self push: rcvr. + + "clear remaining temps to nil" + numArgs+1 to: numTemps do: + [:i | self push: objectMemory nilObject]. + + (self methodHeaderHasPrimitive: methodHeader) ifTrue: + ["Skip the CallPrimitive bytecode, if it's there, and store the error code if the method starts + with a long store temp. Strictly no need to skip the store because it's effectively a noop." + cogMethod ifNil: + [instructionPointer := instructionPointer + (self sizeOfCallPrimitiveBytecode: methodHeader)]. + primFailCode ~= 0 ifTrue: + [self reapAndResetErrorCodeTo: stackPointer header: methodHeader]]. + + ^methodHeader! Item was removed: - ----- Method: CoInterpreter>>long:jmp: (in category 'cog jit support') ----- - long: aJumpBuf jmp: returnValue - "Hack simulation of setjmp/longjmp. - Signal the exception that simulates a longjmp back to the interpreter." - <doNotGenerate> - aJumpBuf == reenterInterpreter ifTrue: - [self assertValidExecutionPointe: instructionPointer r: framePointer s: stackPointer imbar: true line: nil]. - aJumpBuf returnValue: returnValue; signal! Item was changed: ----- Method: CoInterpreter>>saveCStackStateForCallbackContext: (in category 'callback support') ----- saveCStackStateForCallbackContext: vmCallbackContext <var: #vmCallbackContext type: #'VMCallbackContext *'> vmCallbackContext savedCStackPointer: cogit getCStackPointer; savedCFramePointer: cogit getCFramePointer. + super saveCStackStateForCallbackContext: vmCallbackContext! - self mem: vmCallbackContext savedReenterInterpreter asVoidPointer - cp: reenterInterpreter - y: (self sizeof: #'jmp_buf')! Item was removed: - ----- Method: CoInterpreter>>sigset:jmp: (in category 'cog jit support') ----- - sigset:aJumpBuf jmp: sigSaveMask - "Hack simulation of sigsetjmp/siglongjmp. - Assign to reenterInterpreter the exception that when - raised simulates a longjmp back to the interpreter." - <doNotGenerate> - reenterInterpreter := ReenterInterpreter new returnValue: 0; yourself. - ^0! Item was changed: ----- Method: CogVMSimulator>>interpret (in category 'interpreter shell') ----- interpret "This is the main interpreter loop. It normally loops forever, fetching and executing bytecodes. When running in the context of a web browser plugin VM, however, it must return control to the web browser periodically. This should done only when the state of the currently running Squeak thread is safely stored in the object heap. Since this is the case at the moment that a check for interrupts is performed, that is when we return to the browser if it is time to do so. Interrupt checks happen quite frequently. Override for simulation to insert bytecode breakpoint support." <inline: false> "If stacklimit is zero then the stack pages have not been initialized." stackLimit = 0 ifTrue: [^self initStackPagesAndInterpret]. "record entry time when running as a browser plug-in" self browserPluginInitialiseIfNeeded. self internalizeIPandSP. - self fetchNextBytecode. self initExtensions. + self fetchNextBytecode. [true] whileTrue: [self assertValidExecutionPointers. atEachStepBlock value. "N.B. may be nil" self dispatchOn: currentBytecode in: BytecodeTable. self incrementByteCount]. localIP := localIP - 1. "undo the pre-increment of IP before returning" self externalizeIPandSP. ^nil ! Item was changed: ----- Method: Cogit class>>attemptToComputeTempNamesFor: (in category 'in-image compilation support') ----- attemptToComputeTempNamesFor: aCompiledMethod (aCompiledMethod respondsTo: #tempNames) ifTrue: [| schematicTemps blocks | schematicTemps := aCompiledMethod methodNode schematicTempNamesString. blocks := aCompiledMethod embeddedBlockClosures. InitializationOptions at: #tempNames + put: (Dictionary newFrom: {aCompiledMethod initialPC -> (self decomposeSchematicTemps: (schematicTemps copyUpTo: $[))}, - put: (Dictionary withAll: {aCompiledMethod initialPC -> (self decomposeSchematicTemps: (schematicTemps copyUpTo: $[))}, (blocks ifEmpty: [#()] ifNotEmpty: [aCompiledMethod embeddedBlockClosures with: (schematicTemps piecesCutWhere: [:a :b| b = $[]) allButFirst collect: [:c :s| c startpc -> (self decomposeSchematicTemps: (s copyWithoutAll: '[]'))]]))]! Item was changed: VMClass subclass: #InterpreterPrimitives + instanceVariableNames: 'objectMemory messageSelector argumentCount newMethod primFailCode osErrorCode exceptionPC profileMethod profileProcess profileSemaphore nextProfileTick preemptionYields newFinalization sHEAFn' - instanceVariableNames: 'objectMemory messageSelector argumentCount newMethod primFailCode osErrorCode profileMethod profileProcess profileSemaphore nextProfileTick preemptionYields newFinalization sHEAFn' classVariableNames: 'CrossedX EndOfRun MillisecondClockMask' poolDictionaries: 'VMBasicConstants VMBytecodeConstants VMMethodCacheConstants VMObjectIndices VMSqueakClassIndices VMStackFrameOffsets' category: 'VMMaker-Interpreter'! !InterpreterPrimitives commentStamp: 'eem 12/7/2017 18:44' prior: 0! InterpreterPrimitives implements most of the VM's core primitives. It is the root of the interpreter hierarchy so as to share the core primitives amongst the varioius interpreters. Instance Variables argumentCount: <Integer> messageSelector: <Integer> newMethod: <Integer> nextProfileTick: <Integer> objectMemory: <ObjectMemory> (simulation only) preemptionYields: <Boolean> primFailCode: <Integer> osErrorCode: <Integer> profileMethod: <Integer> profileProcess: <Integer> profileSemaphore: <Integer> secHasEnvironmentAccess <Integer> argumentCount - the number of arguments of the current message messageSelector - the oop of the selector of the current message newMethod - the oop of the result of looking up the current message nextProfileTick - the millisecond clock value of the next profile tick (if profiling is in effect) objectMemory - the memory manager and garbage collector that manages the heap preemptionYields - a boolean controlling the process primitives. If true (old, incorrect, blue-book semantics) a preempted process is sent to the back of its run-queue. If false, a process preempted by a higher-priority process is put back at the head of its run queue, hence preserving cooperative scheduling within priorities. primFailCode - primitive success/failure flag, 0 for success, otherwise the reason code for failure osErrorCode - a 64-bit value settable by external primitives conveying arbitrary error codes from the operating system and/or system libraries profileMethod - the oop of the method at the time nextProfileTick was reached profileProcess - the oop of the activeProcess at the time nextProfileTick was reached profileSemaphore - the oop of the semaphore to signal when nextProfileTick is reached secHasEnvironmentAccess - the function to call to check if access to the envronment should be granted to primitiveGetenv ! Item was added: + ----- Method: InterpreterPrimitives>>primitiveFailForFFIException:at: (in category 'primitive support') ----- + primitiveFailForFFIException: exceptionCode at: pc + <var: 'exceptionCode' type: #sqLong> + "Set PrimErrOSError primitive failure and associated osErrorCode." + <api> + osErrorCode := exceptionCode. + exceptionPC := pc. + ^primFailCode := PrimErrFFIException! Item was added: + ----- Method: Object>>perform:with:with:with:with:with: (in category '*VMMaker-message handling') ----- + perform: aSymbol with: firstObject with: secondObject with: thirdObject with: fourthObject with: fifthObject + "Send the selector, aSymbol, to the receiver with the given arguments. + Fail if the number of arguments expected by the selector is not five. + Primitive. Optional. See Object documentation whatIsAPrimitive." + + <primitive: 83> + ^ self perform: aSymbol withArguments: { firstObject. secondObject. thirdObject. fourthObject. fifthObject }! Item was added: + ----- Method: Object>>perform:with:with:with:with:with:with: (in category '*VMMaker-message handling') ----- + perform: aSymbol with: firstObject with: secondObject with: thirdObject with: fourthObject with: fifthObject with: sixthObject + "Send the selector, aSymbol, to the receiver with the given arguments. + Fail if the number of arguments expected by the selector is not six. + Primitive. Optional. See Object documentation whatIsAPrimitive." + + <primitive: 83> + ^ self perform: aSymbol withArguments: { firstObject. secondObject. thirdObject. fourthObject. fifthObject. sixthObject }! Item was added: + ----- Method: SpurMemoryManager>>activateFailingPrimitiveMethod (in category 'simulation only') ----- + activateFailingPrimitiveMethod + "hack around the CoInterpreter/ObjectMemory split refactoring" + <doNotGenerate> + ^coInterpreter activateFailingPrimitiveMethod! Item was added: + ----- Method: SpurMemoryManager>>is:KindOfClass: (in category 'simulation only') ----- + is: oop KindOfClass: aClass + "hack around the CoInterpreter/ObjectMemory split refactoring" + <doNotGenerate> + ^coInterpreter is: oop KindOfClass: aClass! Item was added: + ----- Method: SpurMemoryManager>>primitiveFailForFFIException:at: (in category 'simulation only') ----- + primitiveFailForFFIException: errorCode at: pc + "hack around the CoInterpreter/ObjectMemory split refactoring" + <doNotGenerate> + ^coInterpreter primitiveFailForFFIException: errorCode at: pc! Item was changed: InterpreterPrimitives subclass: #StackInterpreter (excessive size, no diff calculated) Item was changed: ----- Method: StackInterpreter class>>declareCVarsIn: (in category 'translation') ----- declareCVarsIn: aCCodeGenerator | vmClass | self class == thisContext methodClass ifFalse: [^self]. "Don't duplicate decls in subclasses" vmClass := aCCodeGenerator vmClass. "Generate primitiveTable etc based on vmClass, not just StackInterpreter" aCCodeGenerator addHeaderFile:'<stddef.h> /* for e.g. alloca */'; addHeaderFile:'<setjmp.h>'; addHeaderFile:'<wchar.h> /* for wint_t */'; addHeaderFile:'"vmCallback.h"'; addHeaderFile:'"sqMemoryFence.h"'; addHeaderFile:'"dispdbg.h"'. LowcodeVM ifTrue: [ aCCodeGenerator addHeaderFile:'"sqLowcodeFFI.h"']. vmClass declareInterpreterVersionIn: aCCodeGenerator defaultName: 'Stack'. aCCodeGenerator var: #interpreterProxy type: #'struct VirtualMachine*'. aCCodeGenerator declareVar: #sendTrace type: 'volatile int'; declareVar: #byteCount type: #usqInt. "These need to be pointers or unsigned." self declareC: #(instructionPointer method newMethod) as: #usqInt in: aCCodeGenerator. "These are all pointers; char * because Slang has no support for C pointer arithmetic." self declareC: #(localIP localSP localFP stackPointer framePointer stackLimit breakSelector) as: #'char *' in: aCCodeGenerator. aCCodeGenerator var: #breakSelectorLength declareC: 'sqInt breakSelectorLength = MinSmallInteger'. self declareC: #(stackPage overflowedPage) as: #'StackPage *' in: aCCodeGenerator. aCCodeGenerator removeVariable: 'stackPages'. "this is an implicit receiver in the translated code." "This defines bytecodeSetSelector as 0 if MULTIPLEBYTECODESETS is not defined, for the benefit of the interpreter on slow machines." aCCodeGenerator addConstantForBinding: (self bindingOf: #MULTIPLEBYTECODESETS). MULTIPLEBYTECODESETS == false ifTrue: [aCCodeGenerator removeVariable: 'bytecodeSetSelector']. BytecodeSetHasExtensions == false ifTrue: [aCCodeGenerator removeVariable: 'extA'; removeVariable: 'extB']. aCCodeGenerator var: #methodCache declareC: 'sqIntptr_t methodCache[MethodCacheSize + 1 /* ', (MethodCacheSize + 1) printString, ' */]'. NewspeakVM ifTrue: [aCCodeGenerator var: #nsMethodCache declareC: 'sqIntptr_t nsMethodCache[NSMethodCacheSize + 1 /* ', (NSMethodCacheSize + 1) printString, ' */]'] ifFalse: [aCCodeGenerator removeVariable: #nsMethodCache; removeVariable: 'localAbsentReceiver'; removeVariable: 'localAbsentReceiverOrZero']. AtCacheTotalSize isInteger ifTrue: [aCCodeGenerator var: #atCache declareC: 'sqInt atCache[AtCacheTotalSize + 1 /* ', (AtCacheTotalSize + 1) printString, ' */]']. aCCodeGenerator var: #primitiveTable declareC: 'void (*primitiveTable[MaxPrimitiveIndex + 2 /* ', (MaxPrimitiveIndex + 2) printString, ' */])(void) = ', vmClass primitiveTableString. vmClass primitiveTable do: [:symbolOrNot| (symbolOrNot isSymbol and: [symbolOrNot ~~ #primitiveFail]) ifTrue: [(aCCodeGenerator methodNamed: symbolOrNot) ifNotNil: [:tMethod| tMethod returnType: #void]]]. vmClass objectMemoryClass hasSpurMemoryManagerAPI ifTrue: [aCCodeGenerator var: #primitiveAccessorDepthTable type: 'signed char' sizeString: 'MaxPrimitiveIndex + 2 /* ', (MaxPrimitiveIndex + 2) printString, ' */' array: vmClass primitiveAccessorDepthTable] ifFalse: [aCCodeGenerator removeVariable: #primitiveAccessorDepthTable]. aCCodeGenerator var: #displayBits type: #'void *'. self declareC: #(displayWidth displayHeight displayDepth) as: #int in: aCCodeGenerator. aCCodeGenerator var: #primitiveFunctionPointer declareC: 'void (*primitiveFunctionPointer)()'; var: #externalPrimitiveTable declareC: 'void (*externalPrimitiveTable[MaxExternalPrimitiveTableSize + 1 /* ', (MaxExternalPrimitiveTableSize + 1) printString, ' */])(void)'; var: #interruptCheckChain declareC: 'void (*interruptCheckChain)(void) = 0'; var: #showSurfaceFn declareC: 'int (*showSurfaceFn)(sqIntptr_t, int, int, int, int)'; var: #jmpBuf declareC: 'jmp_buf jmpBuf[MaxJumpBuf + 1 /* ', (MaxJumpBuf + 1) printString, ' */]'; var: #suspendedCallbacks declareC: 'usqInt suspendedCallbacks[MaxJumpBuf + 1 /* ', (MaxJumpBuf + 1) printString, ' */]'; var: #suspendedMethods declareC: 'usqInt suspendedMethods[MaxJumpBuf + 1 /* ', (MaxJumpBuf + 1) printString, ' */]'. self declareCAsUSqLong: #(nextPollUsecs nextWakeupUsecs longRunningPrimitiveGCUsecs longRunningPrimitiveStartUsecs longRunningPrimitiveStopUsecs "these are high-frequency enough that they're overflowing quite quickly on modern hardware" statProcessSwitch statIOProcessEvents statForceInterruptCheck statCheckForEvents statStackOverflow statStackPageDivorce statIdleUsecs) in: aCCodeGenerator. aCCodeGenerator var: #nextProfileTick type: #sqLong. + aCCodeGenerator + var: #reenterInterpreter + declareC: 'jmp_buf reenterInterpreter; /* private export */'. - LowcodeVM ifTrue: [aCCodeGenerator var: #lowcodeCalloutState type: #'sqLowcodeCalloutState*'. self declareC: #(nativeSP nativeStackPointer shadowCallStackPointer) as: #'char *' in: aCCodeGenerator] ifFalse: [#(lowcodeCalloutState nativeSP nativeStackPointer shadowCallStackPointer) do: [:var| aCCodeGenerator removeVariable: var]]! Item was changed: ----- Method: StackInterpreter class>>initializeMiscConstants (in category 'initialization') ----- initializeMiscConstants super initializeMiscConstants. STACKVM := true. "These flags function to identify a GC operation, or to specify what operations the leak checker should be run for." GCModeFull := 1. "stop-the-world global GC" GCModeNewSpace := 2. "Spur's scavenge, or V3's incremental" GCModeIncremental := 4. "incremental global gc (Dijkstra tri-colour marking); as yet unimplemented" GCModeBecome := 8. "v3 post-become sweeping/Spur forwarding" GCModeImageSegment := 16. "just a flag for leak checking image segments" GCModeFreeSpace := 32. "just a flag for leak checking free space; Spur only" GCCheckPrimCall := 64. "just a flag for leak checking external primitive calls" StackPageTraceInvalid := -1. StackPageUnreached := 0. StackPageReachedButUntraced := 1. StackPageTraced := 2. DumpStackOnLowSpace := 0. MillisecondClockMask := 16r1FFFFFFF. "Note: The external primitive table should actually be dynamically sized but for the sake of inferior platforms (e.g., Mac :-) who cannot allocate memory in any reasonable way, we keep it static (and cross our fingers...)" MaxExternalPrimitiveTableSize := 4096. "entries" MaxJumpBuf := 32. "max. callback depth" FailImbalancedPrimitives := InitializationOptions at: #FailImbalancedPrimitives ifAbsentPut: [true]. + EnforceAccessControl := InitializationOptions at: #EnforceAccessControl ifAbsent: [true]. + + ReturnToInterpreter := 1 "setjmp/longjmp code."! - EnforceAccessControl := InitializationOptions at: #EnforceAccessControl ifAbsent: [true]! Item was changed: ----- Method: StackInterpreter class>>mustBeGlobal: (in category 'translation') ----- mustBeGlobal: var "Answer if a variable must be global and exported. Used for inst vars that are accessed from VM support code." ^(super mustBeGlobal: var) or: [(self objectMemoryClass mustBeGlobal: var) or: [(#('interpreterProxy' 'interpreterVersion' 'inIOProcessEvents' 'deferDisplayUpdates' 'extraVMMemory' 'showSurfaceFn' 'displayBits' 'displayWidth' 'displayHeight' 'displayDepth' 'desiredNumStackPages' 'desiredEdenBytes' 'breakLookupClassTag' 'breakSelector' 'breakSelectorLength' 'sendTrace' 'checkAllocFiller' 'checkedPluginName' + 'reenterInterpreter' 'suppressHeartbeatFlag' + 'debugCallbackInvokes' 'debugCallbackPath' 'debugCallbackReturns') includes: var) - 'suppressHeartbeatFlag' 'debugCallbackInvokes' 'debugCallbackPath' 'debugCallbackReturns') includes: var) or: [ "This allows slow machines to define bytecodeSetSelector as 0 to avoid the interpretation overhead." MULTIPLEBYTECODESETS not and: [var = 'bytecodeSetSelector']]]]! Item was added: + ----- Method: StackInterpreter class>>prepareToBeAddedToCodeGenerator: (in category 'translation') ----- + prepareToBeAddedToCodeGenerator: aCodeGen + "It is either this or scan cmacro methods for selectors." + aCodeGen retainMethods: #(enterSmalltalkExecutiveImplementation)! Item was added: + ----- Method: StackInterpreter>>activateFailingPrimitiveMethod (in category 'primitive support') ----- + activateFailingPrimitiveMethod + "Assuming the primFailCode (and any other relevant failure state) has been set, + switch the VM to the interpreter if necessary (if in the CoInterpreter executing machine code), + and activate the newMethod (which is expected to have a primitive)." + <api> + self assert: primFailCode ~= 0. + self assert: (objectMemory addressCouldBeObj: newMethod). + self assert: (objectMemory isCompiledMethod: newMethod). + self assert: (self primitiveIndexOf: newMethod) ~= 0. + self justActivateNewMethod: true. "Frame must be interpreted" + self siglong: reenterInterpreter jmp: ReturnToInterpreter. + "NOTREACHED" + ^nil! Item was changed: ----- Method: StackInterpreter>>activateNewMethod (in category 'message sending') ----- activateNewMethod | methodHeader | + methodHeader := self justActivateNewMethod: false. "either interpreted or machine code" - methodHeader := self justActivateNewMethod. "Now check for stack overflow or an event (interrupt, must scavenge, etc)." stackPointer < stackLimit ifTrue: [self handleStackOverflowOrEventAllowContextSwitch: (self canContextSwitchIfActivating: newMethod header: methodHeader)]! Item was changed: ----- Method: StackInterpreter>>callbackEnter: (in category 'callback support') ----- callbackEnter: callbackID + "Re-enter the interpreter to execute a (non-ALien,non-FFI) callback (as used by the Python bridge)." + <volatile> - "Re-enter the interpreter for executing a callback" <export: true> <var: #callbackID type: #'sqInt *'> + | savedReenterInterpreter | + <var: #savedReenterInterpreter type: #'jmp_buf'> "For now, do not allow a callback unless we're in a primitiveResponse" (self asserta: primitiveFunctionPointer ~= 0) ifFalse: [^false]. + self assert: primFailCode = 0. + "Check if we've exceeded the callback depth" (self asserta: jmpDepth < MaxJumpBuf) ifFalse: [^false]. jmpDepth := jmpDepth + 1. "Suspend the currently active process" suspendedCallbacks at: jmpDepth put: self activeProcess. "We need to preserve newMethod explicitly since it is not activated yet and therefore no context has been created for it. If the caller primitive for any reason decides to fail we need to make sure we execute the correct method and not the one 'last used' in the call back" suspendedMethods at: jmpDepth put: newMethod. "Signal external semaphores since a signalSemaphoreWithIndex: request may have been issued immediately prior to this callback before the VM has any chance to do a signalExternalSemaphores in checkForEventsMayContextSwitch:" self signalExternalSemaphores. "If no process is awakened by signalExternalSemaphores then transfer to the highest priority runnable one." (suspendedCallbacks at: jmpDepth) = self activeProcess ifTrue: [self transferTo: self wakeHighestPriority]. "Typically, invoking the callback means that some semaphore has been signaled to indicate the callback. Force an interrupt check as soon as possible." self forceInterruptCheck. + "Save the previous interpreter entry jmp_buf." + self mem: savedReenterInterpreter asVoidPointer + cp: reenterInterpreter + y: (self sizeof: #'jmp_buf'). (self setjmp: (jmpBuf at: jmpDepth)) = 0 ifTrue: "Fill in callbackID" [callbackID at: 0 put: jmpDepth. + self enterSmalltalkExecutive. + self assert: false "NOTREACHED"]. - self interpret]. + "Restore the previous interpreter entry jmp_buf." + self mem: reenterInterpreter + cp: (self cCoerceSimple: savedReenterInterpreter to: #'void *') + y: (self sizeof: #'jmp_buf'). + "Transfer back to the previous process so that caller can push result" self putToSleep: self activeProcess yieldingIf: preemptionYields. self transferTo: (suspendedCallbacks at: jmpDepth). newMethod := suspendedMethods at: jmpDepth. "see comment above" argumentCount := self argumentCountOf: newMethod. + self assert: primFailCode = 0. + jmpDepth := jmpDepth - 1. - jmpDepth := jmpDepth-1. - "clean out the primPops etc since we'll be returning via primitive" - self initPrimCall. ^true! Item was changed: ----- Method: StackInterpreter>>cloneOSErrorObj:numSlots: (in category 'message sending') ----- cloneOSErrorObj: errObj numSlots: numSlots "If errObj is a pointer object with at least two slots, then answer a clone + of the error object with the second slot set to the value of osErrorCode, + and if an PrimErrFFIException, then the third slow with the exceptionPC." - of the error object with the second slot set to the value of osErrorCode." | clone | <inline: true> clone := objectMemory hasSpurMemoryManagerAPI ifTrue: [objectMemory eeInstantiateSmallClassIndex: (objectMemory classIndexOf: errObj) format: objectMemory nonIndexablePointerFormat numSlots: numSlots] ifFalse: [objectMemory eeInstantiateSmallClass: (objectMemory fetchClassOfNonImm: errObj) numSlots: numSlots]. 0 to: numSlots - 1 do: [:i| objectMemory storePointerUnchecked: i ofObject: clone withValue: (objectMemory fetchPointer: i ofObject: errObj)]. + (numSlots > 2 + and: [primFailCode = PrimErrFFIException]) + ifTrue: + [objectMemory + storePointerUnchecked: 1 + ofObject: clone + withValue: (self positive64BitIntegerFor: osErrorCode); + storePointerUnchecked: 2 + ofObject: clone + withValue: (self positive64BitIntegerFor: exceptionPC)] + ifFalse: + [objectMemory + storePointerUnchecked: 1 + ofObject: clone + withValue: (self signed64BitIntegerFor: osErrorCode)]. - objectMemory - storePointerUnchecked: 1 - ofObject: clone - withValue: (self signed64BitIntegerFor: osErrorCode). ^clone! Item was added: + ----- Method: StackInterpreter>>enterSmalltalkExecutive (in category 'initialization') ----- + enterSmalltalkExecutive + "Main entry-point into the interpreter at each execution level, where an + execution level is either the start of execution or reentry for a callback." + <cmacro: '() enterSmalltalkExecutiveImplementation()'> + "Simulation of the setjmp in enterSmalltalkExecutiveImplementation for reentry into interpreter." + [([self enterSmalltalkExecutiveImplementation] + on: ReenterInterpreter + do: [:ex| ex return: ex returnValue]) = ReturnToInterpreter] whileTrue! Item was changed: ----- Method: StackInterpreter>>enterSmalltalkExecutiveFromCallback (in category 'callback support') ----- enterSmalltalkExecutiveFromCallback <inline: true> + self enterSmalltalkExecutive! - self interpret! Item was added: + ----- Method: StackInterpreter>>enterSmalltalkExecutiveImplementation (in category 'initialization') ----- + enterSmalltalkExecutiveImplementation + "Main entry-point into the interpreter at each execution level, where an execution + level is either the start of execution or reentry for a callback. + This is the actual implementation, separated from enterSmalltalkExecutive so the + simulator can wrap it in an exception handler and hence simulate the setjmp/longjmp." + <inline: false> + "Setjmp for reentry into interpreter from elsewhere, e.g. FFI exception primitive failure." + self sigset: reenterInterpreter jmp: 0. + self setMethod: (self frameMethod: framePointer). + self assertValidExecutionPointe: instructionPointer r: framePointer s: stackPointer imbar: true line: #'__LINE__'. + self interpret. + ^0! Item was changed: ----- Method: StackInterpreter>>getErrorObjectFromPrimFailCode (in category 'message sending') ----- getErrorObjectFromPrimFailCode "Answer the errorCode object to supply to a failing primitive method that accepts one. If there is a primitive error table and the primFailCode is a valid index there-in answer the corresponding entry in the table, otherwise simply answer the code as an integer." | table errObj numSlots | primFailCode > 0 ifTrue: [table := objectMemory splObj: PrimErrTableIndex. primFailCode <= (objectMemory numSlotsOf: table) ifTrue: [errObj := objectMemory followField: primFailCode - 1 ofObject: table. + "If this is a PrimErrOSError/PrimErrFFIException and there's a clonable object in the table at that index, - "If this is a PrimErrOSError and there's a clonable object in the table at that index, answer a clone of the error object with the second slot set to the value of osErrorCode." + ((primFailCode = PrimErrOSError or: [primFailCode = PrimErrFFIException]) - (primFailCode = PrimErrOSError and: [(objectMemory formatOf: errObj) = objectMemory nonIndexablePointerFormat and: [(numSlots := objectMemory numSlotsOf: errObj) >= 2]]) ifTrue: [errObj := self cloneOSErrorObj: errObj numSlots: numSlots]. ^errObj]]. ^objectMemory integerObjectOf: primFailCode! Item was changed: ----- Method: StackInterpreter>>initStackPagesAndInterpret (in category 'initialization') ----- initStackPagesAndInterpret "Initialize the stack pages and enter interpret. Use alloca'ed memory so that when we have a JIT its stack pointer will be on the native stack since alloca allocates memory on the stack. Certain thread systems use the native stack pointer as the frame ID so putting the stack anywhere else can confuse the thread system." "This should be in its own initStackPages method but Slang can't inline C code strings." | stackPageBytes stackPagesBytes theStackMemory | <var: #theStackMemory type: #'void *'> stackPageBytes := self stackPageByteSize. stackPagesBytes := self computeStackZoneSize. theStackMemory := self cCode: [self alloca: stackPagesBytes] inSmalltalk: [stackPages initializeWithByteSize: stackPagesBytes for: self]. self cCode: [self me: theStackMemory ms: 0 et: stackPagesBytes]. stackPages initializeStack: theStackMemory numSlots: stackPagesBytes / objectMemory wordSize pageSize: stackPageBytes / objectMemory wordSize. "Once the stack pages are initialized we can continue to bootstrap the system." self loadInitialContext. "We're ready for the heartbeat (poll interrupt)" self ioInitHeartbeat. + self initialEnterSmalltalkExecutive. - self interpret. ^nil! Item was added: + ----- Method: StackInterpreter>>initialEnterSmalltalkExecutive (in category 'initialization') ----- + initialEnterSmalltalkExecutive + "Main entry-point into the interpreter at system start-up. + In the non-threaded VM this is identical to enterSmalltalkExecutive" + <cmacro: '() enterSmalltalkExecutiveImplementation()'> + "Simulation of the setjmp in enterSmalltalkExecutiveImplementation for reentry into interpreter." + [([self enterSmalltalkExecutiveImplementation] + on: ReenterInterpreter + do: [:ex| ex return: ex returnValue]) = ReturnToInterpreter] whileTrue! Item was changed: ----- Method: StackInterpreter>>interpret (in category 'interpreter shell') ----- interpret "This is the main interpreter loop. It normally loops forever, fetching and executing bytecodes. When running in the context of a browser plugin VM, however, it must return control to the browser periodically. This should done only when the state of the currently running Squeak thread is safely stored in the object heap. Since this is the case at the moment that a check for interrupts is performed, that is when we return to the browser if it is time to do so. Interrupt checks happen quite frequently." <inline: false> "If stacklimit is zero then the stack pages have not been initialized." stackLimit = 0 ifTrue: [^self initStackPagesAndInterpret]. "record entry time when running as a browser plug-in" self browserPluginInitialiseIfNeeded. self internalizeIPandSP. - self fetchNextBytecode. self initExtensions. + self fetchNextBytecode. [true] whileTrue: [self dispatchOn: currentBytecode in: BytecodeTable]. localIP := localIP - 1. "undo the pre-increment of IP before returning" self externalizeIPandSP. ^nil ! Item was removed: - ----- Method: StackInterpreter>>justActivateNewMethod (in category 'message sending') ----- - justActivateNewMethod - | methodHeader numArgs numTemps rcvr | - <inline: true> - methodHeader := objectMemory methodHeaderOf: newMethod. - numTemps := self temporaryCountOfMethodHeader: methodHeader. - numArgs := self argumentCountOfMethodHeader: methodHeader. - - rcvr := self stackValue: numArgs. "could new rcvr be set at point of send?" - self assert: (objectMemory isOopForwarded: rcvr) not. - - self push: instructionPointer. - self push: framePointer. - framePointer := stackPointer. - self push: newMethod. - self setMethod: newMethod methodHeader: methodHeader. - self push: (self encodeFrameFieldHasContext: false isBlock: false numArgs: numArgs). - self push: objectMemory nilObject. "FxThisContext field" - self push: rcvr. - - "clear remaining temps to nil" - numArgs+1 to: numTemps do: - [:i | self push: objectMemory nilObject]. - - instructionPointer := (self initialIPForHeader: methodHeader method: newMethod) - 1. - - (self methodHeaderHasPrimitive: methodHeader) ifTrue: - ["Skip the CallPrimitive bytecode, if it's there, and store the error code if the method starts - with a long store temp. Strictly no need to skip the store because it's effectively a noop." - instructionPointer := instructionPointer + (self sizeOfCallPrimitiveBytecode: methodHeader). - primFailCode ~= 0 ifTrue: - [self reapAndResetErrorCodeTo: stackPointer header: methodHeader]]. - - ^methodHeader! Item was added: + ----- Method: StackInterpreter>>justActivateNewMethod: (in category 'message sending') ----- + justActivateNewMethod: mustBeInterpreterFrame + | methodHeader numArgs numTemps rcvr | + <inline: true> + methodHeader := objectMemory methodHeaderOf: newMethod. + numTemps := self temporaryCountOfMethodHeader: methodHeader. + numArgs := self argumentCountOfMethodHeader: methodHeader. + + rcvr := self stackValue: numArgs. "could new rcvr be set at point of send?" + self assert: (objectMemory isOopForwarded: rcvr) not. + + self push: instructionPointer. + self push: framePointer. + framePointer := stackPointer. + self push: newMethod. + self setMethod: newMethod methodHeader: methodHeader. + self push: (self encodeFrameFieldHasContext: false isBlock: false numArgs: numArgs). + self push: objectMemory nilObject. "FxThisContext field" + self push: rcvr. + + "clear remaining temps to nil" + numArgs+1 to: numTemps do: + [:i | self push: objectMemory nilObject]. + + instructionPointer := (self initialIPForHeader: methodHeader method: newMethod) - 1. + + (self methodHeaderHasPrimitive: methodHeader) ifTrue: + ["Skip the CallPrimitive bytecode, if it's there, and store the error code if the method starts + with a long store temp. Strictly no need to skip the store because it's effectively a noop." + instructionPointer := instructionPointer + (self sizeOfCallPrimitiveBytecode: methodHeader). + primFailCode ~= 0 ifTrue: + [self reapAndResetErrorCodeTo: stackPointer header: methodHeader]]. + + ^methodHeader! Item was added: + ----- Method: StackInterpreter>>long:jmp: (in category 'simulation') ----- + long: aJumpBuf jmp: returnValue + "Hack simulation of setjmp/longjmp. + Signal the exception that simulates a longjmp back to the interpreter." + <doNotGenerate> + aJumpBuf == reenterInterpreter ifTrue: + [self assertValidExecutionPointe: instructionPointer r: framePointer s: stackPointer imbar: true line: nil]. + aJumpBuf returnValue: returnValue; signal! Item was changed: + ----- Method: StackInterpreter>>objectMemory (in category 'simulation support') ----- - ----- Method: StackInterpreter>>objectMemory (in category 'cog jit support') ----- objectMemory <doNotGenerate> ^objectMemory! Item was changed: ----- Method: StackInterpreter>>restoreCStackStateForCallbackContext: (in category 'callback support') ----- restoreCStackStateForCallbackContext: vmCallbackContext <var: #vmCallbackContext type: #'VMCallbackContext *'> + self mem: reenterInterpreter + cp: vmCallbackContext savedReenterInterpreter asVoidPointer + y: (self sizeof: #'jmp_buf')! - "this is a no-op for the Stack VM"! Item was changed: ----- Method: StackInterpreter>>saveCStackStateForCallbackContext: (in category 'callback support') ----- saveCStackStateForCallbackContext: vmCallbackContext <var: #vmCallbackContext type: #'VMCallbackContext *'> + self mem: vmCallbackContext savedReenterInterpreter asVoidPointer + cp: reenterInterpreter + y: (self sizeof: #'jmp_buf')! - "this is a no-op for the Stack VM"! Item was changed: ----- Method: StackInterpreter>>sendInvokeCallback:Stack:Registers:Jmpbuf: (in category 'callback support') ----- sendInvokeCallback: thunkPtr Stack: stackPtr Registers: regsPtr Jmpbuf: jmpBufPtr "Send the 4 argument callback message invokeCallback:stack:registers:jmpbuf: to Alien class with the supplied args. The arguments are raw C addresses and are converted to integer objects on the way." <export: true> | classTag | classTag := self fetchClassTagOfNonImm: (self splObj: ClassAlien). messageSelector := self splObj: SelectorInvokeCallback. argumentCount := 4. (self lookupInMethodCacheSel: messageSelector classTag: classTag) ifFalse: [(self lookupOrdinaryNoMNUEtcInClass: (objectMemory classForClassTag: classTag)) ~= 0 ifTrue: [^false]]. ((self argumentCountOf: newMethod) = 4 and: [primitiveFunctionPointer = 0]) ifFalse: [^false]. self push: (self splObj: ClassAlien). "receiver" self push: (self positiveMachineIntegerFor: thunkPtr). self push: (self positiveMachineIntegerFor: stackPtr). self push: (self positiveMachineIntegerFor: regsPtr). self push: (self positiveMachineIntegerFor: jmpBufPtr). self ifAppropriateCompileToNativeCode: newMethod selector: messageSelector. + self justActivateNewMethod: false. "either interpreted or machine code" - self justActivateNewMethod. (self isMachineCodeFrame: framePointer) ifFalse: [self maybeFlagMethodAsInterpreted: newMethod]. self checkForStackOverflow. self enterSmalltalkExecutiveFromCallback. "not reached" ^true! Item was changed: ----- Method: StackInterpreter>>sendInvokeCallbackContext: (in category 'callback support') ----- sendInvokeCallbackContext: vmCallbackContext "Send the calllback message to Alien class with the supplied arg(s). Use either the 1 arg invokeCallbackContext: or the 4 arg invokeCallback:stack:registers:jmpbuf: message, depending on what selector is installed in the specialObjectsArray. Note that if invoking the legacy invokeCallback:stack:registers:jmpbuf: we pass the vmCallbackContext as the jmpbuf argument (see reestablishContextPriorToCallback:). The arguments are raw C addresses and are converted to integer objects on the way. sendInvokeCallbackContext: & returnAs:ThroughCallback:Context: along with ownVM: and disownVM: conspire to save and restore newMethod, argumentCount and primitiveFunctionPointer around a callback. The VM depends on argumentCount being correct to cut-back the correct number of arguments on primitive return. If a primitive that invokes a callback fails after invoking a callback (a bad idea, but s**t happens during development) then newMethod is required to activate the right faling method, and Spur expects primitiveFunctionPointer to be valid, so asserts will fail misleadingly if not." <export: true> <var: #vmCallbackContext type: #'VMCallbackContext *'> | classTag | vmCallbackContext savedPrimFunctionPointer: primitiveFunctionPointer. classTag := self fetchClassTagOfNonImm: (objectMemory splObj: ClassAlien). messageSelector := self splObj: SelectorInvokeCallback. (self lookupInMethodCacheSel: messageSelector classTag: classTag) ifFalse: [(self lookupOrdinaryNoMNUEtcInClass: (objectMemory classForClassTag: classTag)) ~= 0 ifTrue: [^false]]. primitiveFunctionPointer ~= 0 ifTrue: [primitiveFunctionPointer := vmCallbackContext savedPrimFunctionPointer. ^false]. self assert: (debugCallbackInvokes := debugCallbackInvokes + 1) > 0. "self assert: debugCallbackInvokes < 3802." self saveCStackStateForCallbackContext: vmCallbackContext. self push: (objectMemory splObj: ClassAlien). "receiver" (self argumentCountOf: newMethod) = 4 ifTrue: [self push: (self positiveMachineIntegerFor: vmCallbackContext thunkp asUnsignedInteger). self push: (self positiveMachineIntegerFor: vmCallbackContext stackp asUnsignedInteger). self push: (self positiveMachineIntegerFor: vmCallbackContext intregargsp asUnsignedInteger)]. self push: (self positiveMachineIntegerFor: vmCallbackContext asUnsignedInteger). self ifAppropriateCompileToNativeCode: newMethod selector: messageSelector. + self justActivateNewMethod: false. "either interpreted or machine code" - self justActivateNewMethod. (self isMachineCodeFrame: framePointer) ifFalse: [self maybeFlagMethodAsInterpreted: newMethod]. self checkForStackOverflow. self assert: (self frameReceiver: framePointer) = (objectMemory splObj: ClassAlien). self enterSmalltalkExecutiveFromCallback. "not reached" ^true! Item was added: + ----- Method: StackInterpreter>>siglong:jmp: (in category 'primitive support') ----- + siglong: aJumpBuf jmp: returnValue + ^self long: aJumpBuf jmp: returnValue! Item was added: + ----- Method: StackInterpreter>>sigset:jmp: (in category 'primitive support') ----- + sigset: aJumpBuf jmp: sigSaveMask + "Hack simulation of sigsetjmp/siglongjmp. + Assign to reenterInterpreter the exception that when + raised simulates a longjmp back to the interpreter." + <doNotGenerate> + reenterInterpreter := ReenterInterpreter new returnValue: 0; yourself. + ^0! Item was changed: ----- Method: StackInterpreter>>snapshot: (in category 'image save/restore') ----- snapshot: embedded "update state of active context" | activeContext activeProc rcvr setMacType stackIndex | <var: #setMacType type: #'void *'> "For now the stack munging below doesn't deal with more than one argument. It can, and should." argumentCount ~= 0 ifTrue: [^self primitiveFailFor: PrimErrBadNumArgs]. "Need to convert all frames into contexts since the snapshot file only holds objects." self push: instructionPointer. activeContext := self voidVMStateForSnapshotFlushingExternalPrimitivesIf: true. "update state of active process" activeProc := self activeProcess. objectMemory storePointer: SuspendedContextIndex ofObject: activeProc withValue: activeContext. tempOop := activeContext. objectMemory garbageCollectForSnapshot. "Nothing moves from here on so it is safe to grab the activeContext again." activeContext := tempOop. tempOop := 0. self successful ifTrue: ["Without contexts or stacks simulate rcvr := self popStack. ''pop rcvr'' self push: trueObj. to arrange that the snapshot resumes with true. N.B. stackIndex is one-relative." stackIndex := self quickFetchInteger: StackPointerIndex ofObject: activeContext. rcvr := objectMemory fetchPointer: stackIndex + CtxtTempFrameStart - 1 ofObject: activeContext. objectMemory storePointerUnchecked: stackIndex + CtxtTempFrameStart - 1 ofObject: activeContext withValue: objectMemory trueObject. "now attempt to write the snapshot file" self writeImageFileIO. (self successful and: [embedded not]) ifTrue: ["set Mac file type and creator; this is a noop on other platforms" setMacType := self ioLoadFunction: 'setMacFileTypeAndCreator' From: 'FilePlugin'. setMacType = 0 ifFalse: [self cCode: '((sqInt (*)(char *, char *, char *))setMacType)(imageName, "STim", "FAST")']]. "Without contexts or stacks simulate self pop: 1" objectMemory storePointerUnchecked: StackPointerIndex ofObject: activeContext withValue: (objectMemory integerObjectOf: stackIndex - 1)]. objectMemory postSnapshot. self marryContextInNewStackPageAndInitializeInterpreterRegisters: activeContext. self successful ifTrue: [self push: objectMemory falseObject] ifFalse: [self push: rcvr. + self justActivateNewMethod: true] "no point checking for machine code; there isn't any at this point"! - self justActivateNewMethod]! Item was added: + ----- Method: StackInterpreterSimulator>>interpret (in category 'interpreter shell') ----- + interpret + "This is the main interpreter loop. It normally loops forever, fetching and executing bytecodes. + When running in the context of a web browser plugin VM, however, it must return control to the + web browser periodically. This should done only when the state of the currently running Squeak + thread is safely stored in the object heap. Since this is the case at the moment that a check for + interrupts is performed, that is when we return to the browser if it is time to do so. Interrupt + checks happen quite frequently. + + Override for simulation to insert bytecode breakpoint support." + + <inline: false> + "If stacklimit is zero then the stack pages have not been initialized." + stackLimit = 0 ifTrue: + [^self initStackPagesAndInterpret]. + "record entry time when running as a browser plug-in" + self browserPluginInitialiseIfNeeded. + self internalizeIPandSP. + self initExtensions. + self fetchNextBytecode. + [true] whileTrue: + [self assertValidExecutionPointers. + atEachStepBlock value. "N.B. may be nil" + self dispatchOn: currentBytecode in: BytecodeTable. + self incrementByteCount]. + localIP := localIP - 1. "undo the pre-increment of IP before returning" + self externalizeIPandSP. + ^nil! Item was changed: ----- Method: StackInterpreterSimulator>>run (in category 'testing') ----- run "Just run" quitBlock := [displayView ifNotNil: [displayView containingWindow ifNotNil: [:topWindow| ((World submorphs includes: topWindow) and: [UIManager default confirm: 'close?']) ifTrue: [topWindow delete]]]. ^self close]. self initStackPages. self loadInitialContext. + self initialEnterSmalltalkExecutive. - self internalizeIPandSP. - self fetchNextBytecode. - [true] whileTrue: - [self assertValidExecutionPointers. - atEachStepBlock value. "N.B. may be nil" - self dispatchOn: currentBytecode in: BytecodeTable. - self incrementByteCount]. localIP := localIP - 1. "undo the pre-increment of IP before returning" self externalizeIPandSP! Item was changed: ----- Method: TMethod>>removeUnusedTempsAndNilIfRequiredIn: (in category 'utilities') ----- removeUnusedTempsAndNilIfRequiredIn: aCodeGen "Remove all of the unused temps in this method. Answer a set of the references. As a side-effect introduce explicit temp := nil statements for temps that are tested for nil before necessarily being assigned." | refs readBeforeAssigned simplyTypedLocals | refs := self removeUnusedTempsIn: aCodeGen. "reset the locals to be only those still referred to" locals := locals select: [:e| refs includes: e]. (locals notEmpty and: [aCodeGen pushScope: declarations while: [simplyTypedLocals := locals select: [:var| declarations at: var ifPresent: [:decl| aCodeGen isSimpleType: (aCodeGen extractTypeFor: var fromDeclaration: decl)] ifAbsent: [true]]. (readBeforeAssigned := (self findReadBeforeAssignedIn: simplyTypedLocals in: aCodeGen)) notEmpty]]) ifTrue: [readBeforeAssigned := readBeforeAssigned reject: + [:v| | d | "don't initialize externs, statics, arrays or the explicitly initialized." - [:v| | d | "don't initialize externs, arrays or the explicitly initialized." d := self declarationAt: v. + (d beginsWith: 'extern') or: [(d beginsWith: 'static') or: [(d includes: $[) or: [d includes: $=]]]]. - (d beginsWith: 'extern') or: [(d includes: $[) or: [d includes: $=]]]. parseTree statements addAllFirst: (readBeforeAssigned asSortedCollection collect: + [:var| | varNode varType zeroNode | + varNode := TVariableNode new setName: var; yourself. + varType := aCodeGen typeFor: varNode in: self. + zeroNode := TConstantNode new setValue: 0; yourself. + TAssignmentNode new + setVariable: varNode + expression: (((aCodeGen isIntegralCType: varType) + or: [aCodeGen isFloatingPointCType: varType]) + ifTrue: [zeroNode] + ifFalse: [aCodeGen nodeToCast: zeroNode to: varType])])]. - [:var| - TAssignmentNode new - setVariable: (TVariableNode new setName: var; yourself) - expression: (TConstantNode new setValue: 0; yourself)])]. ^refs! Item was changed: ----- Method: TStmtListNode>>addReadBeforeAssignedIn:to:assignments:in: (in category 'utilities') ----- addReadBeforeAssignedIn: variables to: readBeforeAssigned assignments: assigned in: aCodeGen "Add any variables in variables that are read before written to readBeforeAssigned. Add unconditional assignments to assigned. For convenience answer assigned." self nodesWithParentsDo: [:node :parent| (node isAssignment and: [variables includes: node variable name]) ifTrue: [assigned add: node variable name]. (node isVariable and: [(variables includes: node name) and: [(assigned includes: node name) not + and: [(#(nil pointer) includes: (node structTargetKindIn: aCodeGen)) - and: [(node structTargetKindIn: aCodeGen) isNil and: [(parent notNil and: [parent isAssignment and: [parent variable == node]]) not]]]]) ifTrue: [node name = 'theCalloutState' ifTrue: [self halt]. readBeforeAssigned add: node name]] unless: [:node :parent| | conditionalAssignments mayHaveSideEffects | node isSend ifTrue: ["First deal with implicit assignments..." node isValueExpansion ifTrue: [assigned addAll: node receiver args]. (#(mem:cp:y: mem:mo:ve:) includes: node selector) ifTrue: [assigned add: (node args first detect: [:subnode| subnode isVariable]) name]. (#(to:do: to:by:do:) includes: node selector) ifTrue: [assigned addAll: (node args at: node selector numArgs) args. mayHaveSideEffects := node args size = 4. "See TMethod>>prepareMethodIn:" mayHaveSideEffects ifTrue: [assigned add: node args last name]]. "Then deal with read-before-written in the arms of conditionals..." (#(ifTrue: ifFalse: ifNil: ifNotNil:) intersection: node selector keywords) notEmpty ifTrue: ["First find assignments in the expression..." (TStmtListNode new setStatements: {node receiver}; yourself) addReadBeforeAssignedIn: variables to: readBeforeAssigned assignments: assigned in: aCodeGen. "Now find read-before-written in each arm, and collect the assignments to spot those assigned in both arms" conditionalAssignments := node args collect: [:block| block isStmtList ifTrue: [block addReadBeforeAssignedIn: variables to: readBeforeAssigned assignments: assigned copy in: aCodeGen]] thenSelect: [:each| each notNil]. "add to assigned those variables written to in both arms" conditionalAssignments size = 2 ifTrue: [conditionalAssignments := conditionalAssignments collect: [:set| set difference: assigned]. assigned addAll: (conditionalAssignments first intersection: conditionalAssignments last)]. true] ifFalse: [false]] ifFalse: [false]]. ^assigned! Item was changed: ----- Method: ThreadedFFIPlugin>>dispatchFunctionPointer: (in category 'callout support') ----- dispatchFunctionPointer: aFunctionPointer "In C aFunctionPointer is void (*aFunctionPointer)()" <cmacro: '(aFunctionPointer) (aFunctionPointer)()'> + "To write the FFI call failure code we simulate invoking the production VM's + fatal exception handlers (sigsegv on Unix, squeakExceptionHandler on WIN32, et al)." + ^[self perform: aFunctionPointer] + on: Error + do: [:ex| + interpreterProxy + primitiveFailForFFIException: PrimErrFFIException at: aFunctionPointer asInteger; + activateFailingPrimitiveMethod]! - ^self perform: aFunctionPointer! Item was changed: ----- Method: ThreadedFFIPlugin>>dispatchFunctionPointer:with:with:with:with: (in category 'callout support') ----- dispatchFunctionPointer: aFunctionPointer with: int1 with: int2 with: int3 with: int4 "In C aFunctionPointer is void (*aFunctionPointer)(int, int, int, int)" <cmacro: '(aFunctionPointer, int1, int2, int3, int4) (aFunctionPointer)(int1, int2, int3, int4)'> + "To write the FFI call failure code we simulate invoking the production VM's + fatal exception handlers (sigsegv on Unix, squeakExceptionHandler on WIN32, et al)." + ^[self perform: aFunctionPointer + with: int1 + with: int2 + with: int3 + with: int4] + on: Error + do: [:ex| + interpreterProxy + primitiveFailForFFIException: PrimErrFFIException at: aFunctionPointer asInteger; + activateFailingPrimitiveMethod]! - ^self - perform: aFunctionPointer - with: int1 - with: int2 - with: int3 - with: int4! Item was changed: ----- Method: ThreadedFFIPlugin>>dispatchFunctionPointer:with:with:with:with:with:with: (in category 'callout support') ----- dispatchFunctionPointer: aFunctionPointer with: int1 with: int2 with: int3 with: int4 with: int5 with: int6 + "In C aFunctionPointer is void (*aFunctionPointer)(int, int, int, int, int, int)" + <cmacro: '(aFunctionPointer, int1, int2, int3, int4) (aFunctionPointer)(int1, int2, int3, int4, int5, int6)'> + "To write the FFI call failure code we simulate invoking the production VM's + fatal exception handlers (sigsegv on Unix, squeakExceptionHandler on WIN32, et al)." + ^[self perform: aFunctionPointer + with: int1 + with: int2 + with: int3 + with: int4 + with: int5 + with: int6] + on: Error + do: [:ex| + interpreterProxy + primitiveFailForFFIException: PrimErrFFIException at: aFunctionPointer asInteger; + activateFailingPrimitiveMethod]! - "In C aFunctionPointer is void (*aFunctionPointer)(int, int, int, int)" - <cmacro: '(aFunctionPointer,a1,a2, a3, a4,a5,a6) (aFunctionPointer)(a1,a2, a3, a4,a5,a6)'> - ^self - perform: aFunctionPointer - with: int1 - with: int2 - with: int3 - with: int4 - with: int5 - with: int6! Item was changed: ----- Method: ThreadedFFIPlugin>>initialiseModule (in category 'initialize') ----- initialiseModule <export: true> + ffiLastError := 0. "By default, disable logging" ffiLogEnabled := false. "Get the instSize of ExternalFunction to know whether it contains a cache of the stackSize, and what the offset of ExternalLibraryFunction's functionName and moduleName slots are." externalFunctionInstSize := interpreterProxy instanceSizeOf: interpreterProxy classExternalFunction. self initSurfacePluginFunctionPointers. ^true! Item was changed: ----- Method: ThreadedFFIPlugin>>morphIntoConcreteSubclass: (in category 'simulation') ----- morphIntoConcreteSubclass: aCoInterpreter <doNotGenerate> | concreteClass | concreteClass := aCoInterpreter ISA caseOf: { [#X64] -> [(Smalltalk platformName beginsWith: 'Win') ifTrue: [ThreadedX64Win64FFIPlugin] ifFalse: [ThreadedX64SysVFFIPlugin]]. [#IA32] -> [ThreadedIA32FFIPlugin]. [#ARMv5] -> [ThreadedARMFFIPlugin] } otherwise: [self error: 'simulation not set up for this ISA']. + "If the concreteClass has an initialize method, other than ThreadedFFIPlugin class>>initialize + then it needs to be run." + ((concreteClass class whichClassIncludesSelector: #initialize) inheritsFrom: self class class) ifTrue: + [concreteClass initialize]. + concreteClass adoptInstance: self! - self changeClassTo: concreteClass! Item was changed: ----- Method: ThreadedFFIPlugin>>primitiveFFIGetLastError (in category 'primitives') ----- primitiveFFIGetLastError "Primitive. Return the error code from a failed call to the foreign function interface. This is for backwards-compatibility. Thread-safe access to the error code is via the primitive error code." <export: true> <inline: false> + interpreterProxy methodReturnInteger: ffiLastError! - interpreterProxy pop: 1. - ^interpreterProxy pushInteger: ffiLastError! Item was changed: SharedPool subclass: #VMBasicConstants instanceVariableNames: '' + classVariableNames: 'BaseHeaderSize BytecodeSetHasExtensions BytesPerOop BytesPerWord COGMTVM COGVM CloneOnGC CloneOnScavenge DisownVMLockOutFullGC DoAssertionChecks DoExpensiveAssertionChecks GCCheckPrimCall GCModeBecome GCModeFreeSpace GCModeFull GCModeImageSegment GCModeIncremental GCModeNewSpace HashMultiplyConstant HashMultiplyMask IMMUTABILITY LowcodeVM MULTIPLEBYTECODESETS NewspeakVM PharoVM PrimErrBadArgument PrimErrBadIndex PrimErrBadMethod PrimErrBadNumArgs PrimErrBadReceiver PrimErrCallbackError PrimErrFFIException PrimErrGenericFailure PrimErrInappropriate PrimErrLimitExceeded PrimErrNamedInternal PrimErrNoCMemory PrimErrNoMemory PrimErrNoModification PrimErrNotFound PrimErrOSError PrimErrObjectIsPinned PrimErrObjectMayMove PrimErrObjectMoved PrimErrObjectNotPinned PrimErrUnsupported PrimErrWritePastObject PrimNoErr SPURVM STACKVM SistaVM TempVectReadBarrier VMBIGENDIAN' - classVariableNames: 'BaseHeaderSize BytecodeSetHasExtensions BytesPerOop BytesPerWord COGMTVM COGVM CloneOnGC CloneOnScavenge DisownVMLockOutFullGC DoAssertionChecks DoExpensiveAssertionChecks GCCheckPrimCall GCModeBecome GCModeFreeSpace GCModeFull GCModeImageSegment GCModeIncremental GCModeNewSpace HashMultiplyConstant HashMultiplyMask IMMUTABILITY LowcodeVM MULTIPLEBYTECODESETS NewspeakVM PharoVM PrimErrBadArgument PrimErrBadIndex PrimErrBadMethod PrimErrBadNumArgs PrimErrBadReceiver PrimErrCallbackError PrimErrGenericFailure PrimErrInappropriate PrimErrLimitExceeded PrimErrNamedInternal PrimErrNoCMemory PrimErrNoMemory PrimErrNoModification PrimErrNotFound PrimErrOSError PrimErrObjectIsPinned PrimErrObjectMayMove PrimErrObjectMoved PrimErrObjectNotPinned PrimErrUnsupported PrimErrWritePastObject PrimNoErr SPURVM STACKVM SistaVM TempVectReadBarrier VMBIGENDIAN' poolDictionaries: '' category: 'VMMaker-Interpreter'! !VMBasicConstants commentStamp: '<historical>' prior: 0! I am a shared pool for basic constants upon which the VM as a whole depends. self ensureClassPool. self classPool declare: #BytesPerWord from: VMSqueakV3ObjectRepresentationConstants classPool. self classPool declare: #BaseHeaderSize from: VMSqueakV3ObjectRepresentationConstants classPool (ObjectMemory classPool keys select: [:k| k beginsWith: 'Byte']) do: [:k| self classPool declare: k from: ObjectMemory classPool]! Item was changed: ----- Method: VMClass class>>initializePrimitiveErrorCodes (in category 'initialization') ----- initializePrimitiveErrorCodes "Define the VM's primitive error codes. N.B. these are replicated in platforms/Cross/vm/sqVirtualMachine.h." "VMClass initializePrimitiveErrorCodes" | pet | PrimErrTableIndex := 51. "Zero-relative" "See SmalltalkImage>>recreateSpecialObjectsArray for the table definition. If the table exists and is large enough the corresponding entry is returned as the primitive error, otherwise the error is answered numerically." pet := Smalltalk specialObjectsArray at: PrimErrTableIndex + 1 ifAbsent: [#()]. pet isArray ifFalse: [pet := #()]. PrimNoErr := 0. "for helper methods that need to answer success or an error code." PrimErrGenericFailure := pet indexOf: nil ifAbsent: 1. PrimErrBadReceiver := pet indexOf: #'bad receiver' ifAbsent: 2. PrimErrBadArgument := pet indexOf: #'bad argument' ifAbsent: 3. PrimErrBadIndex := pet indexOf: #'bad index' ifAbsent: 4. PrimErrBadNumArgs := pet indexOf: #'bad number of arguments' ifAbsent: 5. PrimErrInappropriate := pet indexOf: #'inappropriate operation' ifAbsent: 6. PrimErrUnsupported := pet indexOf: #'unsupported operation' ifAbsent: 7. PrimErrNoModification := pet indexOf: #'no modification' ifAbsent: 8. PrimErrNoMemory := pet indexOf: #'insufficient object memory' ifAbsent: 9. PrimErrNoCMemory := pet indexOf: #'insufficient C memory' ifAbsent: 10. PrimErrNotFound := pet indexOf: #'not found' ifAbsent: 11. PrimErrBadMethod := pet indexOf: #'bad method' ifAbsent: 12. PrimErrNamedInternal := pet indexOf: #'internal error in named primitive machinery' ifAbsent: 13. PrimErrObjectMayMove := pet indexOf: #'object may move' ifAbsent: 14. PrimErrLimitExceeded := pet indexOf: #'resource limit exceeded' ifAbsent: 15. PrimErrObjectIsPinned := pet indexOf: #'object is pinned' ifAbsent: 16. PrimErrWritePastObject := pet indexOf: #'primitive write beyond end of object' ifAbsent: 17. PrimErrObjectMoved := pet indexOf: #'object moved' ifAbsent: 18. PrimErrObjectNotPinned := pet indexOf: #'object not pinned' ifAbsent: 19. PrimErrCallbackError := pet indexOf: #'error in callback' ifAbsent: 20. + PrimErrOSError := pet indexOf: #'operating system error' ifAbsent: 21. + PrimErrFFIException := pet indexOf: #'ffi call exception' ifAbsent: 22! - PrimErrOSError := pet indexOf: #'operating system error' ifAbsent: 21! Item was changed: ----- Method: VMClass>>alloca: (in category 'C library simulation') ----- alloca: size "Simulation of alloca(3)" <doNotGenerate> + ^CArrayAccessor on: (ByteArray new: size)! - ^ByteArray new: size!

1 0

Build failed: opensmalltalk-vm 1.0.1389
by AppVeyor 23 Aug '18

23 Aug '18

1 0

[OpenSmalltalk/opensmalltalk-vm] 0f7806: 1.3.3: Add path encoding / decoding
by GitHub 23 Aug '18

23 Aug '18

Branch: refs/heads/Cog Home: https://github.com/OpenSmalltalk/opensmalltalk-vm Commit: 0f780694a39155a9149da89d8d3dcc5e8b7b62e9 https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/0f780694a39155a914… Author: AlistairGrant <akgrant0710(a)gmail.com> Date: 2018-08-23 (Thu, 23 Aug 2018) Changed paths: A platforms/iOS/plugins/FileAttributesPlugin/Makefile M src/plugins/FileAttributesPlugin/FileAttributesPlugin.c Log Message: ----------- 1.3.3: Add path encoding / decoding MacOS uses custom decomposed UTF8 encoded strings for path names (while precomposed Unicode strings are typically used within the image). Encode and decode path names using the existing VM routines (ux2sqPath() and sq2uxPath()). Linux provides ux2sqPath() and sq2uxPath() as part of vm.a. OSX requires a plugin specific Makefile to access sqUnixCharConv.[ch] Commit: 2c9cb8a6f80c2e4ff78b7a8f348506534f03ee67 https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/2c9cb8a6f80c2e4ff7… Author: AlistairGrant <akgrant0710(a)gmail.com> Date: 2018-08-23 (Thu, 23 Aug 2018) Changed paths: M build.macos64x64/pharo.cog.spur/plugins.ext M build.macos64x64/pharo.cog.spur/plugins.int Log Message: ----------- FileAttributesPlugin: make plugin internal on macos64x64 Commit: 0ddeabf4f9055284a6cf9645bf67bba4394e4e7c https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/0ddeabf4f9055284a6… Author: AlistairGrant <akgrant0710(a)gmail.com> Date: 2018-08-23 (Thu, 23 Aug 2018) Changed paths: M build.macos64x64/common/Makefile.vm Log Message: ----------- FileAttributesPlugin: add to VM additional includes Commit: 2c9561129b2386eb28dca29af0cdcfdf00eab411 https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/2c9561129b2386eb28… Author: AlistairGrant <akgrant0710(a)gmail.com> Date: 2018-08-23 (Thu, 23 Aug 2018) Changed paths: M build.macos32x86/pharo.cog.spur.lowcode/plugins.ext M build.macos32x86/pharo.cog.spur.lowcode/plugins.int M build.macos32x86/pharo.cog.spur/plugins.ext M build.macos32x86/pharo.cog.spur/plugins.int M build.macos32x86/pharo.sista.spur/plugins.ext M build.macos32x86/pharo.sista.spur/plugins.int M build.macos32x86/pharo.stack.spur.lowcode/plugins.ext M build.macos32x86/pharo.stack.spur.lowcode/plugins.int M build.macos32x86/pharo.stack.spur/plugins.ext M build.macos32x86/pharo.stack.spur/plugins.int M build.macos32x86/squeak.cog.spur+immutability/plugins.ext M build.macos32x86/squeak.cog.spur+immutability/plugins.int M build.macos32x86/squeak.cog.spur/plugins.ext M build.macos32x86/squeak.cog.spur/plugins.int M build.macos32x86/squeak.cog.v3/plugins.ext M build.macos32x86/squeak.cog.v3/plugins.int M build.macos32x86/squeak.sista.spur/plugins.ext M build.macos32x86/squeak.sista.spur/plugins.int M build.macos32x86/squeak.stack.spur/plugins.ext M build.macos32x86/squeak.stack.spur/plugins.int M build.macos32x86/squeak.stack.v3/plugins.ext M build.macos32x86/squeak.stack.v3/plugins.int M build.macos64x64/pharo.cog.spur.lowcode/plugins.ext M build.macos64x64/pharo.cog.spur.lowcode/plugins.int M build.macos64x64/pharo.sista.spur/plugins.ext M build.macos64x64/pharo.sista.spur/plugins.int M build.macos64x64/pharo.stack.spur.lowcode/plugins.ext M build.macos64x64/pharo.stack.spur.lowcode/plugins.int M build.macos64x64/pharo.stack.spur/plugins.ext M build.macos64x64/pharo.stack.spur/plugins.int M build.macos64x64/squeak.cog.spur.immutability/plugins.ext M build.macos64x64/squeak.cog.spur.immutability/plugins.int M build.macos64x64/squeak.cog.spur/plugins.ext M build.macos64x64/squeak.cog.spur/plugins.int M build.macos64x64/squeak.sista.spur/plugins.ext M build.macos64x64/squeak.sista.spur/plugins.int M build.macos64x64/squeak.stack.spur/plugins.ext M build.macos64x64/squeak.stack.spur/plugins.int Log Message: ----------- FileAttributesPlugin: plugin is internal on macos Commit: 71f0df6a09866426abf78cc76b2282efb0ee7f11 https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/71f0df6a09866426ab… Author: AlistairGrant <akgrant0710(a)gmail.com> Date: 2018-08-23 (Thu, 23 Aug 2018) Changed paths: M build.macos64x64/common/Makefile.vm Log Message: ----------- Revert "FileAttributesPlugin: add to VM additional includes" This reverts commit 0ddeabf4f9055284a6cf9645bf67bba4394e4e7c. Confirming that this isn't required on macos. Commit: 217e917cea38ee3a5a381d7aef31643c85c6609f https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/217e917cea38ee3a5a… Author: akgrant43 <akgrant(a)gmail.com> Date: 2018-08-23 (Thu, 23 Aug 2018) Changed paths: M build.macos32x86/pharo.cog.spur.lowcode/plugins.ext M build.macos32x86/pharo.cog.spur.lowcode/plugins.int M build.macos32x86/pharo.cog.spur/plugins.ext M build.macos32x86/pharo.cog.spur/plugins.int M build.macos32x86/pharo.sista.spur/plugins.ext M build.macos32x86/pharo.sista.spur/plugins.int M build.macos32x86/pharo.stack.spur.lowcode/plugins.ext M build.macos32x86/pharo.stack.spur.lowcode/plugins.int M build.macos32x86/pharo.stack.spur/plugins.ext M build.macos32x86/pharo.stack.spur/plugins.int M build.macos32x86/squeak.cog.spur+immutability/plugins.ext M build.macos32x86/squeak.cog.spur+immutability/plugins.int M build.macos32x86/squeak.cog.spur/plugins.ext M build.macos32x86/squeak.cog.spur/plugins.int M build.macos32x86/squeak.cog.v3/plugins.ext M build.macos32x86/squeak.cog.v3/plugins.int M build.macos32x86/squeak.sista.spur/plugins.ext M build.macos32x86/squeak.sista.spur/plugins.int M build.macos32x86/squeak.stack.spur/plugins.ext M build.macos32x86/squeak.stack.spur/plugins.int M build.macos32x86/squeak.stack.v3/plugins.ext M build.macos32x86/squeak.stack.v3/plugins.int M build.macos64x64/pharo.cog.spur.lowcode/plugins.ext M build.macos64x64/pharo.cog.spur.lowcode/plugins.int M build.macos64x64/pharo.cog.spur/plugins.ext M build.macos64x64/pharo.cog.spur/plugins.int M build.macos64x64/pharo.sista.spur/plugins.ext M build.macos64x64/pharo.sista.spur/plugins.int M build.macos64x64/pharo.stack.spur.lowcode/plugins.ext M build.macos64x64/pharo.stack.spur.lowcode/plugins.int M build.macos64x64/pharo.stack.spur/plugins.ext M build.macos64x64/pharo.stack.spur/plugins.int M build.macos64x64/squeak.cog.spur.immutability/plugins.ext M build.macos64x64/squeak.cog.spur.immutability/plugins.int M build.macos64x64/squeak.cog.spur/plugins.ext M build.macos64x64/squeak.cog.spur/plugins.int M build.macos64x64/squeak.sista.spur/plugins.ext M build.macos64x64/squeak.sista.spur/plugins.int M build.macos64x64/squeak.stack.spur/plugins.ext M build.macos64x64/squeak.stack.spur/plugins.int A platforms/iOS/plugins/FileAttributesPlugin/Makefile M src/plugins/FileAttributesPlugin/FileAttributesPlugin.c Log Message: ----------- Merge pull request #280 from akgrant43/FileAttributesPlugin133 1.3.3: Add path encoding / decoding MacOS uses custom decomposed UTF8 encoded strings for path names (while precomposed Unicode strings are typically used within the image). Encode and decode path names using the existing VM routines (ux2sqPath() and sq2uxPath()). Compare: https://github.com/OpenSmalltalk/opensmalltalk-vm/compare/6ed41a4fa01e...21… **NOTE:** This service has been marked for deprecation: https://developer.github.com/changes/2018-04-25-github-services-deprecation/ Functionality will be removed from GitHub.com on January 31st, 2019.

1 0

[OpenSmalltalk/opensmalltalk-vm] 1.3.3: Add path encoding / decoding (#280)
by akgrant43 23 Aug '18

23 Aug '18

MacOS uses custom decomposed UTF8 encoded strings for path names (while precomposed Unicode strings are typically used within the image). Encode and decode path names using the existing VM routines (ux2sqPath() and sq2uxPath()). Linux provides ux2sqPath() and sq2uxPath() as part of vm.a. OSX requires a plugin specific Makefile to access sqUnixCharConv.[ch] You can view, comment on, or merge this pull request online at: https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/280 -- Commit Summary -- * 1.3.3: Add path encoding / decoding -- File Changes -- A platforms/iOS/plugins/FileAttributesPlugin/Makefile (10) M src/plugins/FileAttributesPlugin/FileAttributesPlugin.c (225) -- Patch Links -- https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/280.patch https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/280.diff -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/280

1 5

[OpenSmalltalk/opensmalltalk-vm] FileAttributesPlugin 1.3.3: Add path encoding / decoding (#277)
by akgrant43 23 Aug '18

23 Aug '18

MacOS uses custom decomposed UTF8 encoded strings for path names (while precomposed Unicode strings are typically used within the image). Encode and decode path names using the existing VM routines (ux2sqPath() and sq2uxPath()). You can view, comment on, or merge this pull request online at: https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/277 -- Commit Summary -- * FileAttributesPlugin 1.3.3: Add path encoding / decoding * FileAttributesPlugin 1.3.3: regenerate sources -- File Changes -- M src/plugins/FileAttributesPlugin/FileAttributesPlugin.c (225) -- Patch Links -- https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/277.patch https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/277.diff -- You are receiving this because you are subscribed to this thread. Reply to this email directly or view it on GitHub: https://github.com/OpenSmalltalk/opensmalltalk-vm/pull/277

1 12

Pharo 6.1 installation problem on Ubuntu 18.04.1 Bionic Beaver
by H. Hirzel 22 Aug '18

22 Aug '18

Hello I'd like to install Pharo 6.1 in a new installation of Ubuntu 18.04.1 Bionic Beaver [1] I get a message ./pharo-ui Error. Could not determine platform's libc path for VM. Try forcing $PLATFORMLIBDIR in /home/user25/pharo6.1/pharo-vm/pharo, based on LIBC_SO. [2] Ubuntu 18.04.1 Bionic Beaver is a new installation. The only added sw is the Python anaconda distribution. https://www.anaconda.com/download/#linux Suggestions how fix this issue are welcome. Regards Hannes [1] http://releases.ubuntu.com/18.04/ [2] The installation sequence wget -O- get.pharo.org | bash ./pharo-ui Error. Could not determine platform's libc path for VM. Try forcing $PLATFORMLIBDIR in /home/user25/pharo6.1/pharo-vm/pharo, based on LIBC_SO. Please report what works to pharo [vm-dev] mail list. LIBC_SO= DISTRIB_ID=Ubuntu DISTRIB_RELEASE=18.04 DISTRIB_CODENAME=bionic DISTRIB_DESCRIPTION="Ubuntu 18.04.1 LTS" NAME="Ubuntu" VERSION="18.04.1 LTS (Bionic Beaver)" ID=ubuntu ID_LIKE=debian PRETTY_NAME="Ubuntu 18.04.1 LTS" VERSION_ID="18.04" VERSION_CODENAME=bionic UBUNTU_CODENAME=bionic UNAME=Linux Latitude2 4.15.0-29-generic #31-Ubuntu SMP Tue Jul 17 15:39:52 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux System seems to be 64 bit. You may need to (re)install the 32-bit libraries.

2 2

← Newer
1
2
3
4
5
6
7
8
9
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev August 2018