Vm-dev November 2010

vm-dev@lists.squeakfoundation.org

32 participants
42 discussions

Joys of Squeak-dev image, VM Compiling on MacIntel and Spoon remote OtherBrowsing
by Ken G. Brown 16 Nov '10

16 Nov '10

MacPro OS X 10.4.9 Xcode 2.4.1 Squeak-dev-114-2, VMMaker 2.8b6.1, Squeak 3.8.15beta6U.app, and version 1657 of svn MacOS VM sources, and Spoon v2a12. Downloaded http://www.squeakvm.org/cgi-bin/viewcvs.cgi/ trunk version 1657 for MacOS Ran squeak-dev-beta-114-2.image on Squeak 3.8.15beta6U.app Loaded VMMaker 3.8b6.1 from dev image Universes. Generated vm sources by following instructions in <http://www.squeakvm.org/cgi-bin/viewcvs.cgi/trunk/platforms/Mac%20OS/vm/Doc…> Fought with Xcode wanting to use MacOSX10.3.9.sdk for ppc which was giving an error which was known and documented in the Readme. Finally figured out what Xcode wanted so built universal app just using 10.4.9 sdk. Couple issues: Exupery references remain in sqnamedPrims.h and sqPlatformSpecific.h from svn version 1657, I just commented them out. Notes said: Info-NPSqueak__Upgraded_.plist was to be found in the Developer directory. I could not find it so scammed a info.plist out of John's Squeak 3.8.15beta6U.app vm. Not sure what impact this has. And much, much diddling about figuring out various things... Finally got a build. It's a lot smaller (3.9MB) than John McIntosh's Squeak 3.8.15beta6U.app (8.1MB), and it looks like it is a PowerPC one but at least it runs. I'll look into the Xcode build process some more. Then: Replaced interp.c with Craig's interp.c for Spoon, rebuilt and got a VM with Spoon client stuff. Downloaded Spoon release 2a12. Moved a copy of Flow plugin from within Craig's naiad.app package into a plugins subdirectory where the new spoon client compatible MacIntel universal VM was run from. Followed Craig's Spoon instructions for loading niaid.st and niaid.pr into the 3.10 image (Squeak-dev-114-2) running on the new VM. Did the run spoon.app thing from Spoon.dmg (version 2a12), needs to be done twice if Safari is not running. Got Spoon processor running. Followed instructions again in the Spoon client and lo! Got OtherBrowser browsing the Spoon memory running on processor. Yay Craig! Who do i get to sign my certificate? :) Ken

4 7

latest vmmaker wont run with pharo 1.1.1 (dev)
by Esteban Lorenzano 11 Nov '10

11 Nov '10

Hi, I'm trying to generate a vm... loading ConfigurationOfVMMaker version 1.4, then updating WMMaker package to latest version (200), but the generator, it is sending a DNU: while calling: 'From Pharo-1.1.1-- of 12 September 2010 [Latest update: #11414] on 6 November 2010 at 3:00:14 pm'! !String methodsFor: '*VMMaker-Translation to C' stamp: 'dtl 10/25/2009 14:31'! replaceLastOccurrence: oldSubstring with: newSubstring "Answer a copy with the last occurrence of oldSubstring replaced by newSubstring." " 'int i' replaceLastOccurrence: 'i' with: 'i2' " " 'void *v' replaceLastOccurrence: 'v' with: 'v2' " " 'int intxintxintx' replaceLastOccurrence: 'i' with: 'I2' " " 'int intxintxintx' replaceLastOccurrence: 'FOO' with: 'BAR' " " 'int intxintxintx' replaceLastOccurrence: '' with: 'BAZ' " ^ self class streamContents: [:ws | | pos rs | rs := ReadStream on: self. pos := self findLastOccuranceOfString: oldSubstring startingAt: 1. pos > 0 ifTrue: [ws nextPutAll: (rs next: pos - 1); nextPutAll: newSubstring. rs next: oldSubstring size]. ws nextPutAll: rs upToEnd]! ! the DNU is with: findLastOccuranceOfString: oldSubstring startingAt: 1 Cheers, Esteban

11 24

VM Maker: VMMaker-dtl.203.mcz
by squeak-dev-noreply＠lists.squeakfoundation.org 11 Nov '10

11 Nov '10

Dave Lewis uploaded a new version of VMMaker to project VM Maker: http://www.squeaksource.com/VMMaker/VMMaker-dtl.203.mcz ==================== Summary ==================== Name: VMMaker-dtl.203 Author: dtl Time: 10 November 2010, 10:13:46 am UUID: a7e78345-6df4-417f-bb43-900b4ced6713 Ancestors: VMMaker-dtl.202 Complete the test coverage for primitives in MiscPrimitivePlugin. Rename class IncludedMethodsTest to MiscPrimitivePluginTest. SoundGeneratorPlugin and ADPCMCodecPlugin use included methods similar to MiscPrimitivePlugin; these do not yet have tests.

1 0

VM packaging for Cog transition
by David T. Lewis 10 Nov '10

10 Nov '10

Bert and others have raised the question of how best to package the Cog VM and traditional interpreter VM for the next round of VM releases in December. Cog is a significant advance, and the Squeak board would like this to be fully supported for the Squeak 4.2 release; clearly it is a priority for Pharo as well. Meanwhile we have a responsibility for Etoys, Scratch, OLPC etc to provide VMs that do not break those systems. So - how best to do this? For unix VMs, Bert has suggested this: > Maybe we need a "squeak-interp" and "squeak-cog" binary, with "squeak" > symlinking to either one (using the alternatives system) or "squeak" > being a script choosing the right VM based on the image version. But > we should present a coherent story to the packagers. As well as to > Squeak users. Personally I am inclined to think it would be best for this next release not to automate the selection of VM, but instead have users make an explicit selection. I say this for two reasons: 1) From a marketing point of view, it is good if users can directly experience the improvement from Cog. So the message might be to first run in the standard way (squeak-interp) to get a very cool system that is quite fast, then activate turbo mode (squeak-cog) to get a system that is very noticeably 3X faster. 2) From a technical and support point of view, there may be various cases where it will be necessary to say "sorry, you will need to run squeak-interp if you want to do that." When that happens, it would be best if we do not need to explain e.g. how to edit a shell script to force it to run squeak-interp. The above is just my $.02 to get the discussion started. What do others think? Dave

8 34

VM Maker: VMMaker-dtl.202.mcz
by squeak-dev-noreply＠lists.squeakfoundation.org 10 Nov '10

10 Nov '10

Dave Lewis uploaded a new version of VMMaker to project VM Maker: http://www.squeaksource.com/VMMaker/VMMaker-dtl.202.mcz ==================== Summary ==================== Name: VMMaker-dtl.202 Author: dtl Time: 9 November 2010, 9:34:05 am UUID: 60c09e0d-3785-4390-8b0d-a24264fdc6f4 Ancestors: VMMaker-dtl.201 VMMaker 4.3.16 Add Andreas' patch for TMethod>>argConversionExprFor:stackIndex: This adds a check to ensure that a primitive parameter declared as type char * is a byte indexed object, and fails the primitive if it is not. The change addresses an error condition in ByteString>>findSubstring:in:startingAt:matchTable when one or more of the parameters is a WideString. Add IncludedMethodsTest unit tests to verify this fix, and to verify the presence of other primitives translated from ByteString. Placeholders provided for other tests to cover other included method primitives.

1 0

[DEBIAN] latest standard vm package
by Alexander Lazarević 08 Nov '10

08 Nov '10

Hi! FWIW, I've built a new VM on my machine with the latest sources and latest VMMaker updates (for a standard VM). Thanks Dave for your help on this. As a result here is a debian package from this just in case anyone on Ubuntu or Debian wants to sneak a peek. http://www.lazarevic.de/download/squeak/squeak-vm_4.3.15.2330-1_i386.deb I used the package from the debian and just replaced the sources. I disabled my unfortunate patch for the sources path (this should be removed for good) and had to disable the patch for the browser plugin. So there is no guaranty for nothing on this package and the squeakvm it contains. These are the included vm plugins: "Internal Plugins" "External Plugins" ADPCMCodecPlugin B3DAcceleratorPlugin AsynchFilePlugin B3DEnginePlugin BMPReadWriterPlugin FFIPlugin BalloonEnginePlugin FT2Plugin BitBltSimulation FileCopyPlugin CroquetPlugin HostWindowPlugin DSAPlugin MIDIPlugin DeflatePlugin Mpeg3Plugin DropPlugin UnixAioPlugin FFTPlugin UnixOSProcessPlugin FilePlugin XDisplayControlPlugin FloatArrayPlugin FloatMathPlugin GeniePlugin JPEGReadWriter2Plugin JPEGReaderPlugin JoystickTabletPlugin KlattSynthesizerPlugin LargeIntegersPlugin LocalePlugin Matrix2x3Plugin MiscPrimitivePlugin NewsqueakIA32ABIPlugin RePlugin SecurityPlugin SerialPlugin SlangTestSupportPlugin SocketPlugin SoundCodecPlugin SoundGenerationPlugin SoundPlugin StarSqueakPlugin SurfacePlugin UUIDPlugin Alex

3 4

VM Maker: ImageFormat-dtl.5.mcz
by squeak-dev-noreply＠lists.squeakfoundation.org 08 Nov '10

08 Nov '10

Dave Lewis uploaded a new version of ImageFormat to project VM Maker: http://www.squeaksource.com/VMMaker/ImageFormat-dtl.5.mcz ==================== Summary ==================== Name: ImageFormat-dtl.5 Author: dtl Time: 7 November 2010, 10:21:40 am UUID: a5928c3e-82de-41b6-8903-46cc3e48cb13 Ancestors: ImageFormat-dtl.4 Read the image format from a snapshot image file header, checking byte ordering and 32/64 bit word size. (ImageFormat fromFile: Smalltalk imageName) description ==> 'A 32-bit image with closure support and no Cog byte reversal (6504)'

1 0

Problem changing primitiveBitOr or primitiveBitAnd
by Mariano Martinez Peck 07 Nov '10

07 Nov '10

Hi, I want to change #primitiveBitOr or #primitiveBitAnd and in both cases, I compile the VM, I run an image, and the image cannot even start and CPU 100% :( I have a loop somewhere. This is the current implementation of #primitiveBitOr for example: primitiveBitOr | integerReceiver integerArgument | integerArgument := self popPos32BitInteger. integerReceiver := self popPos32BitInteger. successFlag ifTrue: [self push: (self positive32BitIntegerFor: (integerReceiver bitOr: integerArgument))] ifFalse: [self unPop: 2] I NEED to have the receiver oop and the argument oop. So, I've change it to: primitiveBitOr | integerReceiver integerArgument arg rcvr | arg := self popStack. integerArgument := self positive32BitValueOf: arg. rcvr := self popStack. integerReceiver := self positive32BitValueOf: rcvr. successFlag ifTrue: [ self push: (self positive32BitIntegerFor: (integerReceiver bitOr: integerArgument))] ifFalse: [self unPop: 2] And then to: primitiveBitOr | integerReceiver integerArgument arg rcvr | arg := self stackValue: 0. integerArgument := self positive32BitValueOf: arg. rcvr := self stackValue: 1. integerReceiver := self positive32BitValueOf: rcvr. successFlag ifTrue: [ self push: (self positive32BitIntegerFor: (integerReceiver bitOr: integerArgument))] ifFalse: [self unPop: 2] But in both cases, while trying to start an image, I have cpu 100% Of course, the same happens if I do this in #primitiveBitAnd Any ideas what can be happening? because I tried to understand but nothing :( Thanks in advance Mariano

7 8

Re: [squeak-dev] To a terabyte and... beyond
by David T. Lewis 07 Nov '10

07 Nov '10

On Thu, Oct 28, 2010 at 09:25:18PM -0700, Dan Ingalls wrote: > Hi Guys ;-) > > Anyone have experience with running super huge Squeaks? I have the > chance to use an absurdly big machine. I'd appreciate advice > (offline unless you think it would be generally useful) regarding the > relative stability of, say, linux and windoze builds of 64-bit > Squeaks known (or thought) to run with over a terabyte of objects, > and also where there may be some pre-built 64-bit images (sorry if > this is in an obvious place). Finally (since I've mainly used a Mac > for Squeak) I guess I'll have to know how to tell it how big to be, > or would it grow gracefully if I just said "(String new: > 1000000000000) size" in a normal image? Hi Dan, I've made a few updates today to VMMaker and the unix platform code that should make it easier to experiment with large object memories. These consist of a few type declaration fixes and updates to permit larger expansion of object memory and allocation of large objects when word size is 8 and host platform is 64-bit. I put a copy of a working Squeak 3.8 based 64-bit image, along with VMMaker and platform sources, at http://squeakvm.org/squeak64. The image is at http://squeakvm.org/squeak64/sq64-20101119-dtl.zip. The image along with a copy of complete platform sources and generated C code from VMMaker is at http://squeakvm.org/squeak64/sq64-20101119-dtl.zip. The VMMaker in this image is derived from http://www.squeaksource.com/VMMaker/VMMaker-dtl.200.mcz. I manually removed various things that are not compatible with Squeak 3.8 (pragma declarations and various things related to the blockclosure updates) in order to make it loadable in Squeak 3.8. There may be some errors but I think this is functionally equivalent to VMMaker-dtl.200.mcz. I am not yet able to trace a current Squeak trunk image (the SystemTrace rcan be found at http://www.squeaksource.com/SystemTracing), which would surely be a very good thing to do at this point. The PC that I used has 8MB of real memory, and is running Linux. On this box, I am able to create an image of about 7MB with no trouble, and to save an apparently valid snapshot to disk (although I cannot reload anything bigger than a few GB from disk on this system). The garbage collector seems to still work under these conditions, although I'm not really stressing it since I'm only allocating a small number of very large objects. John pointed out a few likely problem areas here; I'm sure there will be quite a few. Objects (e.g. a String) of several GB can be allocated and seem to function correctly, but do not display properly in an inspector. Hopefully this will allow you to do some experimenting on a box with very large memory. A terabyte seems like a bit of a stretch for a software system that started out on 16 bit hardware, but we're only a few orders of magnitude away so who is to say it can't be done? Attached is a screen shot of the 64-bit image that you and Ian originally did, now bloated out to about 7GB in size after allocating some gigabyte-sized strings. Please keep us posted if you break any interesting boundaries :) Dave

1 1

SmartSyntaxPlugins simulation whitewash
by Eliot Miranda 07 Nov '10

07 Nov '10

Hi All, I just read Anthony Hallinan's most informative comment to SmartSyntaxPlugin class>>simulatorClass which says that "By default SmartSyntaxInterpreterPlugin answers nil because methods in these plugins are intended to be embedded in code that pushes and pops from the stack and therefore cannot be run independently. This wrapper code is generated when translated to C. But, unfortunately, this code is missing during simulation. There was an attempt to simulate this, but only the prologue code (getting arg from the stack) is simulated (see simulatePrologInContext:). The epologue code (popping args and pushing result) is not. So I am making this nil until this can be fixed. Also, beware that primitive methods that take no args exactly match their primitive name (faking out InterpreterSimulator>>callExternalPrimitive:). They should only be called from within wrapper code that simulates the prologue and epilogue. Primitive method that take args don't have this accidental matching problem since their names contain colons while their primitive names do not. - ajh 8/21/2002" Strikes me that what needs to be done is to throw away the tricky implementation of Object>>#primitive:parameters:receiver:, replacing it by a simple direct implementation, and putting a wrapper around each SmartSyntaxPlugin primitive as its installed whose job it is to check for success and if so, cut back the stack and convert the result. Anyone interested who's not also hugely busy? If so, focus on making LargeIntegersPlugin work using 22 factorial printString as a test case. best Eliot

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev November 2010