Vm-dev April 2017

vm-dev@lists.squeakfoundation.org

44 participants
105 discussions

Re: [Vm-dev] [squeak-dev] Should a long running image notice daylight saving?
by Eliot Miranda 03 Apr '17

03 Apr '17

Hi Levente, > On Apr 2, 2017, at 11:46 AM, Levente Uzonyi <leves(a)caesar.elte.hu> wrote: > > Hi Dave, > > As I mentioned before, the problem with that primitive is that it doesn't update the offset when the time zone changes. Surely it would be easy to modify the heartbeat and/or the event checking code in the vm to do thus no? My only questions are a) is this a better place than do it than in the image? and b) who is volunteering to write and test the code? > Here's an example from an image which was started in UTC+1, but is in UTC+2 right now: > > { Time primPosixMicrosecondClockWithOffset. Locale current primTimezone } "#(#(1491158588541139 3600) 120)" > > VM info: > /squeak/products/cogspur64linuxht/lib/squeak/5.0-201609151123/squeak > Croquet Closure Cog[Spur] VM [CoInterpreterPrimitives VMMaker.oscog-eem.1950] > Unix built on Sep 15 2016 11:24:50 Compiler: 4.6.3 > platform sources revision VM: 201609151123 https://github.com/OpenSmalltalk/opensmalltalk-vm.git $ Date: Thu Sep 15 13:23:12 2016 +0200 $ Plugins: 201609151123 https://github.com/OpenSmalltalk/opensmalltalk-vm.git $ > CoInterpreter VMMaker.oscog-eem.1950 uuid: b4089b49-1494-49d2-8966-57cba5c92194 Sep 15 2016 > StackToRegisterMappingCogit VMMaker.oscog-eem.1950 uuid: b4089b49-1494-49d2-8966-57cba5c92194 Sep 15 2016 Why are you used my such an ancient vm? You know the new compactor tie appears that be fixed right? [add smileys to taste; I do not intend to offend here] > > Levente > >> On Sun, 2 Apr 2017, David T. Lewis wrote: >> >> I think I'm getting myself confused with too many images with different >> DateAndTime flavors. We already have primitiveLocalMicrosecondClock that >> can be called with primLocalMicrosecondClock, which hopefully does the >> same thing as my snippet below. >> >> Dave >> >> >>> On Sun, Apr 02, 2017 at 10:48:00AM -0400, David T. Lewis wrote: >>> Or do it like this, which does not require LocalePlugin: >>> >>> localMicrosecondClockDave >>> | timeArray | >>> timeArray := self primPosixMicrosecondClockWithOffset. >>> ^timeArray first + ((2177452800 + timeArray second) * 1000000). >>> Dave >>> On Sun, Apr 02, 2017 at 02:08:07PM +0200, Levente Uzonyi wrote: >>> > Hi Herbert, >>> > > This issue was discussed[1] here recently. I suggested[2] a VM change to > solve this problem, but the same thing can be done on the image side too. >>> > Just change Time class >> #utcMicrosecondClockWithOffset to be: >>> > > utcMicrosecondClockWithOffset >>> > "Answer an array with UTC microseconds since the Smalltalk epoch and > the >>> > current seconds offset from UTC in the local time zone." >>> > > | utc currentMinute | >>> > utc := self utcMicrosecondClock. >>> > currentMinute := utc // 60000000. >>> > LastTimeTimeZoneWasUpdated = currentMinute ifFalse: [ >>> > LastTimeTimeZoneWasUpdated := currentMinute. >>> > TimeZoneOffset := Locale current primTimezone * 60 ]. >>> > ^{ utc. TimeZoneOffset } >>> > > and Time class >> #localMicrosecondClock to be: >>> > > localMicrosecondClock >>> > "Answer the local microseconds since the Smalltalk epoch (January > 1st 1901, the start of the 20th century). >>> > The value is derived from the current UTC wallclock time and the > image's current notion of time zone." >>> > > | utcMicrosecondClockWithOffset | >>> > utcMicrosecondClockWithOffset := self utcMicrosecondClockWithOffset. >>> > ^(utcMicrosecondClockWithOffset at: 2) * 1000000 + > (utcMicrosecondClockWithOffset at: 1) >>> > > > LastTimeTimeZoneWasUpdated and TimeZoneOffset should be class variables. > They don't have to be initialized. >>> > > Levente >>> > > [1] > http://lists.squeakfoundation.org/pipermail/squeak-dev/2017-March/193594.ht… >>> > [2] > http://lists.squeakfoundation.org/pipermail/squeak-dev/2017-March/193638.ht… >>> > > On Sun, 2 Apr 2017, Herbert K?nig wrote: >>> > > >Hi all, >>> > > >>> > >I have a long running 5.1 image on a Raspi A+ which regularly waits on a > >Delay. >>> > > >>> > >Raspbian has noticed daylight saving, Squeak not. >>> > > >>> > >Is this expected and what can I do with the running image to make it > >notice? Except waiting for the monthly crash and restart :-) >>> > > >>> > > >>> > >Cheers, >>> > > >>> > >Herbert >>> > > >>> > > >>> > > >>> > >

3 2

Build pharo vm on ubuntu 16.04 64 bits ?
by Javier Pimás 03 Apr '17

03 Apr '17

Just trying to build the vm on a vanilla ubuntu 16.04 64bits. Cloned from opensmalltalk-vm entered build.linux32x86/pharo.cog.spur and run ./makeallclean It fails like this: ... checking for shared library run path origin... done checking for libssl... no checking for libgcrypt... no checking for libbcrypt... no checking for libcrypt32... no checking for ntdef.h... no checking for ntstatus.h... no checking whether SecureZeroMemory is declared... no configure: error: No crypto library found! Try --with-libssl-prefix=PATH or --with-libgcrypt-prefix=PATH or --with-wincng on Windows .,. I installed all the following packages but didn't help, any clue? sudo apt-get install cmake zip bash-completion ruby git xz-utils debhelper devscripts sudo apt-get install libc6-dev:i386 libasound2:i386 libasound2-dev:i386 libasound2-plugins:i386 libssl-dev:i386 libssl0.9.8:i386 libfreetype6-dev:i386 libx11-dev:i386 libsm-dev:i386 libice-dev:i386 sudo apt-get install build-essential gcc-multilib g++ sudo apt-get install libgl1-mesa-dev libgl1-mesa-glx:i386 sudo apt-get install binutils:i386 g++-4.6:i386 gcc-4.6:i386 sudo ln -s /usr/lib/i386-linux-gnu/mesa/libGL.so /usr/lib/i386-linux-gnu/libGL.so sudo ln -s /usr/lib/i386-linux-gnu/mesa/libGL.so.1 /usr/lib/i386-linux-gnu/mesa/libGL.so sudo apt-get install uuid-dev:i386 sudo apt-get install subversion cheers, Javier -- Javier Pimás Ciudad de Buenos Aires

5 9

Re: [Vm-dev] [Pharo-dev] Problem with OSSubprocess / signals / heartbeat ?
by Guille Polito 02 Apr '17

02 Apr '17

Ok, so following a bit on this. I'll summarize some of our findings, some of them maybe obvious for some people in this list. I saw that there are actually two different kind of VMs for *nix [1] : - threaded heartbeat - itimer + signal heartbeat Specially, I'd like to cite the following paragraph for the lazy: A distinction on linux is between VMs with an itimer hearbeat or a threaded heartbeat. VMs with an itimer hearbeat use setitimer to deliver a SIGALRM signal at regular intervals to interrupt the VM to check for events. These signals can be troublesome, interrupting foreign code that cannot cope with such signals. VMs with a threaded heartbeat use a high-priority thread that loops, blocking on nanosleep and then interrupting the VM, performing the same function as the itimer heartbeat but without using signals. These VMs are to be preferred but suport for multiple thread priorities in user-level processes has only been available on linux in kernels later than 2.6.12. So, I downloaded the heartbeat squeak VM from bintray [2]. This VM requires so deploy some configuration files in /etc/security [2]. Under this configuration OSSubprocess worked like a charm (or I did not found the issue again so far). Now, this heartbeat threaded VM is the recommended in the README file, and we see that OSSubprocess generates the exact issue stated. The main problem remains for the moment since Pharo's default download includes not this VM but the itimer one. I talked with Esteban about it and he was aware of these two VM flavours, and the reason why we are using the itimer one is the need to deploy those permission files in /etc, which makes installation a bit less automatic. Cheers, Guille [1] https://github.com/OpenSmalltalk/opensmalltalk-vm/blob/e17db79411cfec767e04… [2] https://bintray.com/opensmalltalk/vm/download_file?file_path=cog_linux32x86… [3] https://github.com/OpenSmalltalk/opensmalltalk-vm/releases/tag/r3732#linux -------- Original Message -------- > > >> I asked Santa an OSSubprocess that won't hang :) >> > > > I really appreciate to see such not so small polar elfves helping santa :) > > > > Stef > > > > > > > >> Thanks, >> >> Guille >> >> >> >> >> >> -------- Original Message -------- >> >>> >>> >>>> On 19 Dec 2016, at 14:41, Mariano Martinez Peck >>>> <marianopeck(a)gmail.com> wrote: >>>> >>>> >>>> >>>> Hi guys, >>>> >>>> >>>> >>>> Guille Polito kept one of these images if someone can give us a >>>> hand. He also proposed the great idea of using `strace` to see what >>>> was going on. He (together with Pable Tesone) suspected that the >>>> heartbeat could be interrupting the `clone()` function which is (I >>>> think) called internally by the 'posix_spawn()' which is the one >>>> used by OSSubprocess. >>>> >>>> >>>> >>>> When these images are "hung" they found at a infinitive loop like this: >>>> >>> Okay, how many child processes do you have at that point? How many >>> processes does the system have? >>> >>> >>> >>> >>> >>>> [pid 17477] --- SIGALRM {si_signo=SIGALRM, si_code=SI_KERNEL} --- >>>> >>>> [pid 17477] gettimeofday({1482152630, 593498}, NULL) = 0 >>>> >>>> [pid 17477] sigreturn() (mask []) = 120 >>>> >>>> [pid 17477] clone(child_stack=0, >>>> flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, >>>> child_tidptr=0xf7578768) = ? ERESTARTNOINTR (To be restarted) >>>> >>>> [pid 17477] --- SIGALRM {si_signo=SIGALRM, si_code=SI_KERNEL} --- >>>> >>>> [pid 17477] gettimeofday({1482152630, 600126}, NULL) = 0 >>>> >>>> [pid 17477] sigreturn() (mask []) = 120 >>>> >>>> [pid 17477] clone(child_stack=0, >>>> flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, >>>> child_tidptr=0xf7578768) = ? ERESTARTNOINTR (To be restarted) >>>> >>> so above.. 7ms between the two gettimeofday calls? Nothing else? Set >>> a breakpoint on clone/fork in gdb and look at the c-stack at this >>> point? Could you strace with timestamps to see how much time is >>> spent? Is the process suspicious in other ways? >>> >>> >>> >>> So yes.. sounds like clone doesn't complete.. the question is why? >>> Is it out of resources? Is something in the VM blocking longer than >>> the heartbeat, is the heartbeat more frequent than expected? >>> >>> >>> >>> >>> >>>> As you can see, there is a SIGALARM involved. It also looks like >>>> the `gettimeofday` is used by the heartbeat ? Could it be that >>>> someone the heartbeat is interrupting the `clone()` ? >>>> >>>> >>>> >>>> Guille also showed me the `strace` output with a regular / working >>>> image: >>>> >>>> >>>> >>>> >>>> >>>> [pid 18647] --- SIGALRM {si_signo=SIGALRM, si_code=SI_KERNEL} --- >>>> >>>> [pid 18647] gettimeofday({1482152829, 481014}, NULL) = 0 >>>> >>>> [pid 18647] sigreturn() (mask []) = -1 EINTR (Interrupted >>>> system call) >>>> >>>> [pid 18647] getitimer(ITIMER_REAL, {it_interval={0, 2000}, >>>> it_value={0, 1917}}) = 0 >>>> >>>> [pid 18647] recvmsg(3, 0xff7b0734, 0) = -1 EAGAIN (Resource >>>> temporarily unavailable) >>>> >>>> [pid 18647] select(4, [3], [], [3], {0, 1000}) = 0 (Timeout) >>>> >>>> [pid 18647] getitimer(ITIMER_REAL, {it_interval={0, 2000}, >>>> it_value={0, 797}}) = 0 >>>> >>>> [pid 18647] recvmsg(3, 0xff7b0734, 0) = -1 EAGAIN (Resource >>>> temporarily unavailable) >>>> >>>> [pid 18647] select(4, [3], [], [3], {0, 1000}) = ? ERESTARTNOHAND >>>> (To be restarted if no handler) >>>> >>>> [pid 18647] --- SIGALRM {si_signo=SIGALRM, si_code=SI_KERNEL} --- >>>> >>>> >>>> >>>> >>>> >>>> Does anyone have any hint here? >>>> >>> Get timestamps in there. How long does it take to fail/end in this >>> situation? >>> >>> >>> >>> holger >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >> >> >> >> >> >> > > > > > >

7 18

Cannot build Linux32x86 Pharo since upgrade to SDL 2.0.5
by Ben Coman 01 Apr '17

01 Apr '17

I guess its working for the pharo-vm CI, but personally I'm having trouble building opensmalltalk-vm since the upgrade to SDL 2.0.5. I left a comment on the commit... https://github.com/OpenSmalltalk/opensmalltalk-vm/commit/4e292f5733e2404ef8… Can anyone confirm this, or is it just me? cheers -ben

3 2

File I/O performance (Re: [Pharo-dev] [VM] Windows VM SurfacePlugin.dll LoadLibrary failure)
by David T. Lewis 01 Apr '17

01 Apr '17

On Sat, Apr 01, 2017 at 10:06:34AM +0200, Nicolas Cellier wrote: > AFAIR, flushing after each write was a workaround against some linux > problem. This was specifically for the case of writing a chunk to e.g. the changes file. The extra flush for that case is protecting for two processes writing to the same stream. This would not affect overall read/write performance though. > I think that flush is not exagerately expensive on linux, because there's a > difference between flush (transfer data from user space buffers to kernel > space buffers) and sync (transfer data to the disc). The Windows VM uses a different FilePlugin. The I/O calls are made at the HANDLE level, not at the (FILE *) level as in the Unix plugin. A HANDLE on Windows would be loosely equivalent to a file descriptor number on Unix. If #primitiveFileFlush is intended to mean "flush everything from the VM out to the operating system", and #primitiveFileSync is intended to mean "tell the operating system to flush it all way to disk", then flush would be a no-op on Windows, and you would call the sync primitive only in cases where you really need to guarantee a flush to disk. An interesting project would be to adapt the Unix plugin to run on Windows (maybe it already just works, I never tried), or conversely to write a Unix plugin that reads and writes to the file descriptor level as in done with the Windows plugin. My guess is that both approaches are valid, and they probably will have differing performance advantages based on the I/O workload. But someone would have to try it to find out :-) Dave > > In Win32 VM, the fileFlush and fileSync primitives do the same call to > FlushFileBuffers. > The msdn tells it's a bad thing to repeatedly call FlushFileBuffers > https://msdn.microsoft.com/en-us/library/windows/desktop/aa364439(v=vs.85).… > I don't see such thing as a "cheap" flush on windows. > > But do we really need to flush? > Couldn't we rather implement a linuxWorkaroundFlush: aFile method that > would flush on linux and do nothing anywhere else? > > 2017-04-01 6:40 GMT+02:00 Martin Dias <tinchodias(a)gmail.com>: > > > Hi all. I rarely use Windows but this night entered again to repeat the > > load test in Pharo. > > > > Cyril: I uninstalled the antivirus and excluded .changes and .images files > > in the "Windows Defender" (didn't know it exists). I may note some speed up > > but not much, so it wasn't THE solution. > > > > Peter: I didn't check firewall but "Compiling methods..." is what stays on > > screen so it shouldn't be the network. > > > > Eliot: this time I profiled it and can highlight from report that Leaves > > shows 91% in StandardFileStream>>primFlush:. I guess it isn't too > > surprising since file writing is expensive but it's a lot. However I didn't > > compare it yet with the respective report in linux. For the record, I > > attach the report. > > > > Code evaluated: > > AndreasSystemProfiler spyOn: [ > > Gofer new > > url: 'http://www.smalltalkhub.com/mc/ObjectProfile/Roassal2/main'; > > package: 'ConfigurationOfRoassal2'; > > load. > > #ConfigurationOfRoassal2 asClass load.] > > > > Regards > > Mart??n > > > > > > On Thu, Mar 16, 2017 at 8:03 PM, Cyril Ferlicot D. < > > cyril.ferlicot(a)gmail.com> wrote: > > > >> Le 16/03/2017 ?? 05:11, Martin Dias a ??crit : > >> > And it takes >30 minutes to load Roassal2, while takes <1 minyte in > >> > Linux (same notebook). Script: > >> > > >> > >> Do you have an anti-virus? If yes did you excluded the .changes and ombu > >> files from the files to check? If not the anti-virus might analyze your > >> file at each compilation. > >> > >> -- > >> Cyril Ferlicot > >> > >> http://www.synectique.eu > >> > >> 2 rue Jacques Pr??vert 01, > >> 59650 Villeneuve d'ascq France > >> > >> > >

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

Vm-dev April 2017