bsb -make-world -w exits early when backgrounded

[lpil]

I've been running bsb like so ./node_modules/.bin/bsb -make-world -w &.

This worked with the 2.* range, but now with the 3.0.0 release bsb exits after compiling instead of watching.

$ ./node_modules/.bin/bsb -make-world -w &
ninja: no work to do.
ninja: no work to do.
>>>> Start compiling
Rebuilding since just get started
ninja: Entering directory `lib/bs'
ninja: no work to do.
>>>> Finish compiling

Job 3, './node_modules/.bin/bsb -make-w…' has stopped

[bobzhang]

hmm, seems only one commit https://github.com/BuckleScript/bucklescript/commits/master/lib/bsb
I tested on vscode terminal, it works properly

[lpil]

I'm on Ubuntu 16.04 Linux.

I've tested with multiple terminals on bash and fish shells and the same problem occurs.

It doesn't seem to occur with sh shell though

[OvermindDL1]

@lpil and @bobzhang I do see multiple issues with 3.0!

(/me should probably update from 1.6/7* sometime...)

I tested in a variety of shells, results:

Both ZSH and Bash in redhat, it looks like something is really funky with the stream handling in bsb, specifically when it is backgrounded and then anything happens over stdin then it gets suspended, like it's not buffering data (wtf?)... When stdin is resumed then it works fine.

Bash in cygwin, it works fine, although it zombified when stdin closed, I now have a zombie bsb watcher running on the windows (what the heck?! BUG!!!).

For comparison I just tested, 1.7 is working fine on bash in cygwin on windows, and 1.7 is working fine on both zsh and bash on redhat, all when backgrounded and all. Something got royally borked on both linux and windows (in different ways) since 1.7... (EDIT: Nope, 1.7 works fine too)

[tcoopman]

From what I can find (https://superuser.com/a/973036 and phoenixframework/phoenix#2215 (comment)), detaching a process in background mode detaches stdin. So this would have been the behaviour for some time already.

Proposal: I'll submit a PR that adds a flag/config option to listen to stdin or not, so that you have the choise to run it in background (without the flag) and also use it on windows (because there listening to stdin is not enabled at the moment)

[bobzhang]

curious why do you need run watch mode in background?

[lpil]

Just a simple unix-y way of running all the build tools without faffing with multiple terminals or writing a program that will manage multiple subprocesses.

[OvermindDL1]

@tcoopman It detaches stdin, doesn't close it, and reattaches stdin when foregrounded again.

Still though @lpil, why not tmux?

[lpil]

Still though @lpil, why not tmux?

Because that's a lot more work than putting & at the end of the command and it assumes that tmux will be on everyone's machines.

[OvermindDL1]

Won't it output into your console though, mixing up whatever else you are doing anyway then?

[lpil]

With the exception of bsb everything running in the console only prints minimal information unless there is an error, so it's very readable.

[tcoopman]

Both ZSH and Bash in redhat, it looks like something is really funky with the stream handling in bsb, specifically when it is backgrounded and then anything happens over stdin then it gets suspended, like it's not buffering data (wtf?)... When stdin is resumed then it works fine.

I've just tried this out myself and it's really easy to reproduce (https://nodejs.org/dist/latest-v9.x/docs/api/process.html#process_signal_events)

#!/usr/bin/env node

const fs = require('fs');

process.stdin.resume();
fs.watch('to_watch', ()=> {console.log('changed')});

If you run this in background mode you get the same behaviour. Press enter and watch stops. Put it on the foreground and watch resumes.

Anyone with more node knowledge who can give a hint on how this can be improved?

For now I'm still on the opinion that a flag to enable this behaviour would be the best.

[OvermindDL1]

Flags are good, and who knows about node, maybe newer versions are acting weird, wouldn't surprise me, should probably be an OCaml native file instead. 😄

[tcoopman]

@bobzhang are you ok with a flag? (This is probably a bit more work because I'll need to add the flag and documentation to other scripts as well?)

[bobzhang]

@OvermindDL1 if you have a cross platform solution using OCaml, that would be perfect : )

I am not sure that running bsb -w in background is a common use case, given the added complexity, I am not sure it is worthwhile. The startup time of bsb.exe is very low, if you want to take 100% control, you can have your own watcher and call bsb.exe whenever relevant changes are spot

[lpil]

Is a flag required? This sounds like a bug to me as it is exiting when stdin is not closed.