End of line / EOL

[vivek-verma202]

The bug

I am not sure if this issue traces back to Theia. The IDE adds extra line breaks.

The behavior

when I copy (cntrl + c) and paste in my Ubuntu terminal, the output looks:

for i in {1..22}; do

cat -> test_${i} << EOF

#!/bin/bash

echo ${i}

EOF

done

Expected behavior

for i in {1..22}; do
cat -> test_${i} << EOF
#!/bin/bash
echo ${i}
EOF
done

Additional information

tried fixing it manually (with no luck):
"files.eol": "\n"

[jankeromnes]

Hi @vivek-verma202, are you copying text from a Theia editor and pasting them in an Ubuntu Terminal, or the other way around? (Or what are copying from where to where?)

Maybe it could be helpful if you provide a screenshot or screencast demonstrating the problem.

[Kreyren]

kreyren is infuriated by the bash used and can't resist not commenting on it

fwiw double-quote the variables to avoid word-splitting, don't use echo since it's non-standard on XNU, useless use of cat and surrounding variables in curly brackets is bloat, use shellcheck https://github.com/koalaman/shellcheck so the correct version would look like:

for int in {1..22}; do
<<-EOF > "test_$int"
    #!/usr/bin/env bash
    printf '%s\n' "$int"
EOF
done

kreyren runs away, because it's off-topic

[vivek-verma202]

the script:

for i in {1..5}; do
echo ${i}
done
Look on the gitpod editor (no extra spaces):

Look on the gitpod editor's terminal (again, no extra spaces):

And, when I copy - paste to Ubuntu terminal:

(These extra EOLs is not an issue, unless in case of scripts which expect first line to be shebang.)

[Kreyren]

FWIW i don't have this issue on my end:

Caused by an extension?

Something relevant to ubuntu terminal?

[Kreyren]

Is this gitpod on windows parsing the content to WSL ubuntu terminal? (Windows is placing garbage on new-line that usually cause this behaviour)

Relevant: https://github.com/koalaman/shellcheck/wiki/SC1017

[vivek-verma202]

I am using Google chrome on Ubuntu machine.
Copying and pasting on gedit shows no anomalous line break behavior.

Copying lines from Gitpod -> text editor (Gedit) -> Ubuntu 20 / CentOS 7 terminal: again, no anomalous line line breaks.

I have asked Gitpod explicitly to use \n as EOL. But I do notice a small "!" on my settings.json file. Is something wrong with it?

[Kreyren]

@vivek-verma202

Copying and pasting on gedit shows no anomalous line break behavior.

Afaik gedit won't show these since it's formatting the text, can you copy paste these in http://dpaste.com/ ? (or any other way to get raw to us like github's gists https://gist.github.com/)

I have asked Gitpod explicitly to use \n as EOL. But I do notice a small "!" on my settings.json file. Is something wrong with it?

1. editor.cursorWidth is invalid, because you are parsing string to property that expects integer, see
   

recommends removing double-quotes " from value -> So correct syntax is
"editor.cursorWidth": 2,

2. There also seems to be other issues that i can't reproduce on my system, try hovering over theses underscored properties to see what is wrong:
   

Note that gitpod is linting settings.json so you can see all the problems in:

3. If that did not help then try to make a backup of your current settings.json and see if the issue persist, if not try to figure out which property is causing this behavior and report it to us. :)

4. If changing the settings.json did not help, then provide me list of extensions used. You can find these in .gitpod.yml (for repository-wide) or in GUI for user+repository extensions:
   

[svenefftinge]

FWIW I also cannot reproduce this on my mac using chrome. I tried with auto and \n settings for files.eol.
The warnings (!) you see in your settings are indicating that you have specified the same value twice. You should remove one. But really this is unrelated.

[vivek-verma202]

Thank-you so much guys! I was able to fix silly issues in my settings.json and get rid of the annoying "!".

Copy paste from Gitpod to http://dpaste.com/ did not show extra line breaks.
Its not terminal settings, bash_profile or .bashrc issue as copy-paste from gedit or http://dpaste.com/ works absolutely fine.

My "version"of Gitpod / Theia is doing something non-fatal but non-trivial with eols. This is not a generic Gitpod / Theia issue as I was not able to reproduce it when I copy-pasted from: https://ec77d690-8322-4dd1-8052-e70cfe28fd72.ws-us02.gitpod.io/#/workspace/spring-petclinic

Hence, there seems to be something specific with the docker image that I am using. How can I fix it? I need no special functionality (just vanilla sh).

Thanks again.

[Kreyren]

Copy paste from Gitpod to http://dpaste.com/ did not show extra line breaks.

If it's in the raw it won't show up on browser's view of dpaste (browsers do not render these by default) where i was expecting the dpaste link alike http://dpaste.com/0QGE4X4 which looks like this on dpaste:

So that i could pipe it in vim with :set lists shows the special characters:

or in editor capable of rendering invisibles like gitpod (see https://stackoverflow.com/a/61355603 if you want to know how):

My "version"of Gitpod / Theia is doing something non-fatal but non-trivial with eols. This is not a generic Gitpod / Theia issue as I was not able to reproduce it when I copy-pasted from:

kreyren still suspect this being relevant to cascadian return on Windows/DOS

Can you share your:

1. your used browser? (Ideally user-agent from http://whatsmyuseragent.org/)
2. used kernel? (i.e Windows, MacOS, Linux, Redox!, FreeBSD, etc..)
3. your repository or is it private? assuming private since i can't find it on your profile

https://ec77d690-8322-4dd1-8052-e70cfe28fd72.ws-us02.gitpod.io/#/workspace/spring-petclinic

[vivek-verma202]

The dpaste link: http://dpaste.com/3V6Z4SB

Gitpod is not allowing me to use:

"code-eol.newlineCharacter": "¬",
"code-eol.returnCharacter" : "¤",
"code-eol.crlfCharacter"   : "¤¬"

I have made the following workspaces public:

1. gitpod-io/spring-petclinic - master (which adds no extra eols i.e. copy-paste works as expected, got it from "try in Gitpod" on https://theia-ide.org/)

2. vivek-verma202/GWAS_FM - master (which adds extra eols)

I am using Google chrome, Version 81.0.4044.129 (Official Build) (64-bit).

User agent:

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.129 Safari/537.36

Linux Kernel:

tried it on two (same problem):

1. Linux version 3.10.0-1062.12.1.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-39) (GCC) ) "integrated chat" on status bar non functional #1 SMP Tue Feb 4 23:02:59 UTC 2020

2. Linux version 5.4.0-26-generic (buildd@lcy01-amd64-029) (gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)) Support Elixir language #30-Ubuntu SMP Mon Apr 20 16:58:30 UTC 2020

[Kreyren]

The dpaste link: http://dpaste.com/3V6Z4SB

Interesting! i see what i assume is unexpected ¤¬ which is on my gitpod character for CRLF (carriage-return) which is what i believe is causing this issue

But this is usually specific to Windows/DOS (never seen this on linux in 14 years) so i find it unexpected that this behavior has been observed on linux which is using 0x0D character instead of standard new-line 0x0A

‘\n’ == ASCII 10 == 0x0A == line feed

‘\r’ == ASCII 13 == 0x0D == carriage return

Based on available informations my best guess would be that this is caused by some extension that is not optimized for usage on Linux.
Can you try to disable all extensions and if that fixed the issue and if so try to figure out which extension is causing this.

If this solves the issue i recommend filing a new issue to extension developer (that is likely the responsible for this behavior assuming that we can't reproduce it and available info above) informing them about this behavior.

---

Looking at the provided repository (https://github.com/vivek-verma202/GWAS_FM):

• Repository is not using any repository-wide extension that i can see
• The whole code is using unexpected carriage-return characters instead of new-line:
  
• I can reproduce the carriage-return on provided repository in master.bash
  • I can't reproduce the behavior in new file -> Assuming that this is copy-pasted bash file that has been originally written on Windows/DOS and gitpod is using the already present carriage return instead of expected new-line
• Created MR Replace carriage return with blank vivek-verma202/GWAS_FM#2, please verify if you still have this issue

[Kreyren]

Gitpod is not allowing me to use:

Also as referenced on https://stackoverflow.com/a/61355603

you need this extension https://marketplace.visualstudio.com/items?itemName=medo64.render-crlf for gitpod to recognize these properties

[Kreyren]

Also note https://www.gitpod.io/docs/languages/bash/ for shell-relevant development on gitpod