Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Apparently netcdf needs to be compiled an additional option #42

Closed
doutriaux1 opened this issue Apr 19, 2018 · 9 comments
Closed

Apparently netcdf needs to be compiled an additional option #42

doutriaux1 opened this issue Apr 19, 2018 · 9 comments

Comments

@doutriaux1
Copy link
Contributor

Using 4.4 the following command n used to work (linux)

Using 4.6 I now get:

ncdump -h mpaso.hist.am.timeSeriesStatsMonthly.0001-01-01.nc
ERROR: ld.so: object '/lib/i686/nosegneg/libc.so.6' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object '/lib/i686/nosegneg/libc.so.6' from LD_PRELOAD cannot be preloaded: ignored.
ncdump: mpaso.hist.am.timeSeriesStatsMonthly.0001-01-01.nc: NetCDF: Attempt to use feature that was not turned on when netCDF was built.

The message is not very informative. I suspect it has to do with very big variables in very big files

The file is HUGE (~75Gb) you can obtain it at:

curl https://cdat.llnl.gov/cdat/sample_data/mpaso.hist.am.timeSeriesStatsMonthly.0001-01-01.nc -o mpaso.hist.am.timeSeriesStatsMonthly.0001-01-01.nc

Original issue that triggered the need for the latest netcdf can be seen at: CDAT/cdms#238

@ocefpaf
Copy link
Member

ocefpaf commented Apr 19, 2018

Using 4.4 the following command n used to work (linux)

Can you try to force an environment with the old version?

conda create --name TEST --channel conda-forge libnetcdf=4.4

and repeat your test just to be sure it is the new package?

There lines worries me :-/

ERROR: ld.so: object '/lib/i686/nosegneg/libc.so.6' from LD_PRELOAD cannot be preloaded: ignored.
ERROR: ld.so: object '/lib/i686/nosegneg/libc.so.6' from LD_PRELOAD cannot be preloaded: ignored.

We do rely on system libc but I cannot reproduce that error on my Linux machine.

And this line is really not very helpful 😒

ncdump: mpaso.hist.am.timeSeriesStatsMonthly.0001-01-01.nc: NetCDF: Attempt to use feature that was not turned on when netCDF was built.

@czender does this have anything to do with the bug you mentioned?

@czender
Copy link

czender commented Apr 19, 2018

Yes, it does. Because of that bug Unidata changed the default behavior in netCDF 4.5.0, and never re-enabled the old 4.4.x behavior. As of netCDF 4.5.0, please add the configure option "--enable-cdf5". This is something I overlooked and should have noticed earlier. Once netCDF is built with that flag, the above ncdump command should work. Perhaps we could add a test to verify netCDF has been built with CDF5 enabled? nc-config can be used for this purpose, e.g.,

zender@skyglow:~$ nc-config --has-cdf5
yes

I will ask Unidata to make --enable-cdf5 the default again in netCDF 4.7.0, but this option will still be necessary until that occurs.

@WardF
Copy link
Contributor

WardF commented Apr 19, 2018

Enabling CDF5 by default is doable at this point, we have ironed out the issues that required it to be turned off in the first place.

@pmspire
Copy link

pmspire commented Aug 15, 2018

CDF5 support seems to have disappeared (in commit ed28c3d?)

(old) ~ % conda list | grep netcdf
libnetcdf                 4.6.1                         2    conda-forge
(old) ~ % nc-config --has-cdf5
yes
(old) ~ % conda deactivate
~ % conda activate new
(new) ~ % conda list | grep netcdf
libnetcdf                 4.6.1                he6cff42_5    conda-forge
(new) ~ % nc-config --has-cdf5
no

Was this intentional?

@ocefpaf
Copy link
Member

ocefpaf commented Aug 16, 2018

@pmspire that was probably on oversight on my part when I synced the recipes. Do you want to send a PR re-adding that?

@msarahan
Copy link
Member

It would also be good to add a test to ensure that the functionality you depend on does not regress.

@ocefpaf ocefpaf mentioned this issue Aug 16, 2018
@pmspire
Copy link

pmspire commented Aug 16, 2018

I'll try to submit a PR for this today.

@ocefpaf
Copy link
Member

ocefpaf commented Aug 16, 2018

I'll try to submit a PR for this today.

B/c of the testing I went ahead and did myself. Thanks for the offer and sorry for asking you to do it and then doing it...

See #51

@pmspire
Copy link

pmspire commented Aug 16, 2018

No need to apologize for that! Thanks as always for your tireless conda-forge efforts.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants