Skip to content

Commit

Permalink
Merge pull request #828 from datalad-handbook/release-fixes
Browse files Browse the repository at this point in the history
Release fixes
  • Loading branch information
adswa authored Apr 15, 2022
2 parents c490155 + 1dc8600 commit 972be94
Show file tree
Hide file tree
Showing 4 changed files with 132 additions and 22 deletions.
121 changes: 120 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,6 +3,83 @@
All notable changes to this project between releases will be documented in this
file.

## v0.16 (April 13 2022) -- Spring cleaning

Handbook release matching the release of DataLad v0.16.0.
This release contains a number of updates for respective changes in DataLad ``0.16``'s API, including the overhaul of existing commands, reimplementations of commands, and additional commands.

It includes contributions the new contributors @eort, @mslw, @tguiot, @jhpb7 and @eltociear, as well as contributions from established contributors @jsheunis, @mih, @adswa, @yarikoptic, and @Remi-Gau.


### Refactoring or deletions


### Additions

#### Introduction

- Installation instructions on Windows now recommend git-annex'es filter-process configuration for performance improvements ([#791][])

#### Basics

- The chapter on publishing datasets was overhauled and now includes a general overview of publishing routines and hosting service differences. ([#762][])
- Content on ``datalad run`` now mentions its superglob abilities ([#692][]) and how to glob across directories hierarchies with earlier datalad versions ([#785][])
- A few fixes and improvements to the section on publishing datasets to Gin ([#793][])

#### Advanced

- The enki walkthrough links the FAIRly big paper and tutorial as an improved alternative ([#783][])
- A new chapter contains a section on contributing to DataLad and DataLad's design docs ([#782][])
- A new section guides through the process of creating your own extensions ([#812][])
- The section on configuring additional data providers now includes content on DataLad 0.16's credential integration with Git ([#814][])

#### Usecases

- A new general section on how to create interoperable file names was added ([#796][])

#### Miscellaneous additions

- The GitHub project of the handbook now uses templates for easier issue generation. ([#768][])
- A number of CSS improvements fix the rendering of bullet points ([#770][])
- The ML usecase was minified to speed up builds ([#790][])
- A new code list for the DGPA workshop was added ([#820][])

## v0.15 (November 25 2021) -- LaTeX improvements

Handbook release matching the release of DataLad v0.15.0.
This release contains major improvements of the handbook's LaTeX backbone.

With thanks to the new contributors @oesteban, @AKSoo, and @jsheunis, and established contributors @eknahm, @kyleam, @RemiGau, @bpoldrack, @yarikoptic, @effigies @sappelhof, @lilikapa, @arokem

### Refactoring or deletions

- The deprecated --no-storage-sibling parameter was removed from the RIA store chapter ([#641][])

### Additions

#### Introduction

- The installation instructions were updated for Python ([#651][]) and Mac ([#675][]), and overall improved ([#682][])

#### Basics

- The help section was extended with a note on asyncio-related errors in Jupyter ([#646][]) and information on line-endings and and autocrfl true configurations for windows users ([#723][])
- The section on publishing with Gin was amended with content on using Gin as an autoenabled special remote ([#707][])
- The chapter on run now mentions its ``--assume-ready`` and ``--dry-run` parameter ([#699][])`, ([#724][])
- There now is a FAQ on how to fix GitHub displaying the git-annex branch as the default ([#722][])
- A new chapter on Publishing to S3 walks through publishing to a public S3 bucket ([#721][])

#### Miscellaneous additions

- A wide range of improvements in the LaTeX rendering of the handbook ([#647][]), ([#648][]), ([#650][]), ([#655][]), ([#656][]), ([#657][]), ([#658][]), ([#658][]), ([#660][]), ([#661][]), ([#662][]), ([#663][]), ([#665][]), ([#666][]), ([#679][]), ([#684][]), ([#685][]), ([#694][]), ([#759][])
- A number of textual changes to improve the PDF rendering of the handbook ([#48][]), ([#669][]), ([#670][]), ([#671][]), ([#678][]), ([#680][]), ([#691][]), ([#704][])
- New artwork ([#667][]), ([#672][]),
- A new code list for a Repronim Workshop in Yale ([#693][])
- Continuous integration was migrated to GitHub actions ([#703][])
- The Zenodo record now resolves to the latest version ([#717][])
- The code blocks now have copy-buttons ([#615][])
- A monthly linkchecker was implemented to better catch unresolving URLs ([#743][])

## v0.14 (January XX 2021) -- slightly less dreadfulness for Windows users

Handbook release matching the release of DataLad v0.14.0.
Expand Down Expand Up @@ -267,9 +344,51 @@ Alpha stage release with handbook content covering most of the core commands.
[#608]: https://github.com/datalad-handbook/book/pull/608
[#613]: https://github.com/datalad-handbook/book/pull/613
[#614]: https://github.com/datalad-handbook/book/pull/614
[#615]: https://github.com/datalad-handbook/book/pull/615
[#622]: https://github.com/datalad-handbook/book/pull/622
[#624]: https://github.com/datalad-handbook/book/pull/624
[#626]: https://github.com/datalad-handbook/book/pull/626
[#627]: https://github.com/datalad-handbook/book/pull/627
[#630]: https://github.com/datalad-handbook/book/pull/630

[#641]: https://github.com/datalad-handbook/book/pull/641
[#646]: https://github.com/datalad-handbook/book/pull/646
[#647]: https://github.com/datalad-handbook/book/pull/647
[#648]: https://github.com/datalad-handbook/book/pull/648
[#650]: https://github.com/datalad-handbook/book/pull/650
[#651]: https://github.com/datalad-handbook/book/pull/651
[#655]: https://github.com/datalad-handbook/book/pull/655
[#656]: https://github.com/datalad-handbook/book/pull/656
[#657]: https://github.com/datalad-handbook/book/pull/657
[#658]: https://github.com/datalad-handbook/book/pull/658
[#659]: https://github.com/datalad-handbook/book/pull/659
[#660]: https://github.com/datalad-handbook/book/pull/660
[#661]: https://github.com/datalad-handbook/book/pull/661
[#662]: https://github.com/datalad-handbook/book/pull/662
[#663]: https://github.com/datalad-handbook/book/pull/663
[#665]: https://github.com/datalad-handbook/book/pull/665
[#666]: https://github.com/datalad-handbook/book/pull/666
[#667]: https://github.com/datalad-handbook/book/pull/667
[#669]: https://github.com/datalad-handbook/book/pull/669
[#670]: https://github.com/datalad-handbook/book/pull/670
[#671]: https://github.com/datalad-handbook/book/pull/671
[#672]: https://github.com/datalad-handbook/book/pull/672
[#675]: https://github.com/datalad-handbook/book/pull/675
[#678]: https://github.com/datalad-handbook/book/pull/678
[#679]: https://github.com/datalad-handbook/book/pull/679
[#682]: https://github.com/datalad-handbook/book/pull/682
[#684]: https://github.com/datalad-handbook/book/pull/684
[#685]: https://github.com/datalad-handbook/book/pull/685
[#694]: https://github.com/datalad-handbook/book/pull/694
[#759]: https://github.com/datalad-handbook/book/pull/759
[#680]: https://github.com/datalad-handbook/book/pull/680
[#691]: https://github.com/datalad-handbook/book/pull/691
[#693]: https://github.com/datalad-handbook/book/pull/693
[#703]: https://github.com/datalad-handbook/book/pull/703
[#704]: https://github.com/datalad-handbook/book/pull/704
[#707]: https://github.com/datalad-handbook/book/pull/707
[#717]: https://github.com/datalad-handbook/book/pull/717
[#721]: https://github.com/datalad-handbook/book/pull/721
[#722]: https://github.com/datalad-handbook/book/pull/722
[#723]: https://github.com/datalad-handbook/book/pull/723
[#724]: https://github.com/datalad-handbook/book/pull/724
[#743]: https://github.com/datalad-handbook/book/pull/743
24 changes: 12 additions & 12 deletions docs/basics/101-139-gin.rst
Original file line number Diff line number Diff line change
Expand Up @@ -30,12 +30,6 @@ In order to use GIN for hosting and sharing your datasets, you need to

- register
- upload your public :term:`SSH key` for SSH access
- create an empty repository on GIN and publish your dataset to it

.. todo::

Revise this last step once there is a ``datalad create-sibling-gin``
command: https://github.com/datalad/datalad/issues/2680

Once you have `registered <https://gin.g-node.org/user/sign_up>`_
an account on the GIN server by providing your e-mail address, affiliation,
Expand All @@ -58,9 +52,12 @@ You should copy the contents of your public key file into the field labeled
Publishing your dataset to GIN
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

To publish an existing dataset to GIN, create a new, empty repository on GIN first.
Unlike with :command:`datalad create-sibling-github` (that does this step automatically
for you on :term:`GitHub`), this needs to be done via the web interface:
.. index:: ! datalad command; create-sibling-gin

As outlined in the section :ref:`share_hostingservice`, there are two ways in which you can publish your dataset to Gin.
Either by 1) creating a new, empty repository on GIN via the web interface, or 2), if you use DataLad version ``0.16`` or higher, via the :command:`create-sibling-gin` command (:manpage:`datalad-create-sibling-gin` manual).

**1) via webinterface:** If you choose to create a new repository via Gin's web interface, make sure to not initialize it with a README:

.. figure:: ../artwork/src/GIN_newrepo.png

Expand Down Expand Up @@ -90,6 +87,10 @@ and you can type "yes" to continue::

$ python3 /home/me/makepushtarget.py '/home/me/dl-101/DataLad-101' 'gin' '/home/me/pushes/DataLad-101' True True

**2) via command-line:**
If you choose to use the :command:`create-sibling-gin` command, supply the command with a name for the repository, and optionally add a ``-s/--siblingname [NAME]`` parameter (if unconfigured it will be ``gin``), and ``--access-protocol [https|ssh|https-ssh]`` (ideally ``ssh``).
The command has a number of additional useful parameters, so make sure to take a look at :manpage:`datalad-create-sibling-gin`.


Afterwards, you can publish your dataset with :command:`datalad push`. As the
repository on GIN supports a dataset annex, there is no publication dependency
Expand All @@ -102,9 +103,8 @@ stored in Git and in git-annex are published to the same place:

$ datalad push --to gin

If you refresh the GIN web interface afterwards, you will find all of your dataset
-- including annexed contents! -- on GIN. What is especially cool is that the
GIN web interface (unlike :term:`GitHub`) can even preview your annexed contents.
On the GIN web interface you will find all of your dataset -- including annexed contents!
What is especially cool is that the GIN web interface (unlike :term:`GitHub`) can even preview your annexed contents.

.. figure:: ../artwork/src/GIN_dl101_repo.png

Expand Down
4 changes: 0 additions & 4 deletions docs/extension_pkgs.rst
Original file line number Diff line number Diff line change
Expand Up @@ -54,10 +54,6 @@ find out more about them.
on `datasets.datalad.org <http://datasets.datalad.org/>`_ are created and
updated using this extension functionality.

* - `hirni <http://docs.datalad.org/projects/hirni>`_
- A neuroimaging specific extension to allow reproducible DICOM to BIDS
conversion of (f)MRI data. The chapter ... introduces this extension.

* - `htcondor <https://github.com/datalad/datalad-htcondor>`__
- Enhances DataLad with the ability for remote execution via the job
scheduler `HTCondor <https://research.cs.wisc.edu/htcondor/>`_.
Expand Down
5 changes: 0 additions & 5 deletions docs/intro/windows.rst
Original file line number Diff line number Diff line change
Expand Up @@ -19,11 +19,6 @@ This page summarizes core downsides and deficiencies of Windows, DataLad on Wind
Windows-Deficiencies
^^^^^^^^^^^^^^^^^^^^

.. admonition:: Updates

We have succeeded in building git-annex with MagicMime for mimeencoding (that's a good thing).
While we're working on packaging everything into a single, conda-based DataLad installation bundle, you can find a standalone git-annex installer at `http://datasets.datalad.org/datalad/packages/windows/ <http://datasets.datalad.org/datalad/packages/windows/>`_.

Windows works fundamentally different than macOS or Linux-based operating systems.
This results in missing dependencies, altered behavior, and inconvenient workarounds.
Beyond this, Windows uses a different file system than Unix based systems.
Expand Down

0 comments on commit 972be94

Please sign in to comment.