DKAN 1.14.1

This is a "patch" release of DKAN, containing bug fixes and minor updates, but adding no new functionality.

Improvements in this release

• Fix contextual filter on list_of_users_groups view (#2280)
• Change the default title for harvested resources to use the format value rather than url value (#2284)
• Fix hero background image setup (#2265)
• Use geojson icon for GeoJSON files in listings (#2288)
• Share MySQL Credentials With Docker Containers (#2283)
• Remove dkan_workflow_permissions dependency (#2273)
• Docker Proxy Config Updates (#2275)
• Fix harvest validation for accessLevel values (#2263)
• Change timezone handling to 'none' on temporal coverage field (#2249)
• Fixed field mapping defaults for open data schema APIs (#2103)
• Migration of CircleCI from V1 to V2 (#2237)

DKAN 1.14

Read up on the latest release of DKAN, 1.14! While not nearly as big as the previous DKAN point release, 1.13, it brings a number of useful new features and improvements, as well as some important bug fixes. The primary focus of this release is on

1. Improvements and fixes to data visualizations and previews, and
2. Refinement of the Harvester functionality introduced in 1.13.

For a full, detailed list of changes in this release, please consult the CHANGELOG.

What's New

DKAN Harvest

In 1.13, the Harvester would run an entire migration as a single "step" in the web UI, which resulted in timeouts and memory errors on sources with more than a few dozen datasets. When run from the UI, the Harvester now better leverages Drupal's Batch API to process the migrations in 5-dataset "chunks." You'll notice more incremental progress on the status bar that appears while a source is being harvested, and hopefully even the largest sources will complete without exhausting server resources.

A Topics field has also been added to harvest source nodes. When this field contains one or more of the topics from your data catalog, those topics will be applied to every dataset that is harvested from the source. Additionally, the way the Harvester handles resource nodes has been improved and better-documented.

The error messages from the Harvester when filter values are not not present on the source's items have been made clearer.

Visualization Entity Charts

We've made some small but significant improvements to the chart creation experience. Help text is now available for all fields on the chart configuration form, accessed by clicking on a small "?" icon beside the field. Additionally:

• The chart type selection now includes a descriptive name of the chart type (rather than just an image).
• Tick values for axes are validated so that values which would result in an unreadable chart are rejected.
• We now use relative paths for file URLs and set the X-Frame headers to allow easier embedding of charts on external websites.
• Support for values with commas for thousands separators

Dataset Previews

• Tab delimiters and TSV files are now supported for previews.
• Embedded previews no longer show the Grid/Graph/Map tabs.
• Help text has been added to explain the pager buttons on data previews.

Datastore

• Tab delimiters and TSV files are now supported for Datastore import.
• An inconsistency in how the limit (by default, 100 records) on Datastore API requests is applied to results was corrected.
• A bug in the "fast import" method which occasionally led to files being imported to the datastore without dropping the existing records (causing the tables to balloon in size after several consecutive imports of the same file) has been fixed.
• Developer's note: A hook has been added to the Datastore API module to allow altering the fields excluded (see example).

Open Data Schema Mapper

The ODSM module includes a "filecache" system that writes certain open data endpoints to static files on disk rather than generating them on every page request (which is unusably slow on larger sites). A new column on the ODSM main configuration page displays the filecache status of each endpoint and gives the user the ability to generate or delete each cache.

A bug on the mapping for the "language" field in Project Open Data (data.json) that caused many catalogs to fail validation has been fixed.

Workflow

Drafts that were submitted to an editor and then rejected under workflow would never return to the "My Drafts" screen of the original submitter, meaning a contributor could never act on an editor's feedback. This has been fixed.

Administration Views

DKAN now includes the Administration Views module, which replaces Drupal's under-powered default content and user administration pages with more powerful, filterable and searchable versions.

Upgrade notes

Upgrades to this release should be fairly straightforward -- it's a much lower-impact update than version 1.13 was. One note: previous upgrades may have failed on an update to the Search API module. This version contains a patch to avoid this error.

DKAN 1.13.7

This is a "patch" release of DKAN, containing bug fixes and minor updates, but adding no new functionality.

Improvements in this release

• Important security updates to 'views' and 'entityreference' modules.
• Multiple testing improvements.

DKAN 1.13.6

This is a "patch" release of DKAN, containing bug fixes and minor
updates, but adding no new functionality.

Improvements in this release

• Add file_resup to the list of up to date projects (#2036)
• Change the 'Datasets' field on the Resource form to use autocomplete (#2035)
• Include language selectors in the 'chosen_jquery_selector' config (#2034)
• Module upgrades: fieldable_panels_panes, media, and search_api (#2020)

Testing Improvements

• Additional test/devops improvements needed for deployment. See (#2012, #2014, #2015, #2016, #2018) for specifics.
• Add configurable arguments via Behat Contexts. (#2025)
• Add unique tags to more test scenarios (#2021)

DKAN 1.13.5

This is a "patch" release of DKAN, containing bug fixes and minor
updates, but adding no new functionality.

Improvements in this release

• This is a small release adressing some minor issues in 1.13.4. The only significant change is the addition of the devel module to DKAN core. The devel module is used by almost all Drupal developers to debug, test expiremental code, generate dummy content, and perform other developer tasks. DKAN developers are constantly adding the devel module after building DKAN, and a new set of Behat scenarios added to the test suite need to make use of the dummy content generation functions to pass.

• The devel module and its submodules will be disabled by default in DKAN however, and should only be enabled in development environments. Enabling devel in production should be considered a security risk.

• All other improvements are minor issues related to installation and tests that arose during deployments of DKAN 1.13.4. Check the CHANGELOG and Pull Request #2003 where most of these changes are captured.

DKAN 1.13.4

This is a "patch" release of DKAN, containing bug fixes and minor updates, but adding no new functionality.

Improvements in this release

The 1.13.4 release of DKAN contains a very large number of minor fixes. For a full list check the CHANGELOG. Noteable improvements include:

• Some logic concerning when previews were rendered for resources has been simplified. DKAN will now attempt to render a preview for any resource that contains an uploaded or remote file. No API or Website URL links in resources will be previewed other than with an iframe to the URL. Note that in some cases, resources that previously did have Recline previews may now simply display an iframe to the remote resource.

• Relatedly, various issues with previews for resources hosted on external domains have been addressed.

• Publishing options ("draft," "published" etc) were not available when the Workflow module was enabled. This has been fixed.

• A bug where data previews broke when a resource contained only numeric data has been fixed.

• A number of Workflow permissions issues have been resolved, allowing users to access "stale drafts" and other data that had been hidden.

• The groups page now lists groups alphabetically rather than by create date.

• Fixed the output for "language" in Project Open Data and DCAT to be standards-compliant.

• Fixed issues with how timestamps are applied to harvested datasets. See below for details.

• An existing hook_update function that upgraded from a previous version of the Open Data Federal Extras module has been fixed to not fail when the fields are not present.

• The drush dsu command, to update a datastore from a local file, was broken and has been restored.

• Windows line endings are now supported on Datastore "fast imports"

• Several issues causing the Harvester to break on large harvests have been fixed. Remote files on servers (like Socrata) that will not supply a HEAD request are briefly stored on disk instead of in memory to obtain metadata such as filesize. Also, resource previews are no longer rendered for purposes of indexing for Search API, which was causing indexing at the end of a large harvest to fail.

• Drupal core was updated to 7.56 and many contrib modules were updated to their latest stable version.

Special Notes

• Previous versions of DKAN provided a field "Modified Source Date" (machine name field_modified_source_date) to store Project Open Data's "modified" property. The way we capture sources' modified and issued properties has since been revamped (see #1802), and an update function was needed to remove the old field. However, previous versions had put hook_update functions in the wrong order and some sites did not recieve the change when updating. This release should clear up those remaining issues on sites that still have the field_modified_source_date field.

DKAN 1.13.3

This is a "patch" release of DKAN, containing bug fixes and minor updates, but adding no new functionality.

Improvements in this release

• Groups permissions were given better logic. Editors will now become administrators of any group they are added to, giving them permission to edit or moderate any content in that group. Also, Site Manager was given permissions to edit the order of featured groups.

• We now provide parsing options on the Datastore Fast Import. This means a user can set what delimiters and line terminators are used when importing a CSV file, avoiding some import errors users were experiencing.

• Some errors were fixed that caused installing DKAN with the browser (using /install.php rather than drush). Also, special characters were removed from default content filenames, fixing an installation bug on Windows systems.

• The Rules module was patched to prevent a "cache rebuild lock" (see https://www.drupal.org/node/2851567)

• Several bugs in the Harvest module were fixed:

  • The Site Manager can now use the main dashboard view to initiate harvest actions in bulk
  • Inconsistencies in date fields (Harvest source "modified" vs Drupal's "modified" dates) were addressed by adding new fields to the dataset content type.
  • A bug preventing the "temporal coverage" field from being harvested was fixed.

• The restws and media modules were updated to latest versions

• Several other smaller bug fixes and improvements; see the CHANGELOG for more information.

Special Notes

Changes to Harvester's date handling

This update changes the way the Harvest module reflects the issued and modified dates of harvested datasets. Project Open Data and most other metadata standards provide an "issued" or "created" date for datasets, as well as a "modified" date. The original release of Harvester simply overwrote Drupal's created and modified node properties with the source's dates for these fields, but we've run into two problems with this:

1. A node's modified date is easily overwritten by other actions in Drupal
2. It can be useful to store both the date that a dataset was issued in its source, and the date it was added to the portal harvesting it.

An existing field, field_modified_source_date, was already handeling some of this but we decided to scrap that and start from scratch. Starting with this release, a source's issued and modified dates will be stored in the new fields field_harvest_source_issued and field_harvest_source_modified. When these two fields are present, those will be the dates shown on a dataset's landing page on DKAN and in the site's data.json and DCAT RDF feeds.

All sources should be re-harvested after updating to this patch release to ensure that all date fields and properties are accurate.

7.x-1.13.2

DKAN 1.13.2 Release Notes

This is a "patch" release of DKAN, containing bug fixes and minor updates, but adding no new functionality.

See full 1.13 release notes here.

Improvements in this release

• Updated documentation.
• DKAN Datastore: fixed null values being imported as 0.
• Fixed errors related to the open_data_schema_apis_features_rebuild() function.
• Fixed errors when users with content creator role are editing or adding resources.
• Fixed access to the POD validation screen for site managers.
• Fixed access to the featured groups block for anonymous users.
• DKAN Harvest: fixed permissions for the site manager role, they now have access to the cache, delete, harvest, and migrate bulk operations from the Harvest Dashboard.
• DKAN Harvest: added support for importing contact name and contact email.
• Updated contrib modules: services, visualization_entity and views.

7.x-1.12.14

DKAN 1.12.14 Release Notes

This is a "patch" release of DKAN, containing bug fixes and minor updates, but adding no new functionality.

See full 1.12 release notes here.

Improvements in this release

• Added css for chart visualizaitons, fixes issue in IE.
• Updates drupal core to 7.53
• Upgrade visualization_entity to 7.x-1.1
• Upgrade services module (via datastore module) to 3.19

1.13.1

This is a "patch" release of DKAN, containing bug fixes and minor updates to DKAN 1.13, but adding no new functionality. It was released very shortly after 1.13 to address bugs that surfaced during deployments and upgrades. If you have not yet upgraded to 1.13, upgrade directly to this release and skip 1.13; if you have already upgraded, we recommend updating to 1.13.1 immediately.

See full 1.13 release notes here.

Improvements in this release

• Fix validation page permission check using wrong permission name odsm.
• Fixed a bug in the home page conversion function
• Fixed the page title (<head><title>) so that it's just the site name (not the node or panel title)
• Updated the DKAN API link on dataset pages to use the new documentation site page.
• Fixed error messages appearing on homepage after upgrade
• Fixed panelizer permissions to hide the "Customize Display" button for Site Managers.
• Additional minor bug fixes to code and tests