Maintenance / bug fix / copyright change release

The main purpose of this release is house keeping and to cap off the v3 branch of IXP Manager in preparation for v4.

This release also contains an administrative name change for the copyright holder. The full details can be read here but the tl;dr version is:

The copyright statement for IXP Manager was changed on 2016-09-23 to reflect the fact that INEX
changed its formal legal name from "Internet Neutral Exchange Association Limited" to "Internet Neutral
Exchange Association Company Limited By Guarantee", as required by the Companies Act 2014.

• Add note about the reason for the company name change (68418dc - Nick Hilliard - 2016-09-23)
• Change name to "Internet Neutral Exchange Association Company Limited By Guarantee" (8d9a6f2 - Nick Hilliard - 2016-09-23)
• Change name to "Internet Neutral Exchange Association Company Limited By Guarantee" (435b65e - Nick Hilliard - 2016-09-23)
• Removed extraneous copyright statement (46e6c96 - Nick Hilliard - 2016-09-23)
• Fix MAU issue on Arista switches (6d08b49 - Barry O'Donovan - 2016-05-31)
• Fix 'Call to a member function debug() on boolean' error (00a8948 - Barry O'Donovan - 2016-09-05)

Bug fix / improvement

This release fixes some minor bugs and updates the foreign reference to OSS_SNMP to support additional switch platforms.

Commits

• Update FK to latest OSS_SNMP (9039dd3 - Barry O'Donovan - 2016-01-27)
• [BF] min != greater or equal. Doh! Prevented port 1 from being selected (ce236cf - Barry O'Donovan - 2016-01-22)
• [BF] oops, BillingAddress3 was omitted in two locations (0e061c0 - Nick Hilliard - 2015-12-03)
• Remove changed: attributes from RIPE objects to close #233 (a75e1fc - Barry O'Donovan - 2015-09-14)
• [BF] Do not show resold customers who have left - fixes #231 (4af0d76 - Barry O'Donovan - 2015-08-22)
• [BF] Fix #207 - "Undefined index: sid" message while trying to view switch ports via SNMP (7eb2dc7 - Barry O'Donovan - 2015-06-30)
• Update FK to OSS_SNMP (0a93a2a - Barry O'Donovan - 2015-06-30)

Templates Updated

application/modules/apiv1/views/rir/tmpl/as-set-ixp-connected.tpl
application/modules/apiv1/views/rir/tmpl/as-set-ixp-rs-v4.tpl
application/modules/apiv1/views/rir/tmpl/as-set-ixp-rs-v6.tpl
application/modules/apiv1/views/rir/tmpl/as-set-ixp-rs.tpl
application/modules/apiv1/views/rir/tmpl/autnum.tpl
application/views/customer/overview-tabs/details.phtml
application/views/customer/overview-tabs/resold-customers.phtml
application/views/switch-port/list-toolbar.phtml

Improvements / Bug Fixes / Housekeeping

This release merges a number of outstanding pull requests and closing ~20+ issues.

Besides @barryo and @nickhilliard , additional contributors to this release include @will-h, @fooelisa, @rowanthorpe (as well as issues and feedback from @bcix and others). Thanks!

Post Upgrade Tasks

Assuming you're located in the base directory of IXP Manager:

1. Refresh your SQL views:

   mysql -u username -ppassword [dbname] < tools/sql/views.sql
   

2. Rescan your switches:

   ./bin/ixptool.php -a switch-cli.snmp-poll
   

Views Changed Since v3.7.2

application/views/_skins/inex/customer/email/welcome-email.phtml
application/views/_skins/inex/static/support.phtml
application/views/_skins/inex/statistics-cli/mrtg/trunks.cfg
application/views/admin/index.phtml
application/views/customer/detail.phtml
application/views/customer/forms/edit.phtml 
application/views/customer/overview-tabs/overview.phtml
application/views/customer/overview-tabs/ports.phtml
application/views/customer/overview-tabs/ports/physintstatus.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/ipv4-address/js/list.js
application/views/peering-manager/peering-request-message.phtml
application/views/peering-matrix/index.phtml
application/views/router-cli/server/bird/neighbor.cfg  
application/views/rs-prefixes/list-help.phtml
application/views/statistics-cli/mrtg/member-port.cfg
application/views/virtual-interface/add-postamble.phtml
application/views/virtual-interface/forms/add-wizard.phtml
application/views/virtual-interface/js/add-wizard.js
application/views/vlan-interface/forms/vlan-interface.phtml

Commits

• Fix #171 - Discards not graphed on Extreme XOS platforms (f21f95a - Barry O'Donovan - 2015-06-29)
• Fix #166 - statistics-cli.upload-traffic-stats-to-db timeouts when new customer does not have ports (2b664ce - Barry O'Donovan - 2015-06-29)
• Proof of concept to close #21 (e562185 - Barry O'Donovan - 2015-06-29)
• Fix #168 - vlan-interface/edit doesn't sanitise ipvXhostname correctly (114e612 - Barry O'Donovan - 2015-06-29)
• Merge pull request #208 from will-h/master (a259286 - Barry O'Donovan - 2015-06-29)
• Fix #212 - peeringmacrov6 cannot be updated via the UI (d059073 - Barry O'Donovan - 2015-06-29)
• [HK] Close #193 (0630aab - Barry O'Donovan - 2015-06-29)
• Fix #194 - JS md5 password autogenerator (c1affe0 - Barry O'Donovan - 2015-06-29)
• Fix #201 again without white space changes (b33782e - Barry O'Donovan - 2015-06-29)
• Revert "Fix #201 - empty ASN list causes bird RS config to bomb" (1af8fb6 - Barry O'Donovan - 2015-06-29)
• Fix #191 - Can select errors graph type in peer to peer statistics (00a631f - Barry O'Donovan - 2015-06-29)
• Fix #201 - empty ASN list causes bird RS config to bomb (5c99b4d - Barry O'Donovan - 2015-06-29)
• Fix #206 - PHP warnings about undefined variable url (21cce54 - Barry O'Donovan - 2015-06-29)
• [BF] addition fixes for #222 and #217 (7791a8b - Barry O'Donovan - 2015-06-29)
• Merge branch 'rowanthorpe-add-as112-active-config-var' (56bef0f - Barry O'Donovan - 2015-06-29)
• Defaulting to true to maintain backwards compatibility (0789156 - Barry O'Donovan - 2015-06-29)
• Merge branch 'add-as112-active-config-var' of git://github.com/rowanthorpe/IXP-Manager into rowanthorpe-add-as112-active-config-var (ad6cf91 - Barry O'Donovan - 2015-06-29)
• [BF] Fix #222 - Port status displayed incorrectly for LAGs (14497bf - Barry O'Donovan - 2015-06-29)
• Add config-var to make as112 optional in UI (Fixes #217) (5ff31e2 - Rowan Thorpe - 2015-06-18)
• Fix #218 (8772169 - Barry O'Donovan - 2015-06-18)
• Do not escape unicode or escape forward slashes - fixes #216 (033d533 - Nick Hilliard - 2015-06-18)
• Merge pull request #214 from rowanthorpe/add-encoding-to-zend-string-validate (ebaf4cf - Barry O'Donovan - 2015-06-18)
• Do not escape unicode or escape forward slashes - fixes #216 (5c53981 - Barry O'Donovan - 2015-06-18)
• Ensure string-validate uses UTF-8, not system-default (7a07a55 - Rowan Thorpe - 2015-06-17)
• Merge pull request #211 from rowanthorpe/prefix-analysis-tool-tweaks (8d5b472 - Nick Hilliard - 2015-05-29)
• Loosen list-matching regex for whitespace in bird config (8aca25f - Rowan Thorpe - 2015-05-29)
• Mute starting and ending SQL transaction if $do_nothing (04f3742 - Rowan Thorpe - 2015-05-29)
• [BF] peering matrix depends on sflow, not netflow (893cd7a - Nick Hilliard - 2015-05-23)
• Update FK to OSS_SNMP and close #210 (6233575 - Barry O'Donovan - 2015-05-19)
• Address issue #209 - secure by default (f2889a4 - Barry O'Donovan - 2015-05-07)
• Add Connected Capacity totals to admin interface (a2ba79d - will-h - 2015-04-29)
• [BF] Send peering requests as UTF-8 (525cc66 - Barry O'Donovan - 2015-03-30)
• [BF] Fix #202 for multiple VLAN interfaces on the same peering LAN (1832db3 - Barry O'Donovan - 2015-03-30)
• [BF] Fix #202 - md5s for different lans (c71a0d4 - Barry O'Donovan - 2015-03-23)
• [IM] Some switches support MAU but not all of the MIBs (57729a7 - Barry O'Donovan - 2015-03-11)
• [BF] Reset counter for each virtual interface - fixes #192 (e20f677 - Barry O'Donovan - 2015-03-02)
• [BF] Do not show ip addresses if disabled (a57dbc0 - Barry O'Donovan - 2015-02-20)
• Fixes #200 - checking on an undefined snmpid, do not include those into the mrtg conf (3674006 - Barry O'Donovan - 2015-02-18)
• adding belts and all, barryo is going to like this (9660b16 - Elisa Jasinska - 2015-02-11)
• importing LAG MAC addresses which are behind a logical interface by saving the virtual interface name in the DB and matching on those (83dfba1 - Elisa Jasinska - 2015-02-11)

Implement use of the IANA MAU MIB for Discovering Port Media

This update implements the IANA MAU MIB as requested in #130. The features added include:

• use of MAU MIB when polling switches via the routine cron job
• new switch port views for those that support the MAU MIB (click Switches in the admin interface and then select View Port MAU Detail (database only) from the switch row's dropdown);
• a new view of unused optics (click Switches in the admin interface and then Unused Optics);
• the port medium type is now shown in all port details pages.

Schema Updates Required

ALTER TABLE switch 
    ADD mauSupported TINYINT(1) DEFAULT NULL;

ALTER TABLE switchport 
    ADD mauType VARCHAR(255) DEFAULT NULL, 
    ADD mauState VARCHAR(255) DEFAULT NULL, 
    ADD mauAvailability VARCHAR(255) DEFAULT NULL, 
    ADD mauJacktype VARCHAR(255) DEFAULT NULL, 
    ADD mauAutoNegSupported TINYINT(1) DEFAULT NULL, 
    ADD mauAutoNegAdminState TINYINT(1) DEFAULT NULL;

Also In This Release

• Following a mailing list discussion, tools/perl-lib/IXPManager/ixpmanager.conf has been renamed to tools/perl-lib/IXPManager/ixpmanager.conf.dist to prevent overwrites for people who use it in place.
• [IM] Added 40G and 100G speed options for physical interfaces (Elisa Jasinska - 2015-01-16)
• [IM] Updated mrtg trunks.cfg (995fd3c - Nick Hilliard - 2015-01-16)
• [IM] Changed execute bit on perl dependency test script (ebd8158 - Elisa Jasinska - 2015-01-12)
• [IM] Fix typos in the rs-config-all example script (c60d4b7 - Rowan Thorpe - 2014-12-16)
• [IM] Only display a message if we are filtering and then display the appropriate message(s) (54950b7 - Barry O'Donovan - 2014-12-15)
• [BF] Path fix (a8692c4 - Barry O'Donovan - 2014-12-15)
• [CI] New known-good bird configs for deterministic ordering (d983b91 - Barry O'Donovan - 2014-12-15)
• [IM] Also ensure deterministic ordering of acls for route server configs (9cec6bd - Barry O'Donovan - 2014-12-15)
• [IM] Ensure deterministic ordering for same ASNs (1183685 - Barry O'Donovan - 2014-12-15)
• [IM] Added bgp max prefixes to CUSTUSER Member Details view page (389cc30 - Nick Hilliard - 2014-12-14)
• [BF] #190: sflow-to-rrd-handler passes extra argument to rrd update (81a7fa8 - Nick Hilliard - 2014-12-13)
• [BF] perl 5.20 deprecates when/given (53720c2 - Nick Hilliard - 2014-12-13)
• [BF] Limit recent members to 3, not all (479a21a - Barry O'Donovan - 2014-12-12)
• [CI] Update database schema used by CI tests (e27e44c - Barry O'Donovan - 2014-12-08)
• [BF] Ensure we have physical interfaces before using them - fixes #187 (a5abbcb - Barry O'Donovan - 2014-12-04)
• [BF] Fix regression - fixes #186 (2d56b97 - Barry O'Donovan - 2014-12-04)
• [IM] Discourage manaual addition of switches (70643c0 - Barry O'Donovan - 2014-12-04)
• [IM] Remove confusing link to non-SNMP switch add method (58ac575 - Barry O'Donovan - 2014-12-04)
• [BF] fix perl 5.18 hash key randomisation issue (edf6d10 - Nick Hilliard - 2014-11-30)
• [HK] Renamed to prevent overwrites for people who use it in place. (6aad7a2 - Barry O'Donovan - 2014-11-29)

Views / Templates Changed

application/views/_skins/example/public/member-details.phtml
application/views/_skins/example/public/member-details/json.phtml
application/views/customer/detail.phtml
application/views/customer/overview-tabs/ports/physintstatus.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/dashboard/index-tabs/associate.phtml
application/views/menu.phtml
application/views/switch-port/list-column-port-admin-oper-status.phtml
application/views/switch-port/list-mau.phtml
application/views/switch-port/list-toolbar.phtml
application/views/switch-port/unused-optics.phtml
application/views/switch/add-preamble.phtml
application/views/switch/add-toolbar.phtml
application/views/switch/list-row-menu.phtml

Bug fix / improvement

This release fixes a regression introduced in a third party library as part of the recent security fix (v3.6.19). This bug will prevent users from resetting and changing passwords.

Additionally, this release closes #180 by de-INEX-ifying the peering manager. Please see updated documentation at: https://github.com/inex/IXP-Manager/wiki/Peering-Manager

Commits

• [IM] de-inexify peering manager - fixes #180 (272648b - Barry O'Donovan - 2014-11-27)
• [BF] Auth issue for password resets (0070874 - Barry O'Donovan - 2014-11-27)

Templates Updated

application/views/peering-manager/peering-request-message.phtml

New Features / Improvements / Bug Fixes / Housekeeping

This release is very much driven by recent mailing list activity.

NB: This upgrade requires a schema change - see below.

Primarily, scripts have been added to power the peering matrices and peering manager. These scripts parse sflow data and discover established BGP sessions between exchange members. See the following updated and new documentation:

• https://github.com/inex/IXP-Manager/wiki/Installing-Sflow-Support
• https://github.com/inex/IXP-Manager/wiki/Sflowtool-fan-out
• https://github.com/inex/IXP-Manager/wiki/Peering-Matrix
• https://github.com/inex/IXP-Manager/wiki/Peering-Manager

Front end options have been added when adding / editing VLANs to allow you to state whether a given VLAN should be including in the peering matrix page and/or the peering manager. Post upgrade, you need to check these fields for the VLANs you want included.

Schema Change Required

ALTER TABLE vlan 
    ADD peering_matrix TINYINT(1) NOT NULL DEFAULT 0, 
    ADD peering_manager TINYINT(1) NOT NULL DEFAULT 0;

NB: After running the above, edit your VLANs and check peering manager and / or peering matrix as appropriate for VLANs you want included in the peering manager / matrix.

Commits

• [IM] Remove hardcoded INEX VLAN details for peering matrices (16f6411 - Barry O'Donovan - 2014-11-26)
• [IM] Remove hardcoded INEX VLAN details - fixes #178 (87edf85 - Barry O'Donovan - 2014-11-26)
• [NF] Front end glue for new VLAN peering matrix / manager columns (edfefcf - Barry O'Donovan - 2014-11-26)
• [DB] Schema update to VLANs table (5c48610 - Barry O'Donovan - 2014-11-26)
• [BF] Fixes #177 - only one switch per infra was included in EuroIX data output (41cc73c - Barry O'Donovan - 2014-11-25)
• [HK] Remove extraneous files (1518e92 - Barry O'Donovan - 2014-11-24)
• [IM] Reduce cache time pf peering data from 1 day to 1 hour (4db3001 - Barry O'Donovan - 2014-11-24)
• [BF] bugfixes for Daemon::Control (538a306 - Nick Hilliard - 2014-11-23)
• [IM] add script to check for required perl dependencies (f0609e3 - Nick Hilliard - 2014-11-22)
• [IM] wider use of variable names for code which is fundamentally the same (f8f726c - Nick Hilliard - 2014-11-22)
• [BF] use different local variable names and protect with 'my' (daf5406 - Nick Hilliard - 2014-11-22)
• [IM] added peering manager sflow bgp session detector (9942ffa - Nick Hilliard - 2014-11-22)
• [IM] cosmetic fixes for sflow-to-rrd-handler (b8b2035 - Nick Hilliard - 2014-11-22)
• [IM] updated trunks.cfg to reflect topology changes (a39b495 - Nick Hilliard - 2014-11-21)
• HK ORG-INEX1-RIPE -> ORG-INEA1-RIPE (af93c94 - Nick Hilliard - 2014-11-21)
• [IM] compare-route-server-prefixes.pl should do something instead of do_nothing (85bfc98 - Nick Hilliard - 2014-11-18)
• [BF] update route server comparison code to reflect changes in default bird config (8ca7ddc - Nick Hilliard - 2014-11-18)
• [BF] added new-line for prefix comparison tool warnings (5528b5d - Nick Hilliard - 2014-11-18)
• [HK] typos (1644ec3 - Nick Hilliard - 2014-11-17)

Templates Edited

application/modules/apiv1/views/_skins/inex/rir/tmpl/autnum-as2128.tpl
application/views/_skins/inex/statistics-cli/mrtg/trunks.cfg
application/views/peering-manager/index-table.phtml
application/views/peering-matrix/index.phtml
application/views/vlan/add-postamble.phtml

Security Release

IXP Manager v3.6.19 is now available as a security release for all previous versions. We strongly encourage you to update your sites immediately.

This release fixes a possible (already authenticated) user privilege escalation via a stored XSS vulnerability and cookie robbery.

All vulnerabilities were found and responsibly reported by Alexandros Zaharis, Security Officer at GRNET to whom we are very grateful.

IXP Manager v3.6.19 also contains other security changes:

• Reflective XSS vulnerability for non-authenticated users.
• Disabling a user account did not prevent them from logging in.

In addition to the security fixes, there is also a new feature: addition of the euro-ix BCP data export format for IX members as introduced by Elisa Jasinska and Nick Hilliard at RIPE 69 (presentation and video).

---

Views changed since v3.6.16:

application/views/customer/overview-tabs/overview.phtml
application/views/header-css.phtml
application/views/header-js.phtml

Maintenance and bug fix release

Minor improvements including addition of support for HP ProCurve 2824 switches.

Commits

• [NF] Add HP as a vendor (b8d5628 - Barry O'Donovan - 2014-10-21)
• [BF] Make IRRDB form field wider (0c58917 - Barry O'Donovan - 2014-10-21)
• [NF] Update reference to OSS_SNMP (a3c0513 - Barry O'Donovan - 2014-10-21)
• [HK] typo (8a6f5f4 - Nick Hilliard - 2014-10-10)
• [BF] UI tweak for irrdb config (cd29e44 - Nick Hilliard - 2014-09-30)
• [BF] JS Throbber issue - fixes #165 (bb4c11d - Barry O'Donovan - 2014-09-29)
• [BF] Bug introduced regarding uniqueness of monitor index (d43efea - Barry O'Donovan - 2014-09-03)
• [IM] Hide customer details not relevent for associate members (3011e56 - Barry O'Donovan - 2014-08-25)

Templates

The following view files were updated / added:

application/views/customer/overview-tabs/overview.phtml
application/views/header-css.phtml
application/views/header-js.phtml

Maintenance and bug fix release

This release closes a number of issues reported on GitHub.

In particular, something that bites now and again is when a customer or port does not have status NORMAL. This means a lot of auto-conf'd stuff is skipped (MRTG, Nagios, etc.). This release includes commits that will highlight:

• a not normal customer in the overview title
• a not normal customer is the ports overview tab
• a not normal port is the port details (clickable to directly edit)

Commits

• [IM] Enlarge fields - especially chosen dropdowns (209a7b7 - Barry O'Donovan - 2014-08-24)
• [IM] Skip switches with no SNMP password in CLI SNMP poller - closes #145 (d202c38 - Barry O'Donovan - 2014-08-24)
• [IM] Allow IP addresses to be removed from disabled interfaces (c427348 - Barry O'Donovan - 2014-08-24)
• [IM] Enforce unique monitor indexes - closes #156 (9980cfe - Barry O'Donovan - 2014-08-24)
• [BF] Require an infrastructure when adding / editing a VLAN - closes #160 (78735c5 - Barry O'Donovan - 2014-08-24)
• [IM] Show message when some / all of a member's ports have no IRRDB filtering enabled - closes #161 (bd2cf37 - Barry O'Donovan - 2014-08-24)
• [IM] Do not hardcode configuration name - closes #162 (be98af5 - Barry O'Donovan - 2014-08-24)
• [IM] Sort Smokeping by name - closes #163 (0db5163 - Barry O'Donovan - 2014-08-24)
• [NF] Do not set MD5 secret by default as requested in #164 (affcc02 - Barry O'Donovan - 2014-08-24)
• [IM] Better indication of ports not in state normal (41a093b - Barry O'Donovan - 2014-08-24)
• [IM] Better indication of ports not in state normal (85e8115 - Barry O'Donovan - 2014-08-24)
• [IM] Better indication of trafficing customers are not in normal status (1c76492 - Barry O'Donovan - 2014-08-24)

Templates

The following view files were updated / added:

application/views/customer/custtype.phtml
application/views/customer/overview-tabs/ports.phtml
application/views/customer/overview-tabs/ports/physintstatus.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/rs-prefixes/list.phtml
application/views/smokeping-cli/conf/targets.cfg
application/views/virtual-interface/js/add-wizard.js

Per LAG Aggregates

The primary feature of this release is the addition of per LAG aggregate graphs (where as previously we had per port and a single aggregate for all ports).

Following this upgrade, the MRTG configuration file will include these new aggregates by default. If you want to include history in these new aggregates you need to combine the MRTG LOG files of the individual LAG ports. You can do this using this utility and creating a script based on the output of:

bin/ixptool.php -a cli.cli-lag-history-to-from

• [IM] No longer need the warning as we combined past data (46d1eda - Barry O'Donovan - 2014-08-21)
• [NF] Script to merge MRTG logs for the new LAGs feature (bb4f9ed - Barry O'Donovan - 2014-08-21)
• [NF] LAG graphs (20998e7 - Barry O'Donovan - 2014-08-21)
• [NF] Mrtg configuration for per member LAG graphs (e429f0b - Barry O'Donovan - 2014-08-21)
• [IM] Fix #157 - Member list looks a little strange for resellers (3826099 - Barry O'Donovan - 2014-06-26)
• [IM] EuroIX export was meant to be IPv6 and not RS (a10b028 - Barry O'Donovan - 2014-06-11)
• [NF] Euro-IX export of members list (0a90b19 - Barry O'Donovan - 2014-06-10)
• [IM] Better layout for dropdowns (58d0aa0 - Barry O'Donovan - 2014-05-13)
• [BF] added RIPE-NCC-END-MNT to mntners. fixed some typos in generic tpl (ba2d957 - Barry O'Donovan - 2014-05-08)
• [IM] Better error when assigning an existing username to an edited user (4ba8709 - Barry O'Donovan - 2014-05-08)

Views changed since the last release:

application/modules/apiv1/views/_skins/inex/rir/tmpl/autnum-as2128.tpl
application/modules/apiv1/views/_skins/inex/rir/tmpl/autnum-as43760.tpl
application/modules/apiv1/views/rir/tmpl/autnum.tpl
application/views/_skins/inex/nagios-cli/conf/switch-templates.phtml
application/views/_skins/lonap/public/member-details.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/statistics-cli/mrtg/member-lag-port.cfg
application/views/statistics-cli/mrtg/member-port.cfg
application/views/statistics-cli/mrtg/member-ports.cfg
application/views/statistics/member-drilldown.phtml
application/views/statistics/member.phtml