Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

*: vrf northbound callbacks #5989

Merged
merged 5 commits into from
Mar 25, 2020
Merged

Conversation

chiragshah6
Copy link
Member

This PR contains northbound callbacks for yang/frr-vrf.yang module.

Add vrf northbound callbacks.

Insert vrf module in daemons init sequence.

{
"frr-vrf:lib": {
"vrf": [
{
"name": "default",
"id": 0,
"active": true
}
]
}
}

Signed-off-by: Chirag Shah chirag@cumulusnetworks.com

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/8222139957b358e964f582e2a8df7c99/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5989_1583975409.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 12, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11096/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 01:37:59,255 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 01:38:00,031 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 01:38:00,200 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 01:38:00,512 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 01:38:02,092 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 01:38:37,862 ERROR: 'router_json_cmp' failed after 25.51 seconds
2020-03-12 01:38:37,874 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 01:38:43,150 ERROR: 'router_json_cmp' failed after 5.09 seconds
2020-03-12 01:38:43,152 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 01:38:58,178 ERROR: 'router_json_cmp' failed after 5.12 seconds
2020-03-12 01:38:58,182 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3357827507, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 01:40:52,118 ERROR: 'router_json_cmp' failed after 102.06 seconds
2020-03-12 01:40:52,127 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 01:41:08,042 ERROR: 'router_json_cmp' failed after 5.11 seconds
2020-03-12 01:41:08,046 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3616686043, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 01:42:14,718 ERROR: '_output_summary_cmp' failed after 38.53 seconds
2020-03-12 01:42:14,727 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 01:43:49,418 ERROR: '_bgp_converge' failed after 19.17 seconds
2020-03-12 01:43:49,422 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 01:44:14,091 ERROR: '_bgp_converge' failed after 19.19 seconds
2020-03-12 01:44:14,096 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11096/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 01:37:59,255 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 01:38:00,031 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 01:38:00,200 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 01:38:00,512 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 01:38:02,092 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 01:38:37,862 ERROR: 'router_json_cmp' failed after 25.51 seconds
2020-03-12 01:38:37,874 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 01:38:43,150 ERROR: 'router_json_cmp' failed after 5.09 seconds
2020-03-12 01:38:43,152 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 01:38:58,178 ERROR: 'router_json_cmp' failed after 5.12 seconds
2020-03-12 01:38:58,182 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3357827507, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 01:40:52,118 ERROR: 'router_json_cmp' failed after 102.06 seconds
2020-03-12 01:40:52,127 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 01:41:08,042 ERROR: 'router_json_cmp' failed after 5.11 seconds
2020-03-12 01:41:08,046 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3616686043, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 01:42:14,718 ERROR: '_output_summary_cmp' failed after 38.53 seconds
2020-03-12 01:42:14,727 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 01:43:49,418 ERROR: '_bgp_converge' failed after 19.17 seconds
2020-03-12 01:43:49,422 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 01:44:14,091 ERROR: '_bgp_converge' failed after 19.19 seconds
2020-03-12 01:44:14,096 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Addresssanitizer topotest: Incomplete (check logs for details)
IPv4 protocols on Ubuntu 14.04: Failed (click for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11096/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 02:37:53,147 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 02:37:53,905 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 02:37:54,069 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 02:37:54,394 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 02:37:56,098 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 02:38:31,665 ERROR: 'router_json_cmp' failed after 25.99 seconds
2020-03-12 02:38:31,667 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-12 02:38:37,098 ERROR: 'router_json_cmp' failed after 5.27 seconds
2020-03-12 02:38:37,100 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 02:38:51,829 ERROR: 'router_json_cmp' failed after 5.10 seconds
2020-03-12 02:38:51,831 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1638046225, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 02:40:45,883 ERROR: 'router_json_cmp' failed after 102.89 seconds
2020-03-12 02:40:45,885 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 02:41:01,616 ERROR: 'router_json_cmp' failed after 5.19 seconds
2020-03-12 02:41:01,617 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2656536245, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 02:42:07,395 ERROR: '_output_summary_cmp' failed after 38.97 seconds
2020-03-12 02:42:07,398 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 02:43:36,615 ERROR: '_bgp_converge' failed after 19.52 seconds
2020-03-12 02:43:36,618 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 02:44:02,518 ERROR: '_bgp_converge' failed after 19.55 seconds
2020-03-12 02:44:02,521 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11096/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 02:38:03,014 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 02:38:03,635 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 02:38:03,782 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 02:38:04,055 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 02:38:05,633 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 02:38:42,109 ERROR: 'router_json_cmp' failed after 26.31 seconds
2020-03-12 02:38:42,111 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-12 02:38:47,582 ERROR: 'router_json_cmp' failed after 5.29 seconds
2020-03-12 02:38:47,583 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 02:39:02,438 ERROR: 'router_json_cmp' failed after 5.18 seconds
2020-03-12 02:39:02,440 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3715362630, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 02:40:58,784 ERROR: 'router_json_cmp' failed after 104.73 seconds
2020-03-12 02:40:58,786 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-12 02:41:14,764 ERROR: 'router_json_cmp' failed after 5.28 seconds
2020-03-12 02:41:14,765 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2735395841, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 02:42:20,552 ERROR: '_output_summary_cmp' failed after 39.51 seconds
2020-03-12 02:42:20,555 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 02:43:50,681 ERROR: '_bgp_converge' failed after 19.47 seconds
2020-03-12 02:43:50,684 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 02:44:15,394 ERROR: '_bgp_converge' failed after 19.43 seconds
2020-03-12 02:44:15,396 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Successful on other platforms/tests
  • Static analyzer (clang)
  • Ubuntu 16.04 deb pkg check
  • Fedora 29 rpm pkg check
  • Ubuntu 12.04 deb pkg check
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check
  • Debian 10 deb pkg check

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 12, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11096/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 04:20:44,342 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 04:20:45,021 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 04:20:45,157 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 04:20:45,415 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 04:20:46,922 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 04:21:22,814 ERROR: 'router_json_cmp' failed after 25.75 seconds
2020-03-12 04:21:22,817 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 04:21:28,075 ERROR: 'router_json_cmp' failed after 5.09 seconds
2020-03-12 04:21:28,076 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 04:21:43,225 ERROR: 'router_json_cmp' failed after 5.14 seconds
2020-03-12 04:21:43,227 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2849774489, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 04:23:36,521 ERROR: 'router_json_cmp' failed after 102.58 seconds
2020-03-12 04:23:36,523 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 04:23:52,107 ERROR: 'router_json_cmp' failed after 5.08 seconds
2020-03-12 04:23:52,109 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1512054733, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 04:24:57,255 ERROR: '_output_summary_cmp' failed after 38.97 seconds
2020-03-12 04:24:57,259 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 04:26:26,417 ERROR: '_bgp_converge' failed after 19.26 seconds
2020-03-12 04:26:26,419 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 04:26:51,026 ERROR: '_bgp_converge' failed after 19.25 seconds
2020-03-12 04:26:51,028 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11096/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 04:20:44,342 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 04:20:45,021 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 04:20:45,157 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 04:20:45,415 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 04:20:46,922 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 04:21:22,814 ERROR: 'router_json_cmp' failed after 25.75 seconds
2020-03-12 04:21:22,817 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 04:21:28,075 ERROR: 'router_json_cmp' failed after 5.09 seconds
2020-03-12 04:21:28,076 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 04:21:43,225 ERROR: 'router_json_cmp' failed after 5.14 seconds
2020-03-12 04:21:43,227 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2849774489, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 04:23:36,521 ERROR: 'router_json_cmp' failed after 102.58 seconds
2020-03-12 04:23:36,523 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 04:23:52,107 ERROR: 'router_json_cmp' failed after 5.08 seconds
2020-03-12 04:23:52,109 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1512054733, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 04:24:57,255 ERROR: '_output_summary_cmp' failed after 38.97 seconds
2020-03-12 04:24:57,259 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 04:26:26,417 ERROR: '_bgp_converge' failed after 19.26 seconds
2020-03-12 04:26:26,419 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 04:26:51,026 ERROR: '_bgp_converge' failed after 19.25 seconds
2020-03-12 04:26:51,028 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Addresssanitizer topotest: Incomplete (check logs for details)
IPv4 protocols on Ubuntu 14.04: Failed (click for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11096/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-11 21:20:16,720 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-11 21:20:17,560 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-11 21:20:17,737 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-11 21:20:18,049 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-11 21:20:20,024 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-11 21:20:55,703 ERROR: 'router_json_cmp' failed after 25.76 seconds
2020-03-11 21:20:55,705 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-11 21:21:01,043 ERROR: 'router_json_cmp' failed after 5.18 seconds
2020-03-11 21:21:01,045 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-11 21:21:15,791 ERROR: 'router_json_cmp' failed after 5.18 seconds
2020-03-11 21:21:15,793 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2241858639, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-11 21:23:11,303 ERROR: 'router_json_cmp' failed after 103.77 seconds
2020-03-11 21:23:11,311 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-11 21:23:27,159 ERROR: 'router_json_cmp' failed after 5.23 seconds
2020-03-11 21:23:27,162 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 282600464, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-11 21:24:33,988 ERROR: '_output_summary_cmp' failed after 39.69 seconds
2020-03-11 21:24:33,998 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-11 21:26:08,927 ERROR: '_bgp_converge' failed after 19.53 seconds
2020-03-11 21:26:08,930 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-11 21:26:35,751 ERROR: '_bgp_converge' failed after 19.57 seconds
2020-03-11 21:26:35,758 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11096/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 05:20:40,586 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 05:20:41,441 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 05:20:41,633 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 05:20:41,917 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 05:20:43,558 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 05:21:19,949 ERROR: 'router_json_cmp' failed after 26.28 seconds
2020-03-12 05:21:19,953 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:29"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-12 05:21:25,447 ERROR: 'router_json_cmp' failed after 5.27 seconds
2020-03-12 05:21:25,449 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 05:21:40,281 ERROR: 'router_json_cmp' failed after 5.27 seconds
2020-03-12 05:21:40,283 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1360395933, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 05:23:36,830 ERROR: 'router_json_cmp' failed after 104.83 seconds
2020-03-12 05:23:36,832 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-12 05:23:52,850 ERROR: 'router_json_cmp' failed after 5.25 seconds
2020-03-12 05:23:52,852 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1512054733, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 05:24:59,200 ERROR: '_output_summary_cmp' failed after 39.62 seconds
2020-03-12 05:24:59,203 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 05:26:30,664 ERROR: '_bgp_converge' failed after 19.68 seconds
2020-03-12 05:26:30,666 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 05:26:55,445 ERROR: '_bgp_converge' failed after 19.50 seconds
2020-03-12 05:26:55,446 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11096/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Successful on other platforms/tests
  • Static analyzer (clang)
  • Ubuntu 16.04 deb pkg check
  • Fedora 29 rpm pkg check
  • Ubuntu 12.04 deb pkg check
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check
  • Debian 10 deb pkg check

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/906976f4a58c5c9640cdfecd00bb3d70/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5989_1584568614.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 19, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11281/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-18 23:25:02,650 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-18 23:25:03,514 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-18 23:25:03,694 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-18 23:25:04,046 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-18 23:25:05,867 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-18 23:25:41,202 ERROR: 'router_json_cmp' failed after 25.45 seconds
2020-03-18 23:25:41,203 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-18 23:25:46,432 ERROR: 'router_json_cmp' failed after 5.08 seconds
2020-03-18 23:25:46,434 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-18 23:26:01,157 ERROR: 'router_json_cmp' failed after 5.11 seconds
2020-03-18 23:26:01,159 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1283616640, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-18 23:27:55,951 ERROR: 'router_json_cmp' failed after 103.51 seconds
2020-03-18 23:27:55,952 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-18 23:28:11,447 ERROR: 'router_json_cmp' failed after 5.05 seconds
2020-03-18 23:28:11,449 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1039198217, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-18 23:29:15,320 ERROR: '_output_summary_cmp' failed after 38.11 seconds
2020-03-18 23:29:15,322 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-18 23:30:44,830 ERROR: '_bgp_converge' failed after 19.65 seconds
2020-03-18 23:30:44,832 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-18 23:31:09,704 ERROR: '_bgp_converge' failed after 19.48 seconds
2020-03-18 23:31:09,705 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11281/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-18 23:25:02,650 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-18 23:25:03,514 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-18 23:25:03,694 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-18 23:25:04,046 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-18 23:25:05,867 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-18 23:25:41,202 ERROR: 'router_json_cmp' failed after 25.45 seconds
2020-03-18 23:25:41,203 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-18 23:25:46,432 ERROR: 'router_json_cmp' failed after 5.08 seconds
2020-03-18 23:25:46,434 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-18 23:26:01,157 ERROR: 'router_json_cmp' failed after 5.11 seconds
2020-03-18 23:26:01,159 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1283616640, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-18 23:27:55,951 ERROR: 'router_json_cmp' failed after 103.51 seconds
2020-03-18 23:27:55,952 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-18 23:28:11,447 ERROR: 'router_json_cmp' failed after 5.05 seconds
2020-03-18 23:28:11,449 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1039198217, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-18 23:29:15,320 ERROR: '_output_summary_cmp' failed after 38.11 seconds
2020-03-18 23:29:15,322 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-18 23:30:44,830 ERROR: '_bgp_converge' failed after 19.65 seconds
2020-03-18 23:30:44,832 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-18 23:31:09,704 ERROR: '_bgp_converge' failed after 19.48 seconds
2020-03-18 23:31:09,705 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Addresssanitizer topotest: Incomplete (check logs for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11281/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-18 23:25:07,540 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-18 23:25:08,189 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-18 23:25:08,332 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-18 23:25:08,601 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-18 23:25:10,350 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-18 23:25:44,728 ERROR: 'router_json_cmp' failed after 24.82 seconds
2020-03-18 23:25:44,730 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-18 23:25:49,826 ERROR: 'router_json_cmp' failed after 4.96 seconds
2020-03-18 23:25:49,827 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-18 23:26:03,975 ERROR: 'router_json_cmp' failed after 5.03 seconds
2020-03-18 23:26:03,977 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3446351164, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-18 23:27:54,744 ERROR: 'router_json_cmp' failed after 100.21 seconds
2020-03-18 23:27:54,746 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-18 23:28:09,810 ERROR: 'router_json_cmp' failed after 4.99 seconds
2020-03-18 23:28:09,812 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 4274978567, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-18 23:29:13,160 ERROR: '_output_summary_cmp' failed after 37.59 seconds
2020-03-18 23:29:13,162 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-18 23:30:41,025 ERROR: '_bgp_converge' failed after 18.99 seconds
2020-03-18 23:30:41,027 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-18 23:31:05,862 ERROR: '_bgp_converge' failed after 19.12 seconds
2020-03-18 23:31:05,863 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)
IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11281/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-18 22:25:05,178 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-18 22:25:05,831 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-18 22:25:05,974 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-18 22:25:06,241 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-18 22:25:07,817 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-18 22:25:42,020 ERROR: 'router_json_cmp' failed after 24.89 seconds
2020-03-18 22:25:42,022 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-18 22:25:47,148 ERROR: 'router_json_cmp' failed after 4.99 seconds
2020-03-18 22:25:47,149 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-18 22:26:01,159 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-18 22:26:01,161 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1283616640, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-18 22:27:51,763 ERROR: 'router_json_cmp' failed after 99.89 seconds
2020-03-18 22:27:51,765 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-18 22:28:06,829 ERROR: 'router_json_cmp' failed after 4.97 seconds
2020-03-18 22:28:06,831 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1462855284, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-18 22:29:10,321 ERROR: '_output_summary_cmp' failed after 37.53 seconds
2020-03-18 22:29:10,323 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-18 22:30:38,293 ERROR: '_bgp_converge' failed after 19.00 seconds
2020-03-18 22:30:38,296 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-18 22:31:02,837 ERROR: '_bgp_converge' failed after 18.82 seconds
2020-03-18 22:31:02,839 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11281/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Successful on other platforms/tests
  • Ubuntu 16.04 deb pkg check
  • Debian 10 deb pkg check
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • Fedora 29 rpm pkg check
  • Debian 9 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/1dcdf9531596f9a5d222c577e2f0352c/raw/5cebc1f1548702045046bdfe22e7bb56fc9bb33b/cr_5989_1584584430.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index 535aa2da5..40f5aedec 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -66,23 +66,18 @@ static const char *yang_module_imp_clb(const char *mod_name,
 		return e->data;
 	}
 
-    /*NOTE: Daemon starts seeing errors for in built yang types.
-     * Commenting out for now. Need to figure out the error reason.
-     */ 
+	/*NOTE: Daemon starts seeing errors for in built yang types.
+	 * Commenting out for now. Need to figure out the error reason.
+	 */
 	/*flog_warn(EC_LIB_YANG_MODULE_LOAD,*/
-    zlog_debug(
-		  "YANG model \"%s@%s\" not embedded, trying external file",
-		  mod_name, mod_rev ? mod_rev : "*");
+	zlog_debug("YANG model \"%s@%s\" not embedded, trying external file",
+		   mod_name, mod_rev ? mod_rev : "*");
 	return NULL;
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 19, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11283/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-19 03:49:19,439 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-19 03:49:20,180 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-19 03:49:20,342 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-19 03:49:20,643 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-19 03:49:22,429 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-19 03:49:57,603 ERROR: 'router_json_cmp' failed after 25.72 seconds
2020-03-19 03:49:57,605 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-19 03:50:02,918 ERROR: 'router_json_cmp' failed after 5.14 seconds
2020-03-19 03:50:02,920 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-19 03:50:17,502 ERROR: 'router_json_cmp' failed after 5.14 seconds
2020-03-19 03:50:17,504 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 677517245, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-19 03:52:10,173 ERROR: 'router_json_cmp' failed after 101.88 seconds
2020-03-19 03:52:10,176 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-19 03:52:25,463 ERROR: 'router_json_cmp' failed after 5.06 seconds
2020-03-19 03:52:25,464 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1708083112, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-19 03:53:29,575 ERROR: '_output_summary_cmp' failed after 38.68 seconds
2020-03-19 03:53:29,578 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-19 03:54:58,430 ERROR: '_bgp_converge' failed after 19.07 seconds
2020-03-19 03:54:58,431 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-19 03:55:24,755 ERROR: '_bgp_converge' failed after 19.08 seconds
2020-03-19 03:55:24,757 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11283/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-19 03:49:19,439 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-19 03:49:20,180 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-19 03:49:20,342 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-19 03:49:20,643 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-19 03:49:22,429 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-19 03:49:57,603 ERROR: 'router_json_cmp' failed after 25.72 seconds
2020-03-19 03:49:57,605 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-19 03:50:02,918 ERROR: 'router_json_cmp' failed after 5.14 seconds
2020-03-19 03:50:02,920 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-19 03:50:17,502 ERROR: 'router_json_cmp' failed after 5.14 seconds
2020-03-19 03:50:17,504 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 677517245, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-19 03:52:10,173 ERROR: 'router_json_cmp' failed after 101.88 seconds
2020-03-19 03:52:10,176 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-19 03:52:25,463 ERROR: 'router_json_cmp' failed after 5.06 seconds
2020-03-19 03:52:25,464 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1708083112, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-19 03:53:29,575 ERROR: '_output_summary_cmp' failed after 38.68 seconds
2020-03-19 03:53:29,578 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-19 03:54:58,430 ERROR: '_bgp_converge' failed after 19.07 seconds
2020-03-19 03:54:58,431 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-19 03:55:24,755 ERROR: '_bgp_converge' failed after 19.08 seconds
2020-03-19 03:55:24,757 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Addresssanitizer topotest: Incomplete (check logs for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11283/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-18 19:49:32,132 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-18 19:49:33,008 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-18 19:49:33,191 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-18 19:49:33,525 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-18 19:49:35,549 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-18 19:50:12,922 ERROR: 'router_json_cmp' failed after 26.46 seconds
2020-03-18 19:50:12,935 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:30"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:31"
2020-03-18 19:50:18,433 ERROR: 'router_json_cmp' failed after 5.29 seconds
2020-03-18 19:50:18,435 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-18 19:50:33,960 ERROR: 'router_json_cmp' failed after 5.24 seconds
2020-03-18 19:50:33,964 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 12, 
  +        "echo-interval": 0, 
  +        "id": 1858145566, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-18 19:52:32,717 ERROR: 'router_json_cmp' failed after 106.11 seconds
2020-03-18 19:52:32,725 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-18 19:52:49,821 ERROR: 'router_json_cmp' failed after 5.36 seconds
2020-03-18 19:52:49,829 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2282187043, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-18 19:53:59,669 ERROR: '_output_summary_cmp' failed after 40.30 seconds
2020-03-18 19:53:59,679 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-18 19:55:39,389 ERROR: '_bgp_converge' failed after 19.95 seconds
2020-03-18 19:55:39,397 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-18 19:56:06,845 ERROR: '_bgp_converge' failed after 20.09 seconds
2020-03-18 19:56:06,853 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11283/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-19 02:49:23,230 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-19 02:49:23,907 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-19 02:49:24,056 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-19 02:49:24,312 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-19 02:49:25,924 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-19 02:50:00,874 ERROR: 'router_json_cmp' failed after 25.15 seconds
2020-03-19 02:50:00,876 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-19 02:50:06,020 ERROR: 'router_json_cmp' failed after 5.01 seconds
2020-03-19 02:50:06,021 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-19 02:50:20,192 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-19 02:50:20,193 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3216670121, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-19 02:52:10,333 ERROR: 'router_json_cmp' failed after 99.44 seconds
2020-03-19 02:52:10,335 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-19 02:52:25,290 ERROR: 'router_json_cmp' failed after 4.93 seconds
2020-03-19 02:52:25,292 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1708083112, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-19 02:53:29,396 ERROR: '_output_summary_cmp' failed after 37.65 seconds
2020-03-19 02:53:29,400 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-19 02:54:57,541 ERROR: '_bgp_converge' failed after 18.67 seconds
2020-03-19 02:54:57,542 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-19 02:55:21,293 ERROR: '_bgp_converge' failed after 18.74 seconds
2020-03-19 02:55:21,294 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11283/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Successful on other platforms/tests
  • Ubuntu 16.04 deb pkg check
  • Debian 10 deb pkg check
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check
  • Fedora 29 rpm pkg check
  • Ubuntu 14.04 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/694f6694b06604c0dc1ae47af337db8c/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5989_1584754602.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

Copy link
Member

@rwestphal rwestphal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good in general, but please see my inline comments (minor nits).

One additional thing is that you need to convert the "[no] vrf NAME" commands into wrappers around the new VRF callbacks.

Regarding the EC_LIB_YANG_MODULE_LOAD warning problem (which you just removed while I was reviewing this =)), I think we might need to embed IETF modules in addition to our native modules to solve that problem.

leaf id {
type uint32 {
range "0..4294967295";
container netns {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The VRF netns can be configured on zebra only, so this container probably belongs to frr-zebra.yang (which should augment /frr-vrf:lib/vrf).

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure will exclude this from here and submit in a new PR.

range "0..4294967295";
container netns {
/* FIXME: libyang support is required */
/* if-feature "netns"; */
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: to be precise, it's the FRR NB that needs some additional work to support YANG features (libyang is fine). For now, not using if-feature shouldn't be a problem (we can reject netns config changes in the appropriate northbound callbacks).

@@ -3,6 +3,10 @@ module frr-vrf {
namespace "http://frrouting.org/yang/vrf";
prefix frr-vrf;

import ietf-yang-types {
prefix yang;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this seems unnecessary?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rwestphal I added this to see if module load errors can be resolved. I will remove it while handling other review comments.

lib/vrf.c Outdated
/* TODO: implement me. */
break;
}
#endif
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please remove (dead code)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ack.

leaf active {
type boolean;
default "false";
config false;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is unnecessary. When not specified, the "config" setting is inherited from the parent node (which is "state" in this case).

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure will remove it.

@chiragshah6
Copy link
Member Author

@rwestphal The CI is failing when it attempts to configure an interface in default vrf. It appears to be interface module complaining of vrf data tree not present. In my latest commit I moved frr_vrf_info to the first to load in zebra daemon init sequence.

Any thoughts on how to solve if the above attempt fails?

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 21, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11358/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 02:01:50,643 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 02:01:51,295 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 02:01:51,438 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 02:01:51,700 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 02:01:53,269 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 02:02:27,938 ERROR: 'router_json_cmp' failed after 24.84 seconds
2020-03-21 02:02:27,940 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 02:02:37,998 ERROR: 'router_json_cmp' failed after 9.92 seconds
2020-03-21 02:02:37,999 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 02:02:52,518 ERROR: 'router_json_cmp' failed after 4.98 seconds
2020-03-21 02:02:52,520 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1547645313, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 02:04:42,830 ERROR: 'router_json_cmp' failed after 99.27 seconds
2020-03-21 02:04:42,832 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-21 02:04:57,854 ERROR: 'router_json_cmp' failed after 4.99 seconds
2020-03-21 02:04:57,856 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 655419294, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 02:06:01,595 ERROR: '_output_summary_cmp' failed after 37.66 seconds
2020-03-21 02:06:01,598 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 02:07:31,672 ERROR: '_bgp_converge' failed after 18.62 seconds
2020-03-21 02:07:31,674 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 02:07:55,547 ERROR: '_bgp_converge' failed after 18.62 seconds
2020-03-21 02:07:55,548 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11358/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 03:01:45,336 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 03:01:46,074 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 03:01:46,234 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 03:01:46,526 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 03:01:48,303 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 03:02:23,727 ERROR: 'router_json_cmp' failed after 25.55 seconds
2020-03-21 03:02:23,729 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 03:02:34,070 ERROR: 'router_json_cmp' failed after 10.18 seconds
2020-03-21 03:02:34,071 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 03:02:48,847 ERROR: 'router_json_cmp' failed after 5.10 seconds
2020-03-21 03:02:48,848 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1869001078, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 03:04:41,779 ERROR: 'router_json_cmp' failed after 101.96 seconds
2020-03-21 03:04:41,780 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-21 03:04:57,097 ERROR: 'router_json_cmp' failed after 5.09 seconds
2020-03-21 03:04:57,098 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3392715842, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 03:06:02,245 ERROR: '_output_summary_cmp' failed after 38.82 seconds
2020-03-21 03:06:02,248 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 03:07:31,635 ERROR: '_bgp_converge' failed after 19.06 seconds
2020-03-21 03:07:31,636 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 03:07:55,990 ERROR: '_bgp_converge' failed after 19.06 seconds
2020-03-21 03:07:55,991 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11358/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 02:01:50,643 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 02:01:51,295 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 02:01:51,438 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 02:01:51,700 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 02:01:53,269 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 02:02:27,938 ERROR: 'router_json_cmp' failed after 24.84 seconds
2020-03-21 02:02:27,940 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 02:02:37,998 ERROR: 'router_json_cmp' failed after 9.92 seconds
2020-03-21 02:02:37,999 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 02:02:52,518 ERROR: 'router_json_cmp' failed after 4.98 seconds
2020-03-21 02:02:52,520 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1547645313, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 02:04:42,830 ERROR: 'router_json_cmp' failed after 99.27 seconds
2020-03-21 02:04:42,832 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-21 02:04:57,854 ERROR: 'router_json_cmp' failed after 4.99 seconds
2020-03-21 02:04:57,856 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 655419294, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 02:06:01,595 ERROR: '_output_summary_cmp' failed after 37.66 seconds
2020-03-21 02:06:01,598 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 02:07:31,672 ERROR: '_bgp_converge' failed after 18.62 seconds
2020-03-21 02:07:31,674 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 02:07:55,547 ERROR: '_bgp_converge' failed after 18.62 seconds
2020-03-21 02:07:55,548 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11358/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 03:01:45,336 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 03:01:46,074 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 03:01:46,234 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 03:01:46,526 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 03:01:48,303 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 03:02:23,727 ERROR: 'router_json_cmp' failed after 25.55 seconds
2020-03-21 03:02:23,729 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 03:02:34,070 ERROR: 'router_json_cmp' failed after 10.18 seconds
2020-03-21 03:02:34,071 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 03:02:48,847 ERROR: 'router_json_cmp' failed after 5.10 seconds
2020-03-21 03:02:48,848 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1869001078, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 03:04:41,779 ERROR: 'router_json_cmp' failed after 101.96 seconds
2020-03-21 03:04:41,780 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-21 03:04:57,097 ERROR: 'router_json_cmp' failed after 5.09 seconds
2020-03-21 03:04:57,098 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 3392715842, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 03:06:02,245 ERROR: '_output_summary_cmp' failed after 38.82 seconds
2020-03-21 03:06:02,248 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 03:07:31,635 ERROR: '_bgp_converge' failed after 19.06 seconds
2020-03-21 03:07:31,636 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 03:07:55,990 ERROR: '_bgp_converge' failed after 19.06 seconds
2020-03-21 03:07:55,991 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/TOPOI386/ErrorLog/log_topotests.txt

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Addresssanitizer topotest: Incomplete (check logs for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11358/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 03:01:51,406 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 03:01:52,078 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 03:01:52,224 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 03:01:52,498 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 03:01:54,209 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 03:02:28,473 ERROR: 'router_json_cmp' failed after 25.00 seconds
2020-03-21 03:02:28,475 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 03:02:38,562 ERROR: 'router_json_cmp' failed after 9.94 seconds
2020-03-21 03:02:38,563 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 03:02:52,596 ERROR: 'router_json_cmp' failed after 4.96 seconds
2020-03-21 03:02:52,598 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1547645313, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 03:04:42,738 ERROR: 'router_json_cmp' failed after 99.67 seconds
2020-03-21 03:04:42,740 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-21 03:04:57,626 ERROR: 'router_json_cmp' failed after 4.98 seconds
2020-03-21 03:04:57,628 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1185352205, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 03:06:01,575 ERROR: '_output_summary_cmp' failed after 37.76 seconds
2020-03-21 03:06:01,579 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 03:07:29,733 ERROR: '_bgp_converge' failed after 18.73 seconds
2020-03-21 03:07:29,734 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 03:07:53,379 ERROR: '_bgp_converge' failed after 18.68 seconds
2020-03-21 03:07:53,381 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11358/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Successful on other platforms/tests
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • Fedora 29 rpm pkg check
  • Ubuntu 16.04 deb pkg check
  • Debian 10 deb pkg check
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check
  • Ubuntu 14.04 deb pkg check

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/299178138e73f6af01f707cf72bb83ca/raw/75535febfa1b57046688ad6001f2470c7a4a463f/cr_5989_1584769277.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index caf0668ad..40f5aedec 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -76,12 +76,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>
@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 21, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11359/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 06:09:00,878 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 06:09:01,538 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 06:09:01,683 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 06:09:01,947 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 06:09:03,511 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 06:09:38,213 ERROR: 'router_json_cmp' failed after 24.86 seconds
2020-03-21 06:09:38,215 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-21 06:09:48,388 ERROR: 'router_json_cmp' failed after 10.03 seconds
2020-03-21 06:09:48,389 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 06:10:02,590 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-21 06:10:02,592 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2729264821, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 06:11:52,325 ERROR: 'router_json_cmp' failed after 99.16 seconds
2020-03-21 06:11:52,327 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-21 06:12:07,502 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-21 06:12:07,504 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2496951956, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 06:13:11,724 ERROR: '_output_summary_cmp' failed after 37.49 seconds
2020-03-21 06:13:11,726 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 06:14:39,835 ERROR: '_bgp_converge' failed after 18.73 seconds
2020-03-21 06:14:39,836 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 06:15:03,494 ERROR: '_bgp_converge' failed after 18.64 seconds
2020-03-21 06:15:03,496 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11359/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 07:08:56,248 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 07:08:56,989 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 07:08:57,148 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 07:08:57,452 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 07:08:59,232 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 07:09:34,604 ERROR: 'router_json_cmp' failed after 25.62 seconds
2020-03-21 07:09:34,606 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 07:09:44,989 ERROR: 'router_json_cmp' failed after 10.20 seconds
2020-03-21 07:09:44,990 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 07:09:59,913 ERROR: 'router_json_cmp' failed after 5.13 seconds
2020-03-21 07:09:59,914 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1810194055, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 07:11:54,192 ERROR: 'router_json_cmp' failed after 102.47 seconds
2020-03-21 07:11:54,194 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-21 07:12:09,568 ERROR: 'router_json_cmp' failed after 5.10 seconds
2020-03-21 07:12:09,570 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2542068444, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 07:13:14,154 ERROR: '_output_summary_cmp' failed after 38.59 seconds
2020-03-21 07:13:14,156 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 07:14:44,253 ERROR: '_bgp_converge' failed after 19.18 seconds
2020-03-21 07:14:44,254 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 07:15:09,057 ERROR: '_bgp_converge' failed after 19.39 seconds
2020-03-21 07:15:09,058 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/TOPOI386/ErrorLog/log_topotests.txt

IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11359/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 06:09:00,878 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 06:09:01,538 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 06:09:01,683 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 06:09:01,947 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 06:09:03,511 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 06:09:38,213 ERROR: 'router_json_cmp' failed after 24.86 seconds
2020-03-21 06:09:38,215 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-21 06:09:48,388 ERROR: 'router_json_cmp' failed after 10.03 seconds
2020-03-21 06:09:48,389 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 06:10:02,590 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-21 06:10:02,592 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2729264821, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 06:11:52,325 ERROR: 'router_json_cmp' failed after 99.16 seconds
2020-03-21 06:11:52,327 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-21 06:12:07,502 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-21 06:12:07,504 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2496951956, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 06:13:11,724 ERROR: '_output_summary_cmp' failed after 37.49 seconds
2020-03-21 06:13:11,726 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 06:14:39,835 ERROR: '_bgp_converge' failed after 18.73 seconds
2020-03-21 06:14:39,836 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 06:15:03,494 ERROR: '_bgp_converge' failed after 18.64 seconds
2020-03-21 06:15:03,496 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11359/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 07:08:56,248 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 07:08:56,989 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 07:08:57,148 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 07:08:57,452 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 07:08:59,232 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 07:09:34,604 ERROR: 'router_json_cmp' failed after 25.62 seconds
2020-03-21 07:09:34,606 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-21 07:09:44,989 ERROR: 'router_json_cmp' failed after 10.20 seconds
2020-03-21 07:09:44,990 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 07:09:59,913 ERROR: 'router_json_cmp' failed after 5.13 seconds
2020-03-21 07:09:59,914 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1810194055, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 07:11:54,192 ERROR: 'router_json_cmp' failed after 102.47 seconds
2020-03-21 07:11:54,194 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-21 07:12:09,568 ERROR: 'router_json_cmp' failed after 5.10 seconds
2020-03-21 07:12:09,570 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2542068444, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 07:13:14,154 ERROR: '_output_summary_cmp' failed after 38.59 seconds
2020-03-21 07:13:14,156 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 07:14:44,253 ERROR: '_bgp_converge' failed after 19.18 seconds
2020-03-21 07:14:44,254 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 07:15:09,057 ERROR: '_bgp_converge' failed after 19.39 seconds
2020-03-21 07:15:09,058 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/TOPOI386/ErrorLog/log_topotests.txt

IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Addresssanitizer topotest: Incomplete (check logs for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11359/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-21 07:08:59,304 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-21 07:08:59,989 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-21 07:09:00,139 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-21 07:09:00,415 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-21 07:09:02,161 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-21 07:09:36,505 ERROR: 'router_json_cmp' failed after 24.89 seconds
2020-03-21 07:09:36,507 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-21 07:09:46,628 ERROR: 'router_json_cmp' failed after 9.96 seconds
2020-03-21 07:09:46,629 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-21 07:10:00,957 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-21 07:10:00,958 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3114547421, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-21 07:11:51,669 ERROR: 'router_json_cmp' failed after 99.58 seconds
2020-03-21 07:11:51,672 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-21 07:12:06,514 ERROR: 'router_json_cmp' failed after 4.96 seconds
2020-03-21 07:12:06,516 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3114482949, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-21 07:13:10,451 ERROR: '_output_summary_cmp' failed after 37.61 seconds
2020-03-21 07:13:10,453 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-21 07:14:39,780 ERROR: '_bgp_converge' failed after 18.81 seconds
2020-03-21 07:14:39,782 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-21 07:15:03,699 ERROR: '_bgp_converge' failed after 18.73 seconds
2020-03-21 07:15:03,701 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11359/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)
Successful on other platforms/tests
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • Fedora 29 rpm pkg check
  • Ubuntu 16.04 deb pkg check
  • Ubuntu 14.04 deb pkg check
  • Debian 10 deb pkg check
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/596f506ed66592b1fb3a99558a3ec68d/raw/75535febfa1b57046688ad6001f2470c7a4a463f/cr_5989_1584834840.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index caf0668ad..40f5aedec 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -76,12 +76,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

@chiragshah6
Copy link
Member Author

chiragshah6 commented Mar 22, 2020

@rwestphal vrf VRFNAME command is seeing module is not present error. frr-vrf module is initialized/registered at appropriate places that I know of.
Any idea about the error?

% Failed to edit configuration.

Module not found or not implemented.
YANG path: /frr-vrf

2020/03/21 16:48:55 ZEBRA: [EC 100663337] nb_candidate_commit_prepare: failed to validate candidate configuration
2020/03/21 17:22:30 STATIC: libyang: Module not found or not implemented. (/frr-vrf)
2020/03/21 17:22:30 STATIC: [EC 100663322] nb_cli_apply_changes: unknown data path: /frr-vrf:lib/vrf[name='vrf-red'

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 22, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11367/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Addresssanitizer topotest: Incomplete (check logs for details)
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11367/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Successful on other platforms/tests
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • Topology tests on Ubuntu 16.04 amd64
  • IPv4 protocols on Ubuntu 14.04
  • Debian 9 deb pkg check
  • Topotest tests on Ubuntu 16.04 i386
  • Static analyzer (clang)
  • Topology tests on Ubuntu 18.04 amd64
  • Debian 10 deb pkg check
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Fedora 29 rpm pkg check

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 22, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11367/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11367/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Successful on other platforms/tests
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check
  • Topology tests on Ubuntu 16.04 amd64
  • IPv4 protocols on Ubuntu 14.04
  • Debian 9 deb pkg check
  • Topotest tests on Ubuntu 16.04 i386
  • Static analyzer (clang)
  • Topology tests on Ubuntu 18.04 amd64
  • Debian 10 deb pkg check
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Fedora 29 rpm pkg check

Warnings Generated during build:

Checkout code: Successful with additional warnings
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11367/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
<stdin>:332: trailing whitespace.
        /* yang version 0.16 having issue accessing leafref. */ 
<stdin>:208: new blank line at EOF.
+
warning: 2 lines add whitespace errors.
Report for vrf.c | 2 issues
===============================================
< WARNING: braces {} are not necessary for any arm of this statement
< #1071: FILE: /tmp/f1-28715/vrf.c:1071:

@rwestphal
Copy link
Member

@rwestphal vrf VRFNAME command is seeing module is not present error. frr-vrf module is initialized/registered at appropriate places that I know of.
Any idea about the error?

% Failed to edit configuration.

Module not found or not implemented.
YANG path: /frr-vrf

2020/03/21 16:48:55 ZEBRA: [EC 100663337] nb_candidate_commit_prepare: failed to validate candidate configuration
2020/03/21 17:22:30 STATIC: libyang: Module not found or not implemented. (/frr-vrf)
2020/03/21 17:22:30 STATIC: [EC 100663322] nb_cli_apply_changes: unknown data path: /frr-vrf:lib/vrf[name='vrf-red'

This is probably because you're not loading the frr-vrf module in some daemons, especially staticd (which implements the "vrf" command).

length "1..16";
}
/* yang version 0.16 having issue accessing leafref. */
/* type frr-vrf:vrf-ref;*/
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This commit shouldn't be necessary if all daemons implement "frr-vrf" (as they should).

Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/f30e3b09d969ae2137039906442f166a/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5989_1584983098.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>
@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 23, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11386/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11386/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-23 17:31:40,007 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-23 17:31:40,658 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-23 17:31:40,798 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-23 17:31:41,056 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-23 17:31:42,631 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-23 17:32:17,175 ERROR: 'router_json_cmp' failed after 24.85 seconds
2020-03-23 17:32:17,178 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:26"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-23 17:32:27,313 ERROR: 'router_json_cmp' failed after 9.98 seconds
2020-03-23 17:32:27,314 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-23 17:32:41,783 ERROR: 'router_json_cmp' failed after 4.94 seconds
2020-03-23 17:32:41,785 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2638615800, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-23 17:34:32,427 ERROR: 'router_json_cmp' failed after 99.30 seconds
2020-03-23 17:34:32,429 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-23 17:34:47,406 ERROR: 'router_json_cmp' failed after 4.94 seconds
2020-03-23 17:34:47,408 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3982690498, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-23 17:35:52,033 ERROR: '_output_summary_cmp' failed after 37.53 seconds
2020-03-23 17:35:52,035 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-23 17:37:21,447 ERROR: '_bgp_converge' failed after 18.56 seconds
2020-03-23 17:37:21,449 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-23 17:37:45,293 ERROR: '_bgp_converge' failed after 18.58 seconds
2020-03-23 17:37:45,295 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11386/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11386/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-23 17:31:40,007 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-23 17:31:40,658 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-23 17:31:40,798 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-23 17:31:41,056 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-23 17:31:42,631 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-23 17:32:17,175 ERROR: 'router_json_cmp' failed after 24.85 seconds
2020-03-23 17:32:17,178 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:26"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:28"
2020-03-23 17:32:27,313 ERROR: 'router_json_cmp' failed after 9.98 seconds
2020-03-23 17:32:27,314 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-23 17:32:41,783 ERROR: 'router_json_cmp' failed after 4.94 seconds
2020-03-23 17:32:41,785 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2638615800, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-23 17:34:32,427 ERROR: 'router_json_cmp' failed after 99.30 seconds
2020-03-23 17:34:32,429 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-23 17:34:47,406 ERROR: 'router_json_cmp' failed after 4.94 seconds
2020-03-23 17:34:47,408 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3982690498, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-23 17:35:52,033 ERROR: '_output_summary_cmp' failed after 37.53 seconds
2020-03-23 17:35:52,035 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-23 17:37:21,447 ERROR: '_bgp_converge' failed after 18.56 seconds
2020-03-23 17:37:21,449 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-23 17:37:45,293 ERROR: '_bgp_converge' failed after 18.58 seconds
2020-03-23 17:37:45,295 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11386/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)
IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)
Addresssanitizer topotest: Incomplete (check logs for details)
Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11386/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-23 18:31:38,438 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-23 18:31:39,131 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-23 18:31:39,277 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-23 18:31:39,549 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-23 18:31:41,282 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-23 18:32:15,894 ERROR: 'router_json_cmp' failed after 25.11 seconds
2020-03-23 18:32:15,896 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-23 18:32:25,966 ERROR: 'router_json_cmp' failed after 9.91 seconds
2020-03-23 18:32:25,967 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-23 18:32:40,347 ERROR: 'router_json_cmp' failed after 5.02 seconds
2020-03-23 18:32:40,348 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1674087753, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-23 18:34:30,876 ERROR: 'router_json_cmp' failed after 99.75 seconds
2020-03-23 18:34:30,878 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-23 18:34:45,984 ERROR: 'router_json_cmp' failed after 4.99 seconds
2020-03-23 18:34:45,985 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 1417181824, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-23 18:35:49,647 ERROR: '_output_summary_cmp' failed after 37.72 seconds
2020-03-23 18:35:49,649 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-23 18:37:34,834 ERROR: '_bgp_converge' failed after 18.63 seconds
2020-03-23 18:37:34,836 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-23 18:37:58,466 ERROR: '_bgp_converge' failed after 18.68 seconds
2020-03-23 18:37:58,468 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11386/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11386/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11386/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-23 18:31:35,771 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-23 18:31:36,505 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-23 18:31:36,665 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-23 18:31:36,965 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-23 18:31:38,773 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-23 18:32:14,741 ERROR: 'router_json_cmp' failed after 25.70 seconds
2020-03-23 18:32:14,743 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-23 18:32:25,246 ERROR: 'router_json_cmp' failed after 10.31 seconds
2020-03-23 18:32:25,247 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-23 18:32:40,843 ERROR: 'router_json_cmp' failed after 5.16 seconds
2020-03-23 18:32:40,845 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 1674087753, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-23 18:34:35,811 ERROR: 'router_json_cmp' failed after 102.38 seconds
2020-03-23 18:34:35,812 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-23 18:34:51,837 ERROR: 'router_json_cmp' failed after 5.10 seconds
2020-03-23 18:34:51,838 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3783979718, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-23 18:35:56,925 ERROR: '_output_summary_cmp' failed after 38.66 seconds
2020-03-23 18:35:56,928 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-23 18:37:28,316 ERROR: '_bgp_converge' failed after 19.11 seconds
2020-03-23 18:37:28,317 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-23 18:37:53,083 ERROR: '_bgp_converge' failed after 19.10 seconds
2020-03-23 18:37:53,085 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11386/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms/tests
  • Static analyzer (clang)
  • Ubuntu 16.04 deb pkg check
  • Fedora 29 rpm pkg check
  • Ubuntu 12.04 deb pkg check
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • Debian 9 deb pkg check
  • Debian 10 deb pkg check

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>
Unable to access interface command:
root@bharat:~/stash/libyang/build# dpkg-query -W | grep libyang
libyang-dev	0.16.105-3~ubuntu18.04.1
libyang0.16	0.16.105-3~ubuntu18.04.1
root@bharat:~/stash/libyang/build# vtysh
bharat# config t
bharat(config)# interface lo
% Configuration failed: validation error.

Please check the logs for more details.

Logfile:
2020/03/21 16:48:55 ZEBRA: libyang: Leafref
"/frr-vrf:lib/frr-vrf:vrf/frr-vrf:name" of value "default"
points to a non-existing leaf.
(/frr-interface:lib/interface[name='lo'][vrf='default']/vrf)
2020/03/21 16:48:55 ZEBRA: [EC 100663337]
nb_candidate_commit_prepare: failed to validate
candidate configuration

CI system failure:
2020/03/21 18:53:18 ZEBRA: libyang: Leafref
"/frr-vrf:lib/frr-vrf:vrf/frr-vrf:name" of value "default"
points to a non-existing leaf.
(/frr-interface:lib/interface[name='r1-eth0'][vrf='default']/vrf)
2020/03/21 18:53:18 ZEBRA: [EC 100663337] nb_candidate_commit_prepare:
failed to validate candidate configuration
2020/03/21 18:53:18 ZEBRA: libyang: Leafref
"/frr-vrf:lib/frr-vrf:vrf/frr-vrf:name" of value "default"
points to a non-existing leaf.
(/frr-interface:lib/interface[name='r1-eth1'][vrf='default']/vrf)

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>
Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/783e660cc21916bdc79ca401c0f18cd9/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5989_1585002522.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 24, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Successful on other platforms/tests
  • Fedora 29 rpm pkg check
  • Debian 9 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • Ubuntu 16.04 deb pkg check
  • Topology tests on Ubuntu 18.04 amd64
  • IPv6 protocols on Ubuntu 14.04
  • Topotest tests on Ubuntu 16.04 i386
  • Debian 10 deb pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Addresssanitizer topotest
  • Debian 8 deb pkg check
  • IPv4 protocols on Ubuntu 14.04
  • Topology tests on Ubuntu 16.04 amd64

Warnings Generated during build:

Checkout code: Successful with additional warnings
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
<stdin>:426: trailing whitespace.
        /* yang version 0.16 having issue accessing leafref. */ 
<stdin>:304: new blank line at EOF.
+
warning: 2 lines add whitespace errors.
Report for vrf.c | 2 issues
===============================================
< WARNING: braces {} are not necessary for any arm of this statement
< #1086: FILE: /tmp/f1-11095/vrf.c:1086:

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: pkg-js-tools-test-is-missing
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 24, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
Successful on other platforms/tests
  • Fedora 29 rpm pkg check
  • Debian 9 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • Ubuntu 16.04 deb pkg check
  • Topology tests on Ubuntu 18.04 amd64
  • IPv6 protocols on Ubuntu 14.04
  • Topotest tests on Ubuntu 16.04 i386
  • Debian 10 deb pkg check
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • IPv4 protocols on Ubuntu 14.04
  • Topology tests on Ubuntu 16.04 amd64

Warnings Generated during build:

Checkout code: Successful with additional warnings
CentOS 7 rpm pkg check: Failed (click for details) CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found
<stdin>:426: trailing whitespace.
        /* yang version 0.16 having issue accessing leafref. */ 
<stdin>:304: new blank line at EOF.
+
warning: 2 lines add whitespace errors.
Report for vrf.c | 2 issues
===============================================
< WARNING: braces {} are not necessary for any arm of this statement
< #1086: FILE: /tmp/f1-11095/vrf.c:1086:

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11392/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: pkg-js-tools-test-is-missing
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200323-02-g93624af97-0 (missing) -> 7.4-dev-20200323-02-g93624af97-0~deb10u1

gcc 4 variable size array is not calcualated properely

As an example, on Centos 7, yang module fails to load
upon daemon start.

Signed-off-by: chirag shah <chirag@cumulusnetworks.com>
Copy link

@polychaeta polychaeta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/3bed8e5136b45a8d9e0af63b150bb0c7/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5989_1585082951.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Mar 24, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11425/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

Topology tests on Ubuntu 18.04 amd64: Incomplete (check logs for details)
Successful on other platforms/tests
  • Fedora 29 rpm pkg check
  • IPv4 protocols on Ubuntu 14.04
  • Debian 9 deb pkg check
  • Ubuntu 12.04 deb pkg check
  • Static analyzer (clang)
  • IPv6 protocols on Ubuntu 14.04
  • Ubuntu 16.04 deb pkg check
  • Topotest tests on Ubuntu 16.04 i386
  • Addresssanitizer topotests part 1
  • Debian 10 deb pkg check
  • CentOS 7 rpm pkg check
  • Addresssanitizer topotests part 3
  • IPv4 ldp protocol on Ubuntu 16.04
  • Ubuntu 14.04 deb pkg check
  • Debian 8 deb pkg check
  • Addresssanitizer topotests part 2
  • Topology tests on Ubuntu 16.04 amd64

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11425/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings
<stdin>:442: trailing whitespace.
        /* yang version 0.16 having issue accessing leafref. */ 
<stdin>:320: new blank line at EOF.
+
warning: 2 lines add whitespace errors.
Report for vrf.c | 2 issues
===============================================
< WARNING: braces {} are not necessary for any arm of this statement
< #1086: FILE: /tmp/f1-20403/vrf.c:1086:

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11425/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: pkg-js-tools-test-is-missing
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200324-00-g2209fc583-0 (missing) -> 7.4-dev-20200324-00-g2209fc583-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200324-00-g2209fc583-0 (missing) -> 7.4-dev-20200324-00-g2209fc583-0~deb10u1
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200324-00-g2209fc583-0 (missing) -> 7.4-dev-20200324-00-g2209fc583-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200324-00-g2209fc583-0 (missing) -> 7.4-dev-20200324-00-g2209fc583-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.4-dev-20200324-00-g2209fc583-0 (missing) -> 7.4-dev-20200324-00-g2209fc583-0~deb10u1

Copy link
Member

@rwestphal rwestphal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates @chiragshah6! Merging...

@rwestphal rwestphal merged commit 2ee1136 into FRRouting:nb_conversions Mar 25, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants