Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prep 4.0.0b0 for a tagged release to pypi (#182) #184

Merged
merged 2 commits into from
May 29, 2024

Conversation

jeffkala
Copy link
Contributor

  • add a more advanced jdiff jpath query to ios for ni interfaces

  • updates for parsing

  • bump version

  • update network importer

  • add platform none check

  • fix formatting

  • add conditional for no platform

  • add conditional for no platform

  • add conditional for no platform

  • add unsupported check

  • add readtimeout

  • add failed task UI logging

  • add junos support to do

  • add logging for failed reason

  • add junos support to do

  • update junos, add json load to linterfaces

  • update junos, add json load to linterfaces

  • update ios to use tojson filter

  • update ios to use tojson filter

  • formatting, update function name and doc strings

  • use j2 sandbox and nb core render function

  • poetry lock and black

  • black

  • fix juniper_junos.yml

  • juniper_junos.yml formatting

  • update ssot network adapter, models and mock data

  • ios NI initial working

  • fix do for junos

  • add csv support wip

  • update csv import feature

  • update csv support

  • update csv support

  • fix dup ip address extraction

  • fix mgmt_interface from list to string

  • update csv support

  • add orm caching method to onboarding adapter

  • update csv support

  • remove print statement

  • send interfaces in ios as json

  • update csv support

  • bump version

  • update NI

  • remove tag filter option

  • remove tag filter

  • decouple nornir play from job to remove enqueue job option

  • clean up via black

  • update csv import logging

  • fix bug in _process_csv_data

  • remove command getter job

  • update NI

  • updates for description and enabled

  • update mock data

  • formatting

  • black

  • pylint

  • update logging message

  • flake8

  • update CSV support

  • update lock file

  • update lock and toml files

  • update logging around existing devies

  • change command mapper formatting and DO for junos

  • fix junos

  • remove prefix_length from OnboardingDeviceModel

  • add data check for fields returned by devices

  • enhance junos mgmt int and mask captures

  • enhance junos mgmt int and mask captures

  • fixes for most jnos

  • rework yaml format and processor formatter

  • fixed nxos serial

  • improve logging and calls to secrets providers

  • update onboarding adapter

  • set defaut platform value to None when loading devices in onboarding adapter

  • yamllint, ruff

  • add more performant lookup to mgmt interface cisco ios

  • bump version, fix bug with DO adapter

  • update DO adapters, models and job

  • bump version

  • formatting changes

  • changed ip address to list

  • fix yamllint, pylint and juniper yaml jpaths

  • updates to NI formatting

  • fix junos mgmt intrface post processor

  • fix junos

  • Update juniper_junos.yml

  • Update juniper_junos.yml

  • update ni add nxos

  • update vlans

  • update NI adapters and models, add untagged vlan model

  • bump

  • linting

  • update lock file

  • updates for multiple devices

  • update mac address conversion

  • add cache for primary ips to NI adapter

  • update sync complete

  • update sync complete

  • update sync complete

  • add sync complete doc string

  • updated interface mapping

  • bump

  • black

  • pylint

  • add error handling

  • bump version

  • black

  • yamlint

  • updates for vrf

  • revamps and cleanups

  • update list conversion

  • more refactors and cleanups

  • fix custom filters development config

  • remove jinja2 fitler registration in favor of native support with decorator

  • linters, formatters, stuff

  • fix platform parsing info

  • fix return indent level

  • fix return indent level

  • add default dict

  • more cleanups remove transform function

  • more refactors and few cleanups

  • add vrf to ssot sync, fix vlan bug, update logging

  • remove unnecessary logging

  • updates for VRF support

  • removed exception for vrf without rd

  • first DO for WLC

  • added 802.1q support for ios

  • fix / add needed info for wlc

  • updates for vlans ios

  • adjust vrf adapter to load an RD of "None" if not present

  • update vrf model

  • update vrf model for NI

  • add schema and some more new filters and cleanups

  • update for handling

  • update

  • vlans add

  • first pass at adding docs for new ssot features

  • more doc adds

  • more doc adds

  • vlans for nxos working

  • linting

  • fix example dict keys

  • remove RD from vrf sync

  • update mock data

  • removed rd from vrf

  • add wlc mapper and support for do

  • update jinja_filters.py, lock and bump version

  • fix link in docs

  • update mkdocs

  • removed extra rd config

  • cleanup

  • Jkala prep beta (Jkala prep beta #174)

  • rename jobs throughout codebase

  • rename jobs throughout docs

  • few more updates to original definition

  • more rename changes with black

  • bump to beta version

  • fix lock file inconsistances

  • initial round of fixes for mapping etc.

  • change use_textfsm key to parser and update interworks phase1

  • change use_textfsm key to parser and update interworks phase2

  • interface mapping comments

  • fix dedup function to work with dict or list of commands

  • fix support of dict or list def of commands

  • use mapping netmiko specifically

  • mock data

  • add platform to NI device filters

  • updates to vlan and vrf

  • update dependencies, pre-merge linting, black

  • update lock

  • update nautobot version in github ci

  • update role filter params

  • fix error messages, add defaults

  • New framework and cleanups. (New framework and cleanups. #178)

  • prototype working first commit

  • fix a few device onboarding issues

  • more updates to framework

  • getting nxos at least working with sync network data

  • finish renames and cleanup of old functions

  • logic based on vlans and vrfs toggle

  • sync net data for arista

  • testing

  • another round of fixes

  • handle main task failures in processor

  • handle main task failures in processor

  • handle main task failures in processor

  • update for wlc wlc_ssh oddities

  • wlc updates and upgrade ntc-templates to master branch

  • temp juniper

  • temp juniper

  • temp juniper

  • add lag and vrf to ios and xe more junos fixes

  • add lag and vrf to ios and xe more junos fixes

  • add new filter

  • fix lags for ios and xe

  • fix lags for ios and xe

  • fix lags for ios and xe

  • fix lags for ios and xe

  • fix logic for dot1q

  • sync ios and xe mappers

  • sync ios and xe mappers

  • more updates

  • more updates

  • working on interface syncs

  • ios and xe fix vrf, lags for xes with and without switchport command

  • junos work

  • junos work

  • junos work

  • junos work

  • junos work

  • junos work

  • junos work

  • junos work

  • junos work

  • more junos fixes

  • junos work

  • junos work

  • fix junos unlimited mtu issue

  • junos fix vrf jpath

  • junos fix vrf jpath and command

  • junos fix vrf jpath and command

  • fix lag parsing to only parent physical interface

  • junos fix vrf jpath and command

  • fix arista lags and vrfs

  • remove prints and add a specific logger for ETL

  • update to beta2

  • linting and formatting cleanups

  • linting and formatting cleanups round 2

  • fix lock file

  • revert change to dockerfile


  • few fixes for parsing issues when result is empty list

  • update lag constants for nxos

  • hide vlans sync option

  • fix vrf for ios and xe

  • add default of empty list

  • wlc fixes

  • wlc fixes

  • more juniper work

  • more juniper work

  • changed job description

  • fix junos ip address

  • fix bug in network data models

  • yamlint, black

  • update version and lock

  • add schema validation

  • clean up logging

  • add date tracking and additional error handling (add date tracking and additional error handling #180)

  • add date tracking to sync

  • update logging and error handling

  • remove unnecessary line

  • black .

  • update lock

  • udpate comment


  • fix commit

  • add unittest v1

  • remove merge conflict additions in processor, bandit cleanups

  • pylint disables and formatting

  • update import exception

  • add debug for ntc-template parsed result

  • clean up processor logging

  • add test for SyncDevicesNetworkAdapter

  • remove mock data file

  • add more test

  • first sync network data test and run formatting

  • update custom field

  • prep 4.0 beta0 release and get all test passing

  • fix sorting on test

  • fix sorting on test

  • add troubleshooting processor and hidden job

  • add hidden job with json loads for none parsers

  • finalize new unittest for sync devices


* add a more advanced jdiff jpath query to ios for ni interfaces

* updates for parsing

* bump version

* update network importer

* add platform none check

* fix formatting

* add conditional for no platform

* add conditional for no platform

* add conditional for no platform

* add unsupported check

* add readtimeout

* add failed task UI logging

* add junos support to do

* add logging for failed reason

* add junos support to do

* update junos, add json load to linterfaces

* update junos, add json load to linterfaces

* update ios to use tojson filter

* update ios to use tojson filter

* formatting, update function name and doc strings

* use j2 sandbox and nb core render function

* poetry lock and black

* black

* fix juniper_junos.yml

* juniper_junos.yml formatting

* update ssot network adapter, models and mock data

* ios NI initial working

* fix do for junos

* add csv support wip

* update csv import feature

* update csv support

* update csv support

* fix dup ip address extraction

* fix mgmt_interface from list to string

* update csv support

* add orm caching method to onboarding adapter

* update csv support

* remove print statement

* send interfaces in ios as json

* update csv support

* bump version

* update NI

* remove tag filter option

* remove tag filter

* decouple nornir play from job to remove enqueue job option

* clean up via black

* update csv import logging

* fix bug in _process_csv_data

* remove command getter job

* update NI

* updates for description and enabled

* update mock data

* formatting

* black

* pylint

* update logging message

* flake8

* update CSV support

* update lock file

* update lock and toml files

* update logging around existing devies

* change command mapper formatting and DO for junos

* fix junos

* remove prefix_length from OnboardingDeviceModel

* add data check for fields returned by devices

* enhance junos mgmt int and mask captures

* enhance junos mgmt int and mask captures

* fixes for most jnos

* rework yaml format and processor formatter

* fixed nxos serial

* improve logging and calls to secrets providers

* update onboarding adapter

* set defaut platform value to None when loading devices in onboarding adapter

* yamllint, ruff

* add more performant lookup to mgmt interface cisco ios

* bump version, fix bug with DO adapter

* update DO adapters, models and job

* bump version

* formatting changes

* changed ip address to list

* fix yamllint, pylint and juniper yaml jpaths

* updates to NI formatting

* fix junos mgmt intrface post processor

* fix junos

* Update juniper_junos.yml

* Update juniper_junos.yml

* update ni add nxos

* update vlans

* update NI adapters and models, add untagged vlan model

* bump

* linting

* update lock file

* updates for multiple devices

* update mac address conversion

* add cache for primary ips to NI adapter

* update sync complete

* update sync complete

* update sync complete

* add sync complete doc string

* updated interface mapping

* bump

* black

* pylint

* add error handling

* bump version

* black

* yamlint

* updates for vrf

* revamps and cleanups

* update list conversion

* more refactors and cleanups

* fix custom filters development config

* remove jinja2 fitler registration in favor of native support with decorator

* linters, formatters, stuff

* fix platform parsing info

* fix return indent level

* fix return indent level

* add default dict

* more cleanups remove transform function

* more refactors and few cleanups

* add vrf to ssot sync, fix vlan bug, update logging

* remove unnecessary logging

* updates for VRF support

* removed exception for vrf without rd

* first DO for WLC

* added 802.1q support for ios

* fix / add needed info for wlc

* updates for vlans ios

* adjust vrf adapter to load an RD of "None" if not present

* update vrf model

* update vrf model for NI

* add schema and some more new filters and cleanups

* update for handling

* update

* vlans add

* first pass at adding docs for new ssot features

* more doc adds

* more doc adds

* vlans for nxos working

* linting

* fix example dict keys

* remove RD from vrf sync

* update mock data

* removed rd from vrf

* add wlc mapper and support for do

* update jinja_filters.py, lock and bump version

* fix link in docs

* update mkdocs

* removed extra rd config

* cleanup

* Jkala prep beta (#174)

* rename jobs throughout codebase

* rename jobs throughout docs

* few more updates to original definition

* more rename changes with black

* bump to beta version

* fix lock file inconsistances

* initial round of fixes for mapping etc.

* change use_textfsm key to parser and update interworks phase1

* change use_textfsm key to parser and update interworks phase2

* interface mapping comments

* fix dedup function to work with dict or list of commands

* fix support of dict or list def of commands

* use mapping netmiko specifically

* mock data

* add platform to NI device filters

* updates to vlan and vrf

* update dependencies, pre-merge linting, black

* update lock

* update nautobot version in github ci

* update role filter params

* fix error messages, add defaults

* New framework and cleanups. (#178)

* prototype working first commit

* fix a few device onboarding issues

* more updates to framework

* getting nxos at least working with sync network data

* finish renames and cleanup of old functions

* logic based on vlans and vrfs toggle

* sync net data for arista

* testing

* another round of fixes

* handle main task failures in processor

* handle main task failures in processor

* handle main task failures in processor

* update for wlc wlc_ssh oddities

* wlc updates and upgrade ntc-templates to master branch

* temp juniper

* temp juniper

* temp juniper

* add lag and vrf to ios and xe more junos fixes

* add lag and vrf to ios and xe more junos fixes

* add new filter

* fix lags for ios and xe

* fix lags for ios and xe

* fix lags for ios and xe

* fix lags for ios and xe

* fix logic for dot1q

* sync ios and xe mappers

* sync ios and xe mappers

* more updates

* more updates

* working on interface syncs

* ios and xe fix vrf, lags for xes with and without switchport command

* junos work

* junos work

* junos work

* junos work

* junos work

* junos work

* junos work

* junos work

* junos work

* more junos fixes

* junos work

* junos work

* fix junos unlimited mtu issue

* junos fix vrf jpath

* junos fix vrf jpath and command

* junos fix vrf jpath and command

* fix lag parsing to only parent physical interface

* junos fix vrf jpath and command

* fix arista lags and vrfs

* remove prints and add a specific logger for ETL

* update to beta2

* linting and formatting cleanups

* linting and formatting cleanups round 2

* fix lock file

* revert change to dockerfile

---------

Co-authored-by: Jeff Kala <jeff.kala@chevron.com>

* few fixes for parsing issues when result is empty list

* update lag constants for nxos

* hide vlans sync option

* fix vrf for ios and xe

* add default of empty list

* wlc fixes

* wlc fixes

* more juniper work

* more juniper work

* changed job description

* fix junos ip address

* fix bug in network data models

* yamlint, black

* update version and lock

* add schema validation

* clean up logging

* add date tracking and additional error handling (#180)

* add date tracking to sync

* update logging and error handling

* remove unnecessary line

* black .

* update lock

* udpate comment

---------

Co-authored-by: David Cates <david.cates@networktocode.com>

* fix commit

* add unittest v1

* remove merge conflict additions in processor, bandit cleanups

* pylint disables and formatting

* update import exception

* add debug for ntc-template parsed result

* clean up processor logging

* add test for SyncDevicesNetworkAdapter

* remove mock data file

* add more test

* first sync network data test and run formatting

* update custom field

* prep 4.0 beta0 release and get all test passing

* fix sorting on test

* fix sorting on test

* add troubleshooting processor and hidden job

* add hidden job with json loads for none parsers

* finalize new unittest for sync devices

---------

Co-authored-by: Susan Hooks <susan.hooks@chevron.com>
Co-authored-by: David Cates <david.cates@networktocode.com>
Co-authored-by: David Cates <57967713+Dav-C@users.noreply.github.com>
Co-authored-by: Jeff Kala <jeff.kala@chevron.com>
@jeffkala jeffkala force-pushed the network-ssot-integration branch from f6c6fde to 2f12a90 Compare May 29, 2024 21:54
@jeffkala jeffkala changed the base branch from network-ssot-integration to develop May 29, 2024 21:55
@jeffkala jeffkala changed the base branch from develop to network-ssot-integration May 29, 2024 21:55
@jeffkala jeffkala merged commit 6b61850 into network-ssot-integration May 29, 2024
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant