Class Based Forwarding HLD #796

abanu-ms · 2021-06-08T13:45:41Z

This is the spec for the Class Based Forwarding feature.

Code PRs:
swss-common: sonic-net/sonic-swss-common#525
sairedis: sonic-net/sonic-sairedis#909
swss: sonic-net/sonic-swss#1963
buildimage: sonic-net/sonic-buildimage#8689
utilites: sonic-net/sonic-utilities#1799

anshuv-mfst · 2021-08-03T18:26:45Z

hi @ashutosh-agrawal - please review the feature, thanks.

venkatmahalingam · 2021-08-03T19:24:23Z

doc/cbf/cbf_hld.md

+ ;Status: Mandatory
+ key = CLASS_BASED_NEXT_HOP_GROUP_TABLE:string ; arbitrary string identifying the class based next hop group, as determined by the programming application.
+ members = NEXT_HOP_GROUP_TABLE.key, ; one or more indexes within NEXT_HOP_GROUP_TABLE, separated by “,”
+ class_map = number:number, ; one or more mapping from Forwarding Class to index in "members" field to use as NHG, separated by ","


Why can't we have DSCP/EXP to NH mapping configs and use the same in a ROUTE_TABLE from App and then use a config-DB-based mapping for DSCP/EXP to FC before programming the HW? This way, App need not be aware of internal FC mapping.

That would limit flexibility in a couple of ways, so I think the current proposal is better in general.

There is SAI support for setting the FC via ACL rules as well. We're not adding support for that to SONiC at this time, but shouldn't prevent it by making this map go all the way from DSCP/EXP to NH in one go

The DSCP/EXP to FC maps can potentially be configured per-port, which also wouldn't work with this proposed map.

doc/cbf/cbf_hld.md

venkatmahalingam · 2021-08-03T19:31:28Z

doc/cbf/cbf_hld.md

+ ;Status: Mandatory
+ key = DSCP_TO_FC_MAP_TABLE:string ; arbitrary string identifying the name of the map.
+ dscp_value = 1*DIGIT
+ fc_value = 1*DIGIT


Please add SONiC YANG changes for config-DB tables.

Could you please point me to the YANG for DSCP_TO_TC_MAP_TABLE to have an example? I'm not sure where to look for it.

TACappleman · 2021-08-16T09:09:02Z

Hi @venkatmahalingam thanks for the feedback so far. We've got a few queries on some of these - could you have a look at them this week please?

kperumalbfn · 2021-08-20T22:00:10Z

doc/cbf/cbf_hld.md

+```
+This feature enables opeartors, among other things, to send the important (foreground) traffic through the shortest path, while sending the background traffic through longer paths to still give it some bandwidth instead of using QoS queues which may block background traffic from getting bandwitdh.
+
+These new class based next hop groups are allowed thanks to the changes in https://github.com/opencomputeproject/SAI/pull/1193, which allow a next hop group object to also have other next hop group objects as members of the group along with the next hop objects. The way such a next hop group works is that a packet which has a Forwarding Class value of X will be matched against an appropriate member of this group, selected based on the Forwarding Class value thanks to the "class_map" property of the group. As an example, given the CBF group with members Nhg1, Nhg2 and Nhg3 and a class map of FC 0 -> Nhg1, FC 1 -> Nhg2 and FC 3 -> Nhg3, a packet which has an FC value of 0 will be forwarded using Nhg1. Note that multiple FC values can point to the same member, but a single FC value can't be mapped to more than one member.


Any plan to update FC via ACL using SAI attribute SAI_ACL_ENTRY_ATTR_ACTION_SET_FORWARDING_CLASS? If so, please update the HLD.

We're not going to offer this kind of support for now.

kperumalbfn · 2021-08-20T23:05:24Z

doc/cbf/cbf_hld.md

+ nexthop = *prefix, ;IP addresses separated “,” (empty indicates no gateway)
+ ifname = *PORT_TABLE.key, ; zero or more separated by “,” (zero indicates no interface)
+ blackhole = BIT ; Set to 1 if this route is a blackhole (or null0)
+ nexthop_group = NEXT_HOP_GROUP_TABLE.key or CLASS_BASED_NEXT_HOP_GROUP_TABLE.key ; index within the NEXT_HOP_GROUP_TABLE or CLASS_BASED_NEXT_HOP_GROUP_TABLE, optionally used instead of nexthop and intf fields


@TACappleman Could you also add the changes to Sonic orchagent(if any) when some or all members of CBF NHG in ROUTE_TABLE are not resolved?

If a ROUTE_TABLE entry references a CBF NHG which hasn't been added yet by the user application, the behavior is the same as for a normal NHG - the route entry will remain in the Consumer's queue for the event of the NHG being created at some point which will allow the route entry to be created.

If a ROUTE_TABLE entry references a CBF NHG which has been added by the user application, but doesn't exist in the ASIC_DB (because the NH objects weren't created yet in the ASIC_DB perhaps), the same thing as in the first case will happen. RouteOrch will keep the entry in the queue, trying to create it. Beyond that, the CBF NHG handler will also keep trying to create the CBF NHG. This behavior is covered by the following statement from the HLD:
otherwise the task will be kept in the process queue for the event of the missing member(s) being created which would allow the class based next hop group to be created.

kperumalbfn · 2021-08-20T23:08:56Z

doc/cbf/cbf_hld.md

+- If a packet is not matched against an FC value and the route for its destination references a CBF NHG, the packet will be dropped
+- If a packet is matched against an FC value and the route for its destination does not reference a CBF NHG, the packet will use the route's NH
+- If a packet is matched against an FC value and the route for its destination references a CBF NHG which maps the packet's FC value, the packet will use the mapped NHG
+- If a packet is matched against an FC value and the route for its destination references a CBF NHG which doesn't map the packet's FC value, the packet will be dropped


Any CBF specific drop reason for the above drop cases?

Both drop cases have the reasoning that a CBF NHG needs to forward a packet based on its FC value. If that FC value doesn't exist or the FC value isn't mapped by the CBF NHG to a specific NH, we can't make any assumptions on which NH we should choose. The user user application should make sure to provide a correct mapping for each CBF NHG and to have the correct CBF maps configured.

doc/cbf/cbf_hld.md

TACappleman · 2021-11-03T15:39:27Z

@zhangyanzhao can this be merged?

zhangyanzhao · 2021-11-06T17:50:09Z

@TACappleman sonic-net/sonic-swss#1963 #1963 is marked as a code PR but not merged yet. What is the plan for that PR?

TACappleman · 2021-11-08T09:16:39Z

We have a review from Intel which we've almost finished dealing with, and are still awaiting an internal review. Expect to get it merged this week

* [cbf] Added initial CBF support (#2) * Added CBF NHG support to NhgOrch * Added NhgMapOrch to handle DSCP_TO_FC and EXP_TO_FC tables * Added UT for the new NhgOrch function and NhgMapOrch Support sonic-net/SONiC#796 Co-authored-by: Alexandru Banu <v-albanu@microsoft.com>

zhangyanzhao · 2022-03-23T06:53:49Z

All code PRs are merged, HLD is reviewed in community. Merge it.

[cbf] Added CBF spec

6211994

abanu-ms changed the title ~~[cbf] Added CBF spec~~ Class Based Forwarding spec Jun 8, 2021

abanu-ms changed the title ~~Class Based Forwarding spec~~ Class Based Forwarding HLD Jun 8, 2021

abanu-ms added 2 commits June 8, 2021 17:05

[cbf] Update flow diagram to fit

496c6c3

Update markdown formatting

e65d05a

venkatmahalingam reviewed Aug 3, 2021

View reviewed changes

doc/cbf/cbf_hld.md Outdated Show resolved Hide resolved

venkatmahalingam reviewed Aug 3, 2021

View reviewed changes

kperumalbfn reviewed Aug 20, 2021

View reviewed changes

Updates for new SAI model

63c28cf

abanu-ms mentioned this pull request Sep 8, 2021

[schema] Class Based Forwarding sonic-net/sonic-swss-common#525

Merged

TACappleman mentioned this pull request Oct 15, 2021

[cbf] Add class-based forwarding support sonic-net/sonic-swss#1963

Merged

TACappleman mentioned this pull request Oct 25, 2021

[CBF] Added configuration templates to generate configs for CBF sonic-net/sonic-buildimage#8689

Merged

zhangyanzhao merged commit 2e585d8 into sonic-net:master Mar 23, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Class Based Forwarding HLD #796

Class Based Forwarding HLD #796

abanu-ms commented Jun 8, 2021 •

edited by TACappleman

Loading

anshuv-mfst commented Aug 3, 2021

venkatmahalingam Aug 3, 2021 •

edited

Loading

TACappleman Aug 10, 2021

venkatmahalingam Aug 3, 2021

abanu-ms Aug 10, 2021

TACappleman commented Aug 16, 2021

kperumalbfn Aug 20, 2021

abanu-ms Aug 23, 2021

kperumalbfn Aug 20, 2021

abanu-ms Aug 23, 2021

kperumalbfn Aug 20, 2021

abanu-ms Aug 23, 2021

TACappleman commented Nov 3, 2021

zhangyanzhao commented Nov 6, 2021

TACappleman commented Nov 8, 2021

zhangyanzhao commented Mar 23, 2022

Class Based Forwarding HLD #796

Class Based Forwarding HLD #796

Conversation

abanu-ms commented Jun 8, 2021 • edited by TACappleman Loading

anshuv-mfst commented Aug 3, 2021

venkatmahalingam Aug 3, 2021 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

TACappleman commented Aug 16, 2021

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

TACappleman commented Nov 3, 2021

zhangyanzhao commented Nov 6, 2021

TACappleman commented Nov 8, 2021

zhangyanzhao commented Mar 23, 2022

abanu-ms commented Jun 8, 2021 •

edited by TACappleman

Loading

venkatmahalingam Aug 3, 2021 •

edited

Loading