[Enterprise SONiC] Dynamic Port Breakout Follow
Ports can be broken out to different speeds with various lanes. E.g. If we want to change port 0 from 100G to port 0-4 with 4x25G.
How to configure the DPB(Dynamic Port Breakout) on Edgecore SONiC.
Restriction
-
[202111.0] known issue:
-
[SONIC-4681] Switch failed to break out interface if eth0 has static IP address
The issue is fixed on 202111.3
- [SONIC-4331] If there had been ACL that without IP_Type binding on some ports, once other ports try to do the dynamic port breakout, they will face an error.
-
[SONIC-4681] Switch failed to break out interface if eth0 has static IP address
- Before breakout, please make sure the port restore to default configuration. In 202012 branch, "advertised-speed" command is supported. If you have advertised-speed configuration, please remember to remove the configuration. (Refer to this restored guide for config restore. )
- Admin status of interfaces is down by default after applying Dynamic Port Breakout setting.
- AS5835-54X(T), it could only set the port breakout on Ethernet48 and Ethernet60.
- On the version "Edgecore-SONiC_20210209_051110_ec202006_134", AS9716-32D support more breakout mode "2x50G(4), 4x25G[10G](4)".
- AS7816-64X, due to the logical port limitation by ASIC, breakout is realized only in row1 (Ethernet0,8,16,24,32,40,48,56,64,72,80,88,96,104,112,120 as the yellow block) in current design.
- For the mode ‘4x25 [10G] (4)’ of AS9716-32D, the default breakout is 4x25G. If you need 4x10G, you need to break out first and then use the dump speed command as following.
admin@sonic:~$ sudo config interface breakout Ethernet24 '4x25G[10G](4)'
Do you want to Breakout the port, continue? [y/N]: y
Running Breakout Mode : 1x400G
Target Breakout Mode : 4x25G[10G](4)
Ports to be deleted :
{
"Ethernet24": "400000"
}
Ports to be added :
{
"Ethernet25": "25000",
"Ethernet24": "25000",
"Ethernet27": "25000",
"Ethernet26": "25000"
}
After running Logic to limit the impact
Final list of ports to be deleted :
{
"Ethernet24": "400000"
}
Final list of ports to be added :
{
"Ethernet25": "25000",
"Ethernet24": "25000",
"Ethernet27": "25000",
"Ethernet26": "25000"
}
Loaded below Yang Models
['sonic-acl', 'sonic-extension', 'sonic-interface', 'sonic-loopback-interface', 'sonic-port', 'sonic-portchannel', 'sonic-types', 'sonic-vlan']
Note: Below table(s) have no YANG models:
CONTAINER_FEATURE, VERSIONS, DEVICE_METADATA, TELEMETRY, FEATURE, FLEX_COUNTER_TABLE, BREAKOUT_CFG, MGMT_INTERFACE, CRM,
Breakout process got successfully completed.
Please note loaded setting will be lost after system reboot. To preserve setting, run `config save`.
admin@sonic:~$ sudo config interface speed Ethernet24 10000
Dynamic Port Breakout
Tested model & firmware version:
- Switch model name:
DCS203 (AS7326-56X)
- Edgecore SONiC version:
202006.4
202012.0 ~ 202012.4
202111.0 ~ 202111.3
Procedure:
Step 1. We should remove the ip interface/ VLAN member and portchannel member on ports which we want to run the DPB.
Assume if we want to run DPB on "Ethernet48", we need to remove the ip interface on the port.
admin@sonic:~$ show ip interfaces Interface IPv4 address/mask Admin/Oper ----------- ------------------- ------------ Ethernet48 192.168.1.1/24 up/up docker0 240.127.1.1/24 up/down eth0 188.188.98.25/16 up/up lo 127.0.0.1/8 up/up 10.1.0.1/32
admin@sonic:~$ sudo config interface ip remove Ethernet48 192.168.1.1/24
Assume if we want to run DPB on "Ethernet52", we should remove it from the VLAN member of VLAN100.
admin@sonic:~$ show vlan brief +-----------+----------------+------------+----------------+-----------------------+ | VLAN ID | IP Address | Ports | Port Tagging | DHCP Helper Address | +===========+================+============+================+=======================+ | 100 | 192.168.2.2/24 | Ethernet48 | untagged | | +-----------+----------------+------------+----------------+-----------------------+
admin@sonic:~$ sudo config vlan member del 100 Ethernet48
Assume if we want to run the DPB on "Ethernet0", we should remove it from portchannel member of PortChannel01.
admin@sonic:~$ show interface portchannel
Flags: A - active, I - inactive, Up - up, Dw - Down, N/A - not available,
S - selected, D - deselected, * - not synced
No. Team Dev Protocol Ports
----- ----------- ----------- ------------
PortChannel01 LACP(A)(Dw) Ethernet48(D)
admin@sonic:~$ sudo config portchannel member del PortChannel01 Ethernet48
Step 2. Check breakout option availability and current breakout mode on Ethernet48.
admin@sonic:~$ show interfaces breakout
{
...omitted...
"Ethernet48": {
"index": "49,49,49,49",
"default_brkout_mode": "1x100G[40G]",
"child ports": "Ethernet48",
"breakout_modes": "1x100G[40G], 2x50G, 4x25G, 4x10G",
"child port speeds": "100G",
"Current Breakout Mode": "1x100G[40G]",
"lanes": "77,78,79,80",
"alias_at_lanes": "Eth49/1(Port49), Eth49/2(Port49), Eth49/3(Port49), Eth49/4(Port49)" },
},
...omitted...
}
admin@sonic:~$ show interfaces breakout current-mode Ethernet48
+-------------+-------------------------+
| Interface | Current Breakout Mode |
+=============+=========================+
| Ethernet48 | 1x100G[40G] |
+-------------+-------------------------+
Step 3. Configure dynamic port breakout
admin@sonic:~$ sudo config interface breakout Ethernet48 '4x25G' -y
Running Breakout Mode : 1x100G[40G]
Target Breakout Mode : 4x25G
Ports to be deleted :
{
"Ethernet48": "100000"
}
Ports to be added :
{
"Ethernet50": "25000",
"Ethernet51": "25000",
"Ethernet49": "25000",
"Ethernet48": "25000"
}
After running Logic to limit the impact
Final list of ports to be deleted :
{
"Ethernet48": "100000"
}
Final list of ports to be added :
{
"Ethernet50": "25000",
"Ethernet51": "25000",
"Ethernet49": "25000",
"Ethernet48": "25000"
}
Loaded below Yang Models
['sonic-acl', 'sonic-extension', 'sonic-interface', 'sonic-loopback-interface', 'sonic-port', 'sonic-portchannel', 'sonic-types', 'sonic-vlan']
Note: Below table(s) have no YANG models:
KDUMP, CONTAINER_FEATURE, BGP_NEIGHBOR, VERSIONS, DEVICE_METADATA, TELEMETRY, FEATURE, FLEX_COUNTER_TABLE, BREAKOUT_CFG, CRM,
Breakout process got successfully completed.
Please note loaded setting will be lost after system reboot. To preserve setting, run `config save`.
Caution :Be careful, please use include the mode setting with ' '.
Step 4. Show breakout current mode status and interface status
admin@sonic:~$ show interfaces breakout current-mode Ethernet48
+-------------+-------------------------+
| Interface | Current Breakout Mode |
+=============+=========================+
| Ethernet48 | 4x25G |
+-------------+-------------------------+
admin@sonic:~$ show interfaces status Ethernet48-51
Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC
----------- ------- ------- ----- ----- --------------- ------ ------ ------- -------------- ----------
Ethernet48 77 25G 9100 none Eth49/1(Port49) routed down down QSFP+ or later N/A
Ethernet49 78 25G 9100 none Eth49/2(Port49) routed down down N/A N/A
Ethernet50 79 25G 9100 none Eth49/3(Port49) routed down down N/A N/A
Ethernet51 80 25G 9100 none Eth49/4(Port49) routed down down N/A N/A
Step 5. Set the admin status of interface to startup
admin@sonic:~$ sudo config interface startup Ethernet48-51
admin@sonic:~$ show interfaces status Ethernet48-51
Interface Lanes Speed MTU FEC Alias Vlan Oper Admin Type Asym PFC
----------- ------- ------- ----- ----- --------------- ------ ------ ------- -------------- ----------
Ethernet48 77 25G 9100 none Eth49/1(Port49) routed up up QSFP+ or later N/A
Ethernet49 78 25G 9100 none Eth49/2(Port49) routed up up N/A N/A
Ethernet50 79 25G 9100 none Eth49/3(Port49) routed up up N/A N/A
Ethernet51 80 25G 9100 none Eth49/4(Port49) routed up up N/A N/A
Step 6. Save configuration to startup configuration.
admin@sonic:~$ sudo config save -y
Running command: /usr/local/bin/sonic-cfggen -d --print-data > /etc/sonic/config_db.json
Frequently Asked Question
Why failed to breakout after typing the correct command?
Tested model & firmware version:
- Switch model name:
DCS203 (AS7326-56X)
- Edgecore SONiC version:
202012.4
202111.3
Problem description:
admin@sonic:~$ sudo config interface breakout Ethernet48 '4x25G' -y
Running Breakout Mode : 1x100G[40G]
Target Breakout Mode : 4x25G
Ports to be deleted :
{
"Ethernet48": "100000"
}
Ports to be added :
{
"Ethernet48": "25000",
"Ethernet49": "25000",
"Ethernet50": "25000",
"Ethernet51": "25000"
}
After running Logic to limit the impact
Final list of ports to be deleted :
{
"Ethernet48": "100000"
}
Final list of ports to be added :
{
"Ethernet48": "25000",
"Ethernet49": "25000",
"Ethernet50": "25000",
"Ethernet51": "25000"
}
Loaded below Yang Models
['sonic-acl', 'sonic-crm', 'sonic-device_metadata', 'sonic-device_neighbor', 'sonic-extension', 'sonic-flex_counter', 'sonic-interface', 'sonic-loopback-interface', 'sonic-port', 'sonic-portchannel', 'sonic-types', 'sonic-versions', 'sonic-vlan']
Note: Below table(s) have no YANG models:
VRF, VXLAN_EVPN_NVO, BREAKOUT_CFG, FEATURE, VXLAN_TUNNEL, SNMP_COMMUNITY, VXLAN_TUNNEL_MAP, SNMP, REST_SERVER, KDUMP, MGMT_INTERFACE,
libyang[0]: Value "not-provisioned" does not satisfy the constraint "ToRRouter|LeafRouter|SpineChassisFrontendRouter|ChassisBackendRouter|ASIC" (range, length, or pattern). (path: /sonic-device_metadata:sonic-device_metadata/DEVICE_METADATA/localhost/type)
sonic_yang(3):Data Loading Failed:Value "not-provisioned" does not satisfy the constraint "ToRRouter|LeafRouter|SpineChassisFrontendRouter|ChassisBackendRouter|ASIC" (range, length, or pattern).
Data Loading Failed
Value "not-provisioned" does not satisfy the constraint "ToRRouter|LeafRouter|SpineChassisFrontendRouter|ChassisBackendRouter|ASIC" (range, length, or pattern).
ConfigMgmt Class creation failed
Failed to break out Port. Error: Failed to load the config. Error: ConfigMgmtDPB Class creation failed
Once you found you cannot set the breakout successfully, you may check the error message.
In the error message, there's a hint that explains why, please refer to the description in green.
The error message said your type is wrong in DEVICE_METADATA from the config_db.json.
"DEVICE_METADATA": {
"localhost": {
"buffer_model": "traditional",
"default_bgp_status": "up",
"default_pfcwd_status": "disable",
"docker_routing_config_mode": "split",
"hostname": "sonic",
"hwsku": "Accton-AS7326-56X",
"mac": "68:21:5f:dc:3a:c8",
"platform": "x86_64-accton_as7326_56x-r0",
"type": "not-provisioned"
}
},
Solution:
Modify "Type" of DEVICE_METADATA on /etc/sonic/config_db.json. Replace "not-provisioned" by "ToRRouter" or "LeafRouter".
"DEVICE_METADATA": {
"localhost": {
"buffer_model": "traditional",
"default_bgp_status": "up",
"default_pfcwd_status": "disable",
"docker_routing_config_mode": "split",
"hostname": "sonic",
"hwsku": "Accton-AS7326-56X",
"mac": "68:21:5f:dc:3a:c8",
"platform": "x86_64-accton_as7326_56x-r0",
"type": "LeafRouter"
}
},
Comments
1 comment
Hello there this is João from Brasil, is there a way to configure the Edgecore as7316-26xb to do the Dynamic Port Breakout? We really need to use this configuration on our network.
Please sign in to leave a comment.