Top

Menu

Dynamic Port Breakout Follow

Avatar
phoebe_zeng 曾麗凰
  • Updated

Reference model:

  • Switch model name:

- AS7726-32X

- AS7326-56X

- AS7816-64X

- AS5835-54X(T)

- AS4630-54PE

- AS9716-32D

- Wedge100BF-32X

  • Edgecore SONiC version: 

- Edgecore-SONiC_20201123_130028_ec202006_74

- Edgecore-SONiC_20201229_070315_ec202006_101

- Edgecore-SONiC_20201229_070315_ec202006_bfn_65(Wedge100BF-32X)

 

Restriction: :

  1. Port breakout fails if portchannel exists. Please remove portchannel before doing breakout.
  2. After doing breakout, MTU size of the first interface will be disappeared. Doing config reload after save the configuration will correct the MTU.
  3. After SONiC.Edgecore-SONiC_20200827_110345_ec201911_2020-aug_enhanced_178 version, dynamic port breakout fails after using default configuration file generated by sonic-cfggen and restore.sh.
  4. After port breakout, the admin status on port will be down.

Example : Dynamic Port Breakout

Procedure:

Step 1. Check IP interface and portchannel status before doing port breakout. In this example, we may take Ethernet48 to be a breakout port.

Caution:  IP address has to be removed from physical interface and VLAN interface. This port has also to be removed from Vlan member. It's now allowed to do port breakout if the switch has portchannel setting. 

Remove IP address on Ethernet48

admin@sonic:~$ show ip interfaces 
Interface    IPv4 address/mask    Admin/Oper
-----------  -------------------  ------------
Ethernet48   192.168.1.1/24       up/up
docker0      240.127.1.1/24       up/down
eth0         188.188.98.25/16     up/up
lo           127.0.0.1/8          up/up
             10.1.0.1/32
admin@sonic:~$ sudo config interface ip remove Ethernet48 192.168.1.1/24

Since there is IP address on physical interface "Ethernet48",  we have to remove IP address from it.

Example: Remove IP address on Vlan Interface

admin@sonic:~$ show vlan brief     
+-----------+----------------+------------+----------------+-----------------------+    
|   VLAN ID | IP Address     | Ports      | Port Tagging   | DHCP Helper Address   |    
+===========+================+============+================+=======================+    
|       100 | 192.168.2.2/24 | Ethernet52 | untagged       |                       |    --> Let's take Ethernet52 to be a breakout port
+-----------+----------------+------------+----------------+-----------------------+    

admin@sonic:~$ show ip int 
Interface    IPv4 address/mask    Admin/Oper
-----------  -------------------  ------------
Vlan100      192.168.2.2/24       up/up
docker0      240.127.1.1/24       up/down
eth0         188.188.98.30/16     up/up
lo           127.0.0.1/8          up/up
             10.1.0.1/32
admin@sonic:~$ sudo config interface ip remove Vlan100 192.168.2.2/24
admin@sonic:~$ sudo config vlan member del 100 Ethernet52

Since there is IP address on "Vlan100" interface,  we have to remove IP address from it. Don't forget to delete this port from Vlan member. In this Vlan example, remove Ethernet52 from Vlan100.

Example: Remove member port on portchannel

admin@sonic:~$ show interface portchannel
Flags: A - active, I - inactive, Up - up, Dw - Down, N/A - not available,
S - selected, D - deselected, * - not synced
No. Team Dev Protocol Ports
----- ----------- ----------- ------------
PortChannel LACP(A)(Dw) Ethernet0(D)


admin@sonic:~$ sudo config portchannel del 1

Delete ALL portchannel. This is known issue that portchannel existence may let breakout fail.

Step 2. Check breakout option availability and current breakout mode.

admin@sonic:~$ show interfaces breakout
{
	...omitted...
 "Ethernet48": {
      "index": "49,49,49,49",
      "default_brkout_mode": "1x100G[40G]",  
      "child ports": "Ethernet48",
      "breakout_modes": "1x100G[40G], 2x50G, 4x25G, 4x10G",  --> Available breakout mode option
      "child port speeds": "100G",
      "Current Breakout Mode": "1x100G[40G]",
      "lanes": "77,78,79,80",
      "alias_at_lanes": "Eth49/1, Eth49/2, Eth49/3, Eth49/4"
  },
.......omitted...
}


admin@sonic:~$ show interfaces breakout current-mode Ethernet48
+-------------+-------------------------+
| Interface   | Current Breakout Mode   |
+=============+=========================+
| Ethernet48  | 1x100G[40G]             |         --> current mode of Ethernet48
+-------------+-------------------------+

Step 3. Configure dynamic port breakout

admin@sonic:~$ sudo config interface breakout Ethernet48 4x25G --> Breakout Ethernet48 from 1x100G to 4x25G
Do you want to Breakout the port, continue? [y/N]: y

Running Breakout Mode : 1x100G[40G]
Target Breakout Mode : 4x25G

Ports to be deleted :
 {
    "Ethernet48": "100000"
}
Ports to be added :
 {
    "Ethernet50": "25000",
    "Ethernet51": "25000",
    "Ethernet49": "25000",
    "Ethernet48": "25000"
}

After running Logic to limit the impact

Final list of ports to be deleted :
 {
    "Ethernet48": "100000"
}
Final list of ports to be added :
 {
    "Ethernet50": "25000",
    "Ethernet51": "25000",
    "Ethernet49": "25000",
    "Ethernet48": "25000"
}
Loaded below Yang Models
['sonic-acl', 'sonic-extension', 'sonic-interface', 'sonic-loopback-interface', 'sonic-port', 'sonic-portchannel', 'sonic-types', 'sonic-vlan']
Note: Below table(s) have no YANG models:
CONTAINER_FEATURE, VERSIONS, DEVICE_METADATA, FEATURE, FLEX_COUNTER_TABLE, BREAKOUT_CFG, CRM,
Breakout process got successfully completed.
Please note loaded setting will be lost after system reboot. To preserve setting, run `config save`.
admin@sonic:~$
 

Step 4. Show breakout current mode status and interface status

admin@sonic:~$ show interfaces breakout current-mode Ethernet48
+-------------+-------------------------+
| Interface | Current Breakout Mode     |
+=============+=========================+
| Ethernet48 | 4x25G                    |
+-------------+-------------------------+

admin@sonic:~$ show interfaces status
  Interface            Lanes    Speed    MTU    FEC    Alias    Vlan    Oper    Admin             Type    Asym PFC
-----------  ---------------  -------  -----  -----  -------  ------  ------  -------  ---------------  ----------
... omitted
 Ethernet48               77      25G    N/A    N/A  Eth49/1  routed    down      N/A  QSFP28 or later         N/A  
 Ethernet49               78      25G   9100    N/A  Eth49/2  routed    down     down              N/A         N/A
 Ethernet50               79      25G   9100    N/A  Eth49/3  routed    down     down              N/A         N/A
 Ethernet51               80      25G   9100    N/A  Eth49/4  routed    down     down              N/A         N/A
... omitted

Since there's a known issue about the MTU, the MTU is "N/A".

Step 5. Save configuration to startup configuration. Please do config reload to get first MTU corrected (Step 4). 

admin@sonic:~$ sudo config save -y
Running command: /usr/local/bin/sonic-cfggen -d --print-data > /etc/sonic/config_db.json

admin@sonic:~$ sudo config reload –y

admin@sonic:~$ show interfaces status
  Interface            Lanes    Speed    MTU    FEC    Alias    Vlan    Oper    Admin             Type    Asym PFC
-----------  ---------------  -------  -----  -----  -------  ------  ------  -------  ---------------  ----------
… omitted
 Ethernet48               77      25G   9100    N/A  Eth49/1  routed    down     down  QSFP28 or later         N/A
 Ethernet49               78      25G   9100    N/A  Eth49/2  routed    down     down  QSFP28 or later         N/A
 Ethernet50               79      25G   9100    N/A  Eth49/3  routed    down     down  QSFP28 or later         N/A
 Ethernet51               80      25G   9100    N/A  Eth49/4  routed    down     down  QSFP28 or later         N/A

… omitted

Step 6. Undo breakout port.

admin@sonic:~$ sudo config interface breakout Ethernet48 1x100G[40G]
Do you want to Breakout the port, continue? [y/N]: y
Running Breakout Mode : 4x25G

Target Breakout Mode : 1x100G[40G]

Ports to be deleted :
 {
    "Ethernet50": "25000",
    "Ethernet51": "25000",
    "Ethernet49": "25000",
    "Ethernet48": "25000"
}
Ports to be added :
 {
    "Ethernet48": "100000"
}

After running Logic to limit the impact

Final list of ports to be deleted :
 {
    "Ethernet50": "25000",
    "Ethernet51": "25000",
    "Ethernet49": "25000",
    "Ethernet48": "25000"
}
Final list of ports to be added :
 {
    "Ethernet48": "100000"
}
Loaded below Yang Models
['sonic-acl', 'sonic-extension', 'sonic-interface', 'sonic-loopback-interface', 'sonic-port', 'sonic-portchannel', 'sonic-types', 'sonic-vlan']
Note: Below table(s) have no YANG models:
CONTAINER_FEATURE, VERSIONS, DEVICE_METADATA, FEATURE, FLEX_COUNTER_TABLE, BREAKOUT_CFG, CRM,
Breakout process got successfully completed.
Please note loaded setting will be lost after system reboot. To preserve setting, run `config save`.
admin@sonic:~$

Step 7. Show current breakout mode and interface status.

admin@sonic:~$ show interfaces breakout current-mode Ethernet48
+-------------+-------------------------+
| Interface | Current Breakout Mode     |
+=============+=========================+
| Ethernet48 | 1x100G[40G]              |
+-------------+-------------------------+

admin@sonic:~$ show interfaces status
  Interface            Lanes    Speed    MTU    FEC    Alias    Vlan    Oper    Admin             Type    Asym PFC
-----------  ---------------  -------  -----  -----  -------  ------  ------  -------  ---------------  ----------
… omitted
 Ethernet48      77,78,79,80     100G    N/A    N/A  Eth49/1  routed    down      N/A  QSFP28 or later         N/A
 Ethernet52      85,86,87,88     100G   9100    N/A  Eth50/1  routed    down       up              N/A         N/A
 Ethernet56      93,94,95,96     100G   9100    N/A  Eth51/1  routed    down       up              N/A         N/A
 Ethernet60     97,98,99,100     100G   9100    N/A  Eth52/1  routed    down       up              N/A         N/A
… omitted

Since there's a known issue about the MTU, the MTU is "N/A"

Please do config reload to get first MTU corrected.

 

Related articles

Comments

0 comments

Please sign in to leave a comment.

Articles in this section