[Wedge100BF-series] QSFP can't link-up

Purpose:

This is the troubleshooting guide for the QSFP on Wedge100BF-series.

Model:

Wedge100BF-32X/65X/32QS

Procedure:

Step 0. Make sure we have the prior knowledge about port LED behavior

The LED select button switch the LED present "TOP", port #1, #3, #5,..., or "BOT", #2, #4, #6,...

Please refer to [Wedge100BF] LED behavior article for more detail.

Caution: The default port speed is 100G, if want to link up at other speeds required down speed first, otherwise the port won't link up.

Step 1. Specify the problem is on QSFP or Port

Use Cross Comparison tests to judge which has the problem, QSFP or Port.

Prepare several same model QSFPs to do the Cross Comparison tests.

Loop the port directly to do the Cross Comparison tests.

According to the result, decide to run the RMA process with only specific QSFP or switch.

Step 2. Login Diag mode to ensure LED work well

To login Diag, please refer to the article: Install and start up Accton Diag

Choose Diag item 155 to check if the front port LED change color every time after press Enter or not.

Caution: It'll take few minutes at first time, thus do not use "ctrl + c" to shut down the current operation.
Please be patient till you see "Press Enter to change color".

*********************************************************
(...omitted)
155 Test front port LED(OFF->RED->GREEN->BLUE)
(...omitted)
*********************************************************
Please enter your choice (0 to quit): 155
(...omitted)
Press Enter to change color
(...omitted)

Item (155) test result: PASSED

Please choose item 179 Unload Barefoot Diagnostic Service, after test item 155.

Otherwise, you'll see the message as below while testing other item.

*********************************************************
Please enter your choice (0 to quit): 199
Barefoot diagnostic service state:
 0x10: Disable
 0x20: Enable
 0x40: Already execute and Disable
The current state (0x20) of Barefoot diagnostic service is not matched the mask (0x50) for diag item 199
Please enter your choice (0 to quit):

Step 3. Login Diag mode to dump the log to us.

Choose Diag item 104 to show QSFP eeprom.

Please insert QSFP while doing this test.

*********************************************************
(...omitted)
104 Show QSFP EEPROM
(...omitted)
*********************************************************
Please enter your choice (0 to quit): 104
[argc] 2, [optind] 2, argv[2]=(null), optarg=(null)
Driver not running
=======================
READ QSFP port 1
=======================
/root/DIAG-V0.34/usr/local/accton/tools/cp2112_util_upper write 0xe0 0 0x02
/root/DIAG-V0.34/usr/local/accton/tools/cp2112_util_upper addr_read 0xa0 0 256
Writing 2 bytes to address 0xe0:
0000: 00 02
Read 256 bytes at device 0xa0 address 0x00:
0000: 11 05 04 00 00 00 00 00 00 00 00 00 00 00 00 00
0010: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0040: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0050: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0060: 00 00 00 00 ff ff ff ff ff ff ff 00 00 00 08 00
0070: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0080: 11 00 23 80 00 00 00 00 00 00 00 05 ff 00 00 00
0090: 00 00 03 a0 41 6d 70 68 65 6e 6f 6c 20 20 20 20
00a0: 20 20 20 20 1f 78 a7 14 4e 44 41 41 46 46 2d 30
00b0: 30 30 33 20 20 20 20 20 41 20 07 0b 0d 13 55 f9
00c0: 0b 00 00 00 41 50 46 31 35 31 37 30 30 33 32 35
00d0: 4e 30 20 20 31 35 30 35 30 36 20 20 00 00 67 40
00e0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
00f0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Writing 2 bytes to address 0xe0:
0000: 00 00
=======================
READ QSFP port 2
=======================
(...omitted)

Step 4. Use "swutil ps" to check interfaces status

Please connect Port 1 and 2 directly with 100G QSFP.

If you exit from Diag Utility means you had already enter these commands once and can skip to next part.

root@bfn-switch:~# cd DIAG-V0.34/
root@bfn-switch:~/DIAG-V0.34# sudo su
root@bfn-switch:~/DIAG-V0.34# source sysenv
root@bfn-switch:~/DIAG-V0.34# source sysenv2
root@bfn-switch:~/DIAG-V0.34# export ACC_MODEL_SKU=MODEL_1U    <---for 32X/32QS
root@bfn-switch:~/DIAG-V0.34# export ACC_MODEL_SKU=MODEL_2U    <---for 65X
root@bfn-switch:~/DIAG-V0.34# source ./bf_diag_start.sh
[ 124.148979] bf probe ok

Start up the driver.

root@bfn-switch:~/DIAG-V0.34# swutil -C -S --install-path=$BF_DIAG_INSTALL_DIR
(...omitted)

********************************************
 * WARNING: Authorised Access Only *
 ********************************************

bfshell> root@bfn-switch:~/DIAG-V0.34#

Note: It takes about 2 minute and stays at "bfshell>".

root@bfn-switch:~# swutil ps
Trying to connect switch driver...
Switch driver Connected.
Command sent to Switch driver.

(...omitted)

Client=> cat /tmp/mav_diag_result
Port link lns speed dlpx a-neg pause fec  txPre txMain txPost mtu   loop Intf   Ext-intf
------------------------------------------------------------------------------------------
1/0  up   4   100G  FD   Done  None  RS   2     0      0      10240 No   None   CR4_100G
2/0  up   4   100G  FD   Done  None  RS   4     0      0      10240 No   None   CR4_100G
3/0  down 4   100G  FD   None  None  RS   6     0      0      10240 No   None   Other
4/0  down 4   100G  FD   None  None  RS   6     0      0      10240 No   None   Other
5/0  down 4   100G  FD   None  None  RS   6     0      0      10240 No   None   Other
6/0  down 4   100G  FD   None  None  RS   6     0      0      10240 No   None   Other
(...omitted)