Added validation for multipod_modular_spine_bootscript_check - CSCwr66848#365
Added validation for multipod_modular_spine_bootscript_check - CSCwr66848#365asraf-khan wants to merge 5 commits intodatacenter:masterfrom
Conversation
lovkeshsharma702
left a comment
There was a problem hiding this comment.
please repro this in local lab, you can change the target version as per version on lab fabric
|
Based on Mail conversation by Satya, i have removed target version 6.1.5 and tested script on our local lab setup tweeking the script and below are the result for the same ### Multipod not enabled: python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === === Summary Result === PASS : 0 ==== Script Version v4.0.1 FIN ==== ### both files are found: python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === === Summary Result === PASS : 1 ==== Script Version v4.0.1 FIN ==== ### bootscript file is missing: fab3-apic1# python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === [Check 1/1] Multi-Pod modular spine bootscript check... FAIL - OUTAGE WARNING!! 1 201 FAB3-S1 N9K-C9504 No Yes Recommended Action: Delete bootstrap.xml from /bootflash folder and do clean reboot === Summary Result === PASS : 0 ==== Script Version v4.0.1 FIN ==== ### both files are not found: python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === [Check 1/1] Multi-Pod modular spine bootscript check... FAIL - UPGRADE FAILURE!! 1 201 FAB3-S1 N9K-C9504 No No Recommended Action: Move to Fix version. === Summary Result === PASS : 0 ==== Script Version v4.0.1 FIN ==== |
… to remove 6.1.5 version
|
Updated result after removing bootstrap validation: Multi pod not enabled:python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === === Summary Result === PASS : 0 ==== Script Version v4.0.1 FIN ==== Bootscript not found:python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === [Check 1/1] Multi-Pod modular spine bootscript check... FAIL - OUTAGE WARNING!! 1 201 FAB3-S1 N9K-C9504 No Recommended Action: clean reboot on impacted spine === Summary Result === PASS : 0 ==== Script Version v4.0.1 FIN ==== Bootscript is present:python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check !!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!! To use a non-default Login Domain, enter apic#DOMAIN\USERNAME Gathering Node Information... Current APIC Version...6.0(2j) Gathering APIC Versions from Firmware Repository... What is the Target Version? : 1 You have chosen version "6.0(2j)" Collecting VPC Node IDs... Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed === Check Result (failed only) === === Summary Result === PASS : 1 ==== Script Version v4.0.1 FIN ==== |
Multipod is not enabled :
python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check -t "6.1(5e)"
==== 2026-03-11T10-54-31+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.0(2j)
Lowest Switch Version...4.2(3j)
Target APIC version is overridden to 6.1(5e)
Collecting VPC Node IDs...
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
=== Summary Result ===
PASS : 0
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 1
ERROR !! : 0
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/Asraf/preupgrade_validator_2026-03-11T10-54-31+0000.tgz
==== Script Version v4.0.1 FIN ====
Not matched tversion:
aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check -t "6.1(5h)"
==== 2026-03-11T10-58-01+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.0(2j)
Lowest Switch Version...4.2(3j)
Target APIC version is overridden to 6.1(5h)
Collecting VPC Node IDs...
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
=== Summary Result ===
PASS : 0
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 1
ERROR !! : 0
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/Asraf/preupgrade_validator_2026-03-11T10-58-01+0000.tgz
==== Script Version v4.0.1 FIN ====
Modular spine not found:
python aci-preupgrade-validation-script.py -d multipod_modular_spine_bootscript_check -t "6.1(4h)"
==== 2026-03-11T11-01-52+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.2(1.124)
Lowest Switch Version...6.2(1.110)
Target APIC version is overridden to 6.1(4h)
Collecting VPC Node IDs...111, 112, 113, 114
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
=== Summary Result ===
PASS : 0
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 1
ERROR !! : 0
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/preupgrade_validator_2026-03-11T11-01-52+0000.tgz
==== Script Version v4.0.1 FIN ====
bootscript not found:
python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check -t "6.1(5e)"
==== 2026-03-11T10-55-14+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.0(2j)
Lowest Switch Version...4.2(3j)
Target APIC version is overridden to 6.1(5e)
Collecting VPC Node IDs...
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
[Check 1/1] Multi-Pod modular spine bootscript check... FAIL - OUTAGE WARNING!!
Pod ID Node ID Node Name Model Bootscript Present Bootstrap file Present
------ ------- --------- ----- ------------------ ----------------------
1 201 FAB3-S1 N9K-C9504 No Yes
Recommended Action: Bootscript is missing, delete bootstrap.xml from bootflash
Reference Document: https://datacenter.github.io/ACI-Pre-Upgrade-Validation-Script/validations/#multipod-modular-spine-…
=== Summary Result ===
PASS : 0
FAIL - OUTAGE WARNING!! : 1
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 0
ERROR !! : 0
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/Asraf/preupgrade_validator_2026-03-11T10-55-14+0000.tgz
==== Script Version v4.0.1 FIN ====
Both bootscript and bootstrap file not found:
python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check -t "6.1(5e)"
==== 2026-03-11T10-57-39+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.0(2j)
Lowest Switch Version...4.2(3j)
Target APIC version is overridden to 6.1(5e)
Collecting VPC Node IDs...
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
[Check 1/1] Multi-Pod modular spine bootscript check... FAIL - UPGRADE FAILURE!!
Pod ID Node ID Node Name Model Bootscript Present Bootstrap file Present
------ ------- --------- ----- ------------------ ----------------------
1 201 FAB3-S1 N9K-C9504 No No
Recommended Action: bootscript and bootstrap.xml files are not found, Move to Fix version.
Reference Document: https://datacenter.github.io/ACI-Pre-Upgrade-Validation-Script/validations/#multipod-modular-spine-…
=== Summary Result ===
PASS : 0
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 1
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 0
ERROR !! : 0
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/Asraf/preupgrade_validator_2026-03-11T10-57-39+0000.tgz
==== Script Version v4.0.1 FIN ====
Both bootscript & bootstrap file found:
python3 aci-preupgrade-validation-Asraf-script.py -d multipod_modular_spine_bootscript_check -t "6.1(5e)"
==== 2026-03-11T10-56-57+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.0(2j)
Lowest Switch Version...4.2(3j)
Target APIC version is overridden to 6.1(5e)
Collecting VPC Node IDs...
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
=== Summary Result ===
PASS : 1
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 0
ERROR !! : 0
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/Asraf/preupgrade_validator_2026-03-11T10-56-57+0000.tgz
==== Script Version v4.0.1 FIN ====
SSH error for few nodes:
python aci-preupgrade-validation-script.py -d multipod_modular_spine_bootscript_check -t "6.1(4h)"
==== 2026-03-11T12-01-26+0000, Script Version v4.0.1 ====
!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!
To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :
Gathering Node Information...
Current APIC Version...6.2(1.124)
Lowest Switch Version...6.2(1.110)
Target APIC version is overridden to 6.1(4h)
Collecting VPC Node IDs...111, 112, 113, 114
Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed
=== Check Result (failed only) ===
[Check 1/1] Multi-Pod modular spine bootscript check... ERROR !!
Pod ID Node ID Node Name Model Bootscript Present Bootstrap file Present
------ ------- --------- ----- ------------------ ----------------------
1 211 ifav26-spine11 N9K-C9316D-GX Yes Yes
2 212 ifav26-spine12 N9K-C9364C SSH ERROR: failed to login to host SSH ERROR: failed to login to host
3 213 ifav26-spine13 N9K-C9332C SSH ERROR: failed to login to host SSH ERROR: failed to login to host
Recommended Action: Bootscript is missing, delete bootstrap.xml from bootflash
Reference Document: https://datacenter.github.io/ACI-Pre-Upgrade-Validation-Script/validations/#multipod-modular-spine-…
=== Summary Result ===
PASS : 0
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 0
ERROR !! : 1
TOTAL : 1
Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED
Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.
Result Bundle: /data/techsupport/preupgrade_validator_2026-03-11T12-01-26+0000.tgz
==== Script Version v4.0.1 FIN ====