Sihnon wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Firmware ======

The card shipped with firmware for ''9300-8i'' even though it's an external port card (would have thought it were 9300-8e). Might be a knock-off with the wrong description flashed into it.

Download from [[https://www.broadcom.com/support/download-search?pg=Storage+Adapters,+Controllers,+and+ICs&pf=Storage+Adapters,+Controllers,+and+ICs&pn=SAS+9300-8i+Host+Bus+Adapter&pa=&po=&dk=&pl=|Broadcom]]
  * ''Installer_P16_for_Linux'' - contains the ''sas3flash'' utility to apply the firmwares
  * ''9300_8i_Package_P16_IR_IT_FW_BIOS_for_MSDOS_Windows'' - contains the firmware images themselves

There are three components to the firmwares:
  * The controller firmware file, e.g. ''Firmware/SAS9300_8i_IT/SAS9300_8i_IT.bin''
  * The UEFI boot rom, e.g. ''uefi_bsd_rel/mpt3x64.rom''
  * The BIOS boot rom, e.g. ''sasbios_rel/mptsas3.rom''

===== Checking current versions =====

<code>
kowlan ~/Installer_P16_for_Linux # ./sas3flash_linux_x64_rel/sas3flash -list
Avago Technologies SAS3 Flash Utility
Version 17.00.00.00 (2018.04.02) 
Copyright 2008-2018 Avago Technologies. All rights reserved.

        Adapter Selected is a Avago SAS: SAS3008(C0)

        Controller Number              : 0
        Controller                     : SAS3008(C0)
        PCI Address                    : 00:04:00:00
        SAS Address                    : 500605b-0-0b4e-c8d9
        NVDATA Version (Default)       : 0e.01.00.07
        NVDATA Version (Persistent)    : 0e.01.00.07
        Firmware Product ID            : 0x2221 (IT)
        Firmware Version               : 16.00.10.00
        NVDATA Vendor                  : LSI
        NVDATA Product ID              : SAS9300-8i
        BIOS Version                   : 08.11.00.00
        UEFI BSD Version               : 18.00.00.00
        FCODE Version                  : N/A
        Board Name                     : SAS9300-8i
        Board Assembly                 : N/A
        Board Tracer Number            : N/A

        Finished Processing Commands Successfully.
        Exiting SAS3Flash.
</code>

This shows the card is running an "IT" mode firmware, expects firmwares for ''SAS9300-8i'', is currently running contorller firmware ''16.00.10.00'' and UEFI boot rom ''18.00.00.00'',

===== Upgrading =====

<code bash>
./sas3flash_linux_x64_rel/sas3flash -o -f ~/9300_8i_Package_P16_IR_IT_FW_BIOS_for_MSDOS_Windows/Firmware/SAS9300_8i_IT/SAS9300_8i_IT.bin -b ~/9300_8i_Package_P16_IR_IT_FW_BIOS_for_MSDOS_Windows/uefi_bsd_rel/mpt3x64.rom
</code>

Flash the controller ahd UEFI firmwares at the same time. The flash tool will do a compatibility check and warn if there's a bad combination. Might prevent an accidental bricking of the card.

====== Operation ======

===== Listing available controllers =====

<code bash>
kowlan ~ # /opt/lsi/sas3ircu LIST
Avago Technologies SAS3 IR Configuration Utility.
Version 17.00.00.00 (2018.04.02) 
Copyright (c) 2009-2018 Avago Technologies. All rights reserved. 


         Adapter      Vendor  Device                       SubSys  SubSys 
 Index    Type          ID      ID    Pci Address          Ven ID  Dev ID 
 -----  ------------  ------  ------  -----------------    ------  ------ 
   0     SAS3008       1000h   97h    00h:04h:00h:00h      1000h   30e0h 
SAS3IRCU: Utility Completed Successfully.
</code>

===== Viewing available disks =====

Needs ''sys-block/sas3ircu''. Have emerged this onto the box temporarily, but should try to get this packaged upstream.

<code>
kowlan ~ # /opt/lsi/sas3ircu 0 DISPLAY
Avago Technologies SAS3 IR Configuration Utility.
Version 17.00.00.00 (2018.04.02) 
Copyright (c) 2009-2018 Avago Technologies. All rights reserved. 

Read configuration has been initiated for controller 0
------------------------------------------------------------------------
Controller information
------------------------------------------------------------------------
  Controller type                         : SAS3008
  BIOS version                            : 8.11.00.00
  Firmware version                        : 16.00.10.00
  Channel description                     : 1 Serial Attached SCSI
  Initiator ID                            : 0
  Maximum physical devices                : 1023
  Concurrent commands supported           : 9856
  Slot                                    : 2
  Segment                                 : 0
  Bus                                     : 4
  Device                                  : 0
  Function                                : 0
  RAID Support                            : No
------------------------------------------------------------------------
IR Volume information
------------------------------------------------------------------------
------------------------------------------------------------------------
Physical device information
------------------------------------------------------------------------
------------------------------------------------------------------------
Enclosure information
------------------------------------------------------------------------
  Enclosure#                              : 1
  Logical ID                              : 500605b0:0b4ec8d9
  Numslots                                : 8
  StartSlot                               : 0
------------------------------------------------------------------------
SAS3IRCU: Command DISPLAY Completed Successfully.
SAS3IRCU: Utility Completed Successfully.
</code>

No disks or SCSI enclosures here, need to check the cables.

===== Recovering lost arrays =====

[[https://www.thomas-krenn.com/en/wiki/StorCLI_commands#Incorporating_an_improperly_removed_device]]

Seen before, during a reboot, all disks in a RAID1 were detected as ''UBUnsp'' (unconfigured, bad, unsupported). Reseating the drives helped. To bring them back online:

  * Show the foreign configurations: <code bash>
[root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /fall show
CLI Version = 007.1323.0000.0000 May 25, 2020
Operating system = VMkernel 7.0.1
Controller = 0
Status = Success
Description = Operation on foreign configuration Succeeded


FOREIGN CONFIGURATION :
=====================

-----------------------------------------
DG EID:Slot Type  State       Size NoVDs 
-----------------------------------------
 0 -        RAID1 Frgn  931.000 GB     1 
-----------------------------------------

NoVDs - Number of VD in Drive Group
DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID
DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Optl=Optimal|Dgrd=Degraded
Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active
PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign
DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present
TR=Transport Ready

Total foreign Drive Groups = 1


[root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /e8 /s14-15 show
CLI Version = 007.1323.0000.0000 May 25, 2020
Operating system = VMkernel 7.0.1
Controller = 0
Status = Success
Description = Show Drive Information Succeeded.


Drive Information :
=================

-----------------------------------------------------------------------------
EID:Slt DID State DG       Size Intf Med SED PI SeSz Model           Sp Type 
-----------------------------------------------------------------------------
8:14     28 UGood F  931.000 GB SATA SSD N   N  512B CT1000MX500SSD1 U  -    
8:15     29 UGood F  931.000 GB SATA SSD N   N  512B CT1000MX500SSD1 U  -    
-----------------------------------------------------------------------------

EID=Enclosure Device ID|Slt=Slot No.|DID=Device ID|DG=DriveGroup
DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare
UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface
Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info
SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign
UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded
CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded
UBUnsp=UBad Unsupported|Rbld=Rebuild
</code>
  * Import foreign configurations: <code bash>
[root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /fall import
CLI Version = 007.1323.0000.0000 May 25, 2020
Operating system = VMkernel 7.0.1
Controller = 0
Status = Success
Description = Successfully imported foreign configuration
</code>
  * Recheck status: <code bash>
[root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /v1 show
CLI Version = 007.1323.0000.0000 May 25, 2020
Operating system = VMkernel 7.0.1
Controller = 0
Status = Success
Description = None


Virtual Drives :
==============

-----------------------------------------------------------------------
DG/VD TYPE  State Access Consist Cache Cac sCC       Size Name         
-----------------------------------------------------------------------
2/1   RAID1 Optl  RW     No      NRWTD -   OFF 931.000 GB local-ssd-1t 
-----------------------------------------------------------------------

VD=Virtual Drive| DG=Drive Group|Rec=Recovery
Cac=CacheCade|OfLn=OffLine|Pdgd=Partially Degraded|Dgrd=Degraded
Optl=Optimal|dflt=Default|RO=Read Only|RW=Read Write|HD=Hidden|TRANS=TransportReady|B=Blocked|
Consist=Consistent|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|
AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled
Check Consistency
</code>