PCI option ROM space errors in UEFI servers

RETAIN tip: H197144

Symptom

The BladeCenter Advanced Management Module (AMM) event log and the Integrated Management Module (IMM) chassis/web log on rack mount servers show the following error:

FW/BIOS, firmware progress (Firmware Error) hang

See the following screenshot for the IMM System Event Log (SEL) log entry for more details:

Note: With Unified Extensible Firmware Interface (UEFI)/IMM code released in Third Quarter or later 2010, the message is improved to the following:

Error: Error: FW/BIOS, connector (No Op ROM Space) PCI express Slot X fault

Also, see the following screenshot for the IMM SEL log entry for more details:

The slot number will be identified for the PCI device whose ROM could not run.

Note: The IMM code released in Third Quarter 2010 turns on both the FAULT Light Emitting Diode (LED) and the BRD LED on some systems (System x3850 X5 and System x3690 X5). Turning on the BRD LED is not an expected behavior, and this behavior will be corrected in a newer IMM code targeted for Second Quarter 2011.

Affected configurations

The system may be any of the following IBM servers:

• BladeCenter HS22, type 1936, any model
• BladeCenter HS22, type 7870, any model
• BladeCenter HS22V, type 1949, any model
• BladeCenter HS22V, type 7871, any model
• BladeCenter HX5, type 7872, any model
• BladeCenter HX5, type 7873, any model
• System x3550 M2, type 4198, any model
• System x3550 M2, type 7946, any model
• System x3550 M3, type 4254, any model
• System x3550 M3, type 7944, any model
• System x3620 M3, type 7376, any model
• System x3650 M2, type 4199, any model
• System x3650 M2, type 7947, any model
• System x3650 M3, type 4255, any model
• System x3650 M3, type 7945, any model
• System x3690 X5, type 7147, any model
• System x3690 X5, type 7148, any model
• System x3690 X5, type 7149, any model
• System x3690 X5, type 7192, any model
• System x3850 X5, type 7143, any model
• System x3850 X5, type 7145, any model
• System x3850 X5, type 7146, any model
• System x3850 X5, type 7191, any model
• System x3950 X5, type 7145, any model
• iDataPlex dx360 M2 Server, type 6380, any model
• iDataPlex dx360 M2 Server, type 7321, any model
• iDataPlex dx360 M2 Server, type 7323, any model
• iDataPlex dx360 M3 Server, type 6391, any model

This tip is not software specific.

This tip is not option specific.

Workaround

Best practices for resolution on UEFI systems:

Follow these steps to try to resolve the error messages:

1. Firmware updates may reduce ROM size requirements, so this may be a solution. Ensure all system and adapter firmwares are at latest levels.
2. Disable the Preboot eXecution Environment (PXE) ROM of on-board NICs.
   
   The simplest solution to some PCI Option ROM space errors is to reduce the base system ROM requirements to the minimum necessary. Typically, this can be achieved by disabling the PXE (Network boot) ROM capability of the on-board Ethernet.
   
   Note: This does not disable the device in the operating system, it only disables its capability to perform a network boot.
   
   
   1. Access F1 setup,
   2. Select System Settings, Network, and then PXE Configuration
   3. Select the Media Access Control (MAC) address of the on-board Network Interface Controller (NIC) #1
   4. Change the Enable PXE / PXE Mode setting to "Disabled"
   5. Select Save Changes
   6. Select the MAC address of the on-board NIC #2
   7. Change the Enable PXE / PXE Mode setting to "Disabled"
   8. Select Save Changes
      
      
3. Disable all Legacy options ROMs for all devices not booting.
   
   To disable Legacy Option ROMs boot the machine and press F1 to enter the UEFI menu.
   
   
   1. Select System Settings, Devices and I/O Ports, and then Enable / Disable legacy ROM execution.
      
      If machine is PXE or Storage Area Network (SAN) booting, do not disable the Legacy ROMs for adapters that are actually booting a Legacy (non-Extensible Firmware Interface (EFI)) operating system on the machine
      
      
4. Changing ROM order,
   
   
   1. Access F1 setup
   2. Select System Settings, Devices and I/O, and then Set option ROM execution order.
      
      Ensure that the on-board LSI storage controller is first in the list before the on-board Ethernet Devices.
      
5. Move Fibre Channel and Fibre Channel over Ethernet cards to earlier slots as they tend to require more ROM Space and should initialize first to reduce chance of the problem occurring.
6. PCIe adapters with PCI firmware spec 2.1 should be in earlier slots. PCIe adapter with PCI firmware spec 3.x does not need as much Option ROM space due to design changes.
7. If problem is still occurring and there are any Intel Network Interface Controllers (NICs) in the machine use the following steps.
   
   
   1. Download the "BootUtil" which is the new version of the IBAutil from this link: http://downloadcenter.intel.com/Detail_Desc.aspx?agr=Y&Dwnl dID=19186
   2. Extract the package to a hard drive.
   3. Find the DOS utility in this folder: PREBOOT\APPS\BootUtil\DOS\BootUtil.exe
   4. Find the UEFI utility in this folder: PREBOOT\APPS\BootUtil\EFI64\BOOTUTIL64.EFI
   5. Use the BootUtil with the following parameters:
   
   For DOS machines:
   1. Copy the BootUtil.exe onto a bootable DOS floppy.
   2. Boot the floppy to DOS and run this command:
      
      c:\> BootUtil.exe -FLASHDISABLE -ALL

   For EFI machines:

   1. Copy the BOOTUTIL64.EFI utility to a Universal Serial Bus (USB) Key.
   2. Boot a Full EFI Shell environment and then run the utility from the USB key with this command:
      
      > BOOTUTIL64.EFI -FLASHDISABLE -ALL
   
   For BladeCenter HX5, type 7873, only:
   
   HX5 7873 has a new setup option called "Non-system board PXE" under Legacy Support menu. (EnableNonPlanarPxe in Advanced Settings Utility (ASU).) If you do not need to use PXE boot on NICs other than system board/on-board NICs then this setting could be set to "Disable" to free up more space for option ROM and reduce the chances of this error. HX5 7872 will support this setup option in Third Quarter 2011 UEFI update release.

Additional information

This issue was originally discovered on Legacy (non-UEFI) machines and extensive documentation was provided to explain how to resolve the symptoms.

For more details, see the following .pdf file "IBM Support Info - Resolving 1801, 1802 Errors" which is referenced in RETAIN Tip H194252 (MIGR-5078445):

• http://download.boulder.ibm.com/ibmdl/pub/systems/support/system_x_pdf/resolving_1801-1802_errors.pdf

These errors are due to a permanent restriction of legacy PCI ROM space architecture.

주의 :  위 Tips 에서 workround 3번항목

 

System Settings --> Devices and I/O Ports --> Enable /
Disable legacy ROM execution.

 

항목중에는 Raid-Controller 도 포함되어 있으므로 이 항목을 disable 하면 internal disk 를 인식하지 못하여 booting 이 되지 않습니다.