IPMI

IPMI interface#

Dedicated: Always use the dedicated IPMI interface. This is the option you want if you’re trying to have the simplest setup, at the expense of additional cabling.

Shared: Always use the LAN1 interface. This is the option you want if you’re trying to reduce your cabling to each server, and understand the tradeoffs. Under the covers, there’s a virtual switch in hardware that’s splitting out traffic to the IPMI card from traffic to the rest of the system; the IPMI card has a separate MAC address to differentiate the traffic. On modern Supermicro boards, you can also set the IPMI traffic to run on a different VLAN from the rest of the system, so you can tag the IPMI traffic. There are some definite security implication to this design; it’s not difficult for the main system to access the IPMI network, if you were trying to keep them separated. A failure of the LAN1 interface often means that you lose primary and out-of-band connectivity at the same time.

Failover (factory default): On boot, detect if the dedicated IPMI interface is connected. If so, use the dedicated interface, otherwise fall back to the shared LAN1. I’ve never found a good use for this option. As best I can tell, this setup is fundamentally flawed - I haven’t tested it extensively, but I’ve heard reports it’ll fail to detect the dedicated interface in many circumstances because the upstream switch isn’t passing traffic - for example, after a power outage if the switch and system come up simultaneously, or if the switch is still blocking during the spanning tree detection. Combine this with the fact that the check only happens at boot, and it’s just generally hard to control what interface you end up using.

한줄 요약: Hub LAN port와 케이블이 충분하면 Dedicated를 사용하고, 효율적으로 사용을 원하면 Shared를 사용하면 된다.

The following raw commands will surely prove useful to the next person who reads this topic. I got these directly from Supermicro support. Cheers:

To get LAN mode: ipmitool raw 0x30 0x70 0x0c 0.

To set LAN mode dedicated: ipmitool raw 0x30 0x70 0x0c 1 0.

To set LAN mode onboard/shared: ipmitool raw 0x30 0x70 0x0c 1 1.

To set LAN mode failover: ipmitool raw 0x30 0x70 0x0c 1 2.

These raw values will also work with ipmicfg (just remember to use -raw instead of raw).

After setting the required LAN mode, do not forget to do a hard reboot.

wake on LAN#

  1. connect IPMI via ssh
  2. cd system1
  3. cd pwrmgtsvc1
  4. show
  5. start # boot server
  6. show # power state 6 –> 1
  7. exit

2 ~ 7 into start /system1/pwrmgtsvc1