1. Enable SRIOV in BIOS.
2. Enable SRIOV in Linux Kernel:
Activate Intel VT-d in the kernel by appending the intel_iommu=on parameter to the kernel line of the kernel line in the /boot/grub/grub.conf file.
3. Enable SRIOV in the firmware:
A. Copy the INI file locally or dump it from the device by running flint -d <mstdevice> dc >tmp/ini.ini.
B. Edit the INI file and add these params under HCA :
[root@]# vim /tmp/MCX354A-FCB_A1_SRIOV.ini
--> Add the following lines under [HCA] section:
num_pfs = 1
total_vfs = 64
sriov_en = true
C. reburn the FW by running mlxburn -d mstdevice -fw <fw.mlx> -c /tmp/ini.ini
4. Enable SRIOV in the driver:
A. Create the file /etc/modprobe.d/mlx4_core.conf and add the following content:
options mlx4_core num_vfs=64 port_type_array=2,2 (which will open the driver with 64 VFs and Port1 = eth, port2=eth)
If you need IB port_type shall be = 1
B. Restart the driver.
5. Reboot the Machine.
6. How to check that SRIOV is working: Use LSPCI.
A