Lightbits Hardware Requirements

1. Introduction

Lightbits product is software-defined block storage (SDS) bringing hyperscale efficiency and flexibility to all. It delivers high-performance, highly available disaggregated storage on standard servers, NICs and SSDs. Lightbits delivers an unmatched combination of performance, resiliency and scalability. It simplifies infrastructure management and operations while simultaneously lowering cost.

The purpose of this document is to describe hardware and resources required to install or upgrade Lightbits.

2. Hardware and System Resources

To install or upgrade Lightbits, your hardware and system resources must meet requirements described in the tables below.

General guidelines:

  • Memory (RAM):

    • The recommended memory amounts in the tables below apply to installations with non-compressible data. If the stored data is compressible, the memory should be increased proportionally to the expected compression ratio.
    • It is strongly recommended to populate all memory channels to avoid performance degradation.
  • Storage SSDs

    • If two Lightbits instances are planned to be installed on the same server, the populated NVMe SSDs should be evenly distributed between the CPUs.
  • Data NIC:

    • If two Lightbits instances are planned, two Data NICs should be installed - one per CPU. For a single Lightbits instance, one Data NIC is sufficient.

2.1. Dual Socket Platforms - Intel

Note: supported CPUs: Intel Xeon 4th, 5th or 6th Gen

BOM ItemQtyDetails / Comments
Chassisup to 24 NVMe SDD drives
CPU232C/64HT per CPU (e.g. 6430, 6438Y+, 6538Y+, 6745P)
RAM

DDR4/DDR5

Total amount required:

For 24x 3.84TB SSDs: 16x 32GB DDR4/DDR5

For 24x 7.64TB SSDs: 32x 32GB DDR4/DDR5

For 24x 15.36TB SSDs: 32x 32GB DDR4/DDR5

For 16x 30.72TB SSDs: 32x 64GB DDR4/DDR5

Boot drive2240GB SSD (SATA or NVMe) drives in hardware Raid-1
Storage SSD6-24NVMe SSDs, 3.86TB or higher; minimum 6 SSDs per Lightbits instance
Journaling SSD1-8Optional, 1-4 per Lightbits instance, high endurance SSDs (DWPD=3+) for higher resilience (e.g. Micron XTR 1920GB, Micron 7600 MAX 12,800GB)
Access NIC11Gbps or 10Gbps to access the operating system
Data NIC2100Gbps NICs (one per socket), single or dual port
PS2Dual redundant power supplies 1400W each or higher

2.2. Single Socket Platforms - AMD or Intel

Note: supported CPUs: Intel Xeon 4th, 5th or 6th Gen; AMD EPYC 2nd Gen or newer

BOM ItemQtyDetails / Comments
Chassisup to 24 NVMe SDD drives
CPU132C/64HT per CPU (e.g. AMD 7452 , 7543P ; Intel: 6430, 6438Y+, 6538Y+, 6745P)
RAM

DDR4/DDR5

Total amount required:

For 24x 3.84TB SSDs: 16x 32GB DDR4/DDR5

For 24x 7.64TB SSDs: 32x 32GB DDR4/DDR5

For 24x 15.36TB SSDs: 32x 32GB DDR4/DDR5

For 8x 30.72TB SSDs: 32x 32GB DDR4/DDR5

Boot drive2240GB SSD (SATA or NVMe) drives in hardware Raid-1
Storage SSD6-24NVMe SSDs, 3.86TB or higher
Journaling SSD1-4Optional high endurance SSDs (DWPD=3+) for higher resilience (e.g. Micron XTR 1920GB, Micron 7600 MAX 12,800GB)
Access NIC11Gbps or 10Gbps to access the operating system
Data NIC2100Gbps NICs (one per socket), single or dual port
PS2Dual redundant power supplies 1400W each or higher

3. Sample Configurations

This section lists sample storage server configurations which meet Lightbits requirements and can be used as a reference.

For more information and available options, contact Lightbits info@lightbitslabs.com.

3.1. Intel Xeon

3.1.1. Dell PowerEdge R760 Rack Server

Product Description # / NameQty
PowerEdge R760 Server1
Trusted Platform Module 2.0 V31
2.5" Chassis with up to 24 NVMe Direct Drives, 2 CPU1
Fan Foam, HDD 2U1
Intel Xeon-Gold 6438Y+ 2.0GHz 32-core 205W1
Intel Xeon-Gold 6438Y+ 2.0GHz 32-core 205W1
No HBM1
Heatsink for 2 CPU configuration (CPU greater than 165W)1
Performance Optimized1
4800MT/s RDIMMs1
64GB RDIMM, 4800MT/s, Dual Rank 16Gb Base x4, BCC16
C30, No RAID for NVME chassis1
No Controller1
No Hard Drive1
7.68TB Enterprise NVMe Read Intensive AG Drive U.2 Gen4 with carrier24
Performance BIOS Setting1
UEFI BIOS Boot Mode with GPT Partition1
Very High Performance Fan x61
Dual, Fully Redundant (1+1), Hot-Plug Power Supply 1400W, Mixed Mode1
NEMA 5-15P to C13 Wall Plug, 125 Volt, 15 AMP, 10 Feet (3m), Power Cord, North America2
NBR 14136 2P+T to C13, 250V, 10A, 2m, Brazil Power Cord2
Riser Config 5, Half Length, 2x16 FH Slots (Gen4), 2x16 LP Slots (Gen4), 2x16 FH Slots (Gen5)1
Motherboard supports ONLY CPUs below 250W (cannot upgrade to CPUs 250W and above)1
iDRAC Datacenter 16G with OpenManage Enterprise Advanced Plus1
Mellanox ConnectX-6 DX Dual Port 100GbE QSFP562
Broadcom 5720 Dual Port 1GbE LOM1
PowerEdge 2U LCD Bezel1
BOSS-N1 controller card + with 2 M.2 480GB (RAID 1)1
No Quick Sync1
¡DRAC, Legacy Password1
¡DRAC Service Module (ISM), NOT Installed1
¡DRAC Group Manager, Disabled1
No Operating System1
No Media Required1
ReadyRails Sliding Rails With Cable Management Arm1
No Systems Documentation, No OpenManage DVD Kit1
PowerEdge R760 Shipping, BCC1
PowerEdge R760 Shipping Material, BCC1
PowerEdge R760 No CCC, No CE, and No BIS Marking1
5 Years Prosupport Next Business Day Onsite Service-BZ1
No Installation-LABZ1

3.1.2. HPE Alletra Storage Server 4110

Product # / NameQtyProduct Description
S2V32AAE1HPE AL STG SVR 4XXX DAC Nw Op Cnf Trk
S2V33AAE1HPE AL STG SVR 4XXX 25C Op Temp Cnf Trk
P51168-B211HPE Alletra Storage Server 4110 20EDSFF Configure-to-order System
P50806-B212Intel Xeon-Gold 6438Y+ 2.0GHz 32-core 205W Processor Kit for HPE Alletra Storage Server 41X0
P43328-K2124HPE 32GB (1x32GB) Dual Rank x8 DDR5-4800 CAS-40-39-39 EC8 Registered Smart Memory Kit
P40515-K212HPE 1.92TB NVMe Gen3 Mainstream Performance Read Intensive M.2 Multi Vendor SSD
P57807-K2112HPE 15.36TB NVMe Gen5 High Performance Read Intensive E3S EC1 EDSFF PM1743 SSD
P21112-B212Intel E810-CQDA2 Ethernet 100Gb 2-port QSFP28 Adapter for HPE
P44712-B212HPE 1800W-2200W Flex Slot Titanium Hot Plug Low Halogen Power Supply Kit
P51206-B211HPE Alletra Storage Server 4110 NVMe M.2 Enablement Kit
P26489-B211HPE ProLiant DL300 Gen10 Plus 1U Cable Management Arm for Rail Kit
P48183-B211HPE NS204i-u Gen11 NVMe Hot Plug Boot Optimized Storage Device
P51169-B212HPE Alletra Storage Server 4110 High Performance Heat Sink Kit
P51673-B211HPE Alletra Storage Server 4110 High Performance Fan Kit
P52341-B211HPE ProLiant DL3XX Gen11 Easy Install Rail 3 Kit

3.1.3. HPE ProLiant DL380 Gen11

Product # / NameQtyDescription
P52534-B211HPE ProLiant DL380 Gen11 8SFF NC Configure-to-order Server
P52534-B21 ABA1HPE DL380 Gen11 8SFF NC CTO Svr
P49622-B212Intel Xeon-Gold 6448H 2.4GHz 32-core 250W Processor for HPE
P43328-B2132HPE 32GB (1x32GB) Dual Rank x8 DDR5-4800 CAS-40-39-39 EC8 Registered Smart Memory Kit
P48814-B213HPE DL380 Gen11 8SFF U.3 Prem Kit
P50224-B2124HPE 15.36TB NVMe Gen4 High Performance Read Intensive SFF BC U.3 PM1733a SSD
P48803-B211HPE DL380 Gen11 2U 3x16 Prim Riser Kit
P25527-B212HPE DL385 Gen10 Plus 12Gb NVMe 2-port Adapter
P26253-B211Broadcom BCM57416 Ethernet 10Gb 2-port BASE-T Adapter for HPE
P51083-B211HPE ProLiant DL380 Gen11 2U x16/x16/x16 Secondary Riser Kit
P22767-B212Intel E810-CQDA2 Ethernet 100Gb 2-port QSFP28 OCP3 Adapter for HPE
P44712-B212HPE 1800W-2200W Flex Slot Titanium Hot Plug Low Halogen Power Supply Kit
E5Y43A1HPE OneView for ProLiant DL Server including 3yr 24x7 Support FIO Bundle Physical 1-server LTU
P48825-B211HPE ProLiant DL380 Gen11 8SFF CPU1/2 NVMe Cable Kit
P48827-B211HPE ProLiant DL3XX Gen11 OCP1 x16 Enablement Kit
P48828-B211HPE ProLiant DL3XX Gen11 OCP2 x16 Enablement Kit
P54874-B211HPE ProLiant DL380 Gen11 8SFF to Retimer/-P Controller Cable Kit
P48820-B211HPE DL380/DL560 G11 2U High Perf Fan Kit
P48183-B211HPE NS204i-u Gen11 NVMe Hot Plug Boot Optimized Storage Device
P48818-B212HPE DL380/DL560 G11 High Perf 2U HS Kit
P52152-B211HPE ProLiant DL380 Gen11 NS204i-u Internal Cable Kit
P52341-B211HPE ProLiant DL3XX Gen11 Easy Install Rail 3 Kit
P53635-B211HPE ProLiant DL380 Gen11 24NVME Balanced I/O FIO Bundle Kit
P54542-B211HPE ProLiant DL380 Gen11 NS204i-u FIO Bundle Kit

3.1.4. SuperMicro Hyper SuperServer SYS-221H-TN24R

Product # / NameQtyDescription
Chassis1Hyper 2U, 24x2.5" NVMe, Super X13DEM, CSE-HS219-R1K63P
CPU2Intel® Xeon® Gold 5418N Processor, 45M Cache, 1.80 GHz
RAM3232GB DDR5 @ 4000MHz
Boot drive2M.2 240GB SATA or NVMe
Storage SSD20Intel® SSD D7-P5510 7.68TB, 2.5in PCIe 4.0 x4, 3D4, TLC
Access NICs1AOC-AG-i2M, Intel® i350 GbE Controller, 2x 1Gbps ports: 2x RJ45 Connectors
Data NIC2

º AOC-S100GC-i2C - Intel Ethernet 800 QSPF28 dual-port

º AOC-MCX516A-CCAT - Nvidia ConnectX-5 EN 100GbE QSFP28 dual-port

PS21600W Redundant Power Supplies with PMBus

3.1.5. SuperMicro BigTwin SuperServer SYS-221BT-HNR

Product # / NameQtyDescription
Chassis1BigTwin 2U, 24x2.5" NVMe, Super X13DET-B
CPU4x 2Intel® Xeon® Gold 6438Y+, 32C 2GHz
RAM4x 1632GB DDR5
Boot drive4x 2M.2 240GB SATA or NVMe
Storage SSD4x 6Kioxia CM7 U.2 7.68TB, 2.5in PCIe TLC
Access NICs4x 1AOC-AG-i2M
Data NIC4x 1Nvidia ConnectX-6 VPI 200G
PS22x 3000W Redundant

3.1.5. SuperMicro Storage SuperServer SSG-121E-NE316R

Product # / NameQtyDescription
Chassis1SuperServer CSE-126E32-R1K62P 1U, 16xE3.S NVMe, Super X13DSF-A
CPU2Intel® Xeon® Gold 6438Y+, 32C 2GHz
RAM1632GB DDR5
Boot drive2M.2 240GB SATA or NVMe
Storage SSD16Kioxia CM7 E3.S (7.5mm) 7.68TB, 2.5in PCIe TLC
Access NICs1AOC-AG-i2M
Data NIC1 or 2Nvidia ConnectX-6 VPI 200G
PS22x 3000W Redundant

3.1.6. SuperMicro BigTwin SuperServer SYS-222BT-HNR

Product # / NameQtyDescription
Chassis1BigTwin 2U, 24x2.5" NVMe, Super X14DBT-B
CPU4x 2Intel® Xeon® Gold 6710E, 64C 2.4GHz
RAM4x 1632GB 5600 MT/s
Boot drive4x 2SAMSUNG MZ1L2960HCJR-00A07 960GB
Storage SSD4x 6SAMSUNG MZWLO3T8HCLS-00A07 3.84TB
Access NICs4x 1On-board 1GbE
Data NIC4x 1BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb
PS22x 3600W Redundant

3.2. AMD EPYC

Note: At present, only single-socket AMD systems are supported.

3.2.1. HPE ProLiant DL385 Gen10 Plus V2

Product # / NameQtyDescription
Base server1HPE ProLiant DL385 AMD Epyc Gen10 Plus 8x SFF
Power Supplies2HPE 1600W Flex Slot Platinum Hot Plug Low Halogen Power Supply Kit
CPU1AMD EPYC 7452 (2.35GHz/32-core/155W) Processor Kit
Memory16HPE 32GB (1x32GB) DDR4-3200 CAS-22-22-22 Registered Smart Memory
Hard Drive Kits1HPE DL385 Gen10 Plus 16NVMe Balanced Support FIO Bundle
NVME 2.5"16HPE 7.68TB NVMe Read Intensive SFF 2.5-in U.2
Flexible LOM Adapters1HPE Ethernet 1Gb 4-port 331FLR Adapter
PCI-Express Networking Adapters1HPE Ethernet 100Gb 1-port QSFP28 PCIe3 x16 MCX515A-CCAT Adapter
Trusted Management1HPE Trusted Platform Module (TPM) 2.0
Security1HPE Gen10 2U Bezel Kit
Rail Kits1HP 2U Small Form Factor Ball Bearing Rail Kit
Cable Management Arms1HP 2U Cable Management Arm for Easy Install Rail Kit
Embedded Management1HPE iLO Advanced

3.2.2. Lenovo ThinkSystem SR665v3

Product # / NameQtyDescription
BLKK1ThinkSystem V3 2U 24x2.5" Chassis
BR301ThinkSystem AMD EPYC 9354 32C 280W 3.25GHz Processor
BQ292ThinkSystem SR665 V3 2U High Performance Heatsink
BQ368ThinkSystem 64GB TruDDR5 4800MHz (2Rx4) 9x4 RDIMM-A
BC4V1Non RAID NVMe
B98C3ThinkSystem 4-Port PCIe Gen4 NVMe Retimer Adapter
BNEF8ThinkSystem 2.5" U.3 6500 ION 30.72TB Read Intensive NVMe PCIe 4.0 x4 HS SSD
BH8D1ThinkSystem 2U/4U 8x2.5" NVMe Backplane
B8P91ThinkSystem M.2 NVMe 2-Bay RAID Enablement Kit
BTTY1M.2 NVMe
BKSR2ThinkSystem M.2 7450 PRO 960GB Read Intensive NVMe PCIe 4.0 x4 NHS SSD
BPPX1ThinkSystem Broadcom 57508 100GbE QSFP56 2-Port OCP Ethernet Adapter
AUZV1ThinkSystem Broadcom 5719 1GbE RJ45 4-Port PCIe Ethernet Adapter
BLKL1ThinkSystem V3 2U x16/x8/x8 PCIe Gen4 Riser1 or 2
BLKM1ThinkSystem V3 2U x16/x16/E PCIe Gen4 Riser1 or 2
BMUF2ThinkSystem 1800W 230V Platinum Hot-Swap Gen2 Power Supply
640022.8m, 13A/100-250V, C13 to C14 Jumper Cord
BLL66ThinkSystem 2U V3 Performance Fan Module
B91Y1ThinkSystem Toolless Slide Rail Kit v2 with 2U CMA
BQQ31ThinkSystem 2U V3 EIA Latch with VGA Port
BPKR1TPM 2.0
BQ2B1ThinkSystem SR665 V3 MB
BRPJ1XCC Platinum
BQ312ThinkSystem MS 2U common Airductr Filler
BC4X1MS 2FH Riser Filler
BQ2Z1ThinkSystem 2U MS main Airduct
BXGY1Right EIA with FIO assembly
BQQ61ThinkSystem 2U V3 EIA right with FIO
BPKD1ThinkSystem 2U MS 3FH Riser 1&2 Cage w/Label1
BLLD1ThinkSystem 2U MS 3FH Riser 1&2 Cage
BQ351ThinkSystem SR665 V3 Absolut-RoW RoT Module

3.2.3. SuperMicro A+ Server AS-1116CS-TN

Product # / NameQtyDetails
ChassisChassis with up to 12x2.5" Drives
CPU1AMD Turin 9555P UP 64C/128T 3.2G 256MB 360W SP5 HF,RoHS
RAM1264GB DDR5-6400 2Rx4 LP (16Gb) ECC RDIMM, RoHS
Boot drive2Micron 7450 PRO 480GB NVMe PCIe 4.0 M.2 22x80mm 3D TLC
Storage SSD8Micron 7600 PRO 15.36TB E3.S
Access NICs1AIOM 2-port 10GBase-T RJ45,based on Intel Carlsville X71
Data NIC1Nvidia ConnectX-6 DX Dual Port 100GbE Network Adapter, Low Profile
PS21U CRPS Redundant 1000W Titanium ( 185X73.5X40mm)

3.2.4. Dell PowerEdge R7515

Product # / NameQtyDetails
ChassisChassis with up to 24x2.5" Drives
CPU1AMD EPYC 7452 (32C/64HT) @ 2.35GHz
RAM1632GB RDIMM, 3200MT/s, Dual Rank, 8Gb BASE x4
Boot drive2480GB SSD SATA Read Intensive 6Gbps 512 2.5in Hot-plug AG Drive,3.5in HYB CARR, 1 DWPD,
Storage SSD24Intel® SSD D7-P5510 3.84TB, 2.5in PCIe 4.0 x4, 3D4, TLC
Access NICs2On-board RJ45 1GBase-T LAN port
Data NIC1Nvidia ConnectX-6 DX Dual Port 100GbE QSFP56 Network Adapter, Low Profile
PS1Dual, Hot-plug, Redundant Power Supply (1+1), 1600W

Appendix A. Hardware Compatibility List (HCL)

This section specifies the system parts <u>tested by Lightbits</u> for their compatibility with Lightbits SDS.

Note:

LightOS’ ability to work with various hardware is not limited to this list only. Please contact Lightbits Support for any other hardware not listed below.

A.1. High-Speed Ethernet Adapters

VendorModelP/N
BroadcomNetXtreme P1100p 100GbE SPBCM957454A4540C
BroadcomNetXtreme P225P 25GbE DPBCM957414A4142CC
BroadcomNetXtreme II P2100 DPBCM957508-P2100G
IntelE810 Series Adapter 100GbE SPE810-CQDA1
IntelE810 Series Adapter 100GbE DPE810-CQDA2
IntelE810 Series Adapter 100GbE DPE810-2CQDA2
Nvidia/MellanoxConnectX-4 EN 100GbE SPMCX415A-CCAT
Nvidia/MellanoxConnectX-4 LX 25GbE DPMCX4121A-ACAT
Nvidia/MellanoxConnectX-5 100GbE SPMCX515A-CCAT
Nvidia/MellanoxConnectX-5 100GbE DPMCX516A-CDAT
Nvidia/MellanoxConnectX-5 100GbE DPMCX516A-CCAT
Nvidia/MellanoxConnectX-6 Dx EN 100GbE DPMCX623106AN-CDAT
Nvidia/MellanoxConnectX-6 Dx EN adapter card, 200GbEMCX623105AN-VDAT
Nvidia/MellanoxConnectX-7 Adapter Card, PCI Express 5.0 x16, DPMCX755106AC-HEAT
SolarflareXtremeScale SFN-X2542 DP QSFP28 PTP2542303
SolarflareXtremeScale SFN8522 DP 10GbE SFP+8522002

A.2. NVMe SSDs for data storage

VendorFamily
KioxiaCM7-R
KioxiaCM3
KioxiaCD5
KioxiaCM5
KioxiaCD6
Micron7300
Micron9200
Micron9300
Micron7400
Micron7450
Micron9400
Micron6500-ION
Micron7500
SamsungPM1743
SamsungPM960
SamsungPM983
Solidigm/IntelP4510
Solidigm/IntelP4610
Solidigm/IntelD5-P4320
Solidigm/IntelD5-P4326
Solidigm/IntelD7-P5500
Solidigm/IntelD7-P5510
Solidigm/IntelD7-P5520
Solidigm/IntelD5-P5430
Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard