JLSE provides testbeds for the evaluation of high-performance computing systems.

Note: Access to certain testbeds are restricted as it may require an NDA with the vendor for your home institution or it is provisionally allowed for certain projects. If you need access to any of these resources please send an email to help@jlse.anl.gov with a link to your project information on the website, as well as the users and home institutions that need access.

System NameDescriptionHostname(s)Service Date
NVIDIA A40Gigabyte G242-Z11
AMD 7532 32c 2.4Ghz
DDR4-3200 256GB (8x32G DIMMs) RAM
1x Nvidia A40 48GB GDDR6 PCIe 4.0
Mellanox ConnectX-6 EDR
Intel P4510 2TB NVMe
Access Restricted (gpu_a40 queue)
Nvidia A100Gigabyte G242-Z11
AMD 7532 32c 2.4Ghz
DDR4-3200 256GB (8x32G DIMMs) RAM
1x Nvidia A100 40GB PCIe 4.0
Mellanox ConnectX-6 EDR
Intel P4510 2TB NVMe

Access Restricted (gpu_a100 queue)
AMD GPU MI50Gigabyte G482-Z51
- 2x 7742 64c Rome
- 4x AMD MI50 32GB GPUs
- Infinity Fabric
- 256GB DDR-3200 RAM

Access Restricted
AMD GPU MI100- 2x AMD EPYC 7543 32c (Milan)
- 4x AMD MI100 32GB GPUs
- Infinity Fabric
- 512GB DDR4-3200
Access Restricted
amdgpu02 and amdgpu032021-07-01
ArcticusQty 17 - Intel Development Chassis
- 2x Intel development GPU card (Code name XeHP)
- 2x Future Intel Xeon CPU

Access Restricted
CPL "Cooper Lake"Qty 2 - Supermicro SYS-240P-TNRT
- 4 Intel(R) Xeon(R) Platinum 8354H CPU @ 3.10GHz 18 cores/36 threads
- 384GiB DDR4 3200 MHz Memory
- 4x Mellanox MT27800
- 2x Intel X710 10GBASE-T
- 2x Intel X710 10 Gigabit SFP+

Access Restricted (cpl_8354H queue)
CascadeQty 20 - Supermicro SYS-1029GQ-TNRT
- 2x Intel Xeon Gold 6226R
- 12 x 16 GB DDR4-2666
- 1x Mellanox ConnectX-5 EDR
- 2x 1.0TB Intel SSD DC P4510 NVMe

Access Restricted (cascade queue)
WitherspoonQty 1 - IBM Power9 servers with 2 x 20-core Power9 processors @ 2.4GHz (3.00GHz turbo mode)
- 4x NVIDIA Volta V100 16GB SMX2 GPUs
- 512GB DDR4 2666Mhz memory
- 2x 960GB internal SSDs
- 1x 1.6TB NVMe Flash adapter
- Mellanox ConnectX-5 EDR

Access Restricted (gpu_power9_v100_smx2 queue)
IrisQty 20 - SuperMicro X11SSH-GF-1585 Server Motherboard
- Intel Xeon E3-1585 v5 CPU w/ Intel Iris Pro Graphics P580
- 4x 16GB DDR4-2666 SODIMMs (operating at DDR4-2133)
- 1GbE Onboard

Access Restricted
GPU_V100_SMX2Qty 3 - SuperMicro SuperServer 1029GQ-TVRT
- 4x NVIDIA Tesla V100 SXM2 w/32GB HBM2
- 2x Intel Xeon Gold 6152 CPU 22c 2.10GHz
- 192GB RAM DDR4-2666
- Mellanox ConnectX-5 EDR

Access Restricted (DGX Queue)
I2S - SDN TestbedQty: 1 - Intel HNS2600KPR, 2x E5-2667v4 16c 3.20GHz, 128GB RAM, Mellanox ConnectX-4 HCA
Qty: 1 - IBM x3650 M4, Mellanox ConnectX-4 HCA
Qty: 2 - Mellanox SN2100 16x 100GbE Switch

Access Restricted
EPYCQty 2 - Gigabyte R181-Z91, 2x AMD EPYC 7601 32c 2.20Ghz, 128GB RAM, Mellanox ConnectX-5 EDRepyc00-012018-06-25
PetrelkubeKubernetes testbed managed with Rancher

Qty: 14 - IBM x3650 M4, Intel P3700 NVMe 800GB, Mellanox ConnectX-4 40GbE

Access Restricted
SkylakeQty 13 - Intel S2600WF, (12 - 2x Intel Xeon Platinum 8180M CPU @ 2.50GHz, 1 2x Intel Xeon Platinum 8176 CPU @ 2.10GHz), 768GB RAM, EDR IB, Intel P4500 1TB NVMe SSD, Intel P4800X 375GB NVMe Optane SSDskylake00-122018-01-18
ATOSAtos Quantum Learning Machine (QLM-35), Bull Bullion based system with 4x Intel E7-8890 v4, 3TB RAM

Access Restricted
DGXNvidia DGX-1, 8x Nvidia V100 GPUs with NVlink, https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/dgx-1/NVIDIA-DGX-1-Volta-AI-Supercomputer-Datasheet.pdf

Access Restricted (DGX Queue)
ItQty 13 - Intel HNS2600KPR, 2x E5-2699v4 22c 2.2Ghz, 128GB RAM, Omni-path HCA, 200GB SATA SSDit00-122016-05-25
GomezQty 5 - SuperMicro 4048B-TR4FT, 4 Socket - Intel Haswell-EX E7-8867v3 16c 2.5Ghz. 1TB RAM, Mellanox EDR HCA, 200GB SATA SSDgomez00-042016-05-25
FirestoneQty 1 - IBM S822LC, OpenPower, Power8 10c 2.92Ghz, Mellanox EDR, Nvidia K80 GPU, Qty: 2 - 400GB SATA SSD, 128GB RAMfirestone2016-04-11
KNLQty 4 - Intel Adam's Pass S7200AP, (2 - KNL 7210 64c 1.3Ghz, 2 KNL 7250), 192GB RAM, (2 - Samsung 128GB NVMe SSD), Omni-path HCA, 200GB SATA SSD

Access Restricted (Open Intel Resources)
Petrel v3Qty 2 - Intel HNS2600KPF, E5-1660v3, 4-Nodes in 2RU chassis, 1x40GbE WAN, 1x100GbE for Ceph.

See: http://petrel.alcf.anl.gov

Access Restricted

ThingQty 8 - SuperMicro X10DRi, Intel Haswell-EP E5-2699v3, 128GB RAM, Mellanox EDR, 200GB SATA SSD, 4RUthing00-072014-12-12
Fujisu A64FXHPE Apollo 80
8x Fujitsu A64FX ARM CPU
32GB HBM2 per CPU

Access Restricted (arm-users)
DevEPQty 20 - Intel Development Chassis
- 2x Intel development GPU card (Code name XeHP)
- 2x Future Intel Xeon CPU
© 2020 Joint Laboratory for System Evaluation