JENA Loader Benchmarks

From lotico
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

tdbloader

Jena Version OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec real user sys size on disk input notes
3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 2,214.35s 81,516.25 37m6.921s 37m43.594s 0m53.788s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 2,361.31s 76,443.19 39m31.724s 40m53.732s 0m48.914s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 6,893.81s 26,183.74 168m59.657s 76m50.081s 3m48.615s 28G ttl.gz (1.16G)
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 3,406.35 52,990.90 56m49.589s 57m14.923s 2m57.746s 28G ttl.gz (1.16G) Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB

tdbloader2

Jena Version OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec real user sys size on disk input
3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,320.45s 136,700.08 33m38.361s 43m25.897s 1m19.987s 17G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 4451s(2,637.89s) 68,428.11 74m11.262s 81m6.853s 3m53.422s 17G ttl.gz (1.16G)
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1999s(1,309.61s) 137,831.80 33m18.694s 43m0.869s 1m23.055s 17G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 2921s(2,132.71s) 84,636.64 48m40.710s 63m6.416s 3m1.636s 17G ttl.gz (1.16G) Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB

tdb2.tdbloader

# Jena OS JDK Version CPU Memory HD/SSD # Triples Time Triples/sec / indexer real user sys size on disk compressed/uncompressed notes
1 3.11 Ubuntu 19.04 OpenJDK 11 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 26m55.268s 45m29.688s 2m53.078s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
2 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,497.453s 120,542 24m58.791s 44m8.768s 2m42.672s 28G ttl.gz (1.16G) SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
3 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i5-3210M CPU @ 2.50GHz 16GB HD 180,505,758 126m9.826s 98m45.230s 6m43.824s 28G ttl.gz (1.16G)
4 3.13 Ubuntu 19.04 OpenJDK 12.01 Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz 64GB SSD 180,505,758 1,446.839s 124,759 24m8.094 49m33.557s 2m57.582s 28G ttl.gz (1.16G) --loader=parallel SSD=CT500MX500SSD1;RAM=DDR4 Synchronous 2133 MHz
5 3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 256GB SSD 180,505,758 1,571.540 114,859 26m12.842s 65m18.011s 5m15.307s 28G ttl.gz (1.16G) --loader=parallel;Azure VM EAST US Standard E32-16s_v3 (16 vcpus, 256 GiB memory)Premium SSD (30GiB) + 512GB
6 3.13 Ubuntu 19.04 Open JDK 12.01 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,505,758 741.577s 243,408 12m22.734s 35m52.742s 1m40.389s 28G ttl.gz (1.16G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2
7a 3.13 Ubuntu 20.04*
(5.4.0-37-generic)
Open JDK 12.01 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,505,758 1552.857s 116,241 25m59.561s 47m1.060s 3m48.757s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7b 3.15 Ubuntu 20.04*
(5.4.0-39-generic)
Open JDK 12.01 180,505,759 1,519.713 118,776 25m21.039s 46m40.163s 3m33.435s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7c 3.15 Ubuntu 20.04*
(5.4.0-40-generic)
Open JDK 12.01 180,505,759 1,482.566s 121,752 24m43.948s 45m54.528s 3m27.487s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
7d 3.15 Ubuntu 20.04*
(5.4.0-37-generic)
Open JDK 13.02 180,505,758 1,855.803s 97,266 30m57.179s 54m13.804s 3m44.125s 39G ttl.gz (770M/4G) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
8 3.13 Ubuntu 20.04 LTS Open JDK 13.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 12874.74s 77,671 215m3.603s 328m43.471s 43m33.704s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
9 3.15 Ubuntu 20.04 LTS Open JDK 13.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 12993.75s 76,799 217m2.838s 333m58.845s 43m51.748s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
10 3.15 Ubuntu 20.04 LTS Open JDK 12.0.1 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 1,000,000,001 11,467.457 87,203 191m9.179s 301m50.424s 42m50.488s 214G ttl.gz/.ttl (4.2G/23G ) --loader=parallel;RAM=64GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
11 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-9900K CPU @ 3.60GHz 64GB NVMe SSD 180,524,233 1,303.463 219,154/138,496 21m45.282s 39m13.822s 2m29.940s 28G ttl.gz/.ttl (1.2G/20G ) --loader=phased;RAM=128GB DIMM DDR4 Synchronous 2666 MHz (0.4 ns), Samsung PM981 NVMe SSD M.2 RAID1
12 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-13900 CPU 64GB NVMe SSD 180,524,233 767.214 sec 354,735/235,298 12m48.258s 25m14.011s 1m52.646s 28G ttl.gz/.ttl (1.2G/20G ) --loader=phased;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
13 4.8 Ubuntu 22.04.2 LTS Open JDK 19.0.2 Intel(R) Core(TM) i9-13900 CPU 64GB NVMe SSD 180,524,233 526.929 sec 342,597 8m48.018 25m0.701s 2m5.309s 28G ttl.gz/.ttl (1.2G/20G ) --loader=parallel;RAM=64GB DIMM DDR5 4800MHz Samsung unbuffered, Samsung PM9A3 PCIe® Gen4 x4 RAID1
* performance regression might be related to a bug with ZFS in Ubuntu 20.04 LTS which can be fixed with a v5.6.18 Mainline kernel patch  https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.6.18/ (not yet tested)