-
Notifications
You must be signed in to change notification settings - Fork 5
Continuous Speed Testing
Victor Zhang edited this page Jan 23, 2022
·
13 revisions
Ran on kron17 (nonbinary) stream with 46 groups, group size 1, default standalone buffers behavior.
Averaging over 10 trials
Flush timings
0: 122.017 secs
1: 122.211 secs
2: 122.254 secs
3: 122.303 secs
4: 122.309 secs
5: 122.252 secs
6: 122.278 secs
7: 122.313 secs
8: 122.263 secs
9: 122.266 secs
Avg: 122.247 secs
CC timings
0: 2.72022 secs
1: 2.73383 secs
2: 2.74119 secs
3: 2.73515 secs
4: 2.73871 secs
5: 2.72108 secs
6: 2.72492 secs
7: 2.73394 secs
8: 2.7315 secs
9: 2.72432 secs
Avg: 2.73049 secs
CC timings with return
0: 2.76417 secs
1: 2.77416 secs
2: 2.78541 secs
3: 2.77807 secs
4: 2.78299 secs
5: 2.76643 secs
6: 2.76921 secs
7: 2.78191 secs
8: 2.7756 secs
9: 2.77283 secs
Avg: 2.77508 secs
Total timings
0: 126.431 secs
1: 126.735 secs
2: 126.706 secs
3: 126.831 secs
4: 126.76 secs
5: 126.761 secs
6: 126.701 secs
7: 126.847 secs
8: 126.7 secs
9: 126.784 secs
Avg: 126.726 secs
Averaging over 10 trials
Flush timings
0: 48.0838 secs
1: 48.0353 secs
2: 48.1113 secs
3: 48.1384 secs
4: 48.0964 secs
5: 47.98 secs
6: 48.0489 secs
7: 47.9988 secs
8: 48.0078 secs
9: 47.9512 secs
Avg: 48.0452 secs
CC timings
0: 2.75119 secs
1: 2.74627 secs
2: 2.7294 secs
3: 2.74212 secs
4: 2.7498 secs
5: 2.73276 secs
6: 2.74474 secs
7: 2.7414 secs
8: 2.75547 secs
9: 2.7351 secs
Avg: 2.74282 secs
CC timings with return
0: 2.79428 secs
1: 2.79493 secs
2: 2.77242 secs
3: 2.78866 secs
4: 2.79301 secs
5: 2.78093 secs
6: 2.78812 secs
7: 2.78192 secs
8: 2.79887 secs
9: 2.78328 secs
Avg: 2.78764 secs
Total timings
0: 52.6179 secs
1: 52.5023 secs
2: 52.657 secs
3: 52.5901 secs
4: 52.6237 secs
5: 52.4212 secs
6: 52.5721 secs
7: 52.4346 secs
8: 52.5479 secs
9: 52.3977 secs
Avg: 52.5365 secs
Coming Soon
Averaging over 10 trials
Flush timings
0: 441.439 secs
1: 412.718 secs
2: 416.977 secs
3: 443.594 secs
4: 411.939 secs
5: 418.677 secs
6: 436.772 secs
7: 465.221 secs
8: 438.438 secs
9: 444.795 secs
Avg: 433.057 secs
CC timings
0: 95.2318 secs
1: 106.544 secs
2: 100.55 secs
3: 106.729 secs
4: 102.042 secs
5: 108.541 secs
6: 104.476 secs
7: 106.659 secs
8: 101.616 secs
9: 106.782 secs
Avg: 103.917 secs
CC timings with return
0: 102.472 secs
1: 108.119 secs
2: 110.1 secs
3: 108.599 secs
4: 111.705 secs
5: 110.57 secs
6: 114.222 secs
7: 108.518 secs
8: 110.99 secs
9: 108.866 secs
Avg: 109.416 secs
Total timings
0: 703.21 secs
1: 659.727 secs
2: 678.468 secs
3: 695.037 secs
4: 674.59 secs
5: 672.854 secs
6: 699.09 secs
7: 715.749 secs
8: 697.315 secs
9: 695.592 secs
Avg: 689.163 secs
Ran on 1-10/20000 of the stream. All CC attempts take between 7 and 8 rounds.
Flush timings
0: 0.51805 secs
1: 0.515288 secs
2: 0.507673 secs
3: 0.497791 secs
4: 0.496286 secs
5: 0.494386 secs
6: 0.489584 secs
7: 0.48581 secs
8: 0.485796 secs
9: 0.490399 secs
Avg: 0.498106 secs
CC timings [# CCs]
0: 2.5344 secs [8908]
1: 2.69312 secs [1302]
2: 2.71851 secs [329]
3: 2.71779 secs [100]
4: 2.72131 secs [37]
5: 2.7236 secs [18]
6: 2.72304 secs [7]
7: 2.7283 secs [7]
8: 2.72221 secs [5]
9: 2.7242 secs [2]
No limit
Averaging over 40 trials
Flush timings [THIS IS WRONG]
0: 0.000241344 secs
1: 0.000241857 secs
2: 0.000245165 secs
3: 0.000243858 secs
4: 0.000243115 secs
5: 0.000244303 secs
6: 0.000248313 secs
7: 0.000245039 secs
8: 0.000247241 secs
9: 0.000243707 secs
Avg: 0.000244394 secs
CC timings
0: 2.71845 secs
1: 2.7285 secs
2: 2.72145 secs
3: 2.73247 secs
4: 2.71319 secs
5: 2.72761 secs
6: 2.72094 secs
7: 2.73147 secs
8: 2.72713 secs
9: 2.72556 secs
Avg: 2.72468 secs
CC timings with return
0: 2.7536 secs
1: 2.77573 secs
2: 2.76467 secs
3: 2.77965 secs
4: 2.7585 secs
5: 2.77477 secs
6: 2.76941 secs
7: 2.77872 secs
8: 2.7785 secs
9: 2.77278 secs
Avg: 2.77063 secs
Total timings
0: 126.626 secs
1: 126.523 secs
2: 126.679 secs
3: 126.512 secs
4: 126.644 secs
5: 126.538 secs
6: 126.702 secs
7: 126.505 secs
8: 126.669 secs
9: 126.49 secs
Avg: 126.589 secs
No limit
Averaging over 40 trials
0: 0.0403195 secs
1: 0.0373552 secs
2: 0.0379587 secs
3: 0.0376446 secs
4: 0.0377972 secs
5: 0.037786 secs
6: 0.0380764 secs
7: 0.0383319 secs
8: 0.0373426 secs
9: 0.0376959 secs
Avg: 0.0380308 secs
No limit:
Averaging over 70 trials
0: 29.9408 secs
1: 29.8892 secs
2: 29.9117 secs
3: 29.9506 secs
4: 29.9271 secs
5: 29.972 secs
6: 29.8676 secs
7: 29.9261 secs
8: 29.8894 secs
9: 29.9461 secs
Avg: 29.9221 secs
16GB limit
Averaging over 100 trials
0: 33.0179 secs
1: 31.6275 secs
2: 32.6898 secs
3: 31.8545 secs
4: 32.0076 secs
5: 31.6019 secs
6: 31.7544 secs
7: 31.4171 secs
8: 32.1686 secs
9: 31.5286 secs
Avg: 31.9668 secs
8GB limit
Averaging over 46 trials
0: 33.3662 secs
1: 33.3869 secs
2: 33.8504 secs
3: 33.5932 secs
4: 33.7272 secs
5: 33.7083 secs
6: 33.7973 secs
7: 33.6474 secs
8: 33.789 secs
9: 33.648 secs
Avg: 33.6514 secs