List of Plotting Performance Tweaks

[gladanimal]

@freeze

• Sort buckets
  • Fewer buckets need more RAM (2x for half, I believe). Usual recommendation is to keep it at 128 but 64 seems worth trying for people who happen to have a lot of excess RAM anyway. Definitely do not sacrifice parallel plot count for fewer buckets.

Plotting process measurements

128 buckets vs 64 buckets Plot size is: 32 Buffer size is: 28000MiB Using 2 threads of stripe size 65536 Using optimized chiapos 128 buckets (blue) overall Time for phase 1 = 5074.508 seconds. CPU (162.030%) Time for phase 2 = 2212.331 seconds. CPU (90.880%) Time for phase 3 = 3109.913 seconds. CPU (139.740%) Time for phase 4 = 284.687 seconds. CPU (102.400%) Total time = 10681.442 seconds. CPU (139.220%) 64 buckets (red) overall Time for phase 1 = 5216.343 seconds. CPU (160.510%) Time for…