13th November 2021, 3 min read

Performance Comparison Saaze vs. Hugo vs. Zola

Original post is here eklausmeier.goip.de/blog/2021/11-13-performance-comparison-saaze-vs-hugo-vs-zola.

Zola is a static site generator written in Rust. Hugo is a static site generator written in Go. Simplified Saaze, Saaze for short, is written in PHP.

Task: Compare run times of Saaze vs. Hugo vs Zola. I didn't find a direct comparison so far. There is a comparison of Eleventy vs. Gatsby vs. Hugo vs. Jekyll vs. Next vs. Nuxt.

Installation size on Arch Linux for x86 and Odroid/ARM.

Run times are all in seconds. Two different machines were used.

1. x86 is Intel NUC i5-4250U, 4 cores, max 2.6 GHz running Arch Linux 5.14.14
2. ARM is Cortex-A7, 8 core, big-little, max 1.5 GHz running Arch Linux 4.14.180-3

The 13 posts are the music posts in this blog, the 347 posts is the sum of all posts in this blog. 681 and 1349 are just copies of the 347 posts. Below table disadvantages the Simplified Saaze generator as neither PHP's OPCache nor JIT was enabled!

Initially one would think that static site generators written in Go and Rust are faster than generators written in PHP. This time, PHP beats them all.

User times in Hugo are way higher as Hugo uses threads to parallelize the task. But although it fully utilizes all the cores, it is way slower than Saaze and Zola. Neither Saaze nor Zola use threads. So if Saaze would use threads then the difference in run time would even get bigger. It would be quite easy to use threads in Saaze, i.e., so called entries and the chunks of collections could easily be processed in parallel.

Comparing the x86 real- and user-time:

Comparing the ARM real- and user-time:

Results for Hugo:

1. Hugo is always the slowest, contrary to its constant bragging about "The world’s fastest framework for building websites"
2. Hugo's templates are difficult to use, also see Migrating my blog to Zola
3. Hugo is a CPU hog, also see Converting WordPress Export File to Hugo
4. Hugo's Goldmark implementation does not honor plain, simple HTML
5. In defense of Hugo: Hugo automatically uses syntax highlighting. This clearly slows down processing. I switched off syntax highlighting in Zola as well, otherwise Zola would be roughly two times slower.

So apparently it was a wise decision not to use Hugo for this blog, but go with Saaze instead, being way simpler to use and an order of magnitude faster.

Added 13-Jan-2022: Similar findings with regard to inferior performance of Hugo vs. Zola were found in Static site generator benchmarks. The numbers are:

Here Blade is another static site generator written by Maroš Grego. It is programmed in Rust and uses the mustache templating system.

The Nift static site generator also beats Hugo by a factor of four for real time. For user time, i.e., not accounting for multi-core CPUs, Hugo is more than 6-times slower. The results:

Nift is written in C, C++ and Lua. Source code in GitHub. It was written by Nicholas Ham.

Added 11-Feb-2024: Below numbers are from Which generator builds Markdown the fastest? Numbers are in seconds and were measured on a MacBook Air (M1, 2020), macOS Monterey 12.5, 16 GB memory.

According CPU Monkey Intel Core i5-4250U vs Apple M1 the M1 is roughly three to six times faster than the i5 used in above benchmarks.