Test for Ruby 4.0 performance regression
Ruby 100.0%
5 1 0

Clone this repository

https://tangled.org/mackuba.eu/ruby4.0-regexp-test
git@tangled.org:mackuba.eu/ruby4.0-regexp-test

For self-hosted knots, clone URLs may differ based on your setup.

README.md

Ruby 4.0 regexp test#

There seems to be some kind of performance regression in Ruby 4.0 which showed up in my project, which I think is centered around regexp matching. I extracted some minimal code from the project, which runs significantly slower on Ruby 4.0 than on 3.4.

First version (commit 20923f0028e2c023bd5e48be5118c5f97f4f243a)#

Running on my server, with 1000 loops:

$ asdf shell ruby 3.4.8
$ ruby test.rb 1000
1000 * 940 = 940000 records in 7.439838799 -> 126346.82355299778 records/s
$ asdf shell ruby 4.0.0
$ ruby test.rb 1000
1000 * 940 = 940000 records in 13.67647823 -> 68731.14439198723 records/s

With YJIT:

$ asdf shell ruby 3.4.8
$ RUBYOPT="--enable-yjit" ruby test.rb 1000
1000 * 940 = 940000 records in 7.20592409 -> 130448.22402507435 records/s
$ asdf shell ruby 4.0.0
$ RUBYOPT="--enable-yjit" ruby test.rb 1000
1000 * 940 = 940000 records in 13.457106019 -> 69851.57125706079 records/s

Minimal version (commit ccc62810ac635f3250bebe12a08d79ad5d9dd7f5)#

With 2,000,000 loops:

$ /tmp/ruby34/bin/ruby test.rb 2000000 0
2000000 loops in 0.752061 -> 2659358.748824896 loops/s

$ /tmp/ruby4/bin/ruby test.rb 2000000 0 
2000000 loops in 2.711216 -> 737676.3784220808 loops/s