Don't eagerly fill nils because that is slow (but correct) See https://github.com/ruby/ruby/pull/15536