Skip to content

unstable (bi-modal) render durations #585

Description

@mdjastrzebski

Describe the bug
I have observed that in the recent versions of React/React Native render durations seem to cluster around 2 values. The expected behavior would be to cluster around single value (i.e. the expected render duration).

Example results:

Mean: 78.2 ms
Stdev: 23.3 ms (29.8%)
Runs: 83.8 52.4 52.6 79.9 106.7 105.2 56.4 53.9 67.3 105.6 105.6 70.5 53.6 54.5 107.5 106.6 85.1 53.8 57.3 105.5
Warmup runs: 105.0
Removed outliers: (none)
Source: #584 (comment)

There is one cluster around 52ms and secodn around 105, with some results happening in-between.

To Reproduce
Run complex enough test (e.g. AsyncComponent from Reassures test-apps/native) under recent:

  • React Test Renderer 19.1+
  • React DOM 19.1
  • Test Renderer 1.1 (which correponds to React 19.1)

The results should cluster around 2 separate values.

When running under React Test Renderer/React DOM 18.x or 19.0 or Test Renderer 1.0 the results cluster around single value.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions