You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
CircleCI test jobs (test-unit, test-integration-with-request-node, test-integration-with-smart-contracts) were experiencing intermittent failures due to:
Insufficient compute resources — Tests failing with timeouts/OOM on large and default medium resource classes
Lit Protocol network unavailability — Integration tests hard-failing when the Lit datil-dev network is unreachable (an external dependency outside our control, and one that is being sunset on 2/25)
Tight Jest timeouts — Some async tests had timeouts too close to their actual execution time, causing sporadic failures under load
Impact
Flaky CI blocks the entire PR merge pipeline and wastes developer time re-running builds.
Upgraded resource_class from large/medium to xlarge for all three test jobs
Added graceful skip logic for Lit Protocol tests when the datil-dev network is unreachable
Increased Jest timeouts to 180s for affected tests
Considerations
The xlarge resource class increases CircleCI credit consumption. Request Finance pays for the account — significant increases could prompt them to ask us to set up our own.
Jest timeouts were increased uniformly to 180s (from 15-60s). This is generous and could mask performance regressions. May warrant revisiting with more targeted values.
Problem
CircleCI test jobs (
test-unit,test-integration-with-request-node,test-integration-with-smart-contracts) were experiencing intermittent failures due to:largeand defaultmediumresource classesdatil-devnetwork is unreachable (an external dependency outside our control, and one that is being sunset on 2/25)Impact
Flaky CI blocks the entire PR merge pipeline and wastes developer time re-running builds.
Proposed Solution
Fixed in #1698:
resource_classfromlarge/mediumtoxlargefor all three test jobsdatil-devnetwork is unreachableConsiderations