Skip to content
Open
Show file tree
Hide file tree
Changes from 19 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
fefca9c
pinned aria-at version
stalgiag Sep 3, 2025
42c820c
Merge pull request #1 from stalgiag/pinned-aria-at
stalgiag Sep 3, 2025
94a8090
update pinned version
stalgiag Sep 3, 2025
60237b5
Merge pull request #2 from stalgiag/pinned-aria-at
stalgiag Sep 3, 2025
3c1445a
Experiment with older commit
stalgiag Sep 3, 2025
ef2941b
ignore snapshots on initial test
stalgiag Sep 3, 2025
866e3a1
Update workflow to better match test workflow
stalgiag Sep 3, 2025
68c6b0b
more explicit commit SHA for latest
stalgiag Sep 3, 2025
0bf05be
Use arg for latest commit
stalgiag Sep 3, 2025
1a100bc
Ensure config vars are available
stalgiag Sep 3, 2025
89db4f2
chore: bump ARIA-AT pin to 84bd6c8806b51557ff50c8574533a99810d8a5a8
github-actions[bot] Sep 3, 2025
db9a95b
Clean up docs
stalgiag Sep 4, 2025
e377c78
prevent README lint
stalgiag Sep 4, 2025
c2992cf
Merge branch 'w3c:development' into development
stalgiag Oct 1, 2025
0e7f46f
chore: bump ARIA-AT pin to 2c938a8f7b4cadcffa3c17e6b253473b0dc791f8
github-actions[bot] Oct 1, 2025
4c5ca20
Merge branch 'development' into personal-fork-dev
stalgiag Oct 1, 2025
5c44b6e
Use latest commit in deploy cron jobs
stalgiag Oct 1, 2025
8ed5214
chore: bump ARIA-AT pin to 195ff103c49712cd7baf0aa2333d4bc0cd3b5621
github-actions[bot] Oct 3, 2025
c58bc11
chore: bump ARIA-AT pin to 7170ce1c91efa1e3ca3be69b1fb02e097452758f
github-actions[bot] Oct 7, 2025
9b887e7
chore: bump ARIA-AT pin to 3490ef81735d3cd2e56b41a705655a562e02b45f
github-actions[bot] Oct 21, 2025
1a76b82
chore: bump ARIA-AT pin to e532036964a23d93ed446b09b69dcdf5de731da3
github-actions[bot] Oct 27, 2025
2ec615c
chore: bump ARIA-AT pin to d46530513542e7d984df9c54df5af4b747b984ea
github-actions[bot] Oct 28, 2025
9adcef9
chore: bump ARIA-AT pin to 3dda0d1af9d2f9c8592c6155836fe52f3c615bf4
github-actions[bot] Nov 2, 2025
6c3c7da
chore: bump ARIA-AT pin to 5b831a682a2bd070ab3331272b6b34e7e4c76484
github-actions[bot] Nov 3, 2025
eb44c35
chore: bump ARIA-AT pin to fb175e0c7a6472946ea4e75d4ce42fe4f7f42ffd
github-actions[bot] Nov 4, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/runtest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,7 @@ jobs:
yarn sequelize:test db:migrate
yarn sequelize:test db:seed:all
yarn workspace server db-import-tests:test -c "${IMPORT_ARIA_AT_TESTS_COMMIT_1} ${IMPORT_ARIA_AT_TESTS_COMMIT_2} ${IMPORT_ARIA_AT_TESTS_COMMIT_3} ${IMPORT_ARIA_AT_TESTS_COMMIT_4}"
# Import pinned current commit as well (no args defaults to pinned)
yarn workspace server db-import-tests:test
yarn workspace server db-populate-sample-data:test
# yarn test would run all of these in serial, however we split this up to allow it to continue
Expand Down
152 changes: 152 additions & 0 deletions .github/workflows/update-aria-at.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,152 @@
name: Update pinned ARIA-AT data

on:
schedule:
- cron: '0 6 * * *'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I worry that this daily interval is too big given how often the deployed environment actually checks (and may update). Right now that's every 15mins. Could we match that?

workflow_dispatch: {}

concurrency:
group: update-aria-at
cancel-in-progress: false

jobs:
bump:
name: Test latest upstream and update pin if clean
runs-on: ubuntu-latest
permissions:
contents: write
pull-requests: write
steps:
- name: Checkout the repository
uses: actions/checkout@v4
- name: Install NodeJS 20
uses: actions/setup-node@v4
with:
node-version: 20
cache: npm
- run: yarn --version
- name: Remove pre-bundled versions of postgres to avoid version clashes
run: |
sudo DEBIAN_FRONTEND=noninteractive apt-get purge -y postgresql\*
sudo apt-get autoremove -y
sudo rm -rf /var/lib/postgresql/
sudo rm -rf /etc/postgresql/
- name: Install PostgreSQL 12
run: |
wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | sudo apt-key add -
sudo sh -c 'echo "deb https://apt.postgresql.org/pub/repos/apt $(lsb_release -cs)-pgdg main" > /etc/apt/sources.list.d/pgdg.list'
sudo apt-get -y update
sudo apt-get -y install postgresql-12
sudo apt-get -y install postgresql-client-12
- name: before_install
run: |
sudo sed -i 's/port = 5433/port = 5432/' /etc/postgresql/12/main/postgresql.conf
sudo pg_ctlcluster 12 main restart
- name: before_script
run: |
yarn --frozen-lockfile
npx patch-package
source config/test.env
sudo -u postgres createdb ${PGDATABASE}
echo Created ${PGDATABASE}
sudo -u postgres psql -c "CREATE ROLE ${PGUSER} WITH LOGIN PASSWORD '${PGPASSWORD}'"
sudo -u postgres psql -c "GRANT ALL PRIVILEGES ON DATABASE ${PGDATABASE} to ${PGUSER};"
yarn sequelize:test db:migrate
yarn sequelize:test db:seed:all

- name: Check for latest upstream SHA
id: latest
run: |
set -e
echo "Checking for latest ARIA-AT upstream SHA..."
LATEST=$(git ls-remote https://github.com/w3c/aria-at HEAD | cut -f1)
PINNED=$(cat config/aria-at.version || true)
echo "latest=$LATEST" >> $GITHUB_OUTPUT
echo "pinned=$PINNED" >> $GITHUB_OUTPUT

if [ -z "$LATEST" ]; then
echo "Failed to resolve latest upstream SHA"
exit 1
fi

echo "Current pinned SHA: ${PINNED:-none}"
echo "Latest upstream SHA: $LATEST"

if [ "$LATEST" = "$PINNED" ]; then
echo "Already up to date with latest upstream SHA"
exit 0
else
echo "Found newer upstream SHA, will test and update"
fi

- name: Import and test latest upstream SHA
if: steps.latest.outputs.latest != steps.latest.outputs.pinned
run: |
# Ensure IMPORT_ARIA_AT_TESTS_COMMIT_* env vars are available in this step
source config/test.env
echo "Importing historical commits for testing..."
yarn workspace server db-import-tests:test -c "${IMPORT_ARIA_AT_TESTS_COMMIT_1} ${IMPORT_ARIA_AT_TESTS_COMMIT_2} ${IMPORT_ARIA_AT_TESTS_COMMIT_3} ${IMPORT_ARIA_AT_TESTS_COMMIT_4}"

echo "Importing latest upstream commit: ${{ steps.latest.outputs.latest }}"
yarn workspace server db-import-tests:test -c "${{ steps.latest.outputs.latest }}"

echo "Populating sample data..."
yarn workspace server db-populate-sample-data:test

- name: Run tests (excluding snapshots)
if: steps.latest.outputs.latest != steps.latest.outputs.pinned
run: |
yarn workspace shared prettier
yarn workspace client prettier
yarn workspace server prettier
yarn workspace shared lint
yarn workspace client lint
yarn workspace server lint
yarn workspace shared jest
yarn workspace client jest --testPathIgnorePatterns=snapshots
yarn workspace server jest

- name: Update pinned SHA and snapshots (tests passed)
if: steps.latest.outputs.latest != steps.latest.outputs.pinned
run: |
echo "All tests passed! Updating pinned SHA to latest upstream..."
echo "${{ steps.latest.outputs.latest }}" > config/aria-at.version
echo "Updating snapshots..."
yarn update-snapshots

- name: Stage allowed files only
if: steps.latest.outputs.latest != steps.latest.outputs.pinned
run: |
set -e
git reset
git add config/aria-at.version || true
git add client/tests/e2e/snapshots || true
echo "Staged files:"
git diff --cached --name-only

- name: Validate staged files scope
if: steps.latest.outputs.latest != steps.latest.outputs.pinned
run: |
set -e
CHANGED=$(git diff --cached --name-only)
if [ -z "$CHANGED" ]; then echo "No changes to commit"; exit 0; fi
echo "$CHANGED" | awk '{print}' | while read -r f; do
case "$f" in
config/aria-at.version) ;;
client/tests/e2e/snapshots/*|client/tests/e2e/snapshots/*/*) ;;
*) echo "Disallowed staged change: $f"; exit 1 ;;
esac
done

- name: Commit updated ARIA-AT pin and snapshots
if: steps.latest.outputs.latest != steps.latest.outputs.pinned
env:
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
set -e
echo "Committing updated ARIA-AT pin and snapshots..."
git config user.name "github-actions[bot]"
git config user.email "41898282+github-actions[bot]@users.noreply.github.com"
git commit -m "chore: bump ARIA-AT pin to ${{ steps.latest.outputs.latest }}"
echo "Pushing to development branch..."
git push origin HEAD:development
2 changes: 1 addition & 1 deletion client/tests/e2e/snapshots/saved/_account_settings.html
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ <h2>Admin Actions</h2>
<button type="button" class="btn btn-primary">
Import Latest Test Plan Versions
</button>
<p>Date of latest test plan version: August 31, 2025 20:57 UTC</p>
<p>Date of latest test plan version: October 6, 2025 22:33 UTC</p>
</section>
</main>
</div>
Expand Down
99 changes: 79 additions & 20 deletions client/tests/e2e/snapshots/saved/_data-management.html
Original file line number Diff line number Diff line change
Expand Up @@ -276,15 +276,20 @@ <h3 class="disclosure-heading">
</option>
<option value="95">Rating Radio Group</option>
<option value="59">Rating Slider</option>
<option value="7">Select Only Combobox Example</option>
<option value="39">Select Only Combobox Example</option>
<option value="97">Switch Example</option>
<option value="98">
Switch Example Using HTML Button
</option>
<option value="99">Tabs with Automatic Activation</option>
<option value="100">Tabs with Manual Activation</option>
<option value="101">Toggle Button</option>
<option value="102">Vertical Temperature Slider</option>
<option value="99">
Switch Example Using HTML Checkbox Input
</option>
<option value="100">
Tabs with Automatic Activation
</option>
<option value="101">Tabs with Manual Activation</option>
<option value="102">Toggle Button</option>
<option value="103">Vertical Temperature Slider</option>
</select>
</div>
<div class="form-group">
Expand Down Expand Up @@ -384,7 +389,7 @@ <h2>Test Plans Status Summary</h2>
data-testid="filter-all"
aria-pressed="true"
class="filter-button btn active btn-secondary">
All Plans (39)
All Plans (40)
</button>
</li>
<li>
Expand All @@ -393,7 +398,7 @@ <h2>Test Plans Status Summary</h2>
data-testid="filter-rd"
aria-pressed="false"
class="filter-button btn btn-secondary">
R&amp;D Complete (35)
R&amp;D Complete (36)
</button>
</li>
<li>
Expand Down Expand Up @@ -427,7 +432,7 @@ <h2>Test Plans Status Summary</h2>
<div class="table-responsive">
<table
aria-label="Test Plans Status Summary Table"
aria-rowcount="39"
aria-rowcount="40"
class="data-management table table-bordered table-hover">
<thead>
<tr>
Expand Down Expand Up @@ -1197,7 +1202,7 @@ <h2>Test Plans Status Summary</h2>
<td>
<div class="phase-cell" role="list" aria-setsize="2">
<span class="styled-pill full-width auto-width"
><a href="/test-review/101"
><a href="/test-review/102"
><span
><svg
aria-hidden="true"
Expand Down Expand Up @@ -2681,7 +2686,7 @@ <h2>Test Plans Status Summary</h2>
<td>
<div class="status-cell">
<span class="pill full-width rd">R&amp;D</span>
<p class="review-text">Complete <b>Aug 19, 2025</b></p>
<p class="review-text">Complete <b>Oct 1, 2025</b></p>
</div>
</td>
<td>
Expand All @@ -2702,7 +2707,7 @@ <h2>Test Plans Status Summary</h2>
<path
fill="currentColor"
d="M256 512A256 256 0 1 0 256 0a256 256 0 1 0 0 512zM369 209L241 337c-9.4 9.4-24.6 9.4-33.9 0l-64-64c-9.4-9.4-9.4-24.6 0-33.9s24.6-9.4 33.9 0l47 47L335 175c9.4-9.4 24.6-9.4 33.9 0s9.4 24.6 0 33.9z"></path></svg
><b>V25.08.19</b></span
><b>V25.10.01</b></span
></a
></span
><button
Expand Down Expand Up @@ -2735,7 +2740,7 @@ <h2>Test Plans Status Summary</h2>
<td>
<div class="status-cell">
<span class="pill full-width rd">R&amp;D</span>
<p class="review-text">Complete <b>Aug 25, 2025</b></p>
<p class="review-text">Complete <b>Oct 1, 2025</b></p>
</div>
</td>
<td>
Expand All @@ -2756,7 +2761,7 @@ <h2>Test Plans Status Summary</h2>
<path
fill="currentColor"
d="M256 512A256 256 0 1 0 256 0a256 256 0 1 0 0 512zM369 209L241 337c-9.4 9.4-24.6 9.4-33.9 0l-64-64c-9.4-9.4-9.4-24.6 0-33.9s24.6-9.4 33.9 0l47 47L335 175c9.4-9.4 24.6-9.4 33.9 0s9.4 24.6 0 33.9z"></path></svg
><b>V25.08.25</b></span
><b>V25.10.01</b></span
></a
></span
><button
Expand All @@ -2775,6 +2780,60 @@ <h2>Test Plans Status Summary</h2>
<td><span class="none centered absolute">None Yet</span></td>
</tr>
<tr aria-rowindex="36">
<th>
<a href="/data-management/switch-checkbox"
><b>Switch Example Using HTML Checkbox Input</b></a
>
</th>
<td>
<div>
<b>JAWS</b><span>, </span><b>NVDA</b><span> and </span
><b>VoiceOver for macOS</b>
</div>
</td>
<td>
<div class="status-cell">
<span class="pill full-width rd">R&amp;D</span>
<p class="review-text">Complete <b>Oct 6, 2025</b></p>
</div>
</td>
<td>
<div class="phase-cell" role="list" aria-setsize="2">
<span class="styled-pill full-width auto-width"
><a href="/test-review/99"
><span
><svg
aria-hidden="true"
focusable="false"
data-prefix="fas"
data-icon="circle-check"
class="svg-inline--fa fa-circle-check check"
role="img"
xmlns="http://www.w3.org/2000/svg"
viewBox="0 0 512 512"
color="var(--positive-green)">
<path
fill="currentColor"
d="M256 512A256 256 0 1 0 256 0a256 256 0 1 0 0 512zM369 209L241 337c-9.4 9.4-24.6 9.4-33.9 0l-64-64c-9.4-9.4-9.4-24.6 0-33.9s24.6-9.4 33.9 0l47 47L335 175c9.4-9.4 24.6-9.4 33.9 0s9.4 24.6 0 33.9z"></path></svg
><b>V25.10.06</b></span
></a
></span
><button
type="button"
class="advance-button btn btn-secondary">
Advance to Draft
</button>
</div>
</td>
<td>
<span class="none centered absolute">Not Started</span>
</td>
<td>
<span class="none centered absolute">Not Started</span>
</td>
<td><span class="none centered absolute">None Yet</span></td>
</tr>
<tr aria-rowindex="37">
<th>
<a href="/data-management/tabs-automatic-activation"
><b>Tabs with Automatic Activation</b></a
Expand All @@ -2795,7 +2854,7 @@ <h2>Test Plans Status Summary</h2>
<td>
<div class="phase-cell" role="list" aria-setsize="2">
<span class="styled-pill full-width auto-width"
><a href="/test-review/99"
><a href="/test-review/100"
><span
><svg
aria-hidden="true"
Expand Down Expand Up @@ -2828,7 +2887,7 @@ <h2>Test Plans Status Summary</h2>
</td>
<td><span class="none centered absolute">None Yet</span></td>
</tr>
<tr aria-rowindex="37">
<tr aria-rowindex="38">
<th>
<a href="/data-management/tabs-manual-activation"
><b>Tabs with Manual Activation</b></a
Expand All @@ -2843,13 +2902,13 @@ <h2>Test Plans Status Summary</h2>
<td>
<div class="status-cell">
<span class="pill full-width rd">R&amp;D</span>
<p class="review-text">Complete <b>Aug 31, 2025</b></p>
<p class="review-text">Complete <b>Oct 1, 2025</b></p>
</div>
</td>
<td>
<div class="phase-cell" role="list" aria-setsize="2">
<span class="styled-pill full-width auto-width"
><a href="/test-review/100"
><a href="/test-review/101"
><span
><svg
aria-hidden="true"
Expand All @@ -2864,7 +2923,7 @@ <h2>Test Plans Status Summary</h2>
<path
fill="currentColor"
d="M256 512A256 256 0 1 0 256 0a256 256 0 1 0 0 512zM369 209L241 337c-9.4 9.4-24.6 9.4-33.9 0l-64-64c-9.4-9.4-9.4-24.6 0-33.9s24.6-9.4 33.9 0l47 47L335 175c9.4-9.4 24.6-9.4 33.9 0s9.4 24.6 0 33.9z"></path></svg
><b>V25.08.31</b></span
><b>V25.10.01</b></span
></a
></span
><button
Expand All @@ -2882,7 +2941,7 @@ <h2>Test Plans Status Summary</h2>
</td>
<td><span class="none centered absolute">None Yet</span></td>
</tr>
<tr aria-rowindex="38">
<tr aria-rowindex="39">
<th>
<a href="/data-management/vertical-temperature-slider"
><b>Vertical Temperature Slider</b></a
Expand All @@ -2903,7 +2962,7 @@ <h2>Test Plans Status Summary</h2>
<td>
<div class="phase-cell" role="list" aria-setsize="2">
<span class="styled-pill full-width auto-width"
><a href="/test-review/102"
><a href="/test-review/103"
><span
><svg
aria-hidden="true"
Expand Down
1 change: 1 addition & 0 deletions config/aria-at.version
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
7170ce1c91efa1e3ca3be69b1fb02e097452758f
Loading