Add IGN site#61
Open
Edlison wants to merge 1 commit into
Open
Conversation
9 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Mirrored site
IGN — https://www.ign.com/
Added as the 17th WebHarbor site, served on port 40016.
What's included
sites/ign/— Flask + SQLAlchemy app modeling IGN's editorial and account surfaces: news, reviews, videos, guides/wiki pages, local utility pages, scored token-overlap News search, review filtering/sorting controls, article/review/video/guide detail pages, accounts, saved stories, playlist, comments, alerts, profile editing, and guide checklist progress. 17 Jinja2 templates with an IGN-style dark left rail, content cards, review-score treatment, and responsive utility pages.109 seeded content items: 36 articles, 9 reviews, 40 videos, and 24 guides. Real IGN article/video/guide/review images are included under
static/images/content/with 114 local image files.Idempotent seeding with function-level gates and the 4 canonical benchmark users (
alice.j@test.com,bob.c@test.com,carol.d@test.com,david.k@test.com; passwordTestPass123!). Byte-identical reset verified.19 WebVoyager tasks in
sites/ign/tasks.jsonl.Registered in the three required places:
websyn_start.sh,control_server.py,Dockerfile(EXPOSE ... 40016).Seeded rows per major model
Content breakdown: Articles 36 · Reviews 9 · Videos 40 · Guides 24.
Content by section: Games 27 · Reviews 3 · Guides 24 · Videos 32 · Movies 5 · TV 12 · Deals 6.
Tasks
19 tasks in
sites/ign/tasks.jsonl(WebVoyager schema), spanning search, news/category browsing, reviews/filtering, guide checklist progress, login, profile editing, saved stories, playlist add/update/remove, comments, alerts, and multi-step comparison/detail-page reading.The task set includes several auth-gated state-changing workflows and multi-step tasks that require disambiguation between near-miss IGN content, such as same-topic article/video results, physical-media stories, TV streaming stories, and tech review filters.
Byte-identical reset
$ curl -X POST http://localhost:8201/reset/ign {"pid":245,"ready":true,"site":"ign"} $ docker exec wh-submit md5sum /opt/WebSyn/ign/instance/ign.db \ /opt/WebSyn/ign/instance_seed/ign.db da9379739f89373db60e2c32e801bc60 /opt/WebSyn/ign/instance/ign.db da9379739f89373db60e2c32e801bc60 /opt/WebSyn/ign/instance_seed/ign.dbBoth seed functions early-return as a whole. Fresh container verification passed with all 17 sites alive, ports
41000-41016returning 200, andPOST /reset-allreturning every siteready:true.Visual fidelity vs. the real site
Mirror rendered at
localhost:40016(compare against https://www.ign.com/). Real IGN content images are harvested and stored locally.Paired HuggingFace assets PR
https://huggingface.co/datasets/ChilleD/WebHarbor/discussions/41 — uploads
ign.tar.gz(instance_seed/ign.db+static/images: 114 local IGN content images)..assets-revisionis temporarily pinned torevision: refs/pr/41so this GitHub PR builds end-to-end before the assets PR is merged:Merge the HF dataset PR before this one so a clean-clone build can fetch the assets, or keep this GitHub PR pinned to
refs/pr/41until the asset PR is merged. Once the dataset PR merges, bump.assets-revisionto the merged commit SHA onmain.Verification
./scripts/fetch_assets.sh ign python -m py_compile sites/ign/app.py sites/ign/seed_data.py sites/ign/content_seed.py sites/ign/_health.py ./scripts/build.sh webharbor:dev docker run -d --rm --name wh-submit -p 8201:8101 -p 41000-41016:40000-40016 webharbor:dev curl -s http://127.0.0.1:8201/health curl -s -X POST http://127.0.0.1:8201/reset/ign docker exec wh-submit md5sum /opt/WebSyn/ign/instance/ign.db /opt/WebSyn/ign/instance_seed/ign.db curl -s -X POST http://127.0.0.1:8201/reset-allVerified:
./scripts/fetch_assets.sh ignsucceeds fromrefs/pr/41.py_compilepasses forapp.py,seed_data.py,content_seed.py, and_health.py.http://127.0.0.1:8201/healthreturnsok:truewith all 17 sites alive.41000-41016return HTTP 200.POST /reset/ignreturnsready:true.da9379739f89373db60e2c32e801bc60.POST /reset-allreturnsok:trueand every siteready:true.Notes for human review
content_itemsrather than products. The implementation seeds 109 content rows across News, Reviews, Videos, and Guides to preserve browsing depth.Interactive Maps,Discover,Store,Rewards,Privacy Policy,Terms of Use,More) are implemented as local IGN-style replicas. They are visual/navigation surfaces, not real checkout/reward/legal-service integrations.content_seed.pywas fixed before this PR; the file now compiles and contains 109 seed content items.