v0.1.14

Features

• Add ORCID integration backend support (model changes, migration, command for updating authors field to new format) #199 (klpoland)

Documentation

• updated collation notes (Lucas Parzianello)

Commits

• 3149186: updated sdk release checklist (Lucas Parzianello)
• c48c35d: remove important from css (srucker1) #179
• 2b5f1fd: remove important from api key (srucker1) #179
• 3fd5687: add checks for disk space, zip size, cleanup orphaned/partial zips (klpoland) #173
• 8691f09: celery beat, reuse disk space util checks (klpoland) #173
• 24e1d2e: change size field to 64bit int (klpoland) #173
• f904b0d: rearrange zip file creation flow, add creation status, tests for status updates (klpoland) #173
• raising oserror when insufficient disk space #173 (Lucas Parzianello)
• updated pre-commit hooks #173 (Lucas Parzianello)
• linearized migrations #173 (Lucas Parzianello)
• 4f76d40: silencing admin emails in prod (Lucas Parzianello)
• f33d1d8: updated gh actions repos (Lucas Parzianello)
• 15249d9: add access control utility to api endpoints (klpoland) #190
• 7182ea3: troubleshoot tests (klpoland) #190
• c7f135b: pre-commit fixes (klpoland) #190
• 09030c0: direct db query for share access instead of list iteration (klpoland) #190
• 0e16403: fixed path issue in duplicate capture checking (lkruczek) #189
• 6a3905a: fixed path issue in duplicate capture checking (lkruczek) #189
• 56d24bc: Added test. Cleaned up debug message. (lkruczek) #189
• 9f463d4: fixed comments (lkruczek) #189
• 3f6eb48: simple self-test for file validation check (Lucas Parzianello) #191
• 22d277f: fixed ignoring .tmp file issue (lkruczek) #191
• a3a6234: Added test valid file. Refactored is_valid_file logic (lkruczek) #191
• 679d45e: refactored disallow types in test_file.py (lkruczek) #191
• 44e2dbd: simplified test disallow file test logic (lkruczek) #191
• dd4ed68: Spectrogram first pass (Connor Howington) #192
• 128b09f: Fix visualiation modal and spectrogram canvas rendering (Connor Howington) #192
• c8441cb: Add matplotlib and scipy (Connor Howington) #192
• 5ff5d0b: Fix viz compatibility logic (Connor Howington) #192
• 3da6276: Fix status message showing over spectrogram image (Connor Howington) #192
• 782e17e: Fix visualization modal (Connor Howington) #192
• 394822c: Move most visualization logic into viz app (Connor Howington) #192
• 6a0a70d: Move spectrogram behind experimental flag (Connor Howington) #192
• 499f715: Improve viz modal layout (Connor Howington) #192
• fdaf7fc: Remove config test file (Connor Howington) #192
• d2ed35d: Skip spectrogram tests if not enabled (Connor Howington) #192
• docs: additional step for opensearch indices initialization #192 (Lucas Parzianello)
• solved import warnings for visualization component from commit hook #192 (Lucas Parzianello)
• added missing import #192 (Lucas Parzianello)
• 5fc9f22: Convert data class into rich Pydantic model (Connor Howington) #192
• 4247ea4: Address PR comments (Connor Howington) #192
• 589de65: Add visualizations app README (Connor Howington) #192
• 84a86ba: Remove duplicate functions (Connor Howington) #192
• 51e8de4: Manipulate CSS classes rather than styles directly (Connor Howington) #192
• 70dba2b: Pass processing params to pipeline (Connor Howington) #196
• 7d80a9a: Fix viz requests auth (Connor Howington) #196
• 1a8da9e: Use correct id prop (Connor Howington) #196
• 4b565fc: Fix frontend UI logic (Connor Howington) #196
• cb2912b: Add custom cog error handler for viz (Connor Howington) #196
• 3cdf6c2: Fix visualization pipeline and error handler (Connor Howington) #196
• 3350819: Fix info messages (Connor Howington) #196
• 2246b1f: Use plot area dimensions in spectrogram generation (Connor Howington) #196
• c5ddf34: Rename old PostProcessedData model (Connor Howington) #196
• 5a2cb1e: Remove spectrogram experimental flag (Connor Howington) #196
• 456f711: Fix spectrogram generation errors (Connor Howington) #196
• 282587b: Refactor common DRF processing into Pydantic model (Connor Howington) #196
• 4558dde: Remove direct style manipulation in JS (Connor Howington) #196
• 5fc1c95: Do more serverside rendering for viz modal (Connor Howington) #196
• 653f190: Clean PR (Connor Howington) #196
• 62313d0: More PR cleaning (Connor Howington) #196
• 2f2b03d: Add deep=True to model_copy (Connor Howington) #196
• 2e205dd: fixed dropdown modal positioning (lkruczek) #194
• b043f5f: cleaned up unneccessary css (lkruczek) #194
• 963fcd1: Fixed captures table styling and dropdown visibility (lkruczek) #194
• cff1c19: fixed captures table styling (lkruczek) #194
• a98b870: fixed capture timestamp display (lkruczek) #194
• 2520f3a: format time display (lkruczek) #194
• 0b3a31d: fixed white space issue in dataset_list.html (lkruczek) #194
• 2e74a6a: refactored datetime formatting (lkruczek) #194
• 90b0dec: fixed comments (lkruczek) #194
• squashing #188: capture uploads via web UI (Lucas Parzianello)
• 1e3857b: Revert "gwy: squashing #188: capture uploads via web UI" (Lucas Parzianello)
• fixed broken tests (Lucas Parzianello)
• squashing #188: capture uploads via web UI (Lucas Parzianello)
• 749dd83: jupyterhub (srucker1) #186
• 4e05009: juptyerhub (srucker1) #186
• b36686a: linter (srucker1) #186
• 36f6aae: production.ymal (srucker1) #186
• a0a41cf: remove unneeded iinit_.py (srucker1) #186
• b77270c: remove _init...

v0.1.13

Commits

• 4b6e9ef: AI-gen postprocessing first pass (Connor Howington) #159
• c4fa700: Remove new model and fake migration (Connor Howington) #159
• 7073bac: Rewrite cog file (Connor Howington) #159
• acaa34c: Set up django-cog library (Connor Howington) #159
• 4a660f2: Revert capture_serializers changes (Connor Howington) #159
• 5456826: Set up django-cog (Connor Howington) #159
• be1431d: Remove spectrogram tasks (Connor Howington) #159
• 0ed602a: Add untested postsave pipeline trigger (Connor Howington) #159
• c46e63a: Bump django-cog version (Connor Howington) #159
• df78f7d: Improve pipelines logic (Connor Howington) #159
• 4add9e2: Remove unneeded files (Connor Howington) #159
• fe0ae82: Get pipeline succeeding end-to-end (Connor Howington) #159
• 2b6fdd3: Streamline pipeline and store data as JSON (Connor Howington) #159
• 27b06ef: Remove unused tasks (Connor Howington) #159
• 82225e7: Successful pipeline run to make JSON data (Connor Howington) #159
• f1db47a: Add endpoint to get postprocessed data (Connor Howington) #159
• 78e7981: Use correct method to query for capture (Connor Howington) #159
• fc50741: Access file through Django's file API (Connor Howington) #159
• cacad06: PR cleaning 1 (Connor Howington) #159
• 9abb4de: Fix celery flower config (Connor Howington) #159
• df5028a: Fix postprocessing pipeline (Connor Howington) #159
• 849c317: Add endpoint to get postprocessed metadata (Connor Howington) #159
• 4595144: Remove manual postprocessing trigger endpoint (Connor Howington) #159
• 1bff6f4: Fix linting errors (Connor Howington) #159
• 47b0d28: Remove postprocessed data tests (Connor Howington) #159
• cc18d24: Revert accidental changes (Connor Howington) #159
• cb73e53: Revert accidental change (Connor Howington) #159
• a45d50a: Address PR comments (Connor Howington) #159
• 50a0be4: Use dedicated context manager, address PR comments (Connor Howington) #159
• 5f137e6: Address more PR comments (Connor Howington) #159
• 96d77f0: Remove leftover signal hook (Connor Howington) #159
• 04e6ac4: more specific filter on directory and test (klpoland) #175
• 43d04ed: specify test context (klpoland) #175
• changed migration to match model (Lucas Parzianello)
• added linear migrations dependency #178 (Lucas Parzianello)
• created max migrations file #178 (Lucas Parzianello)
• docs: removed unused docs dir #178 (Lucas Parzianello)
• docs: updated python support notes #178 (Lucas Parzianello)
• 47b04dc: fixed markdownlint locations (Lucas Parzianello) #178
• docs: added dev notes on db migration conflicts #178 (Lucas Parzianello)
• docs: added one-liners for opensearch management #178 (Lucas Parzianello)
• 190abc9: api pages (srucker01) #154
• 0635d9b: updated alert to spectrumx modal. Also updated link style (Le Li Kruczek) #154
• 9a29c9a: Discard changes to .pre-commit-config.yaml (Lucas Parzianello) #154
• fd234e1: updated url.py (Le Li Kruczek) #154
• b8d6758: fixed comments (Le Li Kruczek) #154
• c570052: removed djlint overrides (Le Li Kruczek) #154
• fixed migration for blank default in api key description #154 (Lucas Parzianello)
• fixed migration for blank default in api key description #154 (Lucas Parzianello)
• 1341164: squash migrations. (Le Li Kruczek) #154
• c26fe6b: Revert "squash migrations." (Le Li Kruczek) #154
• 94ecc3b: implemented copilot-suggested changes (Le Li Kruczek) #154
• 9f6397b: fixed copilot's comments. Fixed dropdown styling issue (Le Li Kruczek) #154
• bab4f4e: reviewed migrations (Lucas Parzianello) #154
• docs: postgres commands #154 (Lucas Parzianello)
• added wait to allow manual intervention if wsgi server fails #154 (Lucas Parzianello)
• 8066c6e: Add Cursor waterfall page first pass (Connor Howington) #172
• d3c03df: Fix waterfall scrolling and color scale (Connor Howington) #172
• d0601a7: Improve waterfall slice UI (Connor Howington) #172
• d7687e3: More intuitive slice/window selection (Connor Howington) #172
• 15cd928: Move color legend and add index legend (Connor Howington) #172
• 88918f0: Add hover highlighting (Connor Howington) #172
• e6c64e2: Keep periodogram y axis constant (Connor Howington) #172
• cbc4e28: Vertically align periodogram and waterfall plot (Connor Howington) #172
• d6a720d: Tighten up waterfall viz layout (Connor Howington) #172
• e3aeb2e: Fix waterfall capture details table spacing (Connor Howington) #172
• c295344: Improve waterfall page styling (Connor Howington) #172
• 71df01b: Add links to visualize captures (Connor Howington) #172
• 3dfd114: Move visualization files (Connor Howington) #172
• aed7ddb: Refactor waterfall visualization (Connor Howington) #172
• 6505934: Use callback rather than events for playback (Connor Howington) #172
• e03372b: Improve refactored waterfall performance (Connor Howington) #172
• 9eb41a1: Fix slice index legend (Connor Howington) #172
• abb9433: Realign periodogram and waterfall (Connor Howington) #172
• 210f9a9: Clean PR (Connor Howington) #172
• e6e1b9c: Clean PR 2 (Connor Howington) #172
• a246fe3: Remove waterfall download button (Connor Howington) #172
• 819b19c: Hide visualize button by default in HTML (Connor Howington) #172
• 2a0ea1b: Add visualization te...

v0.1.12

Commits

• 9d4ace7: header css (srucker01) #141
• 3100e8b: updated about and home (srucker01) #141
• 707025c: removed about page; updated home page content (David Pettifor) #146
• a55ae59: cleaned up css and reverted back to vanilla css (David Pettifor) #147
• 8fd083c: download (srucker01) #149
• 40c9517: add name to capture model (srucker01) #143
• e1ba9c5: remoe import (srucker01) #143
• 6a5e029: name to sdk (srucker01) #143
• da7c8ec: test feedback (srucker01) #143
• 3443524: linter (srucker01) #143
• 2a8f097: linter (srucker01) #143
• c0ba7b4: add error email sending (klpoland) #150
• 7ac8fb1: fix erroneous reformat (klpoland) #150
• add user share mechanism components and views #152 (klpoland)
• add capture and dataset sharing models and migrations #152 (klpoland)
• add dataset serializers and task updates #152 (klpoland)
• add final sharing functionality and test fixes #152 (klpoland)
• ada3ab4: generalizing share mechnism backend, adding share permission model to track share permissions for users (for scalability) (klpoland) #152
• b5525d5: capture modal (srucker01) #156
• add user share mechanism UI components #151 (klpoland)
• implement share request functionality #151 (klpoland)
• add troubleshooting, CSS improvements, and QOL updates #151 (klpoland)
• final linting fixes and code quality improvements #151 (klpoland)
• 75a9b29: better email styling, generalize share template (klpoland) #151
• 9a39707: More strict user filtering/searching limits, better doc strings (klpoland) #151
• f1328eb: revert linting fixes on includes (klpoland) #151
• a48542c: fix pre-commit hook django template linting issue (klpoland)
• docs: fixing the network creation cmd (Lucas Parzianello)
• ece137f: back end sharing captures integration (klpoland) #158
• 49d7f16: frontend integration to captures (klpoland) #158
• fa687a5: share permissions tests and fixing signals/model helpers (klpoland) #158
• 3c51375: remove duplicate test functions file (klpoland) #158
• 4eb950d: generalize capture/dataset download into item download for easier management, integrate share tests and shared captures/datasets in download logic (klpoland) #158
• 0fa932c: fixing email styling, logo display, volume permissions for zip download (SFDS-186) (klpoland) #158
• c791a5c: refactoring from change requests (klpoland) #158
• 7d53a4e: remove nocopy (klpoland) #158
• 86dba06: fix task timeout, stream minio data into zip directly (klpoland) #162
• c242979: add timeout error catch (klpoland) #162
• 8fbdb8e: remove blind exception (klpoland) #162
• 70ba0f9: 25 min soft limit (klpoland) #162
• f72010d: add dataset details modal, view, move file tree generation to mixin (klpoland) #163
• c228e63: add busy state for submit button on dataset page, change how modal opens (klpoland) #163
• 9c94000: fix linting errors (klpoland) #163
• eaa4930: remove cursor erroneously created files (klpoland) #163
• 4d9ef07: no more support emails (Lucas Parzianello) #164
• 42663f4: only give directories 755 permission (klpoland) #167
• b208017: remove extraneous line (klpoland) #167
• 0219977: prevent overflow scrolling for dropdown on table (klpoland) #166
• release changelog #170 (Lucas Parzianello)
• formatted toml #170 (Lucas Parzianello)

v0.1.11

Builds

• deps-dev: bump the npm_and_yarn group across 1 directory with 2 updates #108 (dependabot[bot])

Commits

• update target to update pre-commit hooks #112 (Lucas Parzianello)
• docs: updated readme #112 (Lucas Parzianello)
• removing orphan containers by default #112 (Lucas Parzianello)
• new config flag SDS_NEW_USERS_APPROVED_ON_CREATION #112 (Lucas Parzianello)
• better type safety for some methods #112 (Lucas Parzianello)
• running db migrations on startup #112 (Lucas Parzianello)
• docs: updated example dotenvs and doc links #112 (Lucas Parzianello)
• setting is_approved flag in signup forms #112 (Lucas Parzianello)
• 1e1b424: add select all checkbox and remove all button (klpoland) #113
• e298cd9: remove indeterminate (unnecessary) (klpoland) #113
• ec7d8da: make sure no files message renders (klpoland) #113
• 34367d1: Update gateway/sds_gateway/static/js/captureGroupingComponents.js (Kinsey Poland) #113
• cac1bd2: Update gateway/sds_gateway/static/js/captureGroupingComponents.js (Kinsey Poland) #113
• cb2fba7: Update gateway/sds_gateway/static/js/captureGroupingComponents.js (Kinsey Poland) #113
• 75f12c6: better empty logic, clean up suggestions (klpoland) #113
• d98b9d1: html update (srucker01) #115
• 3fd12d4: model (srucker01) #115
• c545ec2: pre commit clean up (srucker01) #115
• c101b29: Add root .gitignore for env files and SDK lock files (srucker01) #115
• refactored apply functions out of their modules; removed repetition #115 (Lucas Parzianello)
• additional type hints #115 (Lucas Parzianello)
• 653d586: rm ignore (srucker01) #115
• aa38307: logger debug (srucker01) #115
• 5c65d02: prevent submit button event on enter, add search event on enter when in search input (klpoland) #118
• temporarily setting model default for approved users to true (Lucas Parzianello)
• 11d9cac: expand (srucker01) #119
• 444537a: filter (srucker01) #119
• 43f9086: add center_frequencies to mapping, apply transform, update assertions in tests (klpoland) #116
• cd9f178: integrate v0 and v1 metadata formats into cap tests, make center_frequencies required (klpoland) #116
• 1ba8f7b: use set values for assertions (klpoland) #116
• 2c1c5de: Update file list template and CSS with pagination and layout improvements (srucker01) #122
• bdcd17f: Add file list JavaScript functionality (srucker01) #122
• ee0e9d4: scrollable on smaller screen size (srucker01) #123
• 315d17a: end date (srucker01) #123
• 7602920: remove types (srucker01) #124
• 60130c6: ticket 209 and modal (srucker01) #125
• updated test expectations for center frequencies in search #126 (Lucas Parzianello)
• drf metadata to not attempt conversion of unsupported types #126 (Lucas Parzianello)
• turned methods into functions to reduce scope; removed redundant methods #126 (Lucas Parzianello)
• enforcing 40 char tokens for svi #127 (Lucas Parzianello)
• automated svi key rotation on server startup #127 (Lucas Parzianello)
• reverted approval default for new users to false #127 (Lucas Parzianello)
• docs: readme note for svi key #127 (Lucas Parzianello)
• changed init_svi_token logger #127 (Lucas Parzianello)
• removed svi key example to default to a random value #127 (Lucas Parzianello)
• 70397e9: bootstrap alert (srucker01) #128
• e478478: dataset download initial pass (klpoland) #129
• 090adf1: set up celery, mailhog, tests (klpoland) #129
• 55a2fc6: troubleshooting, bugfixing, tests (klpoland) #129
• 9c25d19: troubleshooting, test refactoring (klpoland) #129
• 7dc172d: edited email config with prod settings (klpoland) #129
• 47b20fe: make example file more general (klpoland) #129
• 64ad3ea: refactoring code to send email with link to download instead of raw zip (klpoland) #129
• 255039e: inspection testing, linting (klpoland) #129
• b104b13: change temp zip file duration (klpoland) #129
• 5eb3b04: better assertions for testing zip file clean up (klpoland) #129
• 1124c55: simplified view and download template with processing message and auto re-direct (klpoland) #129
• 947fb1f: migration (klpoland) #129
• e6b5f9d: skip verify, linter breaks template tags (klpoland) #129
• 7bda4d9: add celery beat with clean up task once a da at 2AM (klpoland) #129
• e1d1c0c: logger error to warning (klpoland) #129
• a2c99b1: SFDS-216: Complete template updates and improvements (srucker01) #135
• 5c9698d: ribbon (srucker01) #135
• f5f2242: date (srucker01) #135
• bce6873: tweaks (srucker01) #135
• qa vs prod improvements #131 (Lucas Parzianello)
• db snapshot scripts #131 (Lucas Parzianello)
• gitignore #131 ([Lucas Parzian...

v0.1.10

Commits

• e2bcd0a: refactoring form functionality (klpoland) #96
• c42af1c: add review page to form, UI bug fixes (klpoland) #96
• solved several type warnings #96 (Lucas Parzianello)
• pyright false positive; reverted type change #96 (Lucas Parzianello)
• db73e9c: sds-ui updates (skradha) #96
• e8b3313: SDS-UI Updates (skradha) #96
• 9d2d621: refactoring form functionality (klpoland) #96
• c4c5cd0: add review page to form, UI bug fixes (klpoland) #96
• 1fd81f2: merge conflict fixes (klpoland) #96
• f9c3934: css fixes from rebase changes (klpoland) #96
• e6f1ea5: fixing bug not able to create dataset with no files/captures (klpoland) #100
• 1445b42: only add contents to metadata files (klpoland) #101
• 2de62c0: add server log for error (klpoland) #101
• crc maintenance warning #98 (Lucas Parzianello)
• init_indices also makes indices writeable #99 (Lucas Parzianello)
• defaulting to pytest: the previous test running mode was missing tests #102 (Lucas Parzianello)
• cmd for listing tests #102 (Lucas Parzianello)
• system notifications accounting for daylight savings #102 (Lucas Parzianello)
• 997004b: omitting makefile comments from stdout (Lucas Parzianello) #102
• c7728f3: add option to edit dataset, fill in existing data, css and js optimizations/additions (klpoland) #103
• 97082df: naming consistency (klpoland) #103
• a1f7192: fix linter issues (klpoland) #103
• 527bb1c: set author to reflect authors field (klpoland) #103
• d1cdd84: fix pagination bug (klpoland) #103
• c015262: disable author field (klpoland) #103
• 6d23089: redundant logic (klpoland) #103
• 9151e3e: redundant logic (klpoland) #103
• added pre-commit action to gateway makefile #103 (Lucas Parzianello)
• 0a0a4f2: put theme settings into separate js file for future integration (klpoland) #103
• 2ab144b: move styling to sass (klpoland) #103
• 6ea3cca: breaking out context data, linter fixes (klpoland) #103
• 0bb5783: custom display classes for rendering, fixing file tree issues/stats not showing, only non-capture files in tree (klpoland) #103
• 855940d: use sanitize path util (klpoland) #103
• cb0e9df: add fetch conditions to load file contents for data files at bounds (klpoland) #104
• 772f0a3: update wording (klpoland) #104
• fc305b0: more error log hints, None handling (klpoland) #104
• 4b93a16: use exists() instead (klpoland) #104
• increasing max connections default for postgres #105 (Lucas Parzianello)
• 5c42a90: deps and pre-commit updated (Lucas Parzianello) #106
• added created_at field to captures #106 (Lucas Parzianello)
• c1cbc21: upgraded sdk and pre-commit hooks (Lucas Parzianello) #106
• unified backport comments to find them easily when upgrading #106 (Lucas Parzianello)
• added 3.10 backport for datetime utc #106 (Lucas Parzianello)
• stopping test-all on first failure; added @-ing echo cmds in makefile #106 (Lucas Parzianello)
• fixed biome perf warning #106 (Lucas Parzianello)
• bool(Paginator) now behaves like bool(List) #106 (Lucas Parzianello)
• integration test for capture created_at attr #106 (Lucas Parzianello)
• docs: pr info for changelog #106 (Lucas Parzianello)
• f62765c: fixed pre-commit errors (Lucas Parzianello) #106
• using stricter queryset for drf capture creation #107 (Lucas Parzianello)
• 8564497: validating channel presence for drf capture creation (Lucas Parzianello) #107
• attempt to make metadata@ files optional #107 (Lucas Parzianello)
• better error handling for drf captures missing metadata@ files #107 (Lucas Parzianello)
• re-enabled template checking #107 (Lucas Parzianello)
• code cleanup #107 (Lucas Parzianello)
• updated ruff rule ignores #107 (Lucas Parzianello)
• synchronized ruff rules with sdk #107 (Lucas Parzianello)
• recovered upload capture tests from stash (Lucas Parzianello)
• corrected path for tests (Lucas Parzianello)
• b36b518: adding more search options, update file tree UI, dynamic loading, QOL updates (klpoland) #109
• 64c63c9: linter fixes (klpoland) #109
• removed octet mime restriction to allow sigmf-data files #110 (Lucas Parzianello)
• 7ba0524: deps and pre-commit updated; sdk version bump to 0.1.10 (Lucas Parzianello) #111
• docs: changelog updated #111 (Lucas Parzianello)

v0.1.9

Builds

• deps-dev: bump the npm_and_yarn group across 1 directory with 2 updates #88 (dependabot[bot])

Commits

• 4d20cb9: add css for sds header text, differentiate local and prod opensearch builds, errors on local dev (klpoland) #81
• 856eeef: matching css layout from svi (klpoland) #81
• e12c216: update width limits for widescreen (klpoland) #81
• 8725a7e: add check for uniqueness on scan_group (rh) and channel/top_level_dir (drf) (klpoland) #83
• formatted hardcoded numbers in tests #83 (Lucas Parzianello)
• sorting captures by updated time #83 (Lucas Parzianello)
• silenced more logs #83 (Lucas Parzianello)
• improved type hints for capture serializer methods #83 (Lucas Parzianello)
• updated test expectations for empty capture list #83 (Lucas Parzianello)
• added colors to standard logs #83 (Lucas Parzianello)
• separated capture creation constraints check from validation #83 (Lucas Parzianello)
• updated test_create_rh_capture_scan_group_conflict #83 (Lucas Parzianello)
• updated expectations for test_create_rh_capture_201 #83 (Lucas Parzianello)
• updated expectations for test_list_captures_by_type_200 #83 (Lucas Parzianello)
• updated expectations for test_create_drf_capture_already_exists #83 (Lucas Parzianello)
• updated expectations for test_create_rh_capture_scan_group_conflict #83 (Lucas Parzianello)
• updated expectations for test_list_captures_200 #83 (Lucas Parzianello)
• updated expectations for test_list_captures_by_invalid_type_400 #83 (Lucas Parzianello)
• e4aa6ab: fixed walrus operator catch (Lucas Parzianello) #83
• added missing logs.py (Lucas Parzianello)
• upgraded deps; integrated sentry for error monitoring #85 (Lucas Parzianello)
• preventing deletion of files linked to captures or datasets #86 (Lucas Parzianello)
• bulk file deletion prevention + tests #86 (Lucas Parzianello)
• preventing soft deletion of blocked files + tests #86 (Lucas Parzianello)
• 095e988: change number typing (klpoland) #80
• 25202b9: add a reset indices command and test to verify it (klpoland) #80
• f847160: change number typing (klpoland) #80
• 391e422: add a reset indices command and test to verify it (klpoland) #80
• 9fa3a51: rework reset index script (klpoland) #80
• 16096d1: create separate test indices, to quarantine opensearch tests (klpoland) #80
• 84b4bca: test refactoring, troubleshooting fail states (klpoland) #80
• 73c588d: updates based on comments, use ospy clone method, add "search_props" (klpoland) #80
• ddbf15f: refactor to run through ingest capture again with duplicate deletion (klpoland) #80
• 464b2e5: testing fixes (klpoland) #80
• 9c1b4e0: adding transforms, fixing assert references (klpoland) #80
• 4b40dbf: change command name, add better docstring, defensive coding (klpoland) #80
• 64d6347: init search props before transforming (WIP) (klpoland) #80
• 40eb76d: use update instead of update_by_query and apply transform to each capture individually (klpoland) #80
• 79f6573: modify tests to patch field transforms, duplicate capture deletion (klpoland) #80
• b643a60: add drf reindex tests, check captures unique by owner, add top_level_dir to base props (klpoland) #80
• 96091eb: combine scripts and run with reindex in case of bulk reindexing (kept for reference) (klpoland) #80
• bf12507: add comment about reindex_with_mapping (klpoland) #80
• d55bc63: better test assertions (klpoland) #80
• e2b512c: change mock import path (klpoland) #80
• leaving room for manual action on init_indices failure #80 (Lucas Parzianello)
• moved testing dependencies to prod for qa machine #80 (Lucas Parzianello)
• capture ingestion now normalizes virtual paths #80 (Lucas Parzianello)
• fixed linter warnings for capture and opensearch tests #80 (Lucas Parzianello)
• linting #80 (Lucas Parzianello)
• first round of improvements and fixes to the replace index command #80 (Lucas Parzianello)
• refactored replace_index module #80 (Lucas Parzianello)
• logging and minor changes #80 (Lucas Parzianello)
• cleanup now removes only captures with non-empty list of missing files; empty captures are preserved #80 (Lucas Parzianello)
• fixed ambiguous test result by changing mock import #80 (Lucas Parzianello)
• capture deletion functionality; local tests; integration tests #84 (Lucas Parzianello)
• build acceptance check for capture deletion #84 (Lucas Parzianello)
• docs: minor pagination docstring improvements [#84](https://g...

v0.1.8

Commits

• changes from prod (Lucas Parzianello)
• fix capture integration tests #70 (Omegaice)
• include name and permissions in file upload #71 (Omegaice)
• implement pydantic model for file upload data #71 (Omegaice)
• implement pydantic model for handling permission strings #71 (Omegaice)
• reducing logging from the verbose boto modules #74 (Lucas Parzianello)
• added test target to make #74 (Lucas Parzianello)
• docs: fixed and updated usage guide and build acceptance script #76 (Lucas Parzianello)
• doctring typo #76 (Lucas Parzianello)
• make capture type optional for listing #78 (Lucas Parzianello)
• individual capture reading #78 (Lucas Parzianello)
• serializing file list in capture getter #78 (Lucas Parzianello)
• fixed pyright warning #78 (Lucas Parzianello)
• updated changelog #78 (Lucas Parzianello)
• setting local path for all upload modes #77 (Lucas Parzianello)
• reviewed the severity of a few log entries #77 (Lucas Parzianello)
• fixed name of new file when created from sibling #77 (Lucas Parzianello)
• testing sibling file uploads #77 (Lucas Parzianello)
• fixed file querysets that included soft-deleted entries #79 (Lucas Parzianello)
• fixed keyerror #79 (Lucas Parzianello)
• integration and local tests for file deletions #79 (Lucas Parzianello)
• delete file functionality #79 (Lucas Parzianello)
• recovered accidentally deleted test file #79 (Lucas Parzianello)
• 5d13b7c: search capture helper (klpoland) #73
• 93e8760: integrate into capture list (klpoland) #73
• 5ae4b9e: add example templates (klpoland) #73
• df83dab: add pagination (klpoland) #73
• a8842d4: update metadata schemas for searching, turn lat and long into geo_point (klpoland) #73
• 7dbd421: allow users to handle their own query creation based on opensearch guidelines (klpoland) #73
• 826130c: add tests, troubleshoot query building for nests (klpoland) #73
• fb7e038: Update readme with searching tips, resources (klpoland) #73
• 68ac702: bring back testing exceptions (klpoland) #73
• 60b1d90: add altitude back in (klpoland) #73
• allow marking tests for platform specific tests #72 (Omegaice)
• update test to utilize pytest's tmp_path fixture instead of hard coding it #72 (Omegaice)
• use PurePosixPath for all SDS paths to ensure paths are correct on windows #72 (Omegaice)
• add windows specific file permissions test due to restricted permission options #72 (Omegaice)
• fix api endpoint code by replacing the use of Path with an f-string #72 (Omegaice)
• ensure external interface always accepts a Path or PurePosixPath or str #72 (Omegaice)
• reverting a8842d4 until a permanent fix is written (Lucas Parzianello)
• updated dependencies #82 (Lucas Parzianello)
• version bump to v0.1.8 #82 (Lucas Parzianello)
• ran pre-commit on project #82 (Lucas Parzianello)
• ran pre-commit on project #82 (Lucas Parzianello)
• removed unused cookiecutter file #82 (Lucas Parzianello)
• removed copyright year #82 (Lucas Parzianello)
• updated capture listing #82 (Lucas Parzianello)
• improved error handling when listing captures #82 (Lucas Parzianello)
• added missing dry-run mode to captures listing #82 (Lucas Parzianello)
• improved test coverage for captures #82 (Lucas Parzianello)
• docs: improved docstrings for the capture api #82 (Lucas Parzianello)
• skipping cache for build acceptance runs #82 (Lucas Parzianello)

v0.1.7

Continuous Integration

• makefiles for sds gateway and network #64 (Lucas Parzianello)

Commits

• 95c3e0c: add scan group, update rh capture create process (klpoland) #61
• 3f12a44: test reconstruct file tree with scan group (klpoland) #61
• 2569b21: update tests, serializers, validation, add update mapping to init_indices (klpoland) #61
• c429f68: add trailing commas (klpoland) #61
• 005be13: remove duplicate scan_group mapping (klpoland) #61
• 8d4779c: add migration (klpoland) #61
• 0cd1cd5: differentiate capture types for filtering file connections (klpoland) #61
• e5fa975: add mixin to redirect to auth0 login, make api docs/schema public (klpoland) #63
• updated rh schema generator code #64 (Lucas Parzianello)
• added radiohound test data #64 (Lucas Parzianello)
• using bs4 to get html text from django stacktrace when testing #64 (Lucas Parzianello)
• moved test env check to utils #64 (Lucas Parzianello)
• testing rh capture creation #64 (Lucas Parzianello)
• added scan group attr for rh captures #64 (Lucas Parzianello)
• added source to radiohound schema generator script #64 (Lucas Parzianello)
• reorganized tests to reflect source tree #64 (Lucas Parzianello)
• copying opensearch certs for django #64 (Lucas Parzianello)
• corrected paths in file tree reconstruction #64 (Lucas Parzianello)
• improved capture listing error handling #64 (Lucas Parzianello)
• local test for capture update #64 (Lucas Parzianello)
• integration test for rh capture update #64 (Lucas Parzianello)
• removed nonexistent minio exceptions (Lucas Parzianello)
• fixed unintentional settings override for prod storage #65 (Lucas Parzianello)
• 2f53d6d: cluster and index permissions set up change (klpoland) #67
• ab7430e: Revert "cluster and index permissions set up change" (Lucas Parzianello) #68
• 935ce4f: add cluster_composite_ops action group to make sure index/cluster composite permissions are included (klpoland) #69
• 7cbfb85: revert bullet points (klpoland) #69
• 98346f4: fix markdown linting (klpoland) #69
• preventing missing sds-ignore file warning (Lucas Parzianello)
• creating index when missing (Lucas Parzianello)
• testing authentication with inlined token; index_name optional for capture creation (Lucas Parzianello)
• updated opensearch default user in django (Lucas Parzianello)
• deprecated index_name arg for capture creation (Lucas Parzianello)
• ci: also pulling compatible images as part of the build (Lucas Parzianello)
• version bump to 0.1.7a0 (Lucas Parzianello)
• updated version matching test to be pep 440 compatible (Lucas Parzianello)
• removed extra log messages (Lucas Parzianello)
• deps updated (Lucas Parzianello)
• improved progress bar for notebooks (Lucas Parzianello)
• ignoring missing import false positive from pyright (Lucas Parzianello)
• also running action on pr synchronization (Lucas Parzianello)
• new unknown index excptn; not keeping captures that failed indexing on creation (Lucas Parzianello)
• added scan group field to capture document creation (Lucas Parzianello)
• updated capture creation example (Lucas Parzianello)
• behavior change: capture listing does not fail anymore when opensearch docs are missing (Lucas Parzianello)
• updated test expectations on opensearch failure (Lucas Parzianello)
• passing args to make targets (Lucas Parzianello)
• improved reconstruct tree logging; fixed pattern matching (Lucas Parzianello)
• added bs4 and ipython to deptry exceptions (already catching these import errors) (Lucas Parzianello)
• updated version tag (Lucas Parzianello)
• updated changelog (Lucas Parzianello)

v0.1.6

See changelog.