Resolution for #796, #453, #385, and #297

[jlarson4]

Description

• Added eager parity testing with HF for [Bug Report] Pythia models / Rotary Embeddings don't match Huggingface. #385 on TransformerBridge
• Updated all testing to use V instead of Vh after yesterday's update & the update to [Proposal] change FactoredMatric.svd() so it doesn't prevent all instances of FactoredMatrix from being garbage collected #796
• Added testing checkpoint loading to TransformerBridge, added alias for checkpoint_label for [Bug Report] form_pretrained() always downloads the same weights when using checkpoint-labels #453
• Added HookIntrospection mixing for [Proposal] Provide better print-outs for current hooks attached #297
• Updated FactoredMatrix caching to ensure proper garbage collection

Fixes #796, #453, #385 and #297

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)

Checklist:

• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• My changes generate no new warnings
• I have added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes
• I have not rewritten tests relating to key interfaces which would affect backward compatibility