https://github.com/kyegomez/gats

Implementation of GATS from the paper: "GATS: Gather-Attend-Scatter" in pytorch and zeta
ai attention attention-is-all-you-need attention-mechanism gpt4 llama ml multi-modal multi-modality multimodal open-source
Added: over 1 year ago - Last Synced: about 1 year ago - Created: January 18, 2024

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 12
  • Committers: 2
  • Issues: 0
  • Pull Requests: 3
  • Owner: kyegomez
  • Stars: 8
  • Forks: 0
  • Packages: 1
  • Downloads: 24
https://github.com/kyegomez/tinygptv

Simple Implementation of TinyGPTV in super simple Zeta lego blocks
artificial-intelligence attention attention-is-all-you-need deep-learning multi-modal multi-modality transformers
Added: over 1 year ago - Last Synced: about 1 year ago - Created: December 29, 2023

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 15
  • Committers: 3
  • Issues: 0
  • Pull Requests: 3
  • Owner: kyegomez
  • Stars: 15
  • Forks: 0
  • Packages: 1
  • Downloads: 18
https://github.com/kyegomez/aoa-torch

Implementation of Attention on Attention in Zeta
ai artificial-intelligence gpt4 machine-learning multi-modal multi-modality research
Added: over 1 year ago - Last Synced: about 1 year ago - Created: December 04, 2023

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 15
  • Committers: 3
  • Issues: 0
  • Pull Requests: 13
  • Owner: kyegomez
  • Stars: 3
  • Forks: 0
  • Packages: 1
  • Downloads: 16