Data

Tools

Indexes

Applications

Experiments

Open Sustainable Technology

https://github.com/kyegomez/gats

Implementation of GATS from the paper: "GATS: Gather-Attend-Scatter" in pytorch and zeta
ai attention attention-is-all-you-need attention-mechanism gpt4 llama ml multi-modal multi-modality multimodal open-source
Added: over 1 year ago - Last Synced: about 1 year ago - Created: January 18, 2024

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 12
  • Committers: 2
  • Issues: 0
  • Pull Requests: 3
  • Owner: kyegomez
  • Stars: 8
  • Forks: 0
  • Packages: 1
  • Downloads: 24
https://github.com/kyegomez/mmca

The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"
artificial-intelligence attention attention-is-all-you-need attention-mechanism gpt4 multimodal multimodality neural-network neuralnetwork opensource-library opensourceforgood
Added: over 1 year ago - Last Synced: about 1 year ago - Created: September 27, 2023

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 15
  • Committers: 3
  • Issues: 1
  • Pull Requests: 12
  • Owner: kyegomez
  • Stars: 9
  • Forks: 0
  • Packages: 1
  • Downloads: 20
https://github.com/kyegomez/tinygptv

Simple Implementation of TinyGPTV in super simple Zeta lego blocks
artificial-intelligence attention attention-is-all-you-need deep-learning multi-modal multi-modality transformers
Added: over 1 year ago - Last Synced: about 1 year ago - Created: December 29, 2023

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 15
  • Committers: 3
  • Issues: 0
  • Pull Requests: 3
  • Owner: kyegomez
  • Stars: 15
  • Forks: 0
  • Packages: 1
  • Downloads: 18
https://github.com/kyegomez/mobilevlm

Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant for Mobile Devices"
ai artificial-intelligence attention attention-is-all-you-need attention-mechanisms machine-learning ml
Added: over 1 year ago - Last Synced: about 1 year ago - Created: January 01, 2024

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 11
  • Committers: 3
  • Issues: 0
  • Pull Requests: 3
  • Owner: kyegomez
  • Stars: 12
  • Forks: 0
  • Packages: 1
  • Downloads: 31