https://github.com/kyegomez/mmca

The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"
artificial-intelligence attention attention-is-all-you-need attention-mechanism gpt4 multimodal multimodality neural-network neuralnetwork opensource-library opensourceforgood
Added: over 1 year ago - Last Synced: 11 months ago - Created: September 27, 2023

  • Relevant topics? true
  • External users? true
  • Open source license? true
  • Active? true
  • Fork? false
  • Main Language: Python
  • Commits: 15
  • Committers: 3
  • Issues: 1
  • Pull Requests: 12
  • Owner: kyegomez
  • Stars: 9
  • Forks: 0
  • Packages: 1
  • Downloads: 20