bolt
Short
visibility
6K views
schedule
1:00
CULCHR.TV
Yandex's PV-Tuning: Run Llama 70B at home! Local AI just got more accessible! 🚀🦙
0:00
thumb_up 428
comment 28
2024 1 year ago
AI Compression just got better!
▼ Link(s) From Today’s Video:
Download the compressed models:
70B Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
70B Instruct Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16/tree/main
8B Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
8B Instruct Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Learn more about PV-Tuning: https://arxiv.org/abs/2405.14852
â–º MattVidPro Discord: https://discord.gg/mattvidpro
â–º Follow Me on Twitter: https://twitter.com/MattVidPro
â–º Buy me a Coffee! https://buymeacoffee.com/mattvidpro
-------------------------------------------------
â–¼ Extra Links of Interest:
AI LINKS MASTER LIST: https://www.futurepedia.io/
General AI Playlist: https://www.youtube.com/playlist?list=PLrfI66qWYbW3acrBQ4qltDBsjxaoGSl3I
AI I use to edit videos: https://www.descript.com/?lmref=nA4fDg
Instagram: instagram.com/mattvidpro
Tiktok: tiktok.com/@mattvidpro
Second Channel: https://www.youtube.com/channel/UC06GdmaEdCdCFwR3NvszloQ
Let's work together!
- For brand & sponsorship inquiries: https://tally.so/r/3xdz4E
- For all other business inquiries: [email protected]
Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
Vintage
Sneakers
Streetwear
Gaming
Travel
Food
Tech
Kids
Reselling
Sports
Comedy
Entertainment
Skate
Cards
Retro
Business
Music
Learn
News
Art
Outdoors
Docuseries
Anime
Wrestling
Lifestyle
Auto
Reality
Shopping
Luxury
Military
Sci-Fi
International
Western
Weather
Movie
Engineering
Gameshow
Home
Local
Relaxation
bolt More Shorts
0:16
visibility 3.9K
come for web dev trivia. stay for spicy moments like @marktechson gaining a new mortal enemy
0:18
visibility 96.9K
Black mirror looking more real very day - 3D memory capture
0:20
visibility 4.9K
AI Motion Capture While Playing Electric Guitar (Wan 2.2)
1:00
visibility 2.8K
Why ChatGPT Isn't Actually Making Your Life Easier
1:15
visibility 4.7K
Are Flying Cars Finally Here?
0:09
visibility 10K
Capturing reality is a damn near superpower
0:35
visibility 5.1K
devs, what if you DIDN'T ignore that voice in your head that says everything should be a custom app?
0:13
visibility 2.9K