bolt
Short
visibility
6K views
schedule
1:00
CULCHR.TV
Yandex's PV-Tuning: Run Llama 70B at home! Local AI just got more accessible! 🚀🦙
0:00
thumb_up 428
comment 28
2024 1 year ago
AI Compression just got better!
▼ Link(s) From Today’s Video:
Download the compressed models:
70B Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
70B Instruct Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16/tree/main
8B Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
8B Instruct Model: https://huggingface.co/ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Learn more about PV-Tuning: https://arxiv.org/abs/2405.14852
â–º MattVidPro Discord: https://discord.gg/mattvidpro
â–º Follow Me on Twitter: https://twitter.com/MattVidPro
â–º Buy me a Coffee! https://buymeacoffee.com/mattvidpro
-------------------------------------------------
â–¼ Extra Links of Interest:
AI LINKS MASTER LIST: https://www.futurepedia.io/
General AI Playlist: https://www.youtube.com/playlist?list=PLrfI66qWYbW3acrBQ4qltDBsjxaoGSl3I
AI I use to edit videos: https://www.descript.com/?lmref=nA4fDg
Instagram: instagram.com/mattvidpro
Tiktok: tiktok.com/@mattvidpro
Second Channel: https://www.youtube.com/channel/UC06GdmaEdCdCFwR3NvszloQ
Let's work together!
- For brand & sponsorship inquiries: https://tally.so/r/3xdz4E
- For all other business inquiries: [email protected]
Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!
All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.
Vintage
Sneakers
Streetwear
Gaming
Travel
Food
Tech
Kids
Reselling
Sports
Comedy
Entertainment
Skate
Cards
Retro
Business
Music
Learn
News
Art
Outdoors
Docuseries
Anime
Wrestling
Lifestyle
Auto
Reality
Shopping
Luxury
Military
Sci-Fi
International
Western
Weather
Movie
Engineering
Gameshow
Home
Local
Relaxation
bolt More Shorts
2:20
visibility 11.2K
News Update: OpenAI & Anthropic Feud Heats Up
1:17
visibility 1.3K
Can AI Defend Us From Social Media Addiction?
1:00
visibility 7.6K
Your New Favorite Coding Employee
0:53
visibility 436
Inside Lenovo’s Tech World: Futuristic AI for All — From The Pocket To The Cloud
1:35
visibility 10.5K
What Successful AI Startups Have In Common
1:06
visibility 2.5K
I got to make a reality tv show for web devs and it's starting to look like I'd imagined it could
0:22
visibility 5.9K
animate things as they scroll into view with pure CSS 🤯
0:41
visibility 711