Laion Big Video Dataset
ks2048
37 points
6 comments
August 27, 2026
Related Discussions
Found 5 related stories in 56.8ms across 4,560 title embeddings via pgvector HNSW
- Getting video models to learn better, faster schopra909 · 16 pts · August 27, 2026 · 57% similar
- LM Studio Bionic: the AI agent for open models minimaxir · 204 pts · July 16, 2026 · 50% similar
- AI-generated videos to maximally drive a target brain region smusamashah · 273 pts · July 10, 2026 · 50% similar
- Lingbot-map: A 3D foundation model for reconstructing scenes from streaming data olalonde · 15 pts · July 17, 2026 · 46% similar
- "Famous Deep Learning Papers", David Bau ggcr · 27 pts · August 26, 2026 · 46% similar
Discussion Highlights (2 comments)
topwalktown
"Overall, we attempted to download 130M videos and achieved a link success rate of approximately 60%, resulting in 80M successfully retrieved videos with a total duration of 10M hours." I am astonished that the success rate is so high. How Youtube didn't block them, I don't know. But I think that this URL list won't age well because youtube will very quickly block any researcher trying to download these videos themselves.
vivzkestrel
- can someone with expertise give us an overview of the architecture involved doing this - let us say you ran yt-dlp inside python aiohttp - surely your ll run a limit soon as your ip address will be flagged - what solutions do we have to auto rotate proxies in python - are there better, faster and more reliable ways to go about downloading a 100 million videos without getting your ip address blocked?