USDB: Scaling Storage for Next-Generation Recommender Systems at ByteDance

BenoitP

Setting up a classical DLRM at work, show of hands: who has managed to bridge the gap to generative recommenders or LRMs? Our survey identified quite a substantial list of challenges: product cardinality (Semantic IDs?), low performance vs discriminative recommenders (our user intents are heavily biases towards repetitive products), cold starts, entity features, missing explainability suite, training cost, prediction cost, etc. Has anyone done it easily? Where is the tutorial for generative recommenders ?

bashhq_r

So bytedance has the luxury of building custom storage for this, meanwhile we're over here trying to shoehorn user sequences into redis sorted sets

mikert89

The future of recommenders is just an agent paging through your data and trying picking the best next options