Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild

darepublic

I'm sorry but this just reminds me of this tng episode that inspired me as a teen https://www.youtube.com/watch?v=4Faiu360W7Q

poly2it

This is insanely promising. What a time to be alive!

tamimio

Cool, so now when the swarm drones come after you, they can reconstruct the video on the fly from that single CCTV shot taken by flock, and pinpoint your location from the aggregated data by plantir!

bensmoif

Really interesting, and a link to your GitHub with a "code coming soon". Please get us the tool already!

christianh

Looks cool. How’s it different from https://github.com/gaomingqi/sam-body4d ? My guess: Is sam-body4d focused on temporally consistent body reconstruction into an MHR model, and Lift4D creates the full scene and a model of the tracked object (that doesn’t need to be a human). I may be way off, but a comparison would help me!

fraywing

wondering how accurate the extrapolated distances are? Like the Rhino and the tree -- I wonder if the approximation could be useful in something like forensics from a security video?

b1n

Enemy of the State predicted this: https://www.youtube.com/watch?v=3EwZQddc3kY&t=11s It's only a matter of time before it's in use by law enforcement: https://news.ycombinator.com/item?id=48520807

jmpman

Can someone use this on Elon's "my heart goes out to you" video, and compare it to... similar gestures. Would be interested to see exactly how close it is.