16 points allenleee 3 hours ago 6 comments
stephenitis 1 hour ago | parent
I like the entire premise, the one thing stopping me from trying this is not knowing the time scales that I will need to set my computer aside for the processing of large folders of video frames, or my photos library's videos, some 12,000 videos
hn3ufz62f7 37 minutes ago | parent
Having built something similar with CLIP on an M1, frame sampling rate is the whole ballgame. One frame a second on 12k videos is days, keyframes only got me to an overnight run.
xnx 18 minutes ago | parent
Have you tried scene detection? I would guess camera cuts are even less frequent than keyframes.
aavisangle 26 minutes ago | parent
How do you do that? What's the architecture? Can you guide on that?
lucideer 12 minutes ago | parent
possibly off-topic, but for anyone interested in this on a more cross-platform / holistic basis, Immich does this
(& by "this" I mean an approximate AI search for photos & videos - I can't account for the "every frame", nor for the comparative search quality)
qprofyeh 10 minutes ago | parent
This is cool. Any way to search for People / faces / pets? Like on iOS?