JEPA pretraining underperforms masked models on MIMIC-IV EHRs
Three joint-embedding formulations trained without collapse but still lost to standard masked language modelling downstream.
1 stories, newest first · one card per story
Three joint-embedding formulations trained without collapse but still lost to standard masked language modelling downstream.
Today 367 readers · 405 views · 34 reads · all time 109K views