SELF-SUPERVISION(masked patch prediction)

[yeqiyuan]

Hello, sir, do you have the link of self-supervision prediction experiments. Could you share it.

[rwightman]

self-supervision experiments are something I'm working on (slowly), but the masked-patch prediction for vit is not the type of SSL I'm plannning to focus on initially