https://www.chenk.top/en/tags/multimodal-learning/Recent content in Multimodal Learning on Chen Kai BlogHugoenThu, 12 Jun 2025 09:00:00 +0000https://www.chenk.top/en/transfer-learning/08-multimodal-transfer/Thu, 12 Jun 2025 09:00:00 +0000https://www.chenk.top/en/transfer-learning/08-multimodal-transfer/<p>How can a model classify an image of a Burmese cat correctly without ever having seen a label &ldquo;Burmese cat&rdquo;? Traditional supervised learning needs millions of labeled examples per class. CLIP, released by OpenAI in 2021, sidesteps that constraint entirely: it learns to put images and natural-language descriptions into the same vector space, and then &ldquo;classification&rdquo; reduces to picking which sentence — out of any candidate sentences you write down — sits closest to the image.</p>