Tipus de document

Treball de fi de màster

Data de publicació

Llicència de publicació

memòria: cc-by-nc-nd (c) Morera Barrios, Ignacio Javier, 2026
Si us plau utilitzeu sempre aquest identificador per citar o enllaçar aquest document: https://hdl.handle.net/2445/232342

Efficient Adaptation of Vision-Language Models for Cloud Image Classification Using LoRA

Títol de la revista

Contribució addicional

ISSN de la revista

Títol del volum

Resum

Accurate cloud classification from ground-based images matters for short-range weather forecasting, climate monitoring, and solar irradiance prediction. In practice, it is a hard visual problem: cloud types share overlapping textures and shapes, their appearance changes with lighting and altitude, and even trained meteorologists sometimes disagree on the correct label. A practical barrier is that available datasets were collected and labelled independently using different taxonomies, so combining them for training requires reconciling incompatible class definitions. further constraint is that achieving high accuracy with large pre-trained models can require computational resources that are unavailable in many practical scenarios. This thesis addresses both issues. First, we build a merged benchmark from four public datasets: SWIMCAT, CCSN, FabraClouds256, and FabraSwimcat, unified under a shared eleven-class taxonomy. Second, we adapt Qwen3.5-0.8B, a compact vision-language model, to this benchmark in two stages: supervised fine-tuning (SFT) with single-label supervision to learn the cloud domain and vocabulary, followed by reinforcement learning via Group Relative Policy Optimisation (GRPO), which trains the model to produce a ranked list of all eleven classes and rewards it for placing the correct class at the top. Low-Rank Adaptation (LoRA) keeps trainable parameters at just 0.13% of the backbone, so the full pipeline fits on free-tier cloud GPUs.

Descripció

Treballs finals del Màster de Fonaments de Ciència de Dades, Facultat de matemàtiques, Universitat de Barcelona. Any: 2026. Tutor: Jordi Vitrià

Recurs relacionat

Citació

Citació

MORERA BARRIOS, Ignacio Javier. Efficient Adaptation of Vision-Language Models for Cloud Image Classification Using LoRA. [consulted: 17 of November of 2026]. Available at: https://hdl.handle.net/2445/232342

Exportar metadades

JSON - METS

Compartir registre