Classification of SAR image data continues to be a big challenge. Major difficulties include the scarcity of available data, and the difficulty of semantically interpreting the SAR backscattered signal. There are no large-scale, SAR-derived image databases for Remote Sensing image analysis and knowledge discovery. Furthermore, while optical image classification has seen a breakthrough with the advent of Deep Learning methods that require Big Data, SAR-based systems have so far not experienced the same progress, likely because not enough data associated training labels is available.