The development of new sensors and easier access to remote sensing data are significantly transforming both the theory and practice of remote sensing. Although data-driven approaches based on innovative algorithms and enhanced computing capacities are gaining importance to process big Earth Observation data, the development of knowledge-driven approaches is still considered by the remote sensing community to be one of the most important directions of their research. In this context, the future of remote sensing science should be supported by knowledge representation techniques such as ontologies. However, ontology-based remote sensing applications still have difficulty capturing the attention of remote sensing experts. This is mainly because of the gap between remote sensing experts' expectations of ontologies and their real possible contribution to remote sensing. This paper provides insights to help reduce this gap. To this end, the conceptual limitations of the knowledge-driven approaches currently used in remote sensing science are clarified first. Then, the different modes of definition of geographic concepts, their duality, vagueness and ambiguity, and the sensory and semantic gaps are discussed in order to explain why ontologies can help address these limitations. In particular, this paper focuses on the capacity of ontologies to represent both symbolic and numeric knowledge, to reason based on cognitive semantics and to share knowledge on the interpretation of remote sensing images. Finally, a few recommendations are provided for remote sensing experts to comprehend the advantages of ontologies in interpreting satellite images.