The concept of independence has been frequently raised in climate science, but has rarely been defined and discussed in a theoretically robust and quantifiable manner. Improved understanding of this topic is critical to better understanding of climate change. In this paper, we introduce a unifying approach based on the statistical definition of independence, and illustrate with simple examples how it can be applied to practical questions.