Discuss the role of caching in performance optimization. What considerations would you take into account while implementing a caching strategy?