That's simply because in climate history, warm climate means small ice sheets, cold climate comes with big ice sheets, and sea level has changed accordingly. (realclimate.org)
We do know about climate history from anecdotal evidence even if we don't have temperature readings. (wattsupwiththat.com)
To view the ocean's climate history on a smaller scale, scientists look elsewhere. (scienceline.org)