The idiomatic expression "the last bit of something" refers to the final or remaining portion, remnants, or residue of that thing. In this context, "the last bit of summer" means the end or closing days of summertime, when warm weather is waning and autumn is approaching.