The other example of a contemporary mikveh with an attached bathroom is at a site excavated in Jerusalem in the nearby Jewish Quarter. (sciencedaily.com)
Yes, rather than look for «baptism» look for ceremonial washings and in other Jewish literature, the mikveh. (redeeminggod.com)