I would add that from personal experience, I've seen more books go on to sell well with smaller advances than with the larger ones. (writerunboxed.com)
Most publishers these days pay new authors very small advances (if any). (kathyide.com)
If you have another miserable failure, then you'd have to step down to an even smaller publisher and an even smaller advance. (advancedfictionwriting.com)