Does the domain’s history matter?

Absolutely.
A domain with a bad history (spam, penalties, malware) can harm your SEO and credibility. Always check its past before buying.