I can only tell you my opinion, as I have never tested it myself and have no deep insights of the matter.
I believe it does matter, and it will affect your SEO, especially with low quality TLD's, cheap TLD's or free TLD's like freenom.
That doesnt mean you wont rank at all, it just means its a disadvantage. Its like not having a SSL certificate.
It wont directly mess up a website SEO, (have a look at pharma companies, distributon/import companies, church websites and others who don't even have SSL but they actually make bilions of dollars - even a backlink from there would be so precious, yet no SSL!)
So yeah, thats my point of view. I think it does matter however not so much.
