From my point of view it very much depends on what your goals - if something like that can be defined - as a music listener are. If you're looking for the most variety for the least amount of money (as a consumer of music), streaming services are your thing. If you're a collector/curator, you wouldn't want to rent because then the streaming services control your collection (that might not be a bad thing to some). My attitude towards streaming services is already well documented (i.e. fuck the rent-seeking tech-bros and their algorithms), so what I'm going for is the collector/curator mode; I don't think about my music library - physical or digital - as something with "holes" to be filled, it's an idiosyncratic collection of records/releases I've found interesting or useful enough to own, a temporal sediment of music that I appreciate enough to want to own. I don't seek the maximum amount of variety - as an electronic (dance) music aficionado, I'm already squeezing myself to a very tight corner in a musical hyperdimension of immense - practically infinite - proportions; I seek associations and links between artists, labels, and collaborators, weaving a web of sound and information - culture, if you will. I prefer depth over superficiality, and tend to procure all releases from an artist or on a label to get the widest possible exposure on that particular theme (e.g. I was just going through Steve Pickton's all aliases and checking out if their compilation appearances have tracks that are not available anywhere else) - this is a holdover from my early days as a sad trainspotter on the IDM mailing list.
One thing I've thought about a lot is entitlement - streaming services produce it as an illusion, because you're paying peanuts and you have more music at your disposal than anyone can ever have, and the ease, comfort and convenience lull you into a laissez-faire mindset. I understand the psychology of convenience very well, because I'm constantly being seduced by it - why pay to get things you can get for a pittance, or even free, if you don't care about the ethics of piracy and/or freeloading? There are certain records that I'd want to have, as a collector, as a curator (in a subjective, personal sense, I'm doing it primarily for myself, but the curating spills over to e.g. WATMM), as a mook who's extremely easily beguiled by limited editions and exclusivity via artificial scarcity - but I wait for them to become available, if and when they do - and a lot don't, and then I just don't have or listen to them. Regardless, I already have enough music to listen for a lifetime several times over (30+ years of vinyl collecting/DJing will do that for you) - so why get more? To me, it's simply a hobby with benefits. It takes a lot of money, time and effort, but it's worth it to me. It takes space, and gets on my SO's nerves because there are vinyl records spilling over from shelves and on the floor all the time, although I've promised to keep everything sorted out. I, too, like a bit of novelty as much as anyone else, listening to Autechre's oeuvre for the umpteenth time just doesn't always cut it for me, and I still entertain the thought that I'm a DJ, so I also select to cater to that as well. It's what I love to do, and what I'm intensely interested it.
I do listen to other music besides electronic, too - but that's very much specific and limited to certain artists and/or selections (popular, even) from a genre, they cover only a handful of percentage points of my collection. This is the "wide array" portion of my listening habits, because this tiny sliver contains music from classical to heavy metal - but I'm definitely not claiming that I listen to "all kinds of music", because there's an infinity of artists/genres that I dislike or even loathe, and wouldn't be caught dead listening to. I don't think I'm conservative in my tastes, because I have explicitly selected the types of music I collect/curate for myself, it's not a stagnated, static leftover or residue from my youth - when I did listen to anything and everything I could get my hands on; I simply don't like the idea of spreading my attention (and money allocation) too wide and thin, as there's already way less of them available than I would prefer: depth over breadth. I habitually try new and different things out for size, but more often than not they don't make the cut and interest me enough to bring them into permanent focus.
I also like the idea of an anti-library (collection) from Umberto Eco via Nassim Nicholas Taleb - because there are records in my collection I have never listened to or played completely, or haven't returned to in a decade or two - but they're still important, because they're available when I need them. This is also the paradox of collecting, you'll have a metric ton (I have estimated that my vinyl collection weighs about that much) of things that mostly just take up space and are not actively used, so what's their use?
To me, the most responsible thing is to use Bandcamp, where one can (usually) listen to music before and after purchase. I still buy vinyl/CDs, too - from a couple of shops and directly from Bandcamp - but almost exclusively releases that are not available in any other format. The curating part does take a lot of time, I do some of it almost every day, but to me, it's definitely more interesting and feels worthwhile when I control my attention rather than delegate it to algorithmic subservience. I'm also fortunate enough to have enough financial resources at my disposal to feed the habit.
But, as always, YMMV. You do what you can with what you have.