Using a Media Player without turning on the TV

Hi. I’m giving serious thought to a Media Player so that I can have all my video and music files in one place. I’d connect it to the TV (for video) and to my hi-fi (for music, obviously). My worry is this - these new Media Players seem so tiny that I can’t imagine they have a display panel of any sort. When I want to play some music, I don’t want to have to switch on the TV solely to find the album I want. Is this a problem with Media Players? If so, are there any which CAN be used without having to switch on the telly? Thanks for any replies.