I have nothing pinned so the taskbar only has the applications that are actually open. That maximises the space for the windows title which helps if for example you have multiple windows explorer windows on different directories.
I mostly use Linux with KDE where if you hover over the application on the taskbar it previews the windows, this includes the path on the file manager unlike Windows where it seems it does not. Also Dolphin (the file manager) lets you split the window in two and use tabs instead of new windows, so that REALLY helps.
I swear, every time Windows updates explorer it makes it HARDER to use not easier. My mum has a real hard time remembering that drive letters are in This PC these days. I despise how every OS is trying to hide where things are in favour of organising it for you.