Which OS? Could be something related to permissions, ownership, apparmor, firejail, etc. I had the same problem when trying to run TB with different group ID, PulseAudio didn't like that.
You don't need torsocks, youtube-dl has built-in socks5 support:
youtube-dl --proxy "socks5://127.0.0.1:9150"
This includes DNS requests, it's the same thing as "socks5h://" in curl. Change port to 9050 if you want to proxy through system Tor instead of Tor Browser.
IIRC torsocks also has problems with certain domains or IPs due to too small buffer. Don't know if this has been fixed already or not.