You're probably better off using kubo directly if you want download CIDs e.g. ipfs get <cid>.
If you want a library to handle setting up libp2p and IPFS - see ipfs-lite.
If you want a minimal Go example of how to download UnixFS CIDs using the amino DHT, see main.go.