There are chances, and the ISP might track down your IP and fine or penalize you for violating the rules.
In case the internet service provider has banned or put restrictions over the particular torrent site. When you try to download a file from torrenting websites, your IP gets tracked.
Torrent downloader software use involves both uploading and downloading files.