In the menu, go to:
- Visual Studio 2017: Tools > Extensions And Updates
- Visual Studio 2019: Extensions > Manage Extensions
A new window will pop up, then in the panel to the left, click the arrow besides Installed to bring it down and select the menu item All.
All you have to do now is to navigate in the middle panel to your installed exstension, select it and click Uninstall.