The Particle workbench extension and Microsoft Visual Studio code both typically update automatically but you can check your auto-update settings by following the instructions here.

We recommend using the the standard release and not the Insiders build. For more information, see the update cadence article for Microsoft Visual Studio Code.