While Azurite is automatically installed with Visual Studio 2022, it's not always the latest version.
To keep in control of which version you're running, run it in docker! Then when Visual Studio tries to start it up, it'll see something's already running on the Azurite ports and use that one instead.
Run it with something like the following to persist any data:
docker run -p 10000:10000 -p 10001:10001 -p 10002:10002 -v c:/azurite:/data mcr.microsoft.com/azure-storage/azurite