Yes, the computer would need to be on and running the service anytime you wish to be able to view the camera streams from Alexa.
As a longer term solution, you can also use a small inexpensive low-powered embedded device like a Raspberry Pi to run the gateway service if you prefer not to leave your computer running full time.
Thanks, Robert