Yeah, that's basically how I handled it when I was doing my own startup on the side while working a day job at someone else's startup.
It can be done, but it's very stressful, both because you're pretty much spending all your waking hours either working or "at work", plus you usually have actual responsibilities at your day job that you're trying to get done while already tired.
