Yeah, you can do it, but the only use case where it makes sense is if you need to do something on the desktop that doesn't take long and doesn't require your active attention (so like starting a download or something).
Anything else, you'd be better off just using the notebook or walking over to the desktop to do it.