You absolutely should observe tomorrow night. Some of the best sky conditions occur in winter. I have done plenty of observing in even sub-zero weather.
Dress as warm as you can. No such thing as overdressing for cold weather astronomy. Remember, this is not an aerobic activity. You will be standing around for the most part.
Bring a thermos with hot cocoa. The sugar will help your eyes stay at the best.
Cold weather will not hurt a telescope. The focuser may get sticky if you have grease in it. Other than that, only issue is battery
drain if you are running a motorized scope. Bring extra batteries
, just in case.
Be very careful handling eyepieces. Cold hands tend to drop things and in sub-zero weather touching metal should always be approached cautiously.
Be careful not to breathe on or near the eyepiece whn observing or it will fog, immediately.
Cover your telescope
with a towel or tarp before bringing it back indoors. This will help with condensation issues.
Get out there and observe. Clear skies to you!