You are on a tough road. Because my sister and I could share my mom's care we each were able to take vacations and time off over the years we spent being there for her. If you're alone that has to be very hard. And then your grandson?
My heart goes out to you. I retired a few years ago to do the things you mentioned. If I was waylaid as you are I would be depressed. Just being honest.
But, if it was what I had to do, I would do it. We don't always get to choose although there are many that say you are in charge of all your choices. Some choices are impossible to say no to and live with yourself, even though they are not exactly what you wanted from life.