I felt exactly the same way. Very, very hard until the kids are in school full time. But still hard until they are teenagers.

I'm finding the teenage years to be much more pleasant. Getting some payback for all the time invested. I know it's still a long way away for you.