From Rockport. Been there hundreds of times. Famous for it Quarries. In its day, Stone blocks were shipped all over the U.S. Almost every residence has Stone foundations, walls etc. When you visit again, drive down all the " hidden" streets. Some look like Private Drives. There are so many great spots to visit off the main drag. I enjoy seeing the protected Harbors etc. At the City Dock, you should look into visiting Thatchers Island. there is a private Foundation, which have a Launch to bring visitors to the Island, but limited seating per trip.
There is also an old Life Station which still exists, but a private residence. Great photo shoot from the rocks...
Also Visit Annisquam, very similar, many nooks and crannies to see, along with Annisquam Lighthouse. Don't worry about driving down what appears as private roads... Your missing a lot!
The red building looks like "Motif 1". ? Most "painted" building in the U.S. For artists, professional and amateur. It is not the original building, it was wahed away during the Blizzard of 1978. It was rebuilt due to its tourist attraction!!
If you were able to take a boat ride around Rockport, you would see mountains of cut granite blocks, but never shipped anywhere...
Ron