We stayed at Web's cottage for a week after our wedding. It was perfect honeymoon - perfect weather, perfect location, and a perfect home-away-from-home. And, to top it off, Web is a fantastic host.
The cottage is about a 10 minute walk into town (an even faster bike ride), and convenient (i.e. a 15-30 minute bike ride) from most of Nantucket's beaches. If you'd prefer to take Nantucket's all-island shuttle, it stops at the end of the street, making it extremely convenient. The cottage is truly well outfitted - all toiletries, a generous supply of towels, everything required for cooking (including oil, spices, etc.), a recent guidebook, beach chairs, coolers, etc. etc.
We couldn't have asked for a better week, and hope to return.