The boys were spending the summer at the Isle of Shoals, off the New England coast. Harry's father was Robert Vandyne, the well-known ship-owner of New York, and Walter's was equally prominent in the wholesale dry-goods business on Broadway. During their stay at this summer resort they had made the acquaintance of Jim Libby, "cook's assistant and everybody's mate" on the fishing-schooner Mary Walker, a craft which visited the Shoals once each week to supply the hotels with fresh fish.