The Sewall-Scripture House is set at the northeast corner of King and Granite Streets (the latter designated Massachusetts Route 127), on the outskirts of Rockport's main village. It is a 2+1⁄2-story structure with a side-gable roof, whose main block is constructed out of locally quarried granite. The front and side walls are formed out of dressed blocks about 1 by 4 feet (0.30m ×1.22m) in size; the rear wall is formed out of coursed random and square rubblestone. A 2+1⁄2-story wood-frame ell, apparently original to the house's construction, extends to the rear; it is finished in wooden clapboards. The main facade is five bays wide, with a central entry set in a round-arch opening with flanking sidelight windows.[3]
The house was built in 1832 by Levi Sewall, owner of a granite quarry located on Pigeon Cove. Stone for this house was hauled from the quarry by teams of oxen. Sewall was one of Rockport's leading quarry owners, his business operating independently until its merger in 1921 with the Rockport Granite Company. Sewall's descendants owned the house until 1957, at which time it was acquired by the Sandy Bay Historical Society. Although there are a number of commercial buildings in Rockport built from local stone, this is the only house that is.[3]