The Custom House was built about 1721 by Richard Ambler. Richard Ambler was a leading merchant in Yorktown and this undoubtedly influenced the selection of Richard Ambler as Customs Officer. He used this building as his office while he served as collector of customs. The Custom House is owned by the Comte De Grasse chapter of the Daughters of the American Revolution and has a museum inside that is open seasonally.