Herman married 5/1/1629 in Amsterdam to Geertruijt Schutte of Lockum, a village in province of Gilderland. Eighteen children were, according to the “Swartwout Chronicles,” born to this marriage — all in Amsterdam, Holland between the years of 1630-1650. Issue noted listed in this epistle

In 1629, he engaged with his brothers, Wybrandt and Tomys, in the wholesale tobacco business at Amsterdam. In 1647, he was residing on the southwest side of the Wagon Square near the Harlem gate.204