Born in Baltimore in 1803, Joseph was brought to Lexington as a young child by his widowed mother. At 16 he became an apprentice cabinet maker and for a time was a journeyman craftsman in Cincinnati and later in Richmond, Ky.

By 1825 Joseph had returned to Lexington for good, opening a business with John Baxter, a wheelwright and wood turner. Their shop was located on South Broadway, on the same street and not far from where Milward Funeral Directors downtown home is located today.

While producing various pieces of furniture, they soon began to focus on producing caskets and providing aid for bereaved families in the community. Within 10 years, Joseph became sole proprietor of his business.