Bet you didn't know that's the last line in the well-known something old, new, borrowed and blue proverb - the actual line is, "and a six pence in your shoe."
The line, if you follow it, is supposed to bring you and your husband wealth.
It may be uncomfortable to have an actual penny or six pence in your shoe so another idea is to have the coin sewn into your hem. Vane from Brooklyn Bride suggested taking two coins, one with the birth you or you and your groom. Or you can find a newly minted penny with the year of your wedding on it.