What Is The Tradition Behind Giving A Penny For A Gift Of A Knife?

It is supposed to keep a friendship and not cut that bond and the same for scissors too, giving a penny means you are paying for it.
The other tradition of putting a penny in a gift of a purse is so that you will never be without money.