What I found out (and others before me) is that by simply ordering a lockpicking set you will have the tools to solve awesome and pretty cheap puzzles, namely locks
Buying locks can be very cheap via ebay for instance, or local locksmits/hardware stores possibly.
It is really awesome to try and pick your own locks too! I tried on a pretty expensive lock I own myself and to my amazement I picked it in 5 minutes