Explore caves for ores and chests. Chests contain useful items, ores are used to make tools, weapons and armor. As you become stronger, go find the Corruption, break some Shadow Orbs, kill some corruption-oriented enemies for loot(which can also be used for better equipment). Try reading some of the previous questions on this site, there is some interesting info there.
