You must have five heart containers before you can pick up the white sword. You start off with three, so that should be two more from the start. You can find the heart containers in the dungeons after the dungeon boss, or picking up the heart containers in the overworld.