When you hit the cobblestone wall it will automatically rebuild on its own! If you want plant a tree in the castle and survive in it and plant other stuff that will feed your hunger.
