I asked a friend this morning how to go about this... he said look at what is already out there and focus on what you like. Do you like type based logos? Image based logos?
So that is what I did.
This is an image I found really interesting... I think it is pretty self-explanatory.
I also find this series of images showing the progression of different famous logo design incredibly informative...