Google Panda updates have been wreaking havoc for a while now. I figured a timeline would be good to provide because if your website had problems in the past with its rankings, you can try to match up the timeline. Once you figure out what update caused your problems, then you can attempt to start fixing your website.
