The cover has two integral plastic clips molded into the bottom side which affix to the metal frame underneath. All you have to do is pull the two tabs slightly outwards away from the metal frame and lift it up. Be careful not to pull the clips too far as they are plastic.

 

slip your hands down the sides and easily spread the clips then pull up.They are on the sides right next to cap, one is towards the front of the car the other towards the back.

 

thanks you all. With you guys help, I am able to get it done. Here is a pic in case other runs into the same question

 

I'm surprised about the location of the clips on your cover. Yours clips to the power steering fluid reservoir while mine clips to the metal frame next to the reservoir.

 

difference between EU and US, maybe?

I got it figured out with your clue and a mirror, while Mircea described my version of clips perfectly.

 

You have to pull off the rear taillight assembly on a B6 A4 to change bulbs as well. It's only one bolt though and it comes right off.