I finally solved the ticking noise that was coming from both passenger and driver side B pillars.
Because it was right behind my head, it was really annoying for quite some time.
I tried everything from sticking high density foam inside to stuffing inside with some cut up pieces of sponges.
But it was simple as removing the stickers inside the rear side panels right under the B pillars.
The stickers were not stuck down fully and I guess the sticky side was sticking and unsticking with the pillar and was creating a ticking sound.
(Sorry for blurry pictures)
Removing the sticker fixed the ticking sound for me!