Thanks guys for your feedback! After going out and testing it again, I've noticed that the sound disappears with only a slight depressing of the clutch pedal.
However, if I am driving along and take foot off accelerator, it makes the noise while coasting. I'm suspecting clutch is on the way out...