As described above,

We cannot move existing folder into the project if we are in visual studio administrator mode. Drag and drop won't work there. It's because Window Explorer is a user process.

Lesson learnt.