Yes I double checked if any process was blocking access, as any windows user painfully learnt to do
I use one of the tools in windows very own power toys. However the tool couldn't find anything.
Obviously a process was holding those files though, because after a full reboot, I was able to delete the folder.
This is not the first time I encounter that issue, so I was hoping it was something common and that maybe a simple fix was known.
Not necessarily - it could have been a zombie lock. The process could have terminated without relinquishing a lock, the kernel could have inherited it. The way to get around deletion is to use something like: