rightclick a file you want to remove, click "remove" and then "apply" in the bottom right. I used a while to notice the apply button myself. Actually, i found this thread searching for how to remove files from quarantine

Edit: you have to delete the files manually after removing them from quarantine.