This was caused by not reloading the user project from disk and losing
previous changes done to the same project.