Cameron has freed his ministers on the EU vote. Now his problems begin