Voters are hearing the risks of remaining in the EU, and are concluding it's time for Brexit