Tories to blame over planning