Avoid changing scale unless necessary

It causes the browser to redo the layout needlessly otherwise,
having annoying effects like moving the scroll position.