The insert key doesn't toggle like caps lock.

Although its effecst on given gadget seem to toggle between insert / overwrite the effect is on a pergadget basis, so you need to kepp track of it yourself in your own uasage context.