How can I automatically return focus to the last control that was focused

I have a picturebox. After scrolling with a keypress, I want the focus to go back to the picturebox if my mouse is there. How can I do this? The reason is, that I use my mousewheel to scroll up or down and if I use the keyboard to override it, then it disables the mouswheel unless I move my mouse out and in again.