For example, I'd like to be able to get alerted if any keyword tracked for the website changes position from above a certain threshold to be low a certain threshold.

Perhaps I set the threshold to "position 9." A keyword rising from 15 to 7 wouldn't trigger the alert, but then if it drops back down to 12 it would send an alert about lost rank on the keyword.