Check Engine Light went on, and then off on its own, should I be concerned?

Start by having the code read. Many chain auto parts places will do this for free (other than in California as I understand it).

If the light starts flashing, you know that you have to stop driving immediately, right?