Thanks everyone!
I went out, and tried, that certainly does the trick.
I pushed in on the door just a little, and turned the key extremely hard, and it opened. When I had tried before, I was so scared that I would break the key off in the lock last night, I chickened out on turning it hard...