A standard lever lock uses one side of the key to lift levers into a "clear" position allowing the bolt to slide. What if we changed that to a two position bolt. The key is double sided, and the levers have sequential "clear" positions. You turn the key 90, bolt moves, another 180, the bolt moves again.
Let me know if I'm not making any sense.

I'm trying to think of that hardest lock to pick or bypass. I think that some sort of lever lock would be the hardest lock to open without a key. Disk locks would be another, but a complex (10+ lever) lever lock would be the most challenging I think.