You save in-game at a designated Save Point or on the Overworld.
That's how you save to the memory card.

And you don't turn off the power.
You press ESC to exit the game window and bring up the GUI, then go to File > Exit.

Try closing it properly and see if ePSXe retains your memcard saves.