When I am applying for an E-visa, do I need to mail in my physical passport? And how will E-visa be returned to me?

You do not need to mail in your physical passport. You only need to e-mail a scan copy of it. Once E-visa is approved, the approval letter is emailed to you; therefore there is no shipping of any physical documents.