Hello,
Thank you for asking the query :
No, you should not be swimming now. You should keep the ears dry at least for a 4 weeks. Even Though there is no pain, you still could be at risk of getting secondary infection. Moreover while swimming water will enter the ear under a pressure, and so it is more dangerous.
In my personal opinion, even after 1 month you should use earplug while swimming. These soft ear plugs can prevent water from entering the ear cavity in high pressure.
Hope this helps. Thank you.