Hello,
Thanks for your query at DoctorSpring.com
I understand your concern
I won't recommend taking over the counter products you mentioned if you have already been taking Nexium. (Alka seltzer contains aspirin which may worsen your problems in a long run)
You can talk with your doctor for evaluation and change in dosage if needed.
Feel free to discuss further
Hope it helps
Regards