You don't need to overdo the modesty, but wear long pants and keep your clothing loose-fitting. If you visit a mosque, bring a headscarf (easily boughten for a rial or two in the souq) and make sure your shirt covers your wrists and your pants your ankles. You most likely won't get in trouble on the streets for dressing immodestly, but you may get some attention that makes you uncomfortable.