Three US Olympic swimmers have been ordered to remain in Brazil to answer questions about a robbery that happened over the weekend.