At the end of your next turn, if nobody within your duel has targeted another creature within the duel (or equipment they bear) with an ability, then the duel ends. You count as "losing" and return to the Material Realm. Any of your opponents count as "winning".