Atlanta United's US Open Cup defense came to an end on Wednesday as they threw away a two-goal lead to lose 3-2 away at Nashville SC.