How would you even balance the first classifier if all the classes it saw is 1?

it's more like regardless of the features, the class is always 1