You cannot be in a worse position than having God bring you down, because no one will be able to help you,

Those who sat in darkness and in the shadow of death,
Bound in affliction and irons—
Because they rebelled against the words of God,
And despised the counsel of the Most High,
Therefore He brought down their heart with labor;
They fell down, and there was none to help.
(Psalm 107:10–12)

If God holds you down, no one can bring you up. If God holds you up, no one can bring you down!