Thank you so much for your reply. I actually called the GoDaddy support and apparently, you cannot remove the full privacy protection if the domain is already expired. This actually makes sense.
So what we did is I just paid for both the domain renewal and privacy protection. Then, GoDaddy will later issue a refund for the privacy protection. After completing the payment, I was now able to downgrade.