As far as I know you'll have to remove them one by one.
There are two options in Settings:
Either select "Edit" at the top right in Settings - Phone - Blocked, then tap one of the red minus signs and approve your intention to remove the contact from the Blocked list, or tap one contact and swipe to the left to remove it. Tap
There's no workaround to remove all of them at once. Sorry!