"Goat" is an image of stubbornness, intransigence, willfulness, reflecting such traits of human character, which he needs to "sacrifice" to God, i.e. by fulfilling His Commandments "burn" in the Fire of the spiritually healing Word of God and so eliminate them from his life.
"The Blood of the Goat" is a symbol of the life of man that takes place in his stubborn unwillingness to submit to the Will of God.