below are verses from the Bible that talk about goats

Leviticus 3:12	If his offering is a goat, he is to present it to the Lord.
Leviticus 16:8-10	He is to cast lots for the two goats—one lot for the Lord and the other for the scapegoat. Aaron shall bring the goat whose lot falls to the Lord and sacrifice it for a sin offering. But the goat chosen by lot as the scapegoat shall be presented alive before the Lord to be used for making atonement by sending it into the desert as a scapegoat.
Leviticus 16:21-22	He is to lay both hands on the head of the live goat and confess over it all the wickedness and rebellion of the Israelites —all their sins— and put them on the goat's head. He shall send the goat away into the desert in the care of a man appointed for the task. The goat will carry on itself all their sins to a solitary place; and the man shall release it into the desert.
Isaiah 1:11	"The multitude of your sacrifices—what are they to me?" says the Lord. "I have more than enough of burnt offerings, of rams and the fat of fattened animals; I have no pleasure in the blood of bulls and lambs and goats."
Ezekiel 34:17	As for you, my flock, this is what the Sovereign Lord says: I will judge between one sheep and another, and between rams and goats.
Matthew 25:32	All the nations will be gathered before him, and he will separate the people one from another as a shepherd separates the sheep from the goats.
Hebrews 9:13	The blood of goats and bulls and the ashes of a heifer sprinkled on those who are ceremonially unclean sanctify them so that they are outwardly clean.
Hebrews 9:19	When Moses had proclaimed every commandment of the law to all the people, he took the blood of slain calves and goats, together with water, scarlet wool and branches of hyssop, and sprinkled the scroll and all the people.
Hebrews 10:3-4	But those sacrifices are an annual reminder of sins, because it is impossible for the blood of bulls and goats to take away sins.