What does goat cheese taste like? You might have asked this question yourself. You might have tried one of the more popular types of goats cheese but wonder what other types taste of, or you may have heard that goat cheese is stinky, and something to stay away from. You might have tried goat cheese with crackers, but wonder how else it might be used. There are many different types of goats cheese, ranging from hard to soft, tangy to nutty, and the cheese can be marinated or drizzled with honey to add new or different flavors.