Pilgrimages in the middle ages were extremely difficult. The people would have to travel long long distances spanning sometimes entire continents and they would often go on foot. They could die to literally anything, from disease, to bandits and murderers, to wild animals, or anything similar.
