Speaking at a news conference in Mexico City, the three-time World Cup winner lamented that protesters are "breaking and burning everything."
Many protesters hold demonstrations in Sao Paulo and about 50 other cities in Brazil last week against the country's hosting of the World Cup football finals from June.
Burning tyres and blocking motorways, people urged the government to improve infrastructure, education and welfare, rather than spending money on a football event.
"We already know that 25 percent of foreigners who are going to Brazil (for the World Cup) are worried about this movement and I think they even cancelled (their trip)," he said.
Pele also criticized the highly publicized corruption scandals that have been associated with the stadium construction sites.
The prosecutors said they found irregularities at the stadium where nearly 20-thousand temporary seats are being installed for the high-profile opener between Brazil and Croatia in four weeks.
The 73-year-old football icon jokingly said he wishes he could play a World Cup final against Uruguay, reminding the audience of the "Maracana Blow," when Uruguay defeated Brazil in the 1950 World Cup final played in at the Maracana stadium in Rio de Janeiro.
AP