Search engine pages results and web pages on urban rivers

This corpus contains 72,722 web pages about urban rivers. The pages were obtained by sending Google queries of the type {river AND city}, for a total of 303 cities worldwide and their associated river(s) (373 city-river pairs in total, see the 'list_city_river' file), sent in April 2024. The cities were selected as part of the GloUrb project based on several criteria, including hydrological, geomorphological and population factors. The selected rivers are located in dense urban centres as defined by the Global Human Settlement layer (JRC 2019) and are 30 metres wide or more.

The 'corpus' file includes information about the websites (website title, position on the results page, snippet, web address, domain, etc.) and contains their tokenized content (i.e. the dictionary form is associated to each word of the text, removing stop words). The original content is not given for data protection reasons (GDPR). The results were collected using the free software R and the Value SERP API. The queries were first launched in English and without any specific location. Then, the queries were launched in each local language of each city and located in the country. Finally, each web page was scrapped using R.