How can I scrape data spanning mult. pages as well as clicking on results on each pg for coordinates?

asked 2015-12-15 12:02:23 -0500

Mcamp gravatar image

I'm attempting to build a database for all flying locations including their individual coordinates from the following URL: http://www.rcgroups.com/places/local?radius=0&type=1&km=true&lat=34.2005&lng=-118.1362&loc=Altadena,+United+States&sort=distance&order=asc (www.rcgroups.com/places/local?radius=...)

This will span all 102 pages with 50 results in each page (roughly 5k total), and I will need the name of the flying field as well as it's coordinate that is found by clicking each individual field and within it clicking on the google maps or weather links which provide the coordinate info. I'm open to any suggestions, thank you!

edit retag flag offensive close merge delete