running through a proxy and get more then first page of data.

[Dwoelper]

How do i get this to run through a proxy server?

also trying to make it loop so it can pull more then the first page.

[RichardModad]

I also wanted to make it loop.

By adding third argument, "pageNumber" you could manually add page number in command like "python3 yellow_pages.py pizza "Las Vegas",NV 2" but I get error: unrecognized arguments: 2

def parse_listing(keyword,place,pageNumber): url = "https://www.yellowpages.com/search?search_terms={0}&geo_location_terms={1}%2CNV&page={2}".format(keyword,place,pageNumber) print("retrieving ",url)

For a loop I am trying something like

pageCount = 1 for url in urls: url = "https://www.yellowpages.com/search?search_terms={0}&geo_location_terms={1}%2CNV&page={2}".format(keyword,place,counter) counter += 1

But this didn't work. I am kind of a newb but I think it should be fairly easy for someone with a lot of python skills to make this work.

[NoobBugHunter]

add this modification in def parse_listing()
for pages in range(1, 5+1): url = "https://www.yellowpages.com/search?search_terms={0}&geo_location_terms={1}".format(keyword, place) + f"&page={pages}"
and change pages range according to your need.

I also wanted to make it loop.

By adding third argument, "pageNumber" you could manually add page number in command like "python3 yellow_pages.py pizza "Las Vegas",NV 2" but I get error: unrecognized arguments: 2

def parse_listing(keyword,place,pageNumber): url = "https://www.yellowpages.com/search?search_terms={0}&geo_location_terms={1}%2CNV&page={2}".format(keyword,place,pageNumber) print("retrieving ",url)

For a loop I am trying something like

pageCount = 1 for url in urls: url = "https://www.yellowpages.com/search?search_terms={0}&geo_location_terms={1}%2CNV&page={2}".format(keyword,place,counter) counter += 1

But this didn't work. I am kind of a newb but I think it should be fairly easy for someone with a lot of python skills to make this work.