fix HTTP proxying

[pawelmhm]

What do these changes do?

• fixes HTTP proxy support.
• adds functional tests for proxies (via Mitmdump)

Are there changes in behavior for the user?

Fixes regression, brings back intended behavior, users will be able to use HTTP proxies without any errors.

Related issue number

#1413

Checklist

• I think the code is well written
• Unit tests for the changes exist
• Documentation reflects the changes
• Add yourself to CONTRIBUTORS.txt
  • The format is <Name> <Surname>.
  • Please keep alphabetical order, the file is sorted by names.
• Add a new entry to CHANGES.rst
  • Choose any open position to avoid merge conflicts with other PRs.
  • Add a link to the issue you are fixing (if any) using #issue_number format at the end of changelog message. Use Pull Request number if there are no issues for PR or PR covers the issue only partially.

[codecov-io]

Current coverage is 98.50% (diff: 100%)

Merging #1415 into master will decrease coverage by 0.37%

@@             master      #1415   diff @@
==========================================
  Files            30         30          
  Lines          6900       6902     +2   
  Methods           0          0          
  Messages          0          0          
  Branches       1143       1144     +1   
==========================================
- Hits           6823       6799    -24   
- Misses           33         39     +6   
- Partials         44         64    +20   

Powered by Codecov. Last update b65ecf4...ac8b43f

[nodermann2]

Long story short

My apologies if not posted there, I tried this patch and found the related bug, it appears after a redirect, I think I should put it here until it's in production

Expected behaviour

http://httpbin.org/redirect/6 (302) -> http://httpbin.org/get (200)

Actual behaviour

Traceback (most recent call last):
  File "/home/user/Projects/test_beh.py", line 14, in <module>
    loop.run_until_complete(go())
  File "/usr/lib/python3.5/asyncio/base_events.py", line 387, in run_until_complete
    return future.result()
  File "/usr/lib/python3.5/asyncio/futures.py", line 274, in result
    raise self._exception
  File "/usr/lib/python3.5/asyncio/tasks.py", line 239, in _step
    result = coro.send(None)
  File "/home/user/Projects/test_beh.py", line 8, in go
    proxy="http://23.81.247.47:29842") as resp:
  File "/home/user/envs/test_env/lib/python3.5/site-packages/aiohttp/client.py", line 529, in __aenter__
    self._resp = yield from self._coro
  File "/home/user/envs/test_env/lib/python3.5/site-packages/aiohttp/client.py", line 168, in _request
    resp = req.send(conn.writer, conn.reader)
  File "/home/user/envs/test_env/lib/python3.5/site-packages/aiohttp/client_reqrep.py", line 442, in send
    path = self.path
AttributeError: 'ClientRequest' object has no attribute 'path'

Steps to reproduce

import asyncio
import aiohttp

async def go():
    async with aiohttp.ClientSession() as session:
        async with session.get("http://httpbin.org/redirect/6",
                               proxy="http://163.172.177.100:80") as resp:
            print(resp.status)


loop = asyncio.get_event_loop()
loop.run_until_complete(go())
loop.close()

Your environment

python 3.5.2
aiohttp 1.1.5 with this patch

Other

random proxy list http://hideme.ru/proxy-list/?ports=80#list

[asvetlov]

There is applied #1421
Please check with a fresh master.
I have nothing against mitmproxy (or other real proxy server, maybe https://github.com/hawkowl/rproxy is also a good candidate for running twisted based server in the same loop -- I don't know).

[asvetlov]

I believe it should be closed

[lock]

This thread has been automatically locked since there has not been
any recent activity after it was closed. Please open a new issue for
related bugs.

If you feel like there's important points made in this discussion,
please include those exceprts into that new issue.