Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document how to create ASGI middlewares #1656

Merged
merged 34 commits into from
Jun 30, 2022
Merged
Changes from 6 commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
09ce984
Document how to create ASGI middlewares
Kludex May 31, 2022
7c51da5
Fix typo
Kludex May 31, 2022
7975168
Merge branch 'master' into document-asgi-middleware
Kludex Jun 2, 2022
a51d5c1
Merge remote-tracking branch 'origin/master' into document-asgi-middl…
Kludex Jun 2, 2022
ea082ab
Add more documentation on how to create pure ASGI middlewares
Kludex Jun 3, 2022
9672c0d
Merge branch 'document-asgi-middleware' of github.com:encode/starlett…
Kludex Jun 3, 2022
961b98d
Apply suggestions from code review
Kludex Jun 3, 2022
7aa5575
Apply suggestions from code review
Kludex Jun 8, 2022
a4800fc
remove empty spaces
Kludex Jun 8, 2022
6f9eda4
Add asgiref hyperlink
Kludex Jun 8, 2022
3384cb1
Fix per-request section
Kludex Jun 8, 2022
c6568bd
Fix scope info
Kludex Jun 8, 2022
46662e9
Remove example section
Kludex Jun 8, 2022
6948b81
Merge branch 'master' into document-asgi-middleware
Kludex Jun 8, 2022
c737fb1
Merge branch 'master' into document-asgi-middleware
Kludex Jun 12, 2022
9a3e9e8
Update docs/middleware.md
Kludex Jun 16, 2022
b0f8029
Merge branch 'master' into document-asgi-middleware
Kludex Jun 16, 2022
3dd6b11
Update docs/middleware.md
adriangb Jun 16, 2022
514c818
Merge branch 'master' into document-asgi-middleware
Kludex Jun 19, 2022
5150507
Apply suggestions from code review
Kludex Jun 19, 2022
0408af2
Merge branch 'master' into document-asgi-middleware
Kludex Jun 27, 2022
5b54dd9
Update docs/middleware.md
Kludex Jun 28, 2022
aa6bbae
Merge branch 'master' into document-asgi-middleware
Kludex Jun 28, 2022
4f12d08
Apply suggestions from code review
Kludex Jun 28, 2022
efbf115
fix typo
adriangb Jun 28, 2022
d218689
Merge branch 'master' into document-asgi-middleware
Kludex Jun 28, 2022
a2c504c
Apply suggestions from code review
Kludex Jun 30, 2022
74664e1
Apply suggestions from code review
Kludex Jun 30, 2022
77e2c27
Apply suggestions from code review
Kludex Jun 30, 2022
b2af992
Update docs/middleware.md
Kludex Jun 30, 2022
046f4d4
Add reference to Starlette components
Kludex Jun 30, 2022
263de76
Add `MutableHeaders` import
Kludex Jun 30, 2022
8868e49
Fix typos from suggestions
Kludex Jun 30, 2022
756036b
Merge remote-tracking branch 'origin/master' into document-asgi-middl…
Kludex Jun 30, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
246 changes: 246 additions & 0 deletions docs/middleware.md
Original file line number Diff line number Diff line change
Expand Up @@ -232,6 +232,252 @@ around explicitly, rather than mutating the middleware instance.
- It's not possible to use `BackgroundTasks` with `BaseHTTPMiddleware`. Check [#1438](https://github.com/encode/starlette/issues/1438) for more details.
- Using `BaseHTTPMiddleware` will prevent changes to [`contextlib.ContextVar`](https://docs.python.org/3/library/contextvars.html#contextvars.ContextVar)s from propagating upwards. That is, if you set a value for a `ContextVar` in your endpoint and try to read it from a middleware you will find that the value is not the same value you set in your endpoint (see [this test](https://github.com/encode/starlette/blob/621abc747a6604825190b93467918a0ec6456a24/tests/middleware/test_base.py#L192-L223) for an example of this behavior).

## Pure ASGI Middleware

Due to how ASGI was designed, we are able to build a chain of ASGI applications, on which each application calls the next one.
Kludex marked this conversation as resolved.
Show resolved Hide resolved
Each element of the chain is an [`ASGI`](https://asgi.readthedocs.io/en/latest/) application by itself, which per definition, is also a middleware.

This is also an alternative approach in case the limitations of `BaseHTTPMiddleware` are a problem.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

### Guiding principles

The most common way to create an ASGI middleware is with a class.

```python
class ASGIMiddleware:
def __init__(self, app):
self.app = app

async def __call__(self, scope, receive, send):
await self.app(scope, receive, send)
```

The middleware above is the most basic ASGI middleware. It just receives an ASGI application as an argument for its constructor, and implements the `__call__` method, with the parameters that the ASGI protocol defines: `scope`, `receive`, and `send`.

The `scope` parameter is a dictionary that contains the information about the connection.
You can see more about it [here](https://asgi.readthedocs.io/en/latest/specs/index.html).

Both `receive` and `send` parameters are async callables that work in opposite ways. The `send` callable allows the application to send event messages to the client, and the `receive` allows the application to receive event messages from the client.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

As an alternative for the class approach, you can also use a function:

```python
def asgi_middleware():
Kludex marked this conversation as resolved.
Show resolved Hide resolved
def asgi_decorator(app):
@functools.wraps(app)
async def wrapped_app(scope, receive, send):
await app(scope, receive, send)
return wrapped_app
return asgi_decorator
```

!!! note
Kludex marked this conversation as resolved.
Show resolved Hide resolved
The function pattern is not commonly spread, but you can check a more advanced implementation of it on
[asgi-cors](https://github.com/simonw/asgi-cors/blob/10ef64bfcc6cd8d16f3014077f20a0fb8544ec39/asgi_cors.py).

#### `Scope` types

As we mention, the scope holds the information about the connection. There are three types of `scope`s:
Kludex marked this conversation as resolved.
Show resolved Hide resolved
- `lifespan` is a special type of scope that is used for the lifespan of the ASGI application.
- `http` is a type of scope that is used for HTTP requests.
- `websocket` is a type of scope that is used for WebSocket connections.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

If you want to create a middleware that only runs on HTTP requests, you'd write something like:

```python
class ASGIMiddleware:
def __init__(self, app):
self.app = app

async def __call__(self, scope, receive, send):
if scope["type"] == "http":
# Do something here!
await self.app(scope, receive, send)
Kludex marked this conversation as resolved.
Show resolved Hide resolved
```
In the example above, if the `scope` type is `lifespan` or `websocket`, we'll directly call the `self.app`.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

The same applies for the other scopes.
adriangb marked this conversation as resolved.
Show resolved Hide resolved

You can read more about those scopes on the [ASGI documentation]().
Kludex marked this conversation as resolved.
Show resolved Hide resolved

Kludex marked this conversation as resolved.
Show resolved Hide resolved
!!! note
Kludex marked this conversation as resolved.
Show resolved Hide resolved
Middleware classes should be stateless -- see [Per-request state](#per-request-state) if you do need to store per-request state.

#### Wrapping `send` and `receive`

A common pattern, that you'll probably need to use is to wrap the `send` or `receive` callables.

```python
class ASGIMiddleware:
Kludex marked this conversation as resolved.
Show resolved Hide resolved
def __init__(self, app):
self.app = app

async def __call__(self, scope, receive, send):
status_code = 500
if scope["type"] == "http":
async def send_wrapper(message):
if message["type"] == "http.response.start":
status_code = message["status"]
await send(message)
return await self.app(scope, receive, send_wrapper)
await self.app(scope, receive, send)
print("This is a primitive access log")
print(f"status = {status_code}")
Kludex marked this conversation as resolved.
Show resolved Hide resolved
```
On the example above, we are wrapping the `send` function with the `send_wrapper` one.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

!!! info
You can check a more advanced implementation of the same rationale on [asgi-logger](https://github.com/Kludex/asgi-logger/blob/main/asgi_logger/middleware.py).

#### Annotation
Kludex marked this conversation as resolved.
Show resolved Hide resolved

There are two ways of annotating a middleware: using Starlette itself or `asgiref`.

Using Starlette, you can do as:

```python
from starlette.types import Message, Scope, Receive, Send
from starlette.applications import Starlette


class ASGIMiddleware:
def __init__(self, app: Starlette) -> None:
self.app = app
Kludex marked this conversation as resolved.
Show resolved Hide resolved

async def __call__(self, scope: Scope, receive: Receive, send: Send) -> None:
if scope["type"] == "http":
async def send_wrapper(message: Message) -> None:
await send(message)
return await self.app(scope, receive, send_wrapper)
await self.app(scope, receive, send)
Kludex marked this conversation as resolved.
Show resolved Hide resolved
```

Although this is easy, you may prefer to be more strict. In which case, you'd need to use `asgiref`:

```python
from asgiref.typing import ASGI3Application, Scope, ASGISendCallable
from asgiref.typing import ASGIReceiveEvent, ASGISendEvent


class ASGIMiddleware:
def __init__(self, app: ASGI3Application) -> None:
self.app = app

async def __call__(self, scope: Scope, receive: ASGIReceiveCallable, send: ASGISendCallable) -> None:
if scope["type"] == "http":
async def send_wrapper(message: ASGISendCallable) -> None:
Kludex marked this conversation as resolved.
Show resolved Hide resolved
await send(message)
return await self.app(scope, receive, send_wrapper)
await self.app(scope, receive, send)
```

The `ASGI3Application` is meant to represent an ASGI application that follows the third version of the standard.
Starlette itself is an ASGI 3 application.
Kludex marked this conversation as resolved.
Show resolved Hide resolved
Kludex marked this conversation as resolved.
Show resolved Hide resolved

### Wrapping the request
Kludex marked this conversation as resolved.
Show resolved Hide resolved

On Starlette, we have data structures that make it more convenient to organize your ASGI middleware.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

For example, we can create a `Request` object, and work with it.
```python
from starlette.requests import Request

class ASGIMiddleware:
def __init__(self, app):
self.app = app

async def __call__(self, scope, receive, send):
if scope["type"] == "http":
request = Request(scope, receive, send)
# Do something here!
await self.app(scope, receive, send)
```

Also, it's possible to make use of `MutableHeaders` to change the headers:
Kludex marked this conversation as resolved.
Show resolved Hide resolved

```python
class ASGIMiddleware:
Kludex marked this conversation as resolved.
Show resolved Hide resolved
def __init__(self, app, headers):
self.app = app
self.headers = headers

async def __call__(self, scope, receive, send):
if scope["type"] == "http":
async def send_wrapper(message):
if message["type"] == "http.response.start":
headers = MutableHeaders(scope=message)
for key, value for self.headers:
headers.append(key, value)
await send(message)
await self.app(scope, receive, send_wrapper)
Kludex marked this conversation as resolved.
Show resolved Hide resolved
```

### Per-request state

The ASGI middleware class is meant to be stateless, as we don't want to spread the state from one request to another.
Kludex marked this conversation as resolved.
Show resolved Hide resolved
The responder pattern is a way to deal with per-request state. The idea is to have an object that will hold that information.

```python
class ASGIMiddleware:
def __init__(self, app):
self.app = app

async def __call__(self, scope, receive, send):
if scope["type"] == "http":
responder = Responder(self.app)
return await responder(scope, receive, send)

await self.app(scope, receive, send)


class Responder:
Kludex marked this conversation as resolved.
Show resolved Hide resolved
def __init__(self, app):
self.app = app
self.started = False

def __call__(self, scope, receive, send):
Kludex marked this conversation as resolved.
Show resolved Hide resolved
async def send_wrapper(message):
if message["type"] == "http.response.body" and not self.started:
self.started = True
await send(message)
await self.app(scope, receive, send_wrapper)
```

The `Responder` object, in this case, will save the information about when the response body has "started" to be sent.

!!! info
You can see a more advanced implementation of this pattern on our [GZipMiddleware](), and also on the [msgpack-asgi](https://github.com/florimondmanca/msgpack-asgi/blob/6261b1e22b3689551f68038ee00adda5fbc04670/src/msgpack_asgi/_middleware.py).
Kludex marked this conversation as resolved.
Show resolved Hide resolved

### Storing context in `scope`

As we know by now, the `scope` holds the information about the application. To be precise, the `scope` holds
the stateless information of the application. IS THIS CORRECT?
Kludex marked this conversation as resolved.
Show resolved Hide resolved

As per the ASGI specifications, any application can store custom information on the `scope`.
To be precise, it should be stored under the `extensions` key.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

```python
class ASGIMiddleware:
def __init__(self, app):
self.app = app

async def __call__(self, scope, receive, send):
scope["extensions"] = {"super.extension": True}
await self.app(scope, receive, send)
Kludex marked this conversation as resolved.
Show resolved Hide resolved
```
On the example above, we stored an extension called "super.extension". That can be used by the application itself, as the scope is forwarded to it.
Kludex marked this conversation as resolved.
Show resolved Hide resolved

### Examples

I WANT TO WRITE SOME DIFFERENT EXAMPLES USING LIFESPAN, RECEIVE EVENTS, AND WEBSOCKETS.

!!! note
This documentation should be enough to have a good basis on how to create an ASGI middleware.
Nonetheless, there are great articles about the subject:

- [Introduction to ASGI: Emergence of an Async Python Web Ecosystem](https://florimond.dev/en/posts/2019/08/introduction-to-asgi-async-python-web/)
- [How to write ASGI middleware](https://pgjones.dev/blog/how-to-write-asgi-middleware-2021/)

## Using middleware in other frameworks

To wrap ASGI middleware around other ASGI applications, you should use the
Expand Down