The asyncio integration breaks Faust
#10323
Comments
|
Thank you for the detailed replication code @j00bar. We'll look into it. cc @majorgreys |
|
@emmettbutler Grateful to you for taking a look - and yeah, it's gotta be tough maintaining a wrapper library with literally infinite use cases and breadth of domain knowledge you'd have to assimilate, so glad I can make it easier to help us in this case! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Summary of problem
I'm trying to instrument workers for Faust, the successor to Celery in Python that does streaming message processing, developed at Robinhood.
When the
asynciointegration is enabled, the Faust worker fails to start up properly.Note the two
RuntimeWarnings that certain coroutines were never awaited. At this point, while the Faust process is still running, none of the loops consuming events are actively running.The two warnings come out of
mode, a related service/worker creation library from the same authors of Faust. Links to those lines of code throwing the warnings are here:Without
asyncio, this is the output, where everything is working fine:Which version of dd-trace-py are you using?
dd-trace-py==2.11.1
Which version of pip are you using?
pip==24.2
Which libraries and their versions are you using?
`pip freeze`
aioconsole==0.7.1 aiodogstatsd==0.16.0.post0 aiohappyeyeballs==2.3.2 aiohttp==3.10.0 aiohttp-cors==0.7.0 aiokafka==0.10.0 aiomonitor==0.7.0 aiosignal==1.3.1 alembic==1.13.2 annotated-types==0.7.0 anyio==4.4.0 aredis==1.1.8 async-timeout==4.0.3 asyncpg==0.29.0 attrs==23.2.0 build==1.2.1 bytecode==0.15.1 casefy==0.1.7 certifi==2024.7.4 charset-normalizer==3.3.2 click==8.1.7 colorlog==6.8.2 cramjam==2.8.3 croniter==2.0.7 dacite==1.8.1 dataclasses-avroschema==0.60.2 datadog==0.49.1 ddtrace==2.11.1 Deprecated==1.2.14 dill==0.3.8 dnspython==2.6.1 email_validator==2.2.0 envier==0.5.2 fastapi==0.111.1 fastapi-cli==0.0.4 fastavro==1.9.5 faust-streaming==0.11.2 faust-streaming-rocksdb==0.9.3 frozenlist==1.4.1 greenlet==3.0.3 h11==0.14.0 httpcore==1.0.5 httptools==0.6.1 httpx==0.27.0 humanize==4.10.0 idna==3.7 importlib_metadata==8.0.0 Inflector==3.1.1 iniconfig==2.0.0 intervaltree==3.1.0 janus==1.0.0 Jinja2==3.1.4 Mako==1.3.5 markdown-it-py==3.0.0 MarkupSafe==2.1.5 mdurl==0.1.2 mode-streaming==0.4.1 molotov==2.6 multidict==6.0.5 multiprocess==0.70.16 mypy==1.11.1 mypy-extensions==1.0.0 opentelemetry-api==1.26.0 opentracing==2.4.0 orjson==3.10.6 packaging==24.1 pip-tools==7.4.1 pluggy==1.5.0 prompt_toolkit==3.0.47 protobuf==5.27.3 psycopg2-binary==2.9.9 pydantic==2.8.2 pydantic-settings==2.4.0 pydantic_core==2.20.1 Pygments==2.18.0 pyproject_hooks==1.1.0 pytest==8.3.2 pytest-asyncio==0.23.8 python-dateutil==2.9.0.post0 python-dotenv==1.0.1 python-multipart==0.0.9 python-snappy==0.7.2 pytz==2024.1 PyYAML==5.3.1 redis==5.0.8 requests==2.32.3 rich==13.7.1 shellingham==1.5.4 six==1.16.0 sniffio==1.3.1 sortedcontainers==2.4.0 SQLAlchemy==2.0.31 starlette==0.37.2 structlog==24.4.0 terminaltables==3.1.10 trafaret==2.1.1 typer==0.12.3 typing_extensions==4.12.2 urllib3==2.2.2 uvicorn==0.30.3 uvloop==0.19.0 venusian==3.1.0 watchfiles==0.22.0 wcwidth==0.2.13 websockets==12.0 wrapt==1.16.0 xmltodict==0.13.0 yarl==1.9.4 zipp==3.20.0How can we reproduce your problem?
You can set up a simple Kafka compatible broker using Docker Compose:
Then you can make a placeholder Faust application like:
The text was updated successfully, but these errors were encountered: