data_pipe

Features

Cross Thread Message Pipe:

• lock-free
• thread-safe
• exponential-back-off

Message Transfer End Points:

• any combination of: sync, trio, curio, asyncio

Benchmark

Performance on local CPU:

cross-thread

sync -> sync     @ 1.0 micros/object
sync -> curio    @ 5.0 micros/object
sync -> asyncio  @ 6.0 micros/object
sync -> trio     @ 7.0 micros/object

cross-process

sync -> sync     @ 0.5 micros/object
sync -> curio    @ 0.7 micros/object
sync -> asyncio  @ 0.7 micros/object
sync -> trio     @ 0.7 micros/object

Install

To install python package:

sudo pip install data_pipe

Usage

cross-process, cross-framework rpc:

• basic_trunk.py
• basic_trunk_test.py

cross-process, cross-framework queue:

• native_ruptor.pyx
• any_ruptor_perf.py