The goal is to benchmark pyscript on file operations
Testing requires some files! A script is provided to generate empty files:
$ python generate_testdata.py --files=10K --size=30K data/Benchmark reading all files with python:
$ python benchmark.py data/
Read 300000000 bytes from 10000 files in 0.9065102919994388s = 331MB/sI suggest running a few times so the data is hot.
Start by serving the files in this directory. I use the VSCode 'Live Server' plugin, but
it would also work with nginx, apache, etc. Directly viewing file:// urls will not
work because local file access requires a server.
Open index.html using Chrome or Edge. Firefox does not support file access. Select the data folder. Wait a few seconds, and you should see the same benchmark results:
Read 300000000 bytes from 10000 files in 0.40560000000000684s = 740MB/s
The pyscript version reports unrealistically high speeds. I suspect that the 'mount' operation loads the files into memory, making the actual parsing fast but at the expense of high setup time. The benchmark should measure setup times, including loading pyscript and mounting the directory