Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add various streaming transducers #282

Closed
wants to merge 8 commits into from
Closed

Add various streaming transducers #282

wants to merge 8 commits into from

Commits on Jun 30, 2022

  1. Add copyless streaming tree transducers 

    The copyless natures is ensured by using a controlled environment update
language, without losing expressiveness.

This execution model emits as soon as possible, and requires transducers
to be total, otherwise the stream fails.
This also ensures that everything is emitted up to the first error.

The STT model can be used to implement query languages on tree
structures and some transformations.
    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    a8c1193 View commit details
    Browse the repository at this point in the history

  2. Respect chunk structure as much as possible

    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    9a498c6 View commit details
    Browse the repository at this point in the history

  3. Allow for symbolic transducers 

    By abstracting the transition table type with a dedicated typeclass, one
can create symbolic transducers, which can come in handy to handle
infinite input alphabets.
    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    5ec24b7 View commit details
    Browse the repository at this point in the history

  4. Put unconsumed chunk back into stream

    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    79dbbe8 View commit details
    Browse the repository at this point in the history

  5. Add implementation of FST 

    The streaming FST are simulated and try to emit as early as possible
when there is no ambiguity.
    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    674b7c0 View commit details
    Browse the repository at this point in the history

  6. Add a way to work with character index in a set 

    This index can be used to implement efficient lookup table in later use.
    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    2617662 View commit details
    Browse the repository at this point in the history

  7. Make laws testing run on all platforms

    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    c091b90 View commit details
    Browse the repository at this point in the history

  8. Re-aggregate CBOR/JSON module

    @satabin
    satabin committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    3471dfd View commit details
    Browse the repository at this point in the history