Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GH-97973: Return all necessary information from the tokenizer #97975

Closed
wants to merge 7 commits into from
Closed

GH-97973: Return all necessary information from the tokenizer #97975

wants to merge 7 commits into from

Commits on Oct 6, 2022

  1. pythonGH-97973: Return all necessary information from the tokenizer 

    Right now, the tokenizer only returns type and two pointers to the
start and end of the token. This PR modifies the tokenizer to return
the type and set all of the necessary information, so that the parser
does not have to this.
    @lysnikolaou
    lysnikolaou committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    5f05ce9 View commit details
    Browse the repository at this point in the history

  2. 📜🤖 Added by blurb_it.

    @blurb-it
    blurb-it[bot] committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    f645664 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into tokenizer-return-token

    @lysnikolaou
    lysnikolaou committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    e53c4ea View commit details
    Browse the repository at this point in the history

  4. Fix tests by using the correct defaults for line number

    @lysnikolaou
    lysnikolaou committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    e892553 View commit details
    Browse the repository at this point in the history

  5. Fix token_setup

    @lysnikolaou
    lysnikolaou committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    0261165 View commit details
    Browse the repository at this point in the history

  6. pythonGH-88050: fix race in closing subprocess pipe in asyncio (pytho… 

    …n#97951)

Check for None when iterating over `self._pipes.values()`.
    @kumaraditya303 @lysnikolaou
    kumaraditya303 authored and lysnikolaou committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    25c1004 View commit details
    Browse the repository at this point in the history

  7. pythongh-94808: Coverage: Test that maximum indentation level is hand… 

    …led (python#95926)

* pythongh-94808: Coverage: Test that maximum indentation level is handled

* Use "compile" rather than "exec"
    @mdboom @lysnikolaou
    mdboom authored and lysnikolaou committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    b3b300e View commit details
    Browse the repository at this point in the history