Skip to content

Commit

Permalink
try fix a strange bug
Browse files Browse the repository at this point in the history
  • Loading branch information
lvdongyi committed Oct 17, 2024
1 parent e367332 commit e84a062
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
2 changes: 1 addition & 1 deletion paddlenlp/transformers/albert/tokenizer.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@

from .. import AddedToken, BertTokenizer, PretrainedTokenizer

__all__ = ["AlbertTokenizer"]
__all__ = ["AlbertTokenizer", "AlbertChineseTokenizer", "AlbertEnglishTokenizer"]

SPIECE_UNDERLINE = "▁"

Expand Down
1 change: 1 addition & 0 deletions paddlenlp/transformers/mbart/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -13,3 +13,4 @@
# limitations under the License.

from .tokenizer import *
from .configuration import *

0 comments on commit e84a062

Please sign in to comment.