:autogenerated:

..
    This file is autogenerated by `sphinx-api`.

span_marker.tokenizer module
============================

.. currentmodule:: span_marker.tokenizer

.. automodule:: span_marker.tokenizer
    :members:
    :undoc-members:
    :show-inheritance:
    :member-order: bysource