Skip to content

tokenize module should have a unicode API #56695

@ssbr

Description

@ssbr
mannequin
BPO 12486
Nosy @warsaw, @terryjreedy, @mdickinson, @vstinner, @ssbr, @tpn, @merwok, @voidspace, @meadori, @ericsnowcurrently, @takluyver, @akheron, @vadmium, @serhiy-storchaka, @willingc, @Carreau
PRs
  • bpo-12486: Document tokenize.generate_tokens() as public API #6957
  • Files
  • tokenize_str.diff
  • tokenize_str_2.diff
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
    closed_at = <Date 2018-06-05.17:30:56.930>
    created_at = <Date 2011-07-04.03:58:16.983>
    labels = ['3.8', 'type-feature', 'library']
    title = 'tokenize module should have a unicode API'
    updated_at = <Date 2018-06-05.17:51:27.955>
    user = 'https://github.com/ssbr'

    bugs.python.org fields:

    activity = <Date 2018-06-05.17:51:27.955>
    actor = 'takluyver'
    assignee = 'none'
    closed = True
    closed_date = <Date 2018-06-05.17:30:56.930>
    closer = 'willingc'
    components = ['Library (Lib)']
    creation = <Date 2011-07-04.03:58:16.983>
    creator = 'Devin Jeanpierre'
    dependencies = []
    files = ['27587', '40679']
    hgrepos = []
    issue_num = 12486
    keywords = ['patch']
    message_count = 19.0
    messages = ['139733', '140050', '140055', '173001', '178473', '252300', '252305', '252309', '313591', '316982', '317004', '317010', '317011', '317018', '317020', '317021', '317912', '318775', '318778']
    nosy_count = 16.0
    nosy_names = ['barry', 'terry.reedy', 'mark.dickinson', 'vstinner', 'Devin Jeanpierre', 'trent', 'eric.araujo', 'michael.foord', 'meador.inge', 'eric.snow', 'takluyver', 'petri.lehtinen', 'martin.panter', 'serhiy.storchaka', 'willingc', 'mbussonn']
    pr_nums = ['6957']
    priority = 'normal'
    resolution = 'fixed'
    stage = 'resolved'
    status = 'closed'
    superseder = None
    type = 'enhancement'
    url = 'https://bugs.python.org/issue12486'
    versions = ['Python 3.8']

    Metadata

    Metadata

    Assignees

    No one assigned

      Labels

      3.8 (EOL)end of lifestdlibStandard Library Python modules in the Lib/ directorytype-featureA feature request or enhancement
      No fields configured for issues without a type.

      Projects

      No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions