Message301687
Type code for ellipsis token doesn't match with the constant token.ELLIPSIS:
---------------------------------------
import io
import token
import tokenize
source = "..."
tokens = list(tokenize.tokenize(io.BytesIO(source.encode('utf-8')).readline))
ellipsis = tokens[1]
print(ellipsis)
print(token.ELLIPSIS)
-----------------------------------------
This code outputs following in Python 3.5 and 3.6:
> TokenInfo(type=53 (OP), string='...', start=(1, 0), end=(1, 3), line='...')
> 52
and following in Python 3.4
> TokenInfo(type=52 (OP), string='...', start=(1, 0), end=(1, 3), line='...')
> 51 |
|
| Date |
User |
Action |
Args |
| 2017-09-08 09:24:31 | Aivar.Annamaa | set | recipients:
+ Aivar.Annamaa |
| 2017-09-08 09:24:31 | Aivar.Annamaa | set | messageid: <1504862671.67.0.693274521398.issue31394@psf.upfronthosting.co.za> |
| 2017-09-08 09:24:31 | Aivar.Annamaa | link | issue31394 messages |
| 2017-09-08 09:24:31 | Aivar.Annamaa | create | |
|