Regex not finding all unicode characters

[tantony]

I'm trying to parse a flight tracker web page. But when I try to get the values from the 'Course' tab, I'm only getting the ←,→ ,↓ ,↑. Its not reading the others, ↗,↙

import urllib3
from bs4 import BeautifulSoup
import regex

url = f'https://flightaware.com/live/flight/ETH3626/history/20210705/1400Z/HAAB/VHHH/tracklog'
req = urllib3.PoolManager()
res = req.request('GET', url)
soup = BeautifulSoup(res.data, 'lxml')
contents = soup.find_all('td', attrs={'align':'right'})

for content in contents:
    content = str(content)

    kts = regex.search(r'<td align="right">\d+</td>',content)
    kts = content.replace('<td align="right">', '').replace('</td>', '')

    course = regex.search(r'<td align="right"><span>[\u2190-\u2199]\s\d+\W</span></td>', content)
    #course = content.replace('<span>>">', '').replace('</span>', '')

    '''course regex only find up,down,left,right not unicodes 2196-2198'''

    print(course)

[tantony]

Any suggestions? I' m not sure my regex is not finding all of the course

course = regex.search(r'<td align="right"><span>[\u2190-\u2199]\s\d+\W</span></td>', content)

[snippsat]

Don't need regex can do it like this,and unescapes the HTML to get Unicode.

import requests
from bs4 import BeautifulSoup
from time import sleep
import html

url = 'https://flightaware.com/live/flight/ETH3626/history/20210705/1400Z/HAAB/VHHH/tracklog'
response = requests.get(url)
soup = BeautifulSoup(response.content, 'lxml')
sleep(2)
table = soup.select_one('#tracklogTable')
row = table.select_one('tr:nth-child(5) > td:nth-child(4)')
print(html.unescape(row.text))

Output:
↙ 226°

This will not work in all Editor or shell,usually don't' want Unicode value as it has no meaning other than display in Browser.
Can read parse whole table with Pandas and open in Jupyter Notebook to get the same display.

[tantony]

Thank you. I'll look into Pandas.