I need to retrieve some values from multiple projects from GitLab. Unfortunately API can not be used to access them. Alternatively I could use screen scraping but when trying to parse html, Beautiful soup returns HTML content of sign in page not the content of actual URL. Could it be possible to login using PAT like it is done with API calls?
My python code:
from asyncore import write
from bs4 import BeautifulSoup
import requests
from csv import writer
url= "https://gitlab.username.com/myGroup/myProject"
page = requests.get(url)
soup = BeautifulSoup(page.content, 'html.parser')
print(soup)
...
