Questions tagged [user-agent]

A user agent is a piece of software (a software agent) that acts on behalf of a user. The term is often used to refer to browsers, and other software that sends network requests. In the HTTP protocol, a user agent identifies itself to the server using a user-agent string. The user-agent string is a string in the header of an HTTP request that identifies the browser, version, device, os, and other information about the device from which the request came.

A user agent is a piece of software (a software agent) that acts on behalf of a user. The term is often used to refer to browsers, and other software that sends network requests. In the HTTP protocol, a user agent identifies itself to the server using a user-agent string. The user-agent string is a string in the header of an HTTP request that identifies the browser, version, device, os, and other information about the device from which the request came.

The user-agent usually consists of the web browser type, the client operating system and device identifier (all with versions or builds). There is not particular standard in how to formulate an user-agent, but browser and device vendors typically standardize within their own scope.

Detection User-agent detection can be hard, especially in the mobile world. Identification of client capabilities usually cannot be done via the user-agent, but must be obtained by looking up the user-agent in a database. The defacto standard user-agent for a device is the one created by its web browser.

2389 questions
0
votes
0 answers

Clone websites with HTTrack that use cloudflare

Everytime I try to download websites that use Cloudflare it HTTrack is giving me an error message that says that the mirror is empty, I suppose this is the case because it tries to copy the bot protection website instead of the real one. Is there…
Syrex
  • 1
  • 3
0
votes
0 answers

How to set a custom User-Agent in Perl's Selenium::Remote::Driver

I use Selenium::Remote::Driver and need to set up a "normal" user-agent. I've tried to use Selenium::UserAgent, but it has only some User-Agents for mobiles and tables, and none for usual desktop PC's. Maybe there's a way to expand the list of…
tester3
  • 413
  • 1
  • 4
  • 12
0
votes
0 answers

How to add user agent to radio players APKs

I have made 2 radio player apps but I want to create a new update with a custom user agent instead of stagefright. My own user-agent will be Shoutcast Streaming Player/1.0 (information of a android device (Version 1.0)) Here is the code of my first…
user20006142
0
votes
1 answer

How do I pass a user-agent to panda's pd.read_html()?

some websites automatically decline requests due to lack of user-agent, and it's a hassle using bs4 to scrape many different types of tables. This issue was resolved before through this code: url =…
0
votes
2 answers

Useragent string doesn't contain browser name

I've been seeing a lot of this useragent in my logs from a webapp: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_6) AppleWebKit/605.1.15 (KHTML, like Gecko) . As the user agent doesn't contain any browser name, is there a way to tell what browser and…
TuanDT
  • 1,627
  • 12
  • 26
0
votes
0 answers

Strange Tailing Number in the User-agent from iOS devices

Mozilla/5.0 (iPhone; CPU iPhone OS 15_6 like Mac OS X) AppleWebKit/605.1.15 (KHTML, like Gecko) Mobile/15E148 (1234567890) What does the the tailing number (1234567890) in the above user-agent mean? Is it something that can be used to track…
Ken T
  • 2,255
  • 1
  • 23
  • 30
0
votes
0 answers

how to change chrome user agent screen to mobile

Ihave been searching for a while I want to change my user agent screen resolution to look like that of a mobile device with my user agent on please help advance tool override but I am not getting it
0
votes
0 answers

chrome user agent doesn't work for a scrapper

I have the following code to scrape images: import os, requests, lxml, re, json, urllib.request from bs4 import BeautifulSoup from os.path import expanduser headers = { "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36…
v_head
  • 759
  • 4
  • 13
0
votes
1 answer

Get userAgentData on server

How can I use userAgentData on server(Nodejs)? In express i am trying to use new JS api: https://developer.mozilla.org/en-US/docs/Web/API/Navigator/userAgentData I tried this ` console.log(global.navigator) But this is printing undefined. I am also…
Yhshsh
  • 3
  • 1
0
votes
0 answers

User agent of older versions of firefox doesn't include browser version

I'm trying to test my app on older versions of firefox. My code relies on the browser version inside the user agent of browser: console.log(navigator.userAgent) I installed various older versions of firefox from this page (versions: 33, 34, 39, os:…
Iman Mahmoudinasab
  • 6,861
  • 4
  • 44
  • 68
0
votes
0 answers

Python data scraping using API and postman

I am working on data scraping project and successfully extracted the data using API and postman. I tried to run the code again but kept getting KeyError: 'products' I am suspecting that I was blocked by the website and I am not sure how to to…
Mela
  • 1
0
votes
0 answers

What is CoinBaseWallet Browsers's userAgent?

In the Metamask App, userAgent returns WebApp MetamaskMobile. However, there is nothing from coinbase wallet browser. Is there any thing that I can detect coinbase wallet browser ?
Jerry
  • 41
  • 1
  • 6
0
votes
0 answers

What do I have to consider with the user-agent when I want to send a request from a nodeJs application?

I use an api to send emails. I noticed that in order for it to work successfully I need to set a user-agent. So I put the following in my header for a POST request. headers: { 'user-agent': 'myapp/2022.6.0', 'content-type': 'application/json', …
Max Pattern
  • 1,430
  • 7
  • 18
0
votes
0 answers

How to block ai image web crawlers?

Certain countries are allowing data mining of images and their meta data to feed ai image creation. What is the best way to block this kind of bot from crawling a site and images while allowing search engines etc. Is it best to use .htaccess to…
SteveAsh
  • 25
  • 7
0
votes
0 answers

python uer-agents pakage: why does the package parse the string not correctly?

I want to parse 3 additional information(browser, device and os) from below sample csv file->AGN column _time,AGN,emoloyee 2022-08-30T17:54:18.796+0000,"[Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)…
peace
  • 299
  • 2
  • 16
1 2 3
99
100