x-ray is a web scraping library for Node.js. It can use various pluggable drivers such as HTTP or PhantomJS.
Resources:
Title 1
Subtitle 1
- Element 1
- Element 2
- Element 3
Questions tagged [x-ray]
107 questions
2
votes
1 answer
Fatal error when scraping dynamic page content with x-ray and x-ray-phantom
I am getting this error in the command line when I run app.js on node:
FATAL ERROR: v8::HandleScope::CreateHandle() Cannot create a handle without a HandleScope
Abort trap: 6
This is what am app.js looks like:
var phantom =…
user1275105
- 2,643
- 5
- 31
- 45
2
votes
0 answers
x ray scraper crawl to another page not returning data
hi am testing the new x ray web scraping , following the listed tutorial for crawling to another website , does not return anything
github x-ray
var Xray = require('x-ray');
var x = Xray();
x('http://google.com', {
main: 'title',
image:…
user2505728
- 93
- 6
1
vote
2 answers
X-ray. How to parse non-nested structure into array of objects?
I'm trying to collect data with x-ray from a page that structured like:
Page title
IllidariCat
- 111
- 2
- 8
1
vote
2 answers
X-Ray and async multithreading: segment cannot be found
I need to run multiple async methods from the main thread, which should be able to finish even after the main thread has returned a response.
I've added a method which does the async call and handles the X-Ray based things, which works if I call it…
warozell
- 49
- 2
- 6
1
vote
1 answer
error when importing robotframework result into xray
I want to import the result of my execution (robot framework) with REST API into JIRA. I used the following command
curl --insecure -H "Content-Type: multipart/form-data" -D- -p -F "file=@outputXX.xml" …
AYLEN ADAM
- 21
- 2
1
vote
1 answer
Npm error when incuding x-ray-scraper in project
I'm developing an application in Vue, also using the x-ray-scraper library, but when I try to run npm run serve in the console to view the application locally I get the following error:
This dependency was not found:
* _http_common in…
Alexander Morozov
- 159
- 1
- 12
1
vote
1 answer
aws-xray-sdk-python: Manually created segments are not displayed on AWS service map
I'm running my applications in a Docker ECS container (and thus the XRAY daemon is also running in a Docker container).
I see my traces resulting from automated patched libraries (requests, sqlite3, httplib, botocore) and instrumented middleware…
silvakle
- 115
- 10
1
vote
1 answer
Proper DICOM image preprocessing for CNN - images with different Modality and Photometric Interpretation
I'm currently working on a deep learning project involving DICOM images. Long story short, in this project I have X-ray images of human pelvises and I'm trying to predict if there are some pathological changes on the hip joint (for example: cysts,…
Maju116
- 1,607
- 1
- 15
- 30
1
vote
1 answer
AWS XRay fails when being used in Typescript with Hapi
I have been trying to incorporate AWS Xray in an API written in Typescript with HAPI framework. I have been using Hapi Xray plugin to append segment property to be appended on Request Object. On doing this, I am able to see the xray traces being…
RohitChawla
- 21
- 4
1
vote
0 answers
I am not able to follow link in x-ray scraper and fetch the data
x(url,some_scope,{
'title':'title',
'desc': x('.coloriginaljobtitle a@href',{
desc: '.desc',
apply_link:'.applyBtnTopDiv a@href'
})
})
//callback for this xray
((err, result)=>{
…
Balkrushna Jadhav
- 11
- 1
1
vote
3 answers
Synchronous Multiple Requests in foor loop with Node js
I'm kind of starting in Javascript and I need help to figure out how can I make this code synchronous while looping through for loop.
Basically what I'm doing is making multiple POST requests inside for loops and then im scrapping the data using the…
Th3Guy
- 21
- 1
- 8
1
vote
1 answer
How to integrate X-Ray with AWS Lambda function on Command line
From the console, it is possible to activate lambda integration with x-ray through the following steps:
From your function in the console > Configuration tab > Advanced dropdown/section > check Enable Active Tracing checkbox > Save.
I couldn't find…
Persistent Plants
- 731
- 7
- 17
1
vote
2 answers
Selecting multiple tags with the same className?
Using this syntax:
x('http://www.viadeo.com/fr/company/unicef',
'.page-content',
[{
img:'img@src',
bio:'.pan-desc-description',
org:'.pan-desc-footer-element @element-value',
link: '.element-value a@href',
…
Taieb
- 920
- 3
- 16
- 37
1
vote
1 answer
How to get data from Viadeo with X-Ray and NodeJs
So I am trying to scrape some content with node.js x-ray scraping framework. While I can get the content from a single page but for exemple only for one employee I can't get my head around on how to get for all the employees.
Working Exemple but…
Taieb
- 920
- 3
- 16
- 37
1
vote
1 answer
x-ray: Read html from a file rather than a URL
Code
const Xray = require('x-ray');
const xray = Xray();
// How do I read a file, rather than a URL?
const url = 'https://www.tel-o-fun.ga/';
xray(url, '.marker')((err, value) => {
console.log(value);
});
My goal
I am using x-ray to scrape…
Adam Matan
- 128,757
- 147
- 397
- 562