Stack Overflow
Stack Overflow

Questions tagged [data-collection]

159 questions
0
votes
1 answer

How do you reference a specific ID while web scraping in Python?

I am trying to web scrape this site in order to get basic stock information: https://www.macrotrends.net/stocks/charts/AAPL/apple/financial-ratios My code is as follows: from requests import get from bs4 import BeautifulSoup as bs url = …
Ross Leavitt
  • 119
  • 4
  • 13
0
votes
1 answer

Scrape data from multiple pages of a website using python

I want to crawl around 500 articles from the site AlJazeera Website and want to collect 4 tags i.e URL Title Tags Author I have written the script that collects data from home page, but it only collects couple of articles. Other articles are in…
MUK
  • 371
  • 4
  • 13
0
votes
3 answers

IBM SPSS Data Collection Professional Survey Activation Problem

I'm hoping someone will be able to help me out here. I need to activate a survey via spss data collection professional. But i'm getting error at the end of activation. Error; Unable to merge questionnaire documents. The following error(s) occurred…
Busra
  • 5
  • 2
0
votes
1 answer

VBA Setting string value with changing string name

Hi I'm trying to create macro that will collect data from excell table. I create strings with similar names and ended by number. Please is there a way to loop over this strings ? This Code is not working, but will explain what I want to do. Sub…
Robo Betteš
  • 15
  • 4
0
votes
1 answer

Automating acquisition of speed limit data from a source such as google maps API, etc

So, I developed a math model for optimizing biking routes based on user preference, and I am trying to develop an application where the solution is solved using Dijkstra's algorithms (and of course graphs). Part of the weighting of the edges is…
tylerthemiler
  • 5,496
  • 6
  • 32
  • 40
0
votes
1 answer

calculating drivers salary in AnyLogic

In Anylogic I am trying to calculate the average driver salary based on some statistics that will be collected during the model run-time. I have figured out how to collect the required statistics. However I want to know how to create a function…
Abdullah Ayoub Abuhilal
  • 47
  • 6
0
votes
0 answers

Collecting data for my master thesis about gamification in Stack Overflow

I am collecting data for my Master thesis, which aims to study how gamification motivates knowledge sharing, using Stack Overflow as an example. The questionnaire is very short and will take about 5 minutes of your time. This questionnaire is…
Jia
  • 1
0
votes
1 answer

How can i add id and password (unique link) to survey link created with ibm spss data collection professional/author?

I created a survey with ibm spss data collection professional/author. Survey link is like : http://survey.xxxyyy.com/mrIWeb/index.htm?I.Project=TestSurvey I would like to add id and password to survey link for personalization. I mean new link should…
Busra
  • 5
  • 2
0
votes
2 answers

Best practice of writing a program which has too many data collection processes C#

I have to login in to various elements to retrieve some data, problem is each element has its own login credentials, I want to write all such data collection processes into one single program so that I dont have 10 different scheduled processes to…
Nidhi
  • 667
  • 3
  • 8
  • 12
0
votes
0 answers

Why is saving data from an API to CSV faster than uploading it to MongoDB database

My question revolves around understanding the following two procedures (particularly performance and code logic) that I used to collect trade data from the US Census Bureau API. I already collected the data but I ended up writing two different ways…
Michael Pont
  • 1
  • 2
0
votes
1 answer

Data collection framework

Suppose you need to collect data from a bunch of people, and then collate their responses, is there a good framework to build an application to coordinate this activity? Are there any off-the-shelf products for this purpose? A simple way of doing…
Pradyumna
  • 1,583
  • 4
  • 19
  • 34
0
votes
2 answers

Multiple data collector for a job without duplicating records in streamsets

I have a directory consist of multiple files, and that is shared across multiple data collectors. I have a job to process those files and put it in the destination. Because the records are huge, I want to run the job in multiple data collector. but…
Tamizharasan
  • 293
  • 1
  • 5
  • 18
0
votes
0 answers

Handling streaming data from a mobile app (via POST)

At some point a dedicated iot device and app may be created but I'm working with an app on an iPhone for now that doesn't address the requirements but still helpful. The app can stream it's data via POST. I have a php file set up that captures the…
pad11
  • 311
  • 3
  • 9
0
votes
1 answer

kaa data collection doesn't retrieve data mongodb

I installed kaa iot server manually on ubuntu 16.04, and use data collection sample to test how it works. the code run without any errors, but when I run these commands below nothing happens: mongo kaa db.logs_$my_app_token$.find() I even comment…
Ali Salehi
  • 341
  • 1
  • 4
  • 16
0
votes
0 answers

collect random facebook sample of people/groups from one country

My goal is to collect a random sample (not that big - several thousands would be enough) of Facebook accounts (at least profiles, but it also would be good to collect pages/groups) from one certain country. The sample is needed for social…
just_flare
  • 31
  • 6
1 2 3
…
10 11