Questions tagged [data-collection]
159 questions
0
votes
0 answers
Performance of an array grouping method
Considering the date model below :
struct Order: Hashable {
let mode: Mode
let title: String
}
enum Mode {
case old, new, middle
}
I am using the basic swift grouping method in order to creating an array of arrays split by the mode…
Blisko
- 107
- 2
- 9
0
votes
1 answer
Does using Heroku impose GDPR requirements on my app?
I am working on a small web-app as a hobby, and I would like to avoid any functionality that would trigger GDPR requirements. As such, the web-app neither collects nor processes personal data, does not set cookies (or otherwise track individual…
Ken
- 3
- 1
0
votes
1 answer
How to scrape data from an obscure Windows 7 program?
I have the task of scraping the data from a piece of software written especially for a small charity. I have attached a screenshot (with identifying information blurred out) below:
The data is in a table format, with too much information to contain…
jserv
- 47
- 5
0
votes
1 answer
WebApp Google Script to collect data and upload a file
I have got some code from another user in this fourm, but the code is uploading the file but not appending the textbox filed data and uploaded file link to the sheet.
i just want to have file upload and details regarding the file to be entered in…
Raghavender
- 3
- 2
0
votes
0 answers
How do i select the first division of a certain class?
I'm using selenium for web scraping. I'm trying to scrape the content of a paragraph within a division of a certain class X. The problem im having is that there are multiple div with the same class inside a collapse group, and what i wanna do is…
jalal abboud
- 23
- 4
0
votes
1 answer
Non Redundant Image Extraction From Video
I am collecting data for a project. The data collection is done by recording videos of the subjects and the environment. However, while training the network, I would not want to train it with all the images collected in the video sequence.
The main…
0
votes
1 answer
Hyperledger Fabric: Service discovery for private data collection
In Hyperledger Fabric, does service discovery support finding query peers for private data collection (PDC).
In a channel consisting of 2 orgs (org1 and org2), if I create a PDC for org1 only, only the peers in org1 hold the private data. If in PDC…
ning
- 731
- 1
- 4
- 15
0
votes
1 answer
Accessing websites in a dropdown list
I'm trying to build a web scraper that visits school district websites and retrieves the names and websites of the schools. I'm using https://www.dallasisd.org/ to test the code below.
I'm currently stuck on how to 1) only access the dropdown list…
watwat7225
- 13
- 2
0
votes
1 answer
Download a xlsx file by clicking a website button using Python
I'm writing a Python script that creates a COVID-19 dashboard for my country and state and updates it daily.
However, I am struggling to download one of the necessary files.
Basically to download the file I have to access the website…
Neves
- 3
- 3
0
votes
2 answers
Moving .NET based data collection system to a remote, unattended installation?
I have a need to do some fairly simple (at least on the surface) data acquisition and logging. In a remote location (as in, on another continent), there will be a few RS-485 devices (our custom hardware product) using a proprietary protocol, plus a…
SWB
- 1,432
- 2
- 14
- 24
0
votes
0 answers
How to create data entry template to be updated monthly by 20 different parties online - focus is recycling data?
The task at-hand is that I coordinate the activity of 20 organisations, each of whom I need to collect monthly data from directly, about the tonnages and types of elecronic items they collected for reuse and recycling. They all use different systems…
0
votes
2 answers
How to stop scrapy from running the same spider twice?
So I'm following the doc for running the spider within the code, but for some reason after it finishes crawling, the spider is run again. I've tried adding the stop_after_crawl and stop() functions but to no luck. It also gives me the error below…
edbertsan
- 1
- 4
0
votes
2 answers
I am trying to download the Yearly data from this website using python but i am not sure how to approach it?
I want to learn how to download the CSV files for the last ten years using python. I think this would be helpful.
https://www.usgovernmentspending.com/compare_state_debt
My attempts involve requests and pandas.
Omar M. Hussein
- 37
- 5
0
votes
0 answers
find link from nested link In R
I am learning text mining using R. I am trying to find all the links in a HTML document.
I tried getHTMLLinks() but it is showing following error:
url =…
Rohit parihar
- 46
- 5
0
votes
1 answer
Is there a way to get submissions or a subreddit based on the flair using pushshift API?
I looked through the documentation but I was not able to find how to retrieve submissions based on flair from a particular subreddit for a given time period, without using BigQuery.
Just using the API.
mk03
- 98
- 7