Stack Overflow
Stack Overflow

Questions tagged [data-collection]

159 questions
0
votes
0 answers

Does it make sens to use fluentd for IOT devices data collection

I am building a system that collects different IOT devices data. Data can come from different sources or providers like http, CSV or TCP. After few research I came across fleuntd. This seems to be what I need but I noticed it is mostly used for "log…
ceessay
  • 322
  • 5
  • 16
0
votes
0 answers

1: What is a dataset in the context of machine learning?

Define the Problem and Objectives: Before embarking on dataset creation, it's important to have a clear understanding of the problem you are trying to solve and the objectives of your machine learning project. This will help you define the scope of…
Shalini
  • 1
0
votes
1 answer

How can I collect custom logs (e.g. from a file of an web app) to Log Analytics Workspace [Continuously] using Azure Monitoring Agent

In the Data Collection Rule I have pointed the file from where the logs should be collected. Then it collects the existing logs from that file. However, it prevents the new logs to be appended in the log file [of my web app]. As a result, I am not…
Shanks
  • 1
0
votes
0 answers

Is there a way for me to fetch all message history from Thumbtack's web site?

I own a pro account and have been delivering services for years now. I have thousands of messages about services I provided. I would like to prepare a digital document of all the services I provided with details of the products, prices etc. For…
ahbyz
  • 15
  • 5
0
votes
0 answers

How to get ALL Mastodon accounts followers using API or web scrapping?

I want to get all the accounts followers by using the Mastodon API. In the documentation https://docs.joinmastodon.org/methods/accounts/#followers it is written that the maximum number of results to return can be 80. Is there another way to get a…
adinas
  • 1
0
votes
0 answers

Rshiny app for collecting fielddata interactively

`Hello everyone, My Rshiny app allows users to input data and show it interactively in the map and table. However, I want to allow user to upload his own coordinates file. then bind the other informations interactively. Simply put: User upload…
Chafdesigny
  • 25
  • 4
0
votes
0 answers

Sagemaker Notebook instance very slow with tweepy api

I collect tweets from file has more than 700,000 ids for tweets by using tweepy . Locally I have I7 processor and 16 GB ram and I make for loop on these ides to get the full text , geo , coordinates and place attributes. And by using tqdm library…
Ahmad Mohammed Abd Elhameed
  • 21
  • 5
0
votes
0 answers

Flume retrieves data from the https interface

I have a requirement to open an https interface on my side to receive data, I know flume's httpSource can be used to receive data sent to Http, but if I want to receive data via Https, is HttpSource still applicable? If not, is there any other way…
Francis Aston Maxwell
  • 1
0
votes
0 answers

Restrict data access based on IP address

Does anyone know if SurveyCTO or Qualtrics have the ability to restrict data access based on physical location? For a specific project, we're thinking about storing the data on Qualtrics (or SurveyCTO if it works better) with a restriction that the…
Matheus
  • 1
  • 1
0
votes
0 answers

Linkedin rest api to search people with their company name

I have come across a data collection problem, that is I want to download data from linkedin. For example, “My Company” is an organization, many people currently working there and may people who worked and let their jobs from “My Company”. I want to…
user867662
  • 1,091
  • 4
  • 20
  • 45
0
votes
1 answer

Datashake alternatives for gathering review data?

I am looking for alternatives to Datashake that would be compatible using webhooks for either Zapier or Pabbly. Let me know if there is any other tool that has a review scraper and is compatible with Zapier and Pabbly. Tried integrating datashake…
kgb040
  • 1
  • 1
0
votes
1 answer

How to scrape changing survey data of an ajax web survey

I have a site where I want to scrape out the contents of the survey. The survey can not be extracted it is a limesurvey service with a PHP backend. I tried using ParseHub but I am stuck. The survey uses an ajax next button which I can happily loop…
rigozsolt01
  • 75
  • 4
0
votes
2 answers

is possible to create a map with 2 keys and a vector of values in Clojure?

I am trying to create a program that reads in a table of temperatures from a csv file and would like to access a a collection of temperatures based on the year and day. the first column stands for the year the tempratures have been recorded. the…
Ebel Ofori
  • 13
  • 4
0
votes
1 answer

How to create CPU, Memory, Disk Alerts by using an Data Collection Rules

Previously as we have created an alerts (Memory, CPU, Disk) using an Log-Analytics workspace is going to be no-use. Create Alerts - CPU, Memory, Disk by using an Data Collection Rules.
Winslet vasanthraaj ts
  • 1
  • 1
0
votes
1 answer

How to delete a row on the master tab (destination) and also delete the same row value on the tab it was queried from automatically?

This is a probably convoluted process in data collection. Any advice on how to best do this will be appreciated. I am working on data collection and I am trying to clean it real time. The data is set up such hat each RA has their own tab on google…
Isa
  • 1
  • 1
1 2 3
…
10 11