Stack Overflow
Stack Overflow

Questions tagged [crowdsourcing]

53 questions
1
vote
2 answers

Crowdflower: how to include custom HTML?

I am trying to create a job on Crowdflower with its Builder tool. So far so good. I have items of text that I want people to label: a string with some html elements, such as

and
When I include {{text}} in the Crowdflower Builder,…

anonymous1fsdfds
  • 281
  • 1
  • 3
  • 13
0
votes
1 answer

Adaptive Payments application approval - average timescale?

Does anyone have any idea of the average Adaptive Payments application approval time at the moment? It appears there may be a backlog as we've heard nothing from the moderators and it has been over 15 days (their usual timescale apparently). Our…
JoeW
  • 578
  • 1
  • 10
  • 29
0
votes
0 answers

Cannot see my MTurk HIT (as a worker) created from the API using boto3 and Python

I am planning to do a large scale crowdsourcing experiment on MTurk and would therefore like to do this using the API and Python, since I am very interested in the ReviewPolicies Feature. I tested this (not only in the sandbox, but also in the…
progsi
  • 1
0
votes
1 answer

What if I have less control tasks than I need to mix all suites for workers in toloka

For example I have 5 control tasks and 100 tasks and have mixing settings 4 task and 1 control. What happens when the worker (aka toloker) just seen the last one, while there are still more potential task suites to work on?
katoquro
  • 326
  • 3
  • 9
0
votes
1 answer

"Recent values to use" in Toloka quality control

Can the "Recent values to use" for control tasks be set to a larger value than the current pool size to include older pools?
Igor Loban
  • 50
  • 4
0
votes
1 answer

Prevent abuse on a crowd-sourced website

I am building a crowd-sourced website where users can create new articles, update any existing articles in a category A. There is no ownership in all articles in category A. Because I wanna show instant response, I let the articles be updated…
Victor
  • 13,010
  • 18
  • 83
  • 146
0
votes
1 answer

How to edit manifest when specifying multiple sources for one task with AWS Sagemaker ground truth

I would like to create a task to have one worker perform labeling of multiple sound sources with AWS Sagemaker ground truth. I created a manifest file as follows, but I cannot specify multiple sound sources with source-ref. How to create a manifest…
shimokin
  • 3
  • 4
0
votes
4 answers

How (in code) can I prevent two people starting the same crowdsourcing task at once?

I'm trying to build a Django app for a translation crowdsourcing task. For each task in the database, I have an is_completed boolean flag that is set when the user completes the task. I also have a 'give me a random task' button, which chooses from…
AP257
  • 89,519
  • 86
  • 202
  • 261
0
votes
2 answers

Calculate the dependency standard deviation in R

I want to calculate the standard deviation in R. But the standard function "sd(x)" is not the function that I need. I'm looking for a function to calculate the sd(x, in dependency of another variable in my dataframe). So that I can add a new column…
Tim Wendt
  • 11
  • 4
0
votes
1 answer

How to secure Pybossa completely?

I want to secure /project/project1/1/results.json end point of pybossa. This end point exposes our results to public without authentication.
sattu
  • 102
  • 1
  • 1
  • 7
0
votes
1 answer

Architecture of crowdsourcing app for real time process

I am a beginner in Android development. I have to develop an Android app which enables real time on-demand crowd feedback. The idea is: the task producer needs a task to be solved on day x, time y, by n workers, so he announces this to the system;…
Betty
  • 1
  • 1
0
votes
1 answer

How to get “qualification_type_id” when using Boto API for Mturk

It seems that the following code should return a qual which contain a qualification_type_id attribute. Since lots of functions in Boto require qualification_type_id as a parameter. It shows that the qualification id returns when you create a…
slhttc
  • 11
  • 4
0
votes
1 answer

Send data from android app to Server without OnClickListener?

I want to build a system based on crowdsoucing.The android app will gather data about the location of itms and send them to the server. How to post data in android without using onClicklstener? I want the data to be sent in the background…
ocean
  • 75
  • 2
  • 9
0
votes
1 answer

CrowdFlower: if-ony logic

I am trying to set up a task in CrowdFlower using their CML language. I keep getting the following error with the only-if logic. contains only-if logic that references a missing field This is the code.
Bipa
  • 189
  • 2
  • 3
  • 14
0
votes
0 answers

Boto interfacing to Amazon Mechanical turk - Hit creation

I'm new to amazon and python, so forgive me this is a easy fix. Upon creating a hit from boto I get the following error: boto.mturk.connection.MTurkRequestError: MTurkRequestError: 200 OK
user3178645
  • 3
  • 2
1 2
3
4