Follow us on...
Follow us on Twitter Follow us on Facebook Watch us on YouTube
Register
Results 1 to 9 of 9
  1. #1
    Saucy
    kryssyy's Avatar
    Join Date
    Feb 2014
    Posts
    7,271
    Points
    6,503,950
    Thanks
    11,485
    Thanked 21,672 Times in 6,989 Posts

    MTurk Grind Glossary

    Table of Contents



    _____

    If there is anything that has been over-looked, needs corrected or is missing, suggestions are welcomed and encouraged.

    Thank you.
    Last edited by kryssyy; 09-07-2014 at 05:35 AM. Reason: formatting

  2. The Following 20 Users Say Thank You to kryssyy For This Useful Post:

    aveline (07-31-2014), Castor (08-01-2014), clickhappier (07-31-2014), Cristo (07-31-2014), DeliriumTremens (07-31-2014), electrolyte (07-31-2014), haihai (09-02-2014), hashtag (07-31-2014), Holly Windstalker (08-09-2014), J D (07-31-2014), jekjek (07-31-2014), kevin215 (07-31-2014), lot krotan (07-31-2014), Mariner (07-31-2014), raidersJ (08-21-2014), Scrump (08-13-2014), Sunlite (07-31-2014), TeenageMutantNinjaTurker (09-06-2014), Tribune (07-31-2014), ZinGy (08-01-2014)

  3. #2
    Saucy
    kryssyy's Avatar
    Join Date
    Feb 2014
    Posts
    7,271
    Points
    6,503,950
    Thanks
    11,485
    Thanked 21,672 Times in 6,989 Posts
    MTurk Grind Glossary


    Acronyms


    AA:
    Auto Approval Time.
    A requester sets an auto-approval time of anywhere between 0 Seconds and 30 days for every HIT they create. After a HIT is submitted, it will automatically approve after this amount of time has gone past.
    (sometimes AA used to refer to AndAccept links instead of “PandA”.)

    AFK:
    Away From Keyboard

    AFAIK:
    As far as I know

    AC: Attention Check Question
    A question used in surveys and other tasks to make sure the worker is paying attention. It may provide instruction to make a certain choice, ignore questions, or other directions. Used to screen out poor quality data.

    AHK:
    Auto Hot Key
    1. A program used to execute hot key scripts.
    2 .A script run with AutoHotKey

    A basic overview of AutoHotKey can be found in this thread.

    AMT:
    Amazon Mechanical Turk (mturk)
    A website for completing tasks for pay. A cloud-based labor platform designed to connect people who need data (Requesters) with people who are willing to provide it (workers).
    (Source = /r/mturk FAQ)

    AWS:
    Amazon Web Services
    A collection of remote computing services (also called web services) that together make up a cloud computing platform, encompassing mturk, offered over the Internet by Amazon.com.

    C4C:
    Check4Change
    FireFox extension that allows auto refreshing of a tab. Also allows you to monitor pages for any changes, giving you a notification when it detects one. (similar to using Page Monitor in Chrome)

    CMB:
    CloudMeBaby Forum
    Refers to http://www.cloudmebaby.com/, one of the mturk communities on the web.

    EZPZ:
    Easy Peasy
    Something that doesn’t require very much skill or effort.

    FWIW:
    For What It's Worth

    GDLK:
    God Like
    Someone or something that is exceptionally good.

    HAM / Hamming:
    A term used to describe going as fast and hard as possible on a batch till there is no more HIT's available. Originates from the saying “Go HAM” which means “go as hard as a mother f***er”.

    HIT:
    Human Intelligence Task
    A job posted to Amazon’s mTurk platform. Referred to as “human intelligence tasks” due to the fact that bots/programs are less capable of performing the work than human beings.
    (Source: Amazon Mechanical Turk on Wikipedia)

    HIT DB / DB:
    MTurk HIT Database
    A user script that keeps track of the HIT's you have completed. It populates a database with information of your submitted HITs and allows you to search through the data from your worker dashboard. The user script can be found on this page.

    HNWTF:
    Hit Not Worth Turking For
    Hits that pay under $0.10 a minute.

    HWTF:
    HITs Worth Turking For on Reddit
    A reddit community (subreddit) where HIT's are posted along with completion times, votes, and comments.

    IC / ICF:
    Informed Consent / Informed Consent Form
    An informed consent document communicates to the prospective research subject the purpose, procedures, risks and benefits of the study, the subject’s rights in participating in the research, and the freedom to decline to participate without jeopardy.
    (Source: Prairie View A&M Univeristy IRB - Informed Consent Process)

    IIRC:
    If I Recall Correctly

    IRB:
    Institutional Review Board
    An institutional review board (IRB), also known as an independent ethics committee (IEC) or ethical review board, is a committee that has been formally designated to approve, monitor, and review biomedical and behavioral research involving humans. They often conduct some form of risk-benefit analysis in an attempt to determine whether or not research should be done.
    (Source: Wikipedia: Institutional Review Board)

    IRC:
    Internet Relay Chat
    A webchat technology used by MTG and countless others.
    MTG on IRC


    MC:
    Memory Check Question
    A quality check question used in surveys that asks you to recall information previously presented in the task.

    MTF:
    Mturk Forum
    Refers to mturkforum.com, one of the mturk communities on the web.

    MTG:
    Mturk Grind
    Refers to mturkgrind.com, the mturk community you’re currently on.

    MOTM:
    Master of the Month.
    A monthly contest on MTG where the community nominates and votes for eligible site contibutors. Winners receive a handful of prizes and listing in the MOTM Hall of Fame Rules can be found in This Thread.

    NSFW:
    Not Safe For Work

    NSFL:
    Not Safe For Life

    PM:
    Page Monitor
    A browser extension for Chrome that allows you to receive a notification when pages change. When used with mturk URLs, this lets you know as soon as certain HITs/requesters are available to work on.
    For instructions, see the Setting Up Page Monitor thread.
    For an alternative that works in all browsers, see the DCI HIT monitor thread.


    Panda / P&A / PandA link:
    Preview and Accept URL (formerly known as AndAccept), often used in tandem with page refresher/auto-reload software. A user script that adds PandA links to your searches on mTurk can be found here.

    TIL:
    Today I Learned

    TL;DR / tl;dr:
    Too Long, Didn’t Read

    TN:
    Turkernation Forum
    Refers to turkernation.com, one of the mturk communities on the web.

    TO:
    Turkopticon
    Turkopticon is a platform that allows you to rate the quality of requesters and view their current reputation with workers. The user script for Turkopticon can be found in this post. Turkopticon also has a discussion page, located here.

    YMMV:
    Your Mileage May Vary
    Last edited by kryssyy; 09-09-2014 at 10:04 PM. Reason: formatting, additional definitions

  4. The Following 22 Users Say Thank You to kryssyy For This Useful Post:

    aveline (07-31-2014), clickhappier (07-31-2014), Cristo (07-31-2014), DeliriumTremens (07-31-2014), forty2 (08-01-2014), haihai (09-02-2014), hashtag (07-31-2014), J D (07-31-2014), jekjek (07-31-2014), kevin215 (07-31-2014), lot krotan (07-31-2014), minkyboodle (07-31-2014), Mirabreano (08-01-2014), montgo (08-01-2014), raidersJ (08-21-2014), Scrump (08-23-2014), Sunlite (07-31-2014), sunsetblow (07-31-2014), TeenageMutantNinjaTurker (09-06-2014), TomKat_HippieFucks (08-20-2014), Tribune (07-31-2014), ZinGy (08-01-2014)

  5. #3
    Saucy
    kryssyy's Avatar
    Join Date
    Feb 2014
    Posts
    7,271
    Points
    6,503,950
    Thanks
    11,485
    Thanked 21,672 Times in 6,989 Posts
    Definitions


    Auto Granted Qualification:
    A qualification that is auto granted. These types of qualifications do not require a test, they can be obtained by simply clicking the "Request Qualification" link on a particular hit. These qualifications are usually given to track and prevent retakes or as a way to set a quality score that can be lowered due to bad work. When the value is changed, it may prevent you from accessing those HITs.

    Batch:
    A type of HIT designed to allow a worker to complete multiple submission. You can complete as many HIT's in the batch as it allows, unless otherwise advised by the requester’s instructions.

    Blocks (Hard/Soft):
    A way for a requester to prevent a worker from accepting any of their HITs. A detailed discussion on the topic can be found in this thread.

    Cat batch / Cat HITs:
    A HIT type based on a template requiring Categorization Masters Qualification. These HITs involve categorizing data into different groups and subgroups. The categorization template provided by Amazon uses the Masters qualification by default. Because of this, only batches of this type that use their own categorization template can be posted without the Master qualification.

    Cherry Picking:
    1. Skipping over the difficult HITs in a batch in order to do only the easiest HIT's available.
    2. Skipping over HITs that are impossible to complete as per requester’s instructions in order to find new HITs in the batch that can be completed. This can cause the last HITs in a batch to be generally unsubmittable and worthless due to being left with nothing but skipped and returned HITs from other workers.


    Closed Qualification:
    A qualification that is no longer available to the general turking public. These types of qualifications are normally obtained by a requester posting a series of HITs to the general turk public and granting the qualification only to the workers who provided acceptable data. Can also be granted during open enrollment type occurrences when a requester advertises the qualification as being open on a turk forum and granting it to those that contact them.

    CS Workstation:
    CrowdSource Workstation
    A web interface from mturk requester CrowdSource that provides a workstation. Shows you HIT's that you qualify for, account stastics, and other information.
    There is also a Support Page, you can navigate to the support page by clicking on the question mark in the top right corner of your Crowdsource Workstation. (When you open the support page you will see a link to "open a ticket", this is the best place to email Crowdsource about any questions you may have regarding their HIT's.)


    Dashboard:
    A worker’s dashboard page on mturk.com. Contains information such as HIT statistics, worker ID, and earnings transfer options.

    Dibs:
    To call dibs on making the daily HITs thread.
    More information can be found in this thread.

    Donation Member:
    Donated to Mturk Grind
    A member who donated at least $5 to the site.
    Details on becoming a donating member and what it has to offer in this thread.


    Greasemonkey:
    Link to Extension:
    A browser extension for Firefox that allows installing and running custom user scripts on websites.

    Golden HITs:
    HITs in a batch with known answers used to compare against a worker’s responses. Used to check for quality.

    Grind:
    1: To focus intensely on completing HIT's for an extended duration (I'm going to grind this batch till it dies).
    2: To complete a large amount of the same HIT from a batch repetitively.


    Grind Mode:
    A forum feature on mturk grind for donation members that allows a member to hide all posts in a thread that don’t contain a URL. Used to filter out chatter or catch up on a thread mid-day.
    Full details in this thread


    Hit Scraper:
    A user script that customizes your search results by setting specific criteria. It can be found on this page.
    (See also HIT Scraper Guide.)


    Hoard:
    To accept as many of a HIT as possible before they are no longer available to be accepted. Loading up with good HITs to work on later from your queue.

    Majority Rules:
    A way of sampling data quality from HITs. With these HITs, a requester allows multiple workers to complete the same task and cross-references their answers to determine if a worker didn’t put in a good effort. Some workers may find themselves in the minority, receiving a rejection or removal of a qualification, if they noticed something other workers missed. Workers tend to avoid majority rules tasks that are subjective in nature if the requester uses this method of accepting/rejecting.

    Masters:
    Master Qualification, Categorization Masters, Photo Moderation Masters
    “Masters are an elite group of Workers, who have demonstrated superior performance while completing thousands of HITs for a variety of Requesters across the Mechanical Turk Marketplace. Masters must maintain this high level of performance or risk losing this distinction. Mechanical Turk has built technology which analyzes Worker performance, identifies high performing Workers and monitors their performance over time.”
    (Source = Amazon Mechanical Turk website)

    Music Room / Plug DJ / DJ Roomoom:
    A website that allows users to chat while taking turns playing songs or videos from playlists. Playlists can be made by searching for the media you want from either youtube or soundcloud MTG on plug.dj

    Rep (Pos/Neg):
    Postive/Negative Reputation
    A system on mturkgrind to allow users to show approval or disapporval for forum posts and award points to the poster.
    For more information see MTG’s thread on forum reputation..


    Queue:
    HITs you have accepted and are awaiting submission. Found under the “HITs Assigned to you” tab on MTurk.

    Page Refresher:
    A piece of software such as Easy Auto Refresh (Chrome), ReloadEvery (FireFox), or similar that refreshes a page at set time intervals. Used with a PandA link to accept HITs automatically..

    /r/mturk:
    mTurk on Reddit
    A community (subreddit) on the popular social link-sharing reddit.com. "Redditors" gather here to share, discuss, and vote on mTurk related content and links.

    Tampermonkey:
    Link to Extension:
    A browser extension for Chrome that allows installing and running custom user scripts on websites.

    TeamRed:
    When you have a substantial amount of HIT's pending, sending your worst case scenario projection into red (under 95%), while using this script; MTurk Worst & Best Case Scenario

    Turker:
    Someone who works to complete tasks for pay on Amazon’s Mechanical Turk.

    Unspun:
    Unspunreality
    MTG member infamous for being the laziest turker ever, so famous that “unspun” has become an adjective for whenever you are feeling lazy.

    Unspun of the Day:
    Slacker of the day, usually the person with the lowest projected earnings for the day gets this award.

    User script / Script:
    Small sets of code/instructions written in JavaScript to alter the functionality of a website.
    More information on mturk relation scrips can be found in the Mechanical Turk User Scripts Thread. There's also a User Script Help Thread.
    Last edited by kryssyy; 08-03-2014 at 11:49 PM. Reason: formatting

  6. The Following 23 Users Say Thank You to kryssyy For This Useful Post:

    aveline (07-31-2014), clickhappier (07-31-2014), Cristo (07-31-2014), DeliriumTremens (07-31-2014), haihai (09-02-2014), hashtag (07-31-2014), J D (07-31-2014), jekjek (07-31-2014), kevin215 (07-31-2014), L M S (09-06-2014), lot krotan (07-31-2014), Mariner (07-31-2014), minkyboodle (07-31-2014), Mirabreano (08-01-2014), NiteLite (08-26-2014), raidersJ (08-21-2014), Scrump (08-23-2014), Shannon (08-01-2014), Sunlite (07-31-2014), TeenageMutantNinjaTurker (09-06-2014), Tribune (07-31-2014), YAHU (07-31-2014), ZinGy (08-01-2014)

  7. #4
    Saucy
    kryssyy's Avatar
    Join Date
    Feb 2014
    Posts
    7,271
    Points
    6,503,950
    Thanks
    11,485
    Thanked 21,672 Times in 6,989 Posts
    Requesters

    Adam
    Adam Beatty
    Adam Beatty Requester Thread

    AJ
    AJ Ghergich
    AJ Ghergich Requester Thread

    Alegion
    Alegion Requester Thread

    AudioKite
    AudioKite Requester Thread

    Binder
    Jeff Binder

    BJ
    Bluejay Labs

    CS
    Crowdsource

    Data Buff
    Data Buff Requester Thread

    Dunking Donuts / DD
    Andrew Stephen

    Endor
    Project Endor or Project Endor (Jamelio)

    Fishies
    Superfish Inc.
    Or their new requester account

    Heather
    Heather Walters

    Hotels /Hoyt / Bens / Ben Hoyt
    Eytan Seidman

    Jaime Arguello
    Jaime Arguello Requster Thread

    Kenta
    Kenta Hirai
    Kenta Hirai Discussion Thread

    RNR
    ProductRnR

    Sets / Set Masters
    SET Master Account

    OCMP
    OCMP/TR Requester Thread

    p9r
    p9r Requester Thread

    Siddharth Suri
    Siddharth Suri Requester Thread

    SS
    Smartsheet.com Clients

    Smarters
    Prospect Smarter

    Tasties / Daniel / TOTW
    Taste of the World

    TLR / TL / Two Lake
    Two Lakes Research

    VG
    Visual Genome

    VQ
    Venue Quality

    WV
    World Vision

    x8 Data
    x8 Data Requester Thread

    _____

    This Glossary was compiled by the suggestion of MTG member forty2 and last updated on September 9th, 2014.

    Contributions from members; kevin215, lot krotan, manzician and jekjek.


    Additional edits made by the suggestion of member, clickhappier.

    Thank you to all the members who provided the valuable content linked in this thread.
    Last edited by kryssyy; 09-09-2014 at 10:30 AM. Reason: formatting, additional requesters

  8. The Following 21 Users Say Thank You to kryssyy For This Useful Post:

    aveline (07-31-2014), clickhappier (07-31-2014), Cristo (07-31-2014), DeliriumTremens (07-31-2014), hashtag (07-31-2014), J D (07-31-2014), jekjek (07-31-2014), kevin215 (07-31-2014), L M S (09-06-2014), lot krotan (07-31-2014), Mariner (07-31-2014), minkyboodle (07-31-2014), Mirabreano (08-01-2014), Mrs B (09-12-2014), raidersJ (08-21-2014), Scrump (08-23-2014), Sunlite (07-31-2014), TeenageMutantNinjaTurker (09-06-2014), TomKat_HippieFucks (09-11-2014), Tribune (07-31-2014), YAHU (07-31-2014)

  9. #5
    Saucy
    kryssyy's Avatar
    Join Date
    Feb 2014
    Posts
    7,271
    Points
    6,503,950
    Thanks
    11,485
    Thanked 21,672 Times in 6,989 Posts
    Placeholder comment, in case the glossary expands past the character limit per post.

  10. The Following 4 Users Say Thank You to kryssyy For This Useful Post:

    Cristo (07-31-2014), jekjek (07-31-2014), TeenageMutantNinjaTurker (09-06-2014), Tribune (07-31-2014)

  11. #6
    Saucy
    kryssyy's Avatar
    Join Date
    Feb 2014
    Posts
    7,271
    Points
    6,503,950
    Thanks
    11,485
    Thanked 21,672 Times in 6,989 Posts
    Placeholder comment, in case the glossary expands past the character limit per post.

  12. The Following 3 Users Say Thank You to kryssyy For This Useful Post:

    Cristo (07-31-2014), jekjek (07-31-2014), Tribune (07-31-2014)

  13. #7
    witty saying
    forty2's Avatar
    Join Date
    Oct 2013
    Posts
    1,142
    Points
    571,095
    Thanks
    3,189
    Thanked 3,923 Times in 1,015 Posts
    Thread has earned llama-approval.

    could have been a lady bug on a wind chime, but she was born a dragonfly

  14. The Following 7 Users Say Thank You to forty2 For This Useful Post:

    clickhappier (08-01-2014), DeliriumTremens (08-01-2014), Jaded (08-25-2014), kryssyy (08-01-2014), lot krotan (08-01-2014), TeenageMutantNinjaTurker (09-06-2014), YAHU (08-01-2014)

  15. #8
    Turker

    Join Date
    Jul 2014
    Posts
    208
    Points
    45,816
    Thanks
    55
    Thanked 283 Times in 143 Posts
    HAs Blue Jay LAbs been around in a while? I haven't heard about them in forever.

  16. #9
    The Machine
    ZinGy's Avatar
    Join Date
    Oct 2013
    Location
    Mariana's Web
    Posts
    28,455
    Points
    2,440,540
    Thanks
    26,938
    Thanked 77,248 Times in 25,141 Posts
    Quote Originally Posted by mikey View Post
    HAs Blue Jay LAbs been around in a while? I haven't heard about them in forever.
    They posted a couple of surveys awhile back, nothing significant though like batches or whatever.
    My Threads
    If you have questions about anything please PM me or post a new thread Here
    The most valuable section on this forum
    "Yall just opened up a can of worms and I'ma start to lose it"
    MTG founder

 

 

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •