CINXE.COM

<!DOCTYPE html> <html lang="en"> <head><script type='text/javascript' src='//cdnjs.cloudflare.com/ajax/libs/yui/3.6.0/yui/yui-min.js'></script><script type='text/javascript' src='//ajax.googleapis.com/ajax/libs/jquery/1.10.2/jquery.min.js'></script><script type='text/javascript' src='https://assets.adobedtm.com/4a848ae9611a/d0e96722185b/launch-d525bb0064d8.min.js'></script><script type='text/javascript' src=/assets/nr_browser_production.js></script>  <meta charset="utf-8"> <meta name="viewport" content="width=device-width"> <title> "The Duality of Empowerment and Marginalization" by Yasamin Hadavi, Eric Villafranca et al. </title>  <meta itemprop="name" content="The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: A Replication"> <meta property="og:title" content="The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: A Replication"> <meta name="twitter:title" content="The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: A Replication"> <meta property="article:author" content="Yasamin Hadavi"> <meta name="author" content="Yasamin Hadavi"> <meta property="article:author" content="Eric Villafranca"> <meta name="author" content="Eric Villafranca"> <meta property="article:author" content="Stacie Petter"> <meta name="author" content="Stacie Petter"> <meta name="robots" content="noodp, noydir"> <meta name="description" content="This paper describes an exact replication of a study by Deng, Joshi, & Galliers (2016) of crowd worker values on Amazon’s Mechanical Turk (MTurk) crowdsourcing platform. The original study analyzed 210 MTurk crowd workers’ narratives using value sensitive design (VSD). The results uncovered nine shared values: access, autonomy, fairness, transparency, communication, security, accountability, making an impact, and dignity. Further analysis in the original study revealed four crowdsourcing structures: compensation, governance, technology, and microtask, and duality of crowd worker perceptions, empowerment, and marginalization. This replication study also asked Amazon Mechanical Turk crowd workers questions about their work and used the original study’s findings for a priori codes. However, new values and findings emerged in our results, which offers additional implications for further research regarding microtask crowdsourcing."> <meta itemprop="description" content="This paper describes an exact replication of a study by Deng, Joshi, & Galliers (2016) of crowd worker values on Amazon’s Mechanical Turk (MTurk) crowdsourcing platform. The original study analyzed 210 MTurk crowd workers’ narratives using value sensitive design (VSD). The results uncovered nine shared values: access, autonomy, fairness, transparency, communication, security, accountability, making an impact, and dignity. Further analysis in the original study revealed four crowdsourcing structures: compensation, governance, technology, and microtask, and duality of crowd worker perceptions, empowerment, and marginalization. This replication study also asked Amazon Mechanical Turk crowd workers questions about their work and used the original study’s findings for a priori codes. However, new values and findings emerged in our results, which offers additional implications for further research regarding microtask crowdsourcing."> <meta name="twitter:description" content="This paper describes an exact replication of a study by Deng, Joshi, & Galliers (2016) of crowd worker values on Amazon’s Mechanical Turk (MTurk) crowdsourcing platform. The original study analyzed 210 MTurk crowd workers’ narratives using value sensitive design (VSD). The results uncovered nine shared values: access, autonomy, fairness, transparency, communication, security, accountability, making an impact, and dignity. Further analysis in the original study revealed four crowdsourcing structures: compensation, governance, technology, and microtask, and duality of crowd worker perceptions, empowerment, and marginalization. This replication study also asked Amazon Mechanical Turk crowd workers questions about their work and used the original study’s findings for a priori codes. However, new values and findings emerged in our results, which offers additional implications for further research regarding microtask crowdsourcing."> <meta property="og:description" content="This paper describes an exact replication of a study by Deng, Joshi, & Galliers (2016) of crowd worker values on Amazon’s Mechanical Turk (MTurk) crowdsourcing platform. The original study analyzed 210 MTurk crowd workers’ narratives using value sensitive design (VSD). The results uncovered nine shared values: access, autonomy, fairness, transparency, communication, security, accountability, making an impact, and dignity. Further analysis in the original study revealed four crowdsourcing structures: compensation, governance, technology, and microtask, and duality of crowd worker perceptions, empowerment, and marginalization. This replication study also asked Amazon Mechanical Turk crowd workers questions about their work and used the original study’s findings for a priori codes. However, new values and findings emerged in our results, which offers additional implications for further research regarding microtask crowdsourcing."> <meta name="keywords" content="Microtask Working, Marginalization, Empowerment, Value Sensitive Design, Crowdsourcing Platforms"> <meta name="bepress_citation_journal_title" content="AIS Transactions on Replication Research"> <meta name="bepress_citation_firstpage" content="2"> <meta name="bepress_citation_author" content="Hadavi, Yasamin"> <meta name="bepress_citation_author_institution" content="Baylor University"> <meta name="bepress_citation_author" content="Villafranca, Eric"> <meta name="bepress_citation_author_institution" content="Baylor University"> <meta name="bepress_citation_author" content="Petter, Stacie"> <meta name="bepress_citation_author_institution" content="Wake Forest University"> <meta name="bepress_citation_title" content="The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: A Replication"> <meta name="bepress_citation_date" content="2022"> <meta name="bepress_citation_volume" content="8"> <meta name="bepress_citation_issue" content="1">   <meta name="bepress_citation_pdf_url" content="https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1075&context=trr"> <meta name="bepress_citation_abstract_html_url" content="https://aisel.aisnet.org/trr/vol8/iss1/2"> <meta name="bepress_citation_doi" content="10.17705/1atrr.00073"> <meta name="bepress_citation_issn" content="2473-3458"> <meta name="bepress_citation_online_date" content="2022/12/9"> <meta name="viewport" content="width=device-width">  <meta name="twitter:card" content="summary">  <meta property="og:type" content="article"> <meta property="og:url" content="https://aisel.aisnet.org/trr/vol8/iss1/2"> <meta property="og:site_name" content="AIS Electronic Library (AISeL)">  <script type="text/javascript"> (function(e,t){var n=e.amplitude||{_q:[],_iq:{}};var r=t.createElement("script") ;r.type="text/javascript";r.async=true ;r.src="https://cdn.amplitude.com/libs/amplitude-4.5.2-min.gz.js" ;r.integrity="5ceGNbvkytO+PTI82JRl6GwJjVCw6k79kP4le5L5/m0Zny1P7taAF6YVvC4z4Pgj" ;r.onload=function(){if(e.amplitude.runQueuedFunctions){ e.amplitude.runQueuedFunctions()}else{ console.log("[Amplitude] Error: could not load SDK")}} ;var i=t.getElementsByTagName("script")[0];i.parentNode.insertBefore(r,i) ;function s(e,t){e.prototype[t]=function(){ this._q.push([t].concat(Array.prototype.slice.call(arguments,0)));return this}} var o=function(){this._q=[];return this} ;var a=["add","append","clearAll","prepend","set","setOnce","unset"] ;for(var u=0;u<a.length;u++){s(o,a[u])}n.Identify=o;var c=function(){this._q=[] ;return this} ;var l=["setProductId","setQuantity","setPrice","setRevenueType","setEventProperties"] ;for(var p=0;p<l.length;p++){s(c,l[p])}n.Revenue=c ;var d=["init","logEvent","logRevenue","setUserId","setUserProperties","setOptOut","setVersionName","setDomain","setDeviceId","setGlobalUserProperties","identify","clearUserProperties","setGroup","logRevenueV2","regenerateDeviceId","groupIdentify","logEventWithTimestamp","logEventWithGroups","setSessionId","resetSessionId"] ;function v(e){function t(t){e[t]=function(){ e._q.push([t].concat(Array.prototype.slice.call(arguments,0)))}} for(var n=0;n<d.length;n++){t(d[n])}}v(n);n.getInstance=function(e){ e=(!e||e.length===0?"$default_instance":e).toLowerCase() ;if(!n._iq.hasOwnProperty(e)){n._iq[e]={_q:[]};v(n._iq[e])}return n._iq[e]} ;e.amplitude=n})(window,document); amplitude.getInstance().init("1d890e80ea7a0ccc43c2b06438458f50"); </script>  <meta name="bepress_is_article_cover_page" content="1">  <link rel="stylesheet" href="/trr/ir-journal-style.css" type="text/css" media="screen"> <link rel="alternate" type="application/rss+xml" title="AIS Transactions on Replication Research Newsfeed" href="/trr/recent.rss"> <link rel="shortcut icon" href="/favicon.ico" type="image/x-icon"> <link type="text/css" rel="stylesheet" href="/assets/floatbox/floatbox.css"> <script type="text/javascript" src="/assets/jsUtilities.js"></script> <script type="text/javascript" src="/assets/footnoteLinks.js"></script> <link rel="stylesheet" href="/ir-print.css" type="text/css" media="print">   <script type="text/javascript">var pageData = {"page":{"environment":"prod","productName":"bpdg","language":"en","name":"ir_journal:volume:issue:article","businessUnit":"els:rp:st"},"visitor":{}};</script> </head> <body >  <div id="trr">  <script src="/assets/scripts/dc-mobile/dc-responsive-nav.js"></script> <header id="mobile-nav" class="nav-down device-fixed-height" style="visibility: hidden;"> <nav class="nav-collapse"> <ul> <li class="menu-item active device-fixed-width"><a href="https://aisel.aisnet.org" title="Home" data-scroll >Home</a></li> <li class="menu-item device-fixed-width"><a href="https://aisel.aisnet.org/do/search/advanced/" title="Search" data-scroll ><i class="icon-search"></i> Search</a></li> <li class="menu-item device-fixed-width"><a href="https://aisel.aisnet.org/communities.html" title="Browse" data-scroll >Browse All Content</a></li> <li class="menu-item device-fixed-width"><a href="/cgi/myaccount.cgi?context=" title="My Account" data-scroll >My Account</a></li> <li class="menu-item device-fixed-width"><a href="https://aisel.aisnet.org/about.html" title="About" data-scroll >About</a></li> <li class="menu-item device-fixed-width"><a href="https://network.bepress.com" title="Digital Commons Network" data-scroll ><img width="16" height="16" alt="DC Network" style="vertical-align:top;" src="/assets/md5images/8e240588cf8cd3a028768d4294acd7d3.png"> Digital Commons Network™</a></li> </ul> </nav> </header> <script src="/assets/scripts/dc-mobile/dc-mobile-nav.js"></script>   <div id="ais"> <div id="container"> <a href="#main" class="skiplink" accesskey="2" >Skip to main content</a> <div id="header" role="banner"> <a href="https://aisel.aisnet.org" id="banner_link" title="AIS Electronic Library (AISeL)" > <img id="banner_image" alt="AIS Electronic Library (AISeL)" width='980' height='138' src="/assets/md5images/ac4d354af06000e62ed76ac56e644074.png"> </a> <a href="http://ais.site-ym.com/" id="logo_link" title="Association for Information Systems" > <img id="logo_image" alt="Association for Information Systems" width='362' height='140' src="/assets/md5images/6979cf156159b3483ddf6e0614ab67bb.png"> </a> </div> <div id="navigation">  <div id="tabs" role="navigation" aria-label="Main"><ul><li id="tabfour"><a href="https://aisel.aisnet.org" title="eLibrary Home" ><span>eLibrary Home</span></a></li><li id="tabthree"><a href="http://ais.site-ym.com/" title="AIS Home" ><span>AIS Home</span></a></li><li id="tabtwo"><a href="https://aisel.aisnet.org/cgi/myaccount.cgi?context=" title="eLibrary Login" ><span>eLibrary Login</span></a></li><li id="tabone"><a href="https://aisnet.org/page/MembershipBenefits" title="Join AIS" ><span>Join AIS</span></a></li></ul></div>  </div> <div id="wrapper"> <div id="content"> <div id="main" class="text" role="main">   <ul id="pager"> <li> </li> <li> </li> </ul> <div class="crumbs" role="navigation" aria-label="Breadcrumb"> <p> <a href="https://aisel.aisnet.org" class="ignore" >Home</a> <span aria-hidden="true">></span> <a href="https://aisel.aisnet.org/journals" class="ignore" >Journals</a> <span aria-hidden="true">></span> <a href="https://aisel.aisnet.org/ais-journals" class="ignore" >AIS Journals</a> <span aria-hidden="true">></span> <a href="https://aisel.aisnet.org/trr" class="ignore" >TRR</a> <span aria-hidden="true">></span> <a href="https://aisel.aisnet.org/trr/vol8" class="ignore" >Vol. 8 (2022)</a> </p> </div> <div class="clear"> </div>   <h1 class="inherit-title"> <a href="https://aisel.aisnet.org/trr" title="AIS Transactions on Replication Research" > AIS Transactions on Replication Research </a> </h1>     <script type="text/javascript" src="/assets/floatbox/floatbox.js"></script>     <div id="sub"> <div id="alpha"><div id='title' class='element'> <h1><a href='https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1075&context=trr'>The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: A Replication</a></h1> </div> <div class='clear'></div> <div id='authors' class='element'> <h2 class='visually-hidden'>Authors</h2> <p class="author"><a href='https://aisel.aisnet.org/do/search/?q=bp_author_id%3A%2286fd16da-8252-421b-8427-48baf73ed05e%22%20OR%20%28author%3A%22Yasamin%20Hadavi%22%20AND%20-bp_author_id%3A%5B%2A%20TO%20%2A%5D%29&start=0&context=509156'><strong>Yasamin Hadavi</strong>, <em>Baylor University</em></a><a rel="nofollow" href="https://network.bepress.com/api/follow/subscribe?user=MTE1NDc3ZTFhNzlmYjJlZg%3D%3D&institution=NWQ1NzUyN2I3ZmY0OTU5NQ%3D%3D&format=html" data-follow-set="user:MTE1NDc3ZTFhNzlmYjJlZg== institution:NWQ1NzUyN2I3ZmY0OTU5NQ==" title="Follow Yasamin Hadavi" class="btn followable">Follow</a><br /> <a href='https://aisel.aisnet.org/do/search/?q=bp_author_id%3A%223bba29a5-a09d-4c92-8448-5dace77984ca%22%20OR%20%28author%3A%22Eric%20Villafranca%22%20AND%20-bp_author_id%3A%5B%2A%20TO%20%2A%5D%29&start=0&context=509156'><strong>Eric Villafranca</strong>, <em>Baylor University</em></a><a rel="nofollow" href="https://network.bepress.com/api/follow/subscribe?user=OWUxZTYyYWE0OTI1ODg2Ng%3D%3D&institution=NWQ1NzUyN2I3ZmY0OTU5NQ%3D%3D&format=html" data-follow-set="user:OWUxZTYyYWE0OTI1ODg2Ng== institution:NWQ1NzUyN2I3ZmY0OTU5NQ==" title="Follow Eric Villafranca" class="btn followable">Follow</a><br /> <a href='https://aisel.aisnet.org/do/search/?q=bp_author_id%3A%22eb2ecbc5-575f-4c03-9928-45097924857e%22%20OR%20%28author%3A%22Stacie%20Petter%22%20AND%20-bp_author_id%3A%5B%2A%20TO%20%2A%5D%29&start=0&context=509156'><strong>Stacie Petter</strong>, <em>Wake Forest University</em></a><a rel="nofollow" href="https://network.bepress.com/api/follow/subscribe?user=N2U1YTVkN2VkOTliOGZmOQ%3D%3D&institution=NWQ1NzUyN2I3ZmY0OTU5NQ%3D%3D&format=html" data-follow-set="user:N2U1YTVkN2VkOTliOGZmOQ== institution:NWQ1NzUyN2I3ZmY0OTU5NQ==" title="Follow Stacie Petter" class="btn followable">Follow</a><br /> </p></div> <div class='clear'></div> <div id='abstract' class='element'> <h2 class='field-heading'>Abstract</h2> <p>This paper describes an exact replication of a study by Deng, Joshi, & Galliers (2016) of crowd worker values on Amazon’s Mechanical Turk (MTurk) crowdsourcing platform. The original study analyzed 210 MTurk crowd workers’ narratives using value sensitive design (VSD). The results uncovered nine shared values: access, autonomy, fairness, transparency, communication, security, accountability, making an impact, and dignity. Further analysis in the original study revealed four crowdsourcing structures: compensation, governance, technology, and microtask, and duality of crowd worker perceptions, empowerment, and marginalization. This replication study also asked Amazon Mechanical Turk crowd workers questions about their work and used the original study’s findings for a priori codes. However, new values and findings emerged in our results, which offers additional implications for further research regarding microtask crowdsourcing.</p> </div> <div class='clear'></div> <div id='recommended_citation' class='element'> <h2 class='field-heading'>Recommended Citation</h2>  <p class="citation"> Hadavi, Yasamin; Villafranca, Eric; and Petter, Stacie (2022) "The Duality of Empowerment and Marginalization in Microtask Crowdsourcing: A Replication," <em>AIS Transactions on Replication Research</em>: Vol. 8, Article 2. <br> DOI: 10.17705/1atrr.00073 <br> Available at: https://aisel.aisnet.org/trr/vol8/iss1/2</p> </div> <div class='clear'></div> <div id='doi' class='element'> <h2 class='field-heading'>DOI</h2> <p>10.17705/1atrr.00073</p> </div> <div class='clear'></div> </div> </div> <div id='beta_7-3'>     <div class="aside download-button"> <a id="pdf" class="btn" href="https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1075&context=trr" title="PDF (332 KB) opens in new window" target="_blank" > <i class="icon-download-alt" aria-hidden="true"></i> Download </a> </div>         <div id="article-stats" class="aside hidden"> <p class="article-downloads-wrapper hidden"><span id="article-downloads"></span> DOWNLOADS</p> <p class="article-stats-date hidden">Since December 09, 2022</p> <p class="article-plum-metrics"> <a href="https://plu.mx/plum/a/?repo_url=https://aisel.aisnet.org/trr/vol8/iss1/2" class="plumx-plum-print-popup plum-bigben-theme" data-badge="true" data-hide-when-empty="true" ></a> </p> </div> <script type="text/javascript" src="//cdn.plu.mx/widget-popup.js"></script>  <script type="text/javascript" src="/assets/scripts/article-downloads.pack.js"></script> <script type="text/javascript"> insertDownloads(32645152); </script>  <script> // bind to event when PlumX widget loads jQuery('body').bind('plum:widget-load', function(e){ // if Plum badge is visible if (jQuery('.PlumX-Popup').length) { // remove 'hidden' class jQuery('#article-stats').removeClass('hidden'); jQuery('.article-stats-date').addClass('plum-border'); } }); // bind to event when page loads jQuery(window).bind('load',function(e){ // if DC downloads are visible if (jQuery('#article-downloads').text().length > 0) { // add border to aside jQuery('#article-stats').removeClass('hidden'); } }); </script>  <script> $(function() { // This is the handler for Plum popup engagement on mouseover $("#article-stats").on("mouseover", "a.plx-wrapping-print-link", function(event) { // Send the event to Amplitude amplitude.getInstance().logEvent("plumPopupMouseover"); }); // This is the handler for Plum badge and 'see details' link clickthrough $("#article-stats").on("click", "div.ppp-container.ppp-small.ppp-badge", function(event) { // Send the event to Amplitude amplitude.getInstance().logEvent("plumDetailsClick"); }); // This is the handler for AddThis link clickthrough $(".addthis_toolbox").on("click", "a", function(event) { // Send the event to Amplitude amplitude.getInstance().logEvent("addThisClick"); }); // This is the handler for AddThis link clickthrough $(".aside.download-button").on("click", "a", function(event) { // Send the event to Amplitude amplitude.getInstance().logEvent("downloadClick"); }); }); </script>  <script> $(function() { // Download button click event tracker for PDFs $(".aside.download-button").on("click", "a#pdf", function(event) { pageDataTracker.trackEvent('navigationClick', { link: { location: 'aside download-button', name: 'pdf' } }); }); // Download button click event tracker for native files $(".aside.download-button").on("click", "a#native", function(event) { pageDataTracker.trackEvent('navigationClick', { link: { location: 'aside download-button', name: 'native' } }); }); }); </script>     <div id="share" class="aside"> <h2>Share</h2> <div class="a2a_kit a2a_kit_size_24 a2a_default_style"> <a class="a2a_button_facebook"></a> <a class="a2a_button_linkedin"></a> <a class="a2a_button_whatsapp"></a> <a class="a2a_button_email"></a> <a class="a2a_dd"></a> <script async src="https://static.addtoany.com/menu/page.js"></script> </div> </div>      <span class="Z3988" title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft_id=https%3A%2F%2Faisel.aisnet.org%2Ftrr%2Fvol8%2Fiss1%2F2&rft.atitle=The%20Duality%20of%20Empowerment%20and%20Marginalization%20in%20Microtask%20Crowdsourcing%3A%20A%20Replication&rft.aufirst=Yasamin&rft.aulast=Hadavi&rft.au=Eric%20Villafranca&rft.au=Stacie%20Petter&rft.jtitle=AIS%20Transactions%20on%20Replication%20Research&rft.volume=8&rft.issue=1&rft.issn=2473-3458&rft.date=2022-12-09&rft_id=info:doi/10.17705%2F1atrr.00073">COinS</span>    </div> <div class='clear'> </div>      </div> <div class="verticalalign"> </div> <div class="clear"> </div> </div> <div id="sidebar">  <ul class="sb-custom-journal"> <li class="sb-home"> <a href="https://aisel.aisnet.org/trr" title="AIS Transactions on Replication Research" accesskey="1" > Journal Home </a> </li> <li class="sb-about"> <a href="https://aisel.aisnet.org/trr/about.html" > About This Journal </a> </li> <li class="sb-ed-board"> <a href="https://aisel.aisnet.org/trr/editorialboard.html" > Editorial Board </a> </li> <li class="sb-policies"> <a href="https://aisel.aisnet.org/trr/policies.html" > Policies </a> </li> <li class="authorinfo"> <a href="https://aisel.aisnet.org/trr/authorinfo.html" > Information for Authors </a> </li> <li><a href="https://aisel.aisnet.org/authorvideos.html" >Submit an Author-Video Here</a></li> </ul>    <div id="navcontainer"> <ul id="navlist"> <li class="sb-popular"> <a href="https://aisel.aisnet.org/trr/topdownloads.html" title="View the top downloaded papers" > Most Popular Papers </a> </li> <li class="sb-rss"> <a href="https://aisel.aisnet.org/trr/announcements.html" title="Receive notifications of new content" > Receive Email Notices or RSS </a> </li> </ul>   </div> <div class="sidebar-search"> <form method="post" action="https://aisel.aisnet.org/cgi/redirect.cgi" id="browse"> <label for="url"> Select a volume: </label> <br> <div> <span class="border"> <select name="url" id="url"> <option value="https://aisel.aisnet.org/trr/all_issues.html"> All Issues </option> <option value="https://aisel.aisnet.org/trr/vol9"> Vol. 9 </option> <option value="https://aisel.aisnet.org/trr/vol8"> Vol. 8 </option> <option value="https://aisel.aisnet.org/trr/vol7"> Vol. 7 </option> <option value="https://aisel.aisnet.org/trr/vol6"> Vol. 6 </option> <option value="https://aisel.aisnet.org/trr/vol5"> Vol. 5 </option> <option value="https://aisel.aisnet.org/trr/vol4"> Vol. 4 </option> <option value="https://aisel.aisnet.org/trr/vol3"> Vol. 3 </option> <option value="https://aisel.aisnet.org/trr/vol2"> Vol. 2 </option> <option value="https://aisel.aisnet.org/trr/vol1"> Vol. 1 </option> </select> <input type="submit" value="Browse" class="searchbutton" style="font-size:11px;"> </span> </div>  <div style="clear:left;"> </div> </form> <h2>Search</h2> <form method='get' action='https://aisel.aisnet.org/do/search/' id="sidebar-search"> <label for="search" accesskey="4"> Enter search terms: </label> <div> <span class="border"> <input type="text" name='q' class="search" id="search"> </span> <input type="submit" value="Search" class="searchbutton" style="font-size:11px;"> </div> <label for="context" class="visually-hidden"> Select context to search: </label> <div> <span class="border"> <select name="fq" id="context"> <option value='virtual_ancestor_link:"https://aisel.aisnet.org/trr"'>in this journal</option> <option value='virtual_ancestor_link:"https://aisel.aisnet.org"'>in this repository</option> <option value='virtual_ancestor_link:"http:/"'>across all repositories</option> </select> </span> </div> </form> <p class="advanced"> <a href="https://aisel.aisnet.org/do/search/advanced/?fq=virtual_ancestor_link:%22https://aisel.aisnet.org/trr%22" > Advanced Search </a> </p>  </div>   <div id="issn"> <p class="sb-issn">ISSN: 2473-3458</p> </div> <div class="clear"> </div>       <div id="sb-custom"> <ul class="sb-custom-ul"> <li class="sb-custom-li"> <a href="https://aisnet.org/page/MembershipBenefits" >Join AIS</a> </li> </ul> </div>   <div class="verticalalign"> </div> </div> </div> <div id="footer" role="contentinfo"> <div id="bepress"> <a href="https://www.elsevier.com/solutions/digital-commons" title="Elsevier - Digital Commons" > <em>Elsevier - Digital Commons</em> </a> </div>  <p> <a href="https://aisel.aisnet.org" title="Home page" accesskey="1" >Home</a> | <a href="https://aisel.aisnet.org/about.html" title="About" >About</a> | <a href="https://aisel.aisnet.org/faq.html" title="FAQ" >FAQ</a> | <a href="/cgi/myaccount.cgi?context=" title="My Account Page" accesskey="3" >My Account</a> | <a href="https://aisel.aisnet.org/accessibility.html" title="Accessibility Statement" accesskey="0" >Accessibility Statement</a> </p> <p> <a class="secondary-link" href="https://www.bepress.com/privacy" title="Privacy Policy" >Privacy</a> <a class="secondary-link" href="https://www.bepress.com/copyright" title="Copyright Policy" >Copyright</a> </p> </div>  </div> </div> </div> <script> (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); ga('create', 'UA-5499681-7', 'auto'); ga('create', 'UA-19199428-1', 'auto', {'name': 'newTracker'}); // Admin tracker. ga('send', 'pageview'); ga('newTracker.send', 'pageview'); // Send page view for admin tracker. </script>  <script type='text/javascript' src='/assets/scripts/bpbootstrap-20160726.pack.js'></script><script type='text/javascript'>BPBootstrap.init({appendCookie:''})</script></body></html>