Person: Lakhani, Karim
Loading...
Email Address
AA Acceptance Date
Birth Date
Research Projects
Organizational Units
Job Title
Last Name
Lakhani
First Name
Karim
Name
Lakhani, Karim
17 results
Search Results
Now showing 1 - 10 of 17
Publication Consuming Contests: The Effect of Outcome Uncertainty on Spectator Attendance in the Australian Football League(Wiley, 2023-05-08) Ferguson, Patrick; Lakhani, KarimContests that non‐contestants consume for entertainment are a fixture of economic, cultural and political life. We exploit injury‐induced changes to teams' line‐ups in a professional sports setting to examine whether individuals prefer to consume contests that have more uncertain outcomes. Studying data from the Australian Football League, we use an instrumental variables design to show that a one standard deviation increase in game outcome uncertainty causes, on average, an 11.2 per cent increase in attendance. When presented alongside ordinary least square's estimates, our results suggest that previous studies may heavily underestimate spectators' preferences for evenly balanced contests.Publication Innovation Experiments: Researching Technical Advance, Knowledge Production and the Design of Supporting Institutions(2015-07-21) Boudreau, Kevin Joseph; Lakhani, KarimThis paper discusses several challenges in designing field experiments to better understand how organizational and institutional design shapes innovation outcomes and the production of knowledge. We proceed to describe the field experimental research program carried out by our Crowd Innovation Laboratory at Harvard University to clarify how we have attempted to address these research design challenges. This program has simultaneously solved important practical innovation problems for partner organizations, like NASA and Harvard Medical School, while contributing research advances, particularly in relation to innovation contests and tournaments.Publication Cumulative Innovation & Open Disclosure of Intermediate Results: Evidence from a Policy Experiment in Bioinformatics(2014-01-13) Boudreau, Kevin; Lakhani, KarimRecent calls for greater openness in our private and public innovation systems have particularly urged for more open disclosure and granting of access to intermediate works–early results, algorithms, materials, data and techniques–with the goals of enhancing overall research and development productivity and enhancing cumulative innovation. To make progress towards understanding implications of such policy changes we devised a large-scale field experiment in which 733 subjects were divided into matched independent subgroups to address a bioinformatics problem under either a regime of open disclosure of intermediate results or, alternatively, one of closed secrecy around intermediate solutions. We observe the cumulative innovation process in each regime with fine-grained measures and are able to derive inferences with a series of cross-sectional comparisons. Open disclosures led to lower participation and lower effort but nonetheless led to higher average problem-solving performance by concentrating these lesser efforts on the most performant technical approaches. Closed secrecy produced higher participation and higher effort, while producing less correlated choices of technical approaches that participants pursued, resulting in greater individual and collective experimentation and greater dispersion of performance. We discuss the implications of such changes to the ongoing theory, evidence and policy considerations with regards to cumulative innovation.Publication From Crowds to Collaborators: Initiating Effort & Catalyzing Interactions Among Online Creative Workers(2014-04-24) Boudreau, Kevin; Gaule, Patrick; Lakhani, Karim; Riedl, Christoph; Woolley, Anita WilliamsOnline collaborative platforms have emerged as a complementary approach to traditional organizations for coordinating the collective efforts of creative workers. However, it is surprising that they result in any productive output as individuals often work without direct monetary incentives while collaborating with unknown others. In this paper, we distinguish the conditions necessary for eliciting effort from those affecting the quality of interdependent teamwork. We consider the role of incentives versus social processes in catalyzing collaboration. We test our hypotheses using a unique data set of 260 individuals randomly assigned to 52 teams tasked with developing working solutions to a complex innovation problem over 10 days, with varying monetary incentives. We find that levels of effort are driven by cash incentives and the presence of other interacting teammates. The level of collaboration, by contrast, was not sensitive to cash incentives. Instead, individuals increased their communication if teammates were also actively participating. Additionally, team performance is uniquely driven by the level of emergent interdependence, as indexed by the diversity of topics discussed and the temporal coordination of activity in short focused time periods. Our results contribute to the literature on how alternative organizational forms can be designed to solve complex innovation tasks.Publication Performance Responses to Competition Across Skill-Levels in Rank Order Tournaments: Field Evidence and Implications for Tournament Design(2014-01-13) Boudreau, Kevin; Lakhani, Karim; Menietti, MichaelTournaments are widely used in the economy to organize production and innovation. We study individual contestant-level data from 2,796 contestants in 774 software algorithm design contests with random assignment. Precisely conforming to theory predictions, the performance response to added contestants varies non-monotonically across contestants of different abilities, most respond negatively to competition, and highest-skilled contestants respond positively. In counterfactual simulations, we interpret a number of tournament design policies (number of competitors, prize allocation and structure, divisionalization, open entry) as a means of reconciling non-monotonic incentive responses to competition, effectively manipulating the number and skills distribution of contestants facing one another.Publication Stepwise Distributed Open Innovation Contests for Software Development: Acceleration of Genome-Wide Association Analysis(Oxford University Press, 2017) Hill, Andrew; Loh, Po-Ru; Bharadwaj, Ragu B.; Pons, Pascal; Shang, Jingbo; Guinan, Eva; Lakhani, Karim; Kilty, Iain; Jelinsky, Scott A.Abstract Background: The association of differing genotypes with disease-related phenotypic traits offers great potential to both help identify new therapeutic targets and support stratification of patients who would gain the greatest benefit from specific drug classes. Development of low-cost genotyping and sequencing has made collecting large-scale genotyping data routine in population and therapeutic intervention studies. In addition, a range of new technologies is being used to capture numerous new and complex phenotypic descriptors. As a result, genotype and phenotype datasets have grown exponentially. Genome-wide association studies associate genotypes and phenotypes using methods such as logistic regression. As existing tools for association analysis limit the efficiency by which value can be extracted from increasing volumes of data, there is a pressing need for new software tools that can accelerate association analyses on large genotype-phenotype datasets. Results: Using open innovation (OI) and contest-based crowdsourcing, the logistic regression analysis in a leading, community-standard genetics software package (PLINK 1.07) was substantially accelerated. OI allowed us to do this in <6 months by providing rapid access to highly skilled programmers with specialized, difficult-to-find skill sets. Through a crowd-based contest a combination of computational, numeric, and algorithmic approaches was identified that accelerated the logistic regression in PLINK 1.07 by 18- to 45-fold. Combining contest-derived logistic regression code with coarse-grained parallelization, multithreading, and associated changes to data initialization code further developed through distributed innovation, we achieved an end-to-end speedup of 591-fold for a data set size of 6678 subjects by 645 863 variants, compared to PLINK 1.07's logistic regression. This represents a reduction in run time from 4.8 hours to 29 seconds. Accelerated logistic regression code developed in this project has been incorporated into the PLINK2 project. Conclusions: Using iterative competition-based OI, we have developed a new, faster implementation of logistic regression for genome-wide association studies analysis. We present lessons learned and recommendations on running a successful OI process for bioinformatics.Publication Field Evidence on Individual Behavior & Performance in Rank-Order Tournaments(2012-09-04) Boudreau, Kevin; Helfat, Constance E.; Lakhani, Karim; Menietti, MichaelEconomic analysis of rank-order tournaments has shown that intensified competition leads to declining performance. Empirical research demonstrates that individuals in tournament-type contests perform less well on average in the presence of larger number of competitors in total and superstars. Particularly in field settings, studies often lack direct evidence about the underlying mechanisms, such as the amount of effort, that might account for these results. Here we exploit a novel dataset on algorithmic programming contests that contains data on individual effort, risk taking, and cognitive errors that may underlie tournament performance outcomes. We find that competitors on average react negatively to an increase in the total number of competitors, and react more negatively to an increase in the number of superstars than non-superstars. We also find that the most negative reactions come from a particular subgroup of competitors: those that are highly skilled, but whose abilities put them near to the top of the ability distribution. For these competitors, we find no evidence that the decline in performance outcomes stems from reduced effort or increased risk taking. Instead, errors in logic lead to a decline in performance, which suggests a cognitive explanation for the negative response to increased competition. We also find that a small group of competitors, who are at the very top of the ability distribution (non-superstars), react positively to increased competition from superstars. For them, we find some evidence of increased effort and no increase in errors of logic, consistent with both economic and psychological explanations.Publication Colocation and Scientific Collaboration: Evidence from a Field Experiment(2012-09-04) Boudreau, Kevin; Ganguli Prokopovych, Ina; Gaule, Patrick; Guinan, Eva; Lakhani, KarimWe present the results of a field experiment conducted within the Harvard Medical School system of hospitals and research centers to understand how colocation impacts the likelihood of scientific collaboration. We introduce exogenous colocation and face-to-face interactions for a random subset of biomedical researchers responding to an opportunity to apply for a research grant. While the overall baseline likelihood of any two researchers collaborating is small, we find that random colocation significantly increases the likelihood of pair-level co-application by almost 70%. The effect of exogenous colocation on subsequent collaboration was greater for previous coauthors, pairs including a woman, and pairs researching similar clinical areas. Our results suggest that matching between scientists may be subject to considerable frictions—even among those in relatively close geographic proximity and in the same organizational system. At the same time, even a brief and focused intervention facilitating face-to-face interactions can provide information that impacts the formation of scientific collaborations.Publication The Novelty Paradox & Bias for Normal Science: Evidence from Randomized Medical Grant Proposal Evaluations(2012-12-06) Boudreau, Kevin; Guinan, Eva; Lakhani, Karim; Riedl, ChristophCentral to any innovation process is the evaluation of proposed projects and allocation of resources. We investigate whether novel research projects, those deviating from existing research paradigms, are treated with a negative bias in expert evaluations. We analyze the results of a peer review process for medical research grant proposals at a leading medical research university, in which we recruited 142 expert university faculty members to evaluate 150 submissions, resulting in 2,130 randomly-assigned proposal-evaluator pair observations. Our results confirm a systematic penalty for novel proposals; a standard deviation increase in novelty drops the expected rank of a proposal by 4.5 percentile points. This discounting is robust to various controls for unobserved proposal quality and alternative explanations. Additional tests suggest information effects rather than strategic effects account for the novelty penalty. Only a minority of the novelty penalty could be related to perceptions of lesser feasibility of novel proposals.Publication Marginality and Problem Solving Effectiveness in Broadcast Search(Institute for Operations Research and the Management Sciences (INFORMS), 2009) Jeppesen, Lars Bo; Lakhani, KarimWe examine who the winners are in science problem solving contests characterized by open broadcast of problem information, self-selection of external solvers to discrete problems from the laboratories of large R&D intensive companies and blind review of solution submissions. Analyzing a unique dataset of 166 science challenges involving over 12,000 scientists revealed that technical and social marginality, being a source of different perspectives and heuristics, plays an important role in explaining individual success in problem solving. The provision of a winning solution was positively related to increasing distance between the solver’s field of technical expertise and the focal field of the problem. Female solvers – known to be in the “outer circle” of the scientific establishment - performed significantly better than men in developing successful solutions. Our findings contribute to the emerging literature on open and distributed innovation by demonstrating the value of openness, at least narrowly defined by disclosing problems, in removing barriers to entry to non-obvious individuals. We also contribute to the knowledge-based theory of the firm by showing the effectiveness of a market-mechanism to draw out knowledge from diverse external sources to solve internal problems.