article

What Happens When Evaluation Goes Online? Exploring Apparatuses of Valuation in the Travel Sector

Organization Science, Volume 25, Issue 3

Pages 868 - 891

https://doi.org/10.1287/orsc.2013.0877

Published: 01 June 2014 Publication History

Abstract

<P>Our research focuses on the fast-changing landscape of contemporary social media where user-generated content is increasingly being used to evaluate a wide range of products and services. The move to online valuations is raising important questions about how valuations change when they are produced online by consumers and what outcomes they generate for the organizations being evaluated. To address these questions, we investigate two prominent hotel valuation schemes currently at work in the hospitality industry, and we identify significant differences in their valuation practices and outcomes. We develop a practice-based lens for examining the materiality of valuations, providing a way of understanding the differences we observed in terms of performativity. This lens explains both how valuations are actively produced in ongoing practice and how their production is significantly reconfiguring everyday practices of the organizations being evaluated. We conclude by considering the implications of our findings for research on valuation and organizations.</P>

References

[1]

Austin JL (1962) How to Do Things with Words (Clarendon Press, Oxford, UK).

[2]

Barad K (1998) Getting real: Technoscientific practices and the materialization of reality. Differences 10(2):87-128.

[3]

Barad K (2003) Posthumanist performativity: Toward an understanding of how matter comes to matter. Signs 28(3):801-831.

[4]

Barad K (2007) Meeting the University Halfway: Quantum Physics and the Entanglement of Matter and Meaning (Duke University Press, Durham, NC).

[5]

Barley SR (1986) Technology as an occasion for structuring: Evidence from observations of CT scanners and the social order of radiology departments. Admin. Sci. Quart. 31(1):78-108.

[6]

Barley SR, Meyerson DE, Grodal S (2011) E-mail as a source and symbol of stress. Organ. Sci. 22(4):887-906.

Digital Library

[7]

Bohr NHD (1963 [1929]) The Philosophical Writings of Niels Bohr: Vol. 1, Atomic Theory and the Description of Nature (Ox Bow Press, Woodbridge, CT).

[8]

Boudreau MC, Robey D (2005) Enacting integrated information technology: A human agency perspective. Organ Sci. 16(1):3-18.

Digital Library

[9]

Bowker GC, Star SL (1999) Sorting Things Out: Classification and Its Consequences (MIT Press, Cambridge, MA).

[10]

Butler J (2010) Performative agency. J. Cultural Econom. 3(2): 147-161.

[11]

Callon M (2007) What does it mean to say that economics is performative? MacKenzie D, Muniesa F, Siu L, eds. Do Economists Make Markets? On the Performativity of Economics (Princeton University Press, Princeton, NJ), 311-357.

[12]

Callon M, Muniesa F (2005) Economic markets as calculative collective devices. Organ. Stud. 26(8):1229-1250.

[13]

Casile M, Davis-Blake A (2002) When accreditation standards change: Factors affecting differential responsiveness of public and private organizations. Acad. Management J. 45(1):180-195.

[14]

Cooren F, Fairhurst GT, Huët R (2012) Why matter always matters in (organizational) communication. Leonardi PM, Nardi BA, Kallinikos J, eds. Materiality and Organizing: Social Interaction in a Technological World (Oxford University Press, Oxford, UK), 296-314.

[15]

Corley K, Gioia D (2000) The rankings game: Managing business school reputation. Corporate Reputation Rev. 3(4):319-333.

[16]

Covaleski MA, Dirsmith MW, Heian JB, Samuel S (1998) The calculated and the avowed: Techniques of discipline and struggles over identity in big six public accounting firms. Admin. Sci. Quart. 43(2):293-327.

[17]

Dougherty D (2002) Grounded theory building: Some principles and practices. Baum JAC, ed. Companion to Organizations (Blackwell Publishers, Oxford, UK), 849-867.

[18]

Elsbach KD, Kramer RM (1996) Members' responses to organizational identity threats: Encountering and countering the Business Week rankings. Admin. Sci. Quart. 41(3):442-476.

[19]

Espeland WN, Sauder M (2007) Ranking and reactivity: How public measures recreate social worlds. Amer. J. Sociol. 113(1):1-40.

[20]

Espeland WN, Stevens ML (1998) Commensuration as a social process. Annual Rev. Sociol. 24:313-343.

[21]

Espeland WN, Stevens ML (2008) A sociology of quantification. Eur. J. Sociol. 49(3):401-436.

[22]

Feldman MS, Orlikowski WJ (2011) Theorizing practice and practicing theory. Organ. Sci. 22(5):1240-1253.

Digital Library

[23]

Fitzgerald M (2009) The AA logo tops ranking of brands by colour recall. Marketing (October 3) www.marketingmazagine.co.uk/article/888532/aa-logo-tops-ranking-brands-colour-recall.

[24]

Fleischer A (2009) Ambiguity and the equity of rating systems: United States brokerage firms, 1995-2000. Admin. Sci. Quart. 54(4):555-574.

[25]

Frommer A (2010) Brit publications waging battle against Trip-Advisor. Palm Beach Post (September 12).

[26]

Garud R, Rappa MA (1994) A socio-cognitive model of technology evolution: The case of cochlear implants. Organ. Sci. 5(3):344-362.

Digital Library

[27]

Geertz C (1973) The Interpretation of Cultures (Basic Books, New York).

[28]

Gioia DA, Corley KG (2002) Being good versus looking good: Business school rankings and the Circean transformation from substance to image. Acad. Management Learn. Ed. 1(1):107-120.

[29]

Glynn MA, Lounsbury M (2005) Logic blending, discursive change and authenticity in a cultural production system. J. Management Stud. 42(5):1031-1055.

[30]

Hacking I (1990) The Taming of Chance (Cambridge University Press, Cambridge, UK).

[31]

Hastings R (2011) Hotel star system to lose official backing. Independent (January 24) http://www.independent.co.uk/travel/news-and-advice/hotel-star-system-to-lose-official-backing-2192474.html.

[32]

Hsu G (2006) Evaluative schemas and the attention of critics in the US film industry. Indust. Corporate Change 15(3):467-496.

[33]

Hsu G, Roberts PW, Swaminathan A (2012) Evaluative schemas and the mediating role of critics. Organ. Sci. 23(1):83-97.

Digital Library

[34]

Huber GP (1990) A theory of the effects of advanced information technologies on organizational design, intelligence, and decision making. Acad. Management Rev. 15(1):47-71.

[35]

Iedema R (2007) On the multi-modality, materiality and contingency of organizational discourse. Organ. Stud. 28(6):931-946.

[36]

Introna LD (2011) The enframing of code: Agency, originality and the plagiarist. Theory, Culture Soc. 28(6):113-141.

[37]

Jeacle I, Carter C (2011) In TripAdvisor we trust: Rankings, calculative regimes and abstract systems. Accounting, Organ. Soc. 3(4-5):293-309.

[38]

Karpik L (2010) Valuing the Unique: The Economics of Singularities (Princeton University Press, Princeton, NJ).

[39]

Kaufer S (2011) General impacts and success stories: The Trip-Advisor story. Presentation, MIT Sloan School of Management, March 8, Cambridge, MA.

[40]

Knorr Cetina K (1997) Sociality with objects: Social relations in post-social knowledge societies. Theory, Culture Soc. 14(4):1-30.

[41]

Kühn K (2007) UK consumers use online reviews to decide hotel and restaurant booking. Caterer Hotelkeeper (June 8) http://www.catererandhotelkeeper.co.uk/articles/8/6/2007/314259/uk-consumers-use-online-reviews-to-decide-hotel-and-restaurant-booking.htm.

[42]

Latour B (2005) Reassembling the Social: An Introduction to Actor-Network-Theory (Oxford University Press, Oxford, UK).

[43]

Leonardi PM (2011) When flexible routines meet flexible technologies: Affordance, constraint, and the imbrication of human and material agencies. MIS Quart. 35(1):147-167.

Digital Library

[44]

Leonardi PM, Barley SR (2010) What's under construction here? Social action, materiality, and power in constructivist studies of technology and organizing. Acad. Management Ann. 4(1):1-51.

[45]

Livingstone J (2007) Stephen Kaufer: Cofounder, TripAdvisor. Founders at Work: Stories of Startups' Early Days (Apress, Berkeley, CA), 361-375.

[46]

MacKenzie D, Muniesa F, Sui L, eds. (2007) Do Economists Make Markets? On the Performativity of Economics (Princeton University Press, Princeton, NJ).

[47]

Martins LL (2005) A model of the effects of reputational rankings on organizational change. Organ. Sci. 16(6):701-720.

Digital Library

[48]

Mazmanian M, Orlikowski WJ, Yates J (2013) The autonomy paradox: The implications of wireless email devices for knowledge professionals. Organ. Sci. 24(5):1337-1357.

[49]

Miller P, Rose N (2008) Governing the Present: Administering Economic Social and Personal Life (Polity Press, Cambridge, UK).

[50]

Mol A (2002) The Body Multiple: Ontology in Medical Practice (Duke University Press, Durham, NC).

[51]

Munro R, Mouritsen J, eds. (1996) Accountability: Power, Ethos and the Technologies of Managing (International Thomson Business Press, London).

[52]

Nyberg D (2009) Computers, customer service operatives and cyborgs: Intra-actions in call centres. Organ. Stud. 30(11): 1181-1199.

[53]

Orlikowski WJ (2000) Using technology and constituting structures. Organ. Sci. 11(4):404-428.

Digital Library

[54]

Orlikowski WJ (2007) Sociomaterial practices: Exploring technology at work. Organ. Stud. 28(9):1435-1448.

[55]

Orlikowski WJ (2010) The sociomateriality of organizational life: Considering technology in management research. Cambridge J. Econom. 34(1):125-141.

[56]

Orlikowski WJ, Scott SV (2008) Sociomateriality: Challenging the separation of technology, work and organization. Ann. Acad. Management 2(1):433-474.

[57]

Pentland BT (2000) Will auditors take over the world? Program, technique and the verification of everything. Accounting, Organ. Soc. 25(3):307-312.

[58]

Pickering A (1995) The Mangle of Practice: Time, Agency and Science (University of Chicago Press, Chicago).

[59]

Pinch T (2008) Technology and institutions: Living in a material world. Theory Soc. 37(5):461-483.

[60]

Power M (1994) The Audit Explosion (Demos, London).

[61]

Power M (1997) The Audit Society: Rituals of Verification (Oxford University Press, Oxford, UK).

[62]

Rao H (1994) The social construction of reputation: Certification contests, legitimation, and the survival of organizations in the American automobile industry: 1895-1912. Strategic Management J. 15(S1):29-44.

[63]

Rao H, Monin P, Durand R (2003) Institutional change in Toque Ville: Nouvelle cuisine as an identity movement in French gastronomy. Amer. J. Sociol. 108(4):795-843.

[64]

Schatzki TR (2002) The Site of the Social: A Philosophical Account of the Constitution of Social Life and Change (Pennsylvania State University Press, University Park, PA).

[65]

Sauder M, Espeland WN (2006) Strength in numbers? The advantages of multiple rankings. Indiana Law J. 81(1):205-227.

[66]

Sauder M, Espeland WN (2009) The discipline of rankings: Tight coupling and organizational change. Amer. Sociol. Rev. 74(1):63-82.

[67]

Schatzki TR (2002) The Site of the Social: A Philosophical Account of the Constitution of Social Life and Change (Pennsylvania State University Press, University Park, PA).

[68]

Schultz M, Mouritsen J, Gabrielsen G (2001) Sticky reputation: Analyzing a ranking system. Corporate Reputation Rev. 4(1):24-43.

[69]

Smith O (2013a) TripAdvisor fails to spot fake restaurant. Telegraph (July 25) http://www.telegraph.co.uk/travel/travelnews/ 10201754/TripAdvisor-fails-to-spot-fake-restaurant.html.

[70]

Smith O (2013b) TripAdvisor reviewer exposed as hotel executive. Telegraph (May 24) http://www.telegraph.co.uk/travel/travelnews/10076753/TripAdvisor-reviewer-exposed-as-hotel-executive.html.

[71]

Stanford D (2013) Coke engineers its orange juice--With an algorithm. Bloomberg Businessweek (January 31) http://www.businessweek.com/articles/2013-01-31/coke-engineers-its-orange-juice-with-an-algorithm.

[72]

Starmer-Smith C (2010) TripAdvisor reviews: Can we trust them? Telegraph (October 8) http://www.telegraph.co.uk/travel/hotels/8050127/Tripadvisor-reviews-can-we-trust-them.html.

[73]

Stellin S (2010) Hoteliers look to shield themselves from dishonest online reviews. New York Times (October 25) http://www.nytimes.com/2010/10/26/business/26hotels.html.

[74]

Strathern M (2000) The tyranny of transparency. Brit. Educational Res. J. 26(3):309-321.

[75]

Strauss A, Corbin J (1990) Basics of Qualitative Research: Grounded Theory, Procedures, and Techniques (Sage, Newbury Park, CA).

[76]

Streitfeld D (2012) The best book reviews money can buy. New York Times (August 25), http://www.nytimes.com/2012/08/26/business/book-reviewers-for-hire-meet-a-demand-for-online-raves.html.

[77]

Suchman LA (2007) Human-Machine Reconfigurations (Cambridge University Press, Cambridge, UK).

[78]

Tsoukas H (1998) The word and the world: A critique of representationalism in management research. Internat. J. Public Admin. 21(5):781-817.

[79]

Tushman M, Anderson P (1986) Technological discontinuities and organizational environments. Admin. Sci. Quart. 31(3):439-465.

[80]

Vaast E, Walsham G (2005) Representations and actions: The transformation of work practices with IT use. Inform. Organ. 15(1):65-89.

Digital Library

[81]

Waguespack DM, Sorenson O (2011) The ratings game: Asymmetry in classification. Organ. Sci. 22(3):541-553.

Digital Library

[82]

Zammuto RF, Griffith TL, Majchrzak A, Dougherty DJ, Faraj S (2007) Information technology and the changing fabric of organization. Organ. Sci. 18(5):749-762.

Digital Library

[83]

Zhao W (2005) Understanding classifications: Empirical evidence from the American and French wine industries. Poetics 33(3-4): 179-200.

[84]

Zhao W, Zhou X (2011) Status inconsistency and product valuation in the California wine market. Organ. Sci. 22(6):1435-1448.

Digital Library

Cited By

Seredko AHillman T(2024)What Does a Downvote Do? Performing Complementary and Competing Knowledge Practices on an Online PlatformProceedings of the ACM on Human-Computer Interaction10.1145/36536928:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653692
Cepa KSchildt H(2023)Data-Induced Rationality and Unitary Spaces in Interfirm CollaborationOrganization Science10.1287/orsc.2021.156634:1(129-155)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1287/orsc.2021.1566
Shaikh MVaast E(2023)Algorithmic Interactions in Open Source WorkInformation Systems Research10.1287/isre.2022.115334:2(744-765)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1287/isre.2022.1153
Show More Cited By

Recommendations

On becoming a sociomaterial researcher: Exploring epistemological practices grounded in a relational, performative ontology
Abstract
What is the role of the researcher in a world that is continuously enacted and reconfigured in sociomaterial practices, a world in which subject and object, structure and agency, body and mind, knower and known, are assumed to be ...
Highlights
- The paper contributes to the development of epistemological practices available to draw upon for researchers assuming a sociomaterial approach.
The algorithm and the crowd: considering the materiality of service innovation

This special issue acknowledges important innovations in the world of service and within this domain we are particularly interested in exploring the rise and influence of web-based crowd-sourcing and algorithmic rating and ranking mechanisms. We suggest ...
How social media disrupts institutions: Exploring the intersection of online disinformation, digital materiality and field-level change
Abstract
The diffusion of disinformation via social media has become a pressing societal concern for business leaders and policy makers. In recent years, online disinformation has been implicated as a source of field-level institutional change across a ...
Highlights
- Individuals circulate online disinformation to disrupt institutions.
- Three aspects of digital materiality contribute to disinformation.
- Digital materiality affords users opportunities to create and spread disinformation.
- ...

Comments

Information & Contributors

Information

Published In

cover image Organization Science

Organization Science Volume 25, Issue 3

June 2014

315 pages

ISSN:1526-5455

Issue’s Table of Contents

Publisher

INFORMS

Linthicum, MD, United States

Publication History

Published: 01 June 2014

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Seredko AHillman T(2024)What Does a Downvote Do? Performing Complementary and Competing Knowledge Practices on an Online PlatformProceedings of the ACM on Human-Computer Interaction10.1145/36536928:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653692
Cepa KSchildt H(2023)Data-Induced Rationality and Unitary Spaces in Interfirm CollaborationOrganization Science10.1287/orsc.2021.156634:1(129-155)Online publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1287/orsc.2021.1566
Shaikh MVaast E(2023)Algorithmic Interactions in Open Source WorkInformation Systems Research10.1287/isre.2022.115334:2(744-765)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1287/isre.2022.1153
Bailey DFaraj SHinds PLeonardi Pvon Krogh G(2022)We Are All Theorists of Technology NowOrganization Science10.1287/orsc.2021.156233:1(1-18)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1287/orsc.2021.1562
Cameron LRahman H(2022)Expanding the Locus of ResistanceOrganization Science10.1287/orsc.2021.155733:1(38-58)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1287/orsc.2021.1557
Alaimo CKallinikos J(2022)Organizations DecenteredOrganization Science10.1287/orsc.2021.155233:1(19-37)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1287/orsc.2021.1552
Karunakaran AOrlikowski WScott S(2022)Crowd-Based AccountabilityOrganization Science10.1287/orsc.2021.154633:1(170-193)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1287/orsc.2021.1546
Pentland BYoo YRecker JKim I(2022)From Lock-In to TransformationOrganization Science10.1287/orsc.2021.154333:1(194-211)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1287/orsc.2021.1543
Kellogg K(2022)Local Adaptation Without Work IntensificationOrganization Science10.1287/orsc.2021.144533:2(571-599)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1287/orsc.2021.1445
Scott SOrlikowski W(2022)The Digital UndertowInformation Systems Research10.1287/isre.2021.105633:1(311-336)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1287/isre.2021.1056
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents