Sunday, November 8, 2015

Paper Review: Notes from "Using thematic analysis in psychology"

#Title#
Using thematic analysis in psychology

#Authors#
Virginia Braun & Victoria Clarke

#Venue#
Qualitative Research in Psychology

#DOI#
http://dx.doi.org/10.1191/1478088706qp063oa

#Abstract#
Thematic analysis is a poorly demarcated, rarely acknowledged, yet widely used qualitative analytic method within psychology. In this paper, we argue that it offers an accessible and theoretically flexible approach to analysing qualitative data. We outline what thematic analysis is, locating it in relation to other qualitative analytic methods that search for themes or patterns, and in relation to different epistemological and ontological positions. We then provide clear guidelines to those wanting to start thematic analysis, or conduct it in a more deliberate and rigorous way, and consider potential pitfalls in conducting thematic analysis. Finally, we outline the disadvantages and advantages of thematic analysis. We conclude by advocating thematic analysis as a useful and flexible method for qualitative research in and beyond psychology. 

#Comments#

Useful paper to plug the gap of the absence of an introductory paper on thematic analysis for non-qualitative researchers.  While I do have problems with this as a technique in contrast to quantitative methods that I have usually used in either software engineering, computer graphics or otherwise, it does enable contextualisation of the thoughts of participants in user studies.

Reading starts here:

Seems to be a lack of consensus on the placement of thematic analysis, is or is not a specific method.  The authors argue it is a specific method.

They argue that it is to be well defined in this paper, without restricting its flexibility.

Corpus refers to all data, while data set is the data to be used in analysis.  

Key Point - "Thematic analysis is a method for identifying, analysing and reporting patterns (themes) within data." Obvious, but it has to be stated.

They claim that it is a method of analysis, and that other named approaches are essentially still a form of thematic analysis.

They comment that themes should not emerge; this is a passive approach, denying the place of the researcher.  They say that themes reside in our head from our thinking about the data.  ME: I wonder if it is a product of an interaction with the data, which probably puts me into a social constructivist position.  Does the data turn into an entity in my phenomenological experience.  No, that is too silly.  But, one could imagine that I am giving the data some agency in some way.  Something to think about...

"What counts as a theme? A theme captures something important about the data in relation to the research question, and represents some level of patterned response or meaning within the data set."

They suggest there is no hard percentage of data that establishes a theme; ME: can this get any more vague?  This suggests no standard computational component to thematic analysis.  Though they suggest prevalence as a heuristic approach.  I guess one instance is disproving evidence of the absence of that instance in the rest of the cohort.

"Part of the flexibility of thematic analysis is that it allows you to determine themes (and prevalence) in a number of ways. What is important is that you are consistent in how you do this within any particular analysis."

ME: I am struggling here.  How do you take a measurement without a clear comparable metric that generalises to other cohorts?  While I get the primacy of consistency, one can be consistently wrong as well.

They then compare and contrast the top down theoretical approaches to bottom up inductive processes.  Inductive is considered richer, top down is more detailed analysis of a particular theme.

Semantic or latent themes.  Semantic is more of an analysis of the themes present in the data prima facie, while latent analysis looks for underlying ideas from the themes; thus is more interpretive.  They also note it is more constructivist, but is not necessarily completely constructivist. ME: man, my poor quantitative brain is struggling a little here. :-)  while I get that phenomenological outcomes are going to be inexact and dynamic, I am finding this a little hard going. 

"Those approaches which consider specific aspects, latent themes and are constructionist tend to often cluster together, while those that consider meanings across the whole data set, semantic themes, and are realist, often cluster together."

There are 6 guidelines (not rules, of course! :-))  With some comments or extracts from their descriptions of these phases.

1. Familiarizing yourself with your data:
2. Generating initial codes:
3. Searching for themes:
4. Reviewing themes:
5. Defining and naming themes:
6. Producing the report:

Phase 1

They recommend re-reading data.  Mark down codes now, as part of an interpretive process.  Make sure not to process transcriptions, as punctuation can matter at this stage.   Interestingly they suggest to personally transcribe (my IS school hires people) in order to develop deep reading skills.  Good point.

Phase 2

"remember that you can code individual extracts of data in as many different ‘themes’ as they fit into 􏰀/ so an extract may be uncoded, coded once, or coded many times, as relevant."  ME: This seems to be an m-to-m mapping for themes.  I would need an example, but if many themes use elements that reappear, then that must be problematic for identification of themes as entities.  Just seems too incoherent.

Phase 3

Key point, do not throw out any themes, just keep them in the basket for later.

Phase 4 

Make sure your themes fit all the data; which to me is almost impossible, but may work as an inexact process.

Stop refining when there is no new contribution to the themes.  ME: Almost a embedded grounded theory exercise.

Phase 5

The key point to take home is the need for the themes to be an essential description of the data, with a punchy and clear title for communicating the ideas.

Phase 6

The report provides sufficient evidence of the presence of the themes within the data set analysed.

Needs to go beyond description to make an argument about the data analysed.  ME: Key point here.

Common Problems

Lack of actual analysis - obvious, but I have seen it a lot in tool evaluations.  Maybe because the response to the tool is not expected to be that complex?

"The third is a weak or unconvincing analysis, where the themes do not appear to work, where there is too much overlap between themes, or where the themes are not internally coherent and consistent."

Avoid:

"‘anecdotalism’ in qualitative research 􏰀/ where one or a few instances of a phenomenon are reified into a pattern or theme, when it or they are actually idiosyncratic."

Consider alternative thematic explanations in the analysis, to show deep insight into the data and its context.

"One of the criticisms of qualitative research from those outside the field is the perception that ‘anything goes’." ME: The authors have insight! :-) 

As can be seen by my comments, I have some skepticism about the results of such thematic analysis.  However, I do give it validity for its ability to contextualise quantitative results.  I aim to do that with more rigour in the future in my research, as my work usually involves software tool analysis.

#ImportantRefs#

Thursday, November 5, 2015

Paper: Exploring collaborative modeling of business processes on large interactive touch display walls

Workshop paper and related ITS poster has been uploaded to eprints.  Will be presented on the 15th Nov. at ITS 2015 and related CMIS workshop.  Is part of a collaboration with University of Bochum, supported by IFE  @ QUT.

Ross

Wednesday, November 4, 2015

Boast: QUT Games Project Download Links

Last Wednesday night we had our BGIE Industry Showcase in P Block @ QUT.  Great night, with heaps of gameplay.  But, even if you missed the event, you can play the games!  All the links to the student projects follow.  So knock yourself out and play my students' games.  You won't be disappointed. :-)

Archmage - http://www.indiedb.com/games/archmage/downloads/archmage
Endpoint - http://www.indiedb.com/games/endpoint/downloads/endpoint
Heroes of Yggdrasil - http://www.indiedb.com/games/heroes-of-yggdrasil/downloads/heroes-of-yggrasil
Overground - http://www.indiedb.com/games/overground/downloads/overground
The Skeleton War - http://www.indiedb.com/games/the-skeleton-war/downloads/the-skeleton-war
Curse of Excalibur - https://play.google.com/store/apps/details?id=com.TeamMonoXTreme.CurseOfExcalibur
The Library - http://www.indiedb.com/games/the-library-4dminds/downloads/the-library1
Solitude Station - http://www.indiedb.com/games/solitude-station/downloads/solitude-station-104
M is for Mutant - http://www.indiedb.com/games/m-is-for-mutant/downloads/m-is-for-mutant-101
Right To Rule - http://www.indiedb.com/games/right-to-rule/downloads/right-to-rule
Capacitor - http://www.indiedb.com/games/capacitor/downloads/capacitor2
League of Metal Men - http://www.indiedb.com/games/the-league-of-metal-men/downloads/the-league-of-metal-men
Cube Commander - https://play.google.com/store/apps/details?id=com.PlaceHolderProductions.CubeCommander2
Barnyard Revolution - http://www.indiedb.com/games/barnyard-revolution/downloads/barnyard-revolution-pc1
Icarus - http://www.indiedb.com/games/icarus-by-maximum-crinkle-games/downloads/icarus-v104

Good to also see the "The Skeleton War" and "M is for Mutant" have been featured on the banner of IndiDB and are still in the Top 100 after a number of weeks.

Way to go guys!

Ross

Video: Large Scale Multi-touch Process Modelling @ QUT

Link to a video showing the full feature set of our large scale process modeller.  Video was made for a workshop paper at ITS 2015, to appear soon on this blog.

Great work by the team: Erik, Fortune, Artem, Alex and Matt!

Ross

Sunday, October 11, 2015

Video: Our Elicitation Research on ABC TV in Australia!

Woot!  Our virtual world expert elicitation research has just been shown on ABC QLD TV.  Footage of our work commences at the 25 minute mark: http://ab.co/1K1CsOt (available to Australian IP addresses only).

Ross

Sunday, August 9, 2015

CFP: 11th International Symposium on Visual Computing (ISVC'15) http://www.isvc.net

CALL FOR PAPERS
11th International Symposium on Visual Computing (ISVC'15)

December 14-16, 2015
Monte Carlo Resort & Casino
Las Vegas, Nevada, USA

ISVC provides a common forum for researchers, scientists, engineers and practitioners to present their latest research findings, ideas, developments and applications in visual computing. We seek papers contributing to the state of the art and practice in any of the four central areas of visual computing: (1) computer vision, (2) computer graphics, (3) virtual reality, and (4) visualization.  Of particular interest are papers that combine technologies from two or more areas. For a list of topics, see http://www.isvc.net

ISVC'15 will consist of invited and contributed presentations dealing with all aspects of visual computing. In addition to the main program, the symposium will include several keynote presentations, special tracks, and a poster session. Significantly extended and revised versions of selected papers will be considered for publication in a special issue of the International Journal on Artificial Intelligence Tools (IJAIT) (ISI/SCIE indexed). Also, a "best paper" award ($500) will be sponsored by Mitsubishi Electric Research Laboratories (MERL). The symposium's proceedings will be published by Springer-Verlag in Lecture Notes in Computer Science.

***Important Dates***

Paper submissions August 21, 2015
Notification of acceptance September 23, 2015
Final camera ready paper October 20, 2015
Advance Registration October 20, 2015
ISVC'15 Symposium December 14-16, 2015


***Keynote Speakers***

Fei-Fei Li, Stanford University, USA
Ravi Ramamoorthy, UCSD, USA
Claudio Silva, New York University, USA
Oncel Tuzel, MERL, USA
Evan Suma, USC, USA
Luc Vincent, Google, USA


(Area 1) Computer Vision Chairs:
Pavlidis Ioannis, University of Houston, USA
Feris Rogerio, IBM, USA

(Area 2) Computer Graphics Chairs:
McGraw Tim, Purdue University, USA
Elendt Mark, Side Effects Software Inc., USA


(Area 3) Virtual Reality Chairs:
Kopper Regis, Duke University, USA
Ragan Eric, Oak Ridge National Laboratory, USA

(Area 4) Visualization Chairs:
Yang Jing, University of North Carolina, USA
Weber Gunther, Lawrence Berkeley National Laboratory, USA


*** Submission Procedure ***

Papers submitted to ISVC'15 must not have been previously published and must not be currently under consideration for publication elsewhere. A complete paper should be submitted in camera-ready format. The length should match that intended for final publication. The page limit is 12 pages. In submitting a paper the author(s) agree that, upon acceptance, they will prepare the final manuscript in time for inclusion into the proceedings and will present the paper at the symposium.


***Special Tracks***

Papers submitted to a special track must not have been previously published, and must not be currently under consideration for publication elsewhere.

ST1: Computational Bioimaging
       Organizers:
       Tavares João Manuel R. S., University of Porto, Portugal
       Natal Jorge Renato, University of Porto, Portugal

ST2: 3D Surface Reconstruction, Mapping, and Visualization
       Organizers:
       Nefian Ara, Carnegie Mellon University/NASA Ames Research Center, USA
       Edwards Laurence, NASA Ames Research Center, USA
       Huertas Andres, NASA Jet Propulsion Lab, USA

ST3: Observing Humans
       Organizers:
       Savakis Andreas, Rochester Institute of Technology, USA
       Argyros Antonis, University of Crete, Greece
       Asari Vijay, University of Dayton, USA

ST4: Advancing Autonomy for Aerial Robotics
       Organizers:
       Alexis Kostas, ETH Zurich, Switzerland
       Chli Margarita,, University of Edinburgh, UK
       Achtelik Marcus, ETH Zurich, Switzerland
       Kottas Dimitrios, University of Minnesota, USA
       Bebis George, University of Nevada, Reno, USA

ST5: Spectral Imaging Processing and Analysis for Environmental, Engineering and Industrial Applications
       Organizers:
       Doulamis Anastasions (Tasos) , National Technical University of Athens, Greece
      Loupos Konstantinos, Institute of Communications and Computer Systems, Greece

ST6: Big Data Visualization and Analytics
       Organizers:
       Yang Lei, University of Nevada, Reno, USA
       Chen Xu, University of Goettingen, Germany
       Lin Fuhong, University of Science and Technology Beijing, China
       Zhang Rui, University of Hawaii, Honolulu, HI, USA

ST7: Unconstrained Biometrics: Challenges and Applications (tentative)
       Organizers:
       Proença Hugo, University of Beira Interior, Portugal
       Ross Arun, Michigan State University, USA

ST8: Intelligent Transportation Systems
       Organizers:
       Ambardekar, Amol, Microsoft, USA
       Morris, Brendan, University of Nevada, Las Vegas, USA

ST9: Visual Perception and Robotic Systems
       Organizers:
       La Hung, University of Nevada, Reno, USA
       Sheng Weihua, Oklahoma State University, USA
       Fan Guoliang, Oklahoma State University, USA
       Kuno Yoshinori, Saitama University, Japan
       Ha Quang, University of Technology Sydney, Australia
       Tran Anthony (Tri), Nanyang Technological University, Singapore

       Dinh Kien, Rutgers University, USA