Analysis of results: quantitative and qualitative
Chapters 13 & 20- 25
Contents
The main steps in quantitative research
Types of Variable and Deciding How to Categorize a Variable
Descriptive and Inferential Statistics
Checklist on Doing and Writing up Quantitative Data Analysis
Strauss and Corbin's Classification of Coding in Grounded Theory
Steps and Considerations in Coding
Other Methods for Qualitative Data Analysis & Using NVivo
To see video clips of students talking about their experiences of analysing data, click here
Quantitatative data analysis
One of the biggest mistakes that people make about quantitative data analysis:
- I don't have to concern myself with how I'm going to analyse my survey data until after I've collected my data. I'll leave thinking about it until then, because it doesn't impinge on how I collect my data
You should be fully aware of what techniques you will apply at a fairly early stage:
- you cannot apply just any technique to any variable as techniques must match the types of variables you have created and you must be fully conversant with the ways in which different types of variable are classified
- the size and nature of your sample are likely to impose limitations on the kinds of techniques you can use (see Chapter 8, 'Kind of analysis')
The Main Steps in Quantitative Research (Ch. 8; Fig. 8.1)
Types of Variable (page 317; Table 15.1)
- Interval/ratio variables - where the distances between the categories are identical across the range
- Ordinal variables - whose categories can be rank ordered but the distances between the categories are not equal across the range
- Nominal variables - whose categories cannot be rank ordered; also known as categorical
- Dichotomous variables - containing data that have only two categories
Deciding How to categorize a variable (Fig.15.1)
Descriptive and inferential statistics
Descriptive statistics:
- methods used to describe general trends and patterns in a data set
-uses measures of central tendency and dispersion - provide a summary of the data collected
- associated with inductive approaches and Tukey's (1977) Exploratory Data Analysis
Inferential (confirmatory) statistics:
- methods used to test hypotheses about relationships or differences (estimates, generalizations and predictions) in populations based on measurements made on samples
- uses measures such as Pearson's r and tests such as Chi-square and analysis of variance - provide inferences that extend beyond the data collected
- associated with deductive approaches and correlation, bi- and multivariate analysis
Using SPSS
You will need to discover whether your institution supports SPSS, many actually sell registered versions of SPSS at a discount price for student use.
Web link:
www.policymagic.org/spss_tutor.htm - links to SPSS tutorials and resources hosted by John G. McNutt
Checklist on doing and writing up quantitative data analysis
- Have you answered your research questions?
- Have you made sure that you have presented only analyses that are relevant to your research questions?
- Have you made sure that you have taken into account the nature of the variable(s) being analysed when using a particular technique (i.e. whether nominal, ordinal, interval/ratio, or dichotomous)?
- Have you used the most appropriate and powerful techniques for answering your research questions?
- If your sample has not been randomly selected, have you made sure that you have not made inferences about a population (or at least, if you have done so, have you outlined the limitations of making such an inference?)?
- If your data are based on a cross-sectional design, have you resisted making unsustainable inferences about causality?
- Have you remembered to code any missing data?
- Have you commented on all the analyses you present?
- Have you gone beyond univariate analysis and conducted at least some bivariate analyses?
- If you have used a Likert scale with reversed items, have you remembered to reverse the coding of them?
Web links:
http://onlinestatbook.com/rvls.html - Rice Virtual Lab in Statistics, excellent site from Rice University Texas includes:
- An online statistics book with links to other statistics resources on the web
- Java applets that demonstrate various statistical concepts (can be downloaded)
- Examples of real data with analyses and interpretation
- Some basic statistical analysis tools.
www.42explore.com/statistics.htm - links and activities on probability and introductory statistics from 42Explore
Qualitative data analysis (chapter 24)
General strategies of qualitative data analysis:
- analytic induction*
- grounded theory*
(*Note - their iterative nature means they can also be viewed as strategies of data collection, see Key concept 24.3)
Strauss and Corbin's Classification of coding in grounded theory (Key concept 24.2)
Open coding
- 'breaking down, examining, comparing, conceptualizing, and categorizing data' (Strauss and Corbin, 1990: 61)
- this process yields concepts, which are later grouped and turned into categories
Axial coding
- 'data are put back together in new ways after open coding, by making connections between categories' (1990: 96)
- this is done by linking codes to contexts, consequences, patterns of interaction and to causes
Selective coding
- 'selecting the core category, systematically relating it to other categories, validating those relationships, and filling in categories that need further refinement and development' (1990: 116)
- a core category is the central issue or focus around which all other categories are integrated
Steps and considerations in coding (page 531)
Lofland and Lofland (1995) give the following considerations:
- Of what general category is this item of data an instance?
- What does this item of data represent?
- What is this item of data about?
- Of what topic is this item of data an instance?
- What question about a topic does this item of data suggest?
- What sort of answer to a question about a topic does this item of data imply?
- What is happening here?
- What are people doing?
- What do people say they are doing?
- What kind of event is going on?
Steps in coding:
- Code as soon as possible
- Read through your initial set of transcripts, field notes, documents, etc.
- Do it again
- Review your codes
- Consider more general theoretical ideas in relation to codes and data
- Any one item or slice of data can and often should be coded in more than one way
- Do not worry about generating what seem to be too many codes
- Keep coding in perspective
Other methods for qualitative data analysis:
Narrative analysis:
- Narratives should be viewed in terms of the functions that the narrative serves for the teller
- The aim of narrative interviews is to elicit interviewees' reconstructed accounts of connections between events and between events and contexts
- For the management researcher, narrative analysis can prove extremely helpful in:
- providing a springboard for understanding what Weick (1995) has termed 'organizational sensemaking'
- understanding the internal politics of organizations (see Research in focus 5.4)
Using NVivo (Ch.25)
- Some readers will decide it is not for them and that the tried-and-tested scissors and paste will do the trick
- On the other hand, the software warrants serious consideration because of its power and flexibility
- See pages 539-42 for arguments for and against the use of CAQDAS
Web links:
Free copy of the booklet, Getting Started in NVivo from QSR International at: http://www.qsrinternational.com/nvivo/free-nvivo-resources/getting-started.
Checklist on content analysis of documents
Can you answer the following questions?
- Who produced the document?
- Why was the document produced?
- Was the person or group that produced the document in a position to write authoritatively about the subject or issue?
- Is the material genuine?
- Did the person or group have an axe to grind and if so can you identify a particular slant?
- Is the document typical of its kind and if not is it possible to establish how untypical it is and it what ways?
- Is the meaning of the document clear?
- Can you corroborate the events or accounts presented in the document?
- Are there different interpretations of the document from the one you offer and if so what are they and why have you discounted them?
Exercise: content analysis
Go to the websites for three large companies in the same or different industrial/commercial sectors. Examples might be:
1 |
Exercise: quantitative data analysis
2 |
3 |
4 |
Exercise: using SPSS for Windows
A small, explorative survey (20 responses) was done in a supermarket car park to determine what factors were important to buyers when buying a car. The 4 most important factors identified by the buyers were price, service interval, an assessment of quality and value for money.
Buyers were given a questionnaire which had a 5-point interval scale on which they could rate their preference. 1 on the scale meant very important and 5 very unimportant. In between points on the scale were intended to allow for degrees of preference between the polar extremes. The results were as follows:
Respondent |
Price |
Service interval |
Quality |
Value for money |
---|---|---|---|---|
1 |
1 |
2 |
2 |
2 |
2 |
2 |
2 |
3 |
1 |
3 |
1 |
3 |
3 |
2 |
4 |
2 |
1 |
4 |
2 |
5 |
1 |
2 |
3 |
2 |
6 |
1 |
3 |
3 |
1 |
7 |
2 |
3 |
2 |
3 |
8 |
1 |
3 |
2 |
1 |
9 |
1 |
1 |
2 |
1 |
10 |
2 |
1 |
2 |
2 |
11 |
1 |
2 |
3 |
3 |
12 |
2 |
3 |
3 |
2 |
13 |
1 |
3 |
1 |
2 |
14 |
1 |
3 |
2 |
2 |
15 |
1 |
3 |
2 |
4 |
16 |
1 |
3 |
2 |
2 |
17 |
2 |
2 |
2 |
1 |
18 |
1 |
3 |
2 |
2 |
19 |
1 |
2 |
3 |
2 |
20 |
1 |
3 |
2 |
1 |
5 |
Exercise: qualitative data analysis
As part of a survey to ascertain opinions amongst its clients for falling repeat business, the Cornwell Training Company (which had full residential facilities) conducted a preliminary semi-structured focus group on representatives of some of its largest private and public sector customers. The following is a paraphrased transcript of the group's responses:
Question 1: Having attended at least one training programme at Cornwell, what is your general feeling about the quality of the course and the services offered?
Response:
- Generally the training courses are fine, but there is room for improvement e g the courses could be longer
- It was agreed that shortening the course duration may compromise quality
- Courses of 2 weeks duration were too long for the private sector due to the pressure of work
- The public sector suggested the quality of courses was declining through lack of competent and knowledgeable trainers
- All agreed the courses were generally very dated
- Course fees were too high for some
- General type courses e.g. 'Marketing for non Marketers' were too non-specific, but were better when tailor made to specific industries or clients
- Facilities during the evenings were not very good given the isolated location and few recreational amenities of the Company
- The interior of the building did not match the exterior as beds were small and there were no telephone extensions
Question 2: What do you think could be the reasons for low repeat business to Cornwall?
Response:
- Failure by Cornwell to carry out proper customer training needs analysis
- A Certificate of Achievement was better than receiving a Certificate of - Attendance as was the case now
- Some courses too theoretical and so companies were opting for on the job training
- Acknowledgement of successful acceptance on the course was too long, putting off clients
- Lack of follow-up after the courses
Question 3: In your opinion what can Cornwell do to help customer retention?
Response
- Improve communications and customer service
- Examine or assess the courses as this leads to certification of Achievement rather than Attendance
- Provide better social activities, especially in the evenings
- Have more competent, knowledgeable and interesting presenters
- Better IT facilities
Question 4: Why did you choose to attend a Cornwell course?
Response
- The private sector said it was personal initiative to find suitable courses and then persuading their supervisors to approve it
- Tight training budgets in the private sector dictated cheaper courses, like Cornwell
- The public sector said it was a mixture of the Training Director's and prospective participant's decision
- There was no alternative in the vicinity
- Past reputation
Question 5: Should your organization give you an opportunity to choose any training provider for any course of your choice would you opt for Cornwell?
- The private sector said 'unlikely', unless the issues in response to Question 3 were resolved
- The public sector said they would opt for Cornwell
6 |