Peter Chen and S.M. Hinton (1999) 'Realtime Interviewing Using the World Wide Web'
Sociological Research Online, vol. 4, no. 3, <http://www.socresonline.org.uk/4/3/chen.html>
To cite articles published in Sociological Research Online, please reference the above information and include paragraph numbers if necessary
Received: 26/7/1999 Accepted: 17/9/1999 Published: 30/9/1999
Figure 1: The Interviewer and Interviewees' Screens
Advantages | Disadvantages[24] |
---|---|
Cost savings | Qualitative nature of research method |
Objectivity of subjects through anonymity | Increased Willingness of participants to voice negative views |
Geographic Reach (subjects need not travel to centralised location) | Careful screening of participants required |
Speed, method is quick to establish and run and post analysis is faster because of lack of transcription | Lack of facial expression |
The possibility of quickly reformulating ones question does not always exist in the use of email, and so it can become a tedious business for both researcher and researched to conduct this type of interview. In many occurrences of my study people would read their mail three or four times a week and thus it could easily take a week for a reply to arrive. Add that to the repetition of clarifying questions, and one was looking at 3 to 4 weeks in extreme cases to get a question and its surrounding areas answered and clarified.
Advantages | Disadvantages |
---|---|
Cost: | Cost: |
|
|
Sample (Bias Reduction): | Sample (Increased Bias): |
|
|
Paralinguistic Cues: | Paralinguistic Cues: |
|
|
General: | General: |
|
|
"... we only had half an hour so there's of course an adjustment, but by the end of the half hour I was getting into the swing of it.".
... written language isolates the individual from the group and is the communication medium of isolated individuals. ... It allows communication over great differences and long stretches of time with people who are unknown and may never be seen. Because of this the writer cannot assume that his readers have the same background as he does - the same values, shared experience, language, assumptions, definitions. As a result his discourse must be explicit, autonomous, and spelled out. (sic)
02 Estimates place the number of pages of information available on the World Wide Web at 320 million (Reuters, 1998).
03 These studies, however, (for example Smith's sociological study, Voices from the WELL, or Rimms Marketing Pornography on the Information Superhighway) have mainly been concerned with the World Wide Web or other online service as the focus of the study, rather than simply a tool for the study of an unrelated issue or subject.
04 Figallo (1995:54) argues that continuously scrolling documents in conference discussion are more coherent than separately displayed messages (such as email or Usenet postings) and draw users more deeply into the discussion.
05 It is important to distance the technique outlined above and Computer-Assisted Personal Interviewing (CAPI). CAPI is a interactive interviewing method that replaces the human interviewer and substitutes a predeveloped system of tree-structured coding to allow for the substitution / insertion of questions based on a number of predefined responses (Saris, 1991).
06 Such as observing the interviewee in their home /
work environment, observing the nature of the office (for example, noticing
piles of uncompleted work, etc.).
07 Or: Aare a significant proportion of the
interviewees able to access the technology required?
08 Hammer and
Wildavsky estimate nine hours of transcription are required for each
hour of tape.
09 It should be noted that this consent my be worked
into the interview transcript itself, through some form of "gateway" page
that includes an online informed consent document suitable for electronic
"signing". If this is used, however, then one should examine Bradburn and Sudman's (1980) chapter
regarding the sampling effects of informed consent. To summarise: written
consent forms can lower the response rate (by some eight per cent overall),
and those who reject signing such forms provide lower quality responses
than those who do.
10 The legality of employers reading the electronic
communications of the employees, for example, remains uncertain. Some
cases exist where employers have take action over their employees use of
computer networks (example, in 1997 a Victorian university staff member was
dismissed for misuse of computer facilities [Healy, 1997:33]).
Additionally, an interview conducted in a relatively public place (such as
an open-plan office or Internet cafe) may allow others to see the text as
it appears on the computer screen. Where some interviewees are concerned
about eavesdropping may request the interview not occur in such a place,
the online interview is limited by the access of the participants to
networked computers.
11 A "plug-in" is an additional piece of software
that adds capabilities to the original browsing software. These programs
extend the usefulness of the browsing software, but are not universally
used (many of the latest developments are beyond the capacity of older
hardware or software).
12 Is should be noted that this debate concerns the
use of qualitative data analysis software specifically, however these
concerns have relevance to the data collection tool as well. HTML does
allow greater flexibility in the design and functions of the webpage
interviewing screen (one of the reasons HTML is preferred to other software
packages), however the fundamental nature of the communication: using
computers, and the parameters set by HTML and the browsing software do
limit the researchers ability to modify the method ad infinitum.
13 Thus while Platt (1996) sees funding issues as not
affecting the underlying approach of research conducted (qualitative versus
quantitative), it does facilitate research and the amount of data
collected. Research is not exempt from the context of equipment
availability or funding considerations, a context that may need to be
explicitly recognised by researchers when justifying their methodological
choices.
14 Split screens containing two different pages of
information.
15 The most obvious example of a rival approach
would be the use of Internet Relay Chat (IRC). IRC is a realtime
conversational medium that utilises the Internet network to allow for group
and "coupled" conversation through a very similar medium as outlined in the
section above. Compared to uptake of the World Wide Web, however, IRC
remains a subset of the larger Internet community. Accessing IRC can be a
technical task requiring some skill and additional software that must be
used by its participants. While IRC would probably be suited to "random"
interviews (especially where the research wishes to take advantage of the
self-selected nature of participants in different IRC "channels" [topic
areas]), it is likely to also include the sample bias of a medium requiring
more computer literacy than the average Internet user. However, as Rose (1995) points out, most users will
have some facility with the medium (having been able to establish contact
with IRC hosts) and will be more familiar with the concept of online
communication, using non-paralinguistic cue substitutes (such as the
ubiquitous ":)" smiling face symbol, and other facial expression
substitutes.
16 "Server push" is one solution devised to
circumvent problems caused by the stateless nature of HTTP. Server push
keeps the connection between the web server and the browser open
indefinitely, allowing data to be "pushed" across the Internet to the user.
This method was not used, since it requires a browser at the other end
which knows how to process the incoming stream of data.
17 Unlike server-push, client-pull is simply a
directive written into the HTML source which tells the browser to load an
arbitrary web page after a certain number of seconds. This "client-push"
has been implemented by browsers for some time, and will work with even
early versions of Netscape.
18 Smith does
highlight the advantages of this face to face discussions (conducted at a
social function for WELL users), where
he gathered impressions of the "...social status of WELL members that could not be easily
derived from contact via the WELL
itself.".
19 While Smith
is not specific about the nature of this email interview forum (and
certainly some of the interviews were undertaken as correspondence, rather
than as a realtime interview), it is certain that Smith accessed chatting facilities
commonly used by WELL users. These
users would have had a degree of expertise in using these facilities that
is not required in the method outlined in this paper.
20 Which is not well articulated in Smith's piece and lacks a keen assessment
of the advantages and limitations of the approach used. Similar
discussions on the topic of computer moderated communications and the
research implications for social researchers (such as Thomas, 1995) also fall into this
category.
21 As a tool of the marketing profession, the focus
group is often used with a individuals who are deemed as either users (the
market) or potential users (target market) of a product or service. The
group interview allows the researcher to introduce issues and questions for
discussion, with the aim of developing a view of consensus opinion, or
where discordant views exist (for the purposes of "niche" marketing or
product modification).
22 This is due to the incentives requires to get
participants to come to a central location (normally a conference facility
or similarly appointed room), unlike in the interview environment where the
interviewer often travels to the interviewee. Participants are usually
provided with gifts or remuneration for their attendance, which is not
common in semi-structured, in-depth interviewing. However, as groups are
"interviewed" in the focus group method, the cost per interviewee
(individual) may be lower. However, it is likely that cost comparisons are
not really very meaningful.
23 Which are surprisingly homogenous in their
assessments of the strengths and weaknesses of the approach.
24 Of the material reviewed, only two companies
listed limitations (Insights Online and
the Xerox Business Research Group).
25 Often selection is via a direct relation to
computer usage (such as the access of certain websites, use of particular
facilities, etc.). Additionally, initial contact to request participation
is often through email (Frangiamore, 1998:1).
26 Either through interest in the novelty of the
process (Xerox Business Research Group,
1998) or through incentive payment (Strategic
Focus Online, 1998).
27 It would be misleading to draw to close a
comparison between online focus groups and online interviewing, however,
because of the differences of the two methods. As Krueger (1988:19) points out,
interviewing is an active process (where the interviewer seeks
information), while a focus group is more passive (the facilitator attempts
to encourage and guide the discussion of the group, rather than be a key
part of the discussion themself). In this way the focus group has been
compared to a compromise between the semi-structured, in-depth interview
and participant observation, placing a distinctly different emphasis on the
role of the researcher in the process.
28 These two factors are importantly different: the
first relates to individuals acceptance of the method (understanding its
workings and agreeing that they wish to be part of a study based on the
method); the second relates to the physical ability of a researcher using a
particular tool to reach interviewees (an example being the telephone,
which is an unsuitable research tool where interviewees have no access to
it).
29 King et. al
(1994) list sample bias as one of the key questions of social research with
the consideration of factors leading to bias being one of the earliest
considerations in the process of constructing social inquiry.
30 Coomer's work centres around the use of the
Internet for the collection of written surveys, rather than interviewing,
however his use of methods (writing to Listservers and Newsgroups and the
establishment of an online, web based surveying tool) have relevance for
this method, especially if the interviewer were attempting "vox pop"
interviews, where the initial point of contact with interviewees were
through mass emailings to wide samples.
31 A "classic" example being Donath's (1996) study of identity in
virtual communities where the sampling universe was Usenet Users.
32 This trend, however, is slowly changing due to
the increased usage of the Internet, it's popularism and decreasing costs
associated with the uptake of the technology required to use its services.
33 Frey (1983),
in recognising the declining level of sample bias in telephone research (in
the United States), does identify problems associated with locating certain
types of respondent via telephone. The telephone, therefore remains
limited, as does mail survey, face to face (geographic sampling has always
remained difficult to logistically manage and is filled with compromises
based on geographic access and cost issues).
34 This is also relevant in most survey methods
where the respondent is required to invest in the process (for example: the
investment of the time required to undertake the interview, effort in
completing a survey form, or the money to return post a mail survey).
35 The interviewees spoke of being "surprised" at
the use of the computer.
36 The term "interview" in regards to CASI can be
misleading, CASI is a survey approach using predeveloped questions and
answers (designed for larger studies for ease of tabulation and analysis).
Therefore the CASI approach is distinctly dissimilar to a semi-structured
in-depth interview in the number of possible responses that can be gathered
via the method.
37 This issue is also relevant to the pilot study.
38 In this regard Mizrach is writing speculatively,
rather than from experience. He outlines a number of possible methods:
IRC, video conferencing, and standard email interviewing.
39 As Dexter
(1970:63-4) outlines, the interviewer can also use significant
paralinguistic cues (a raised eyebrow, a significant pause) to prompt the
interviewee for more information.
40 Possibly because of the difficulty of the task.
The researcher is often faced with the question "What does that gesture
mean?", while the gesture is important, simply observing these cues is not
interpretation and interpretation based on casual inference can lead the
researcher beyond the scope of their competence.
41 To the extent that an interviewer attempting to
arrange a face to face interview, is able to suggest locations and veto
suggestions of the potential interviewee.
42 Such as leaning forward, appearing interested,
and showing distress at an interviewee wishing to terminate the interview.
43 Some considered that they would talk about the
same issues in face to face while others felt that they would be able to
speak more freely.
44 To the extent that one interviewee was so
concerned at their text being too off the cuff they edited their response
before sending.
45 Note here that this is neither identified as a
valuable or problematic issue. This depended on the nature of the
interview and the issue under consideration. Generally the loss of
preconscious immediacy may be seen as problematic to the extent that the
interviewee is more measured in their response to questions, however this
may increase the clarity of the written transcript in better conveying the
true meaning of the interviewees intended replies. The study group did
recognise the "formality" of the online interview - a factor that may have
tempered their responses. This could conform to Labov's view of "careful"
and "casual" speech, where the interviewee recognises the formality and
seriousness of the interview, and changes modes of conversation for the
different occasion (as examined in Briggs, 1986:18).
46 This issue was highlighted by the study group,
who would have preferred a period of rapport building (which was called a
"practice period" by the group). This practice period would have allowed
the interviewees to gain confidence with the method, as well as trust in
the interviewer as an attentive person, rather than a "ghost in the
machine".
47 Kahn and
Cannell call this the non-directive technique, where the interviewer
must balance their desire to elicit additional responses or more detailed
information, without introducing unwanted or unplanned influence upon their
responses.
48 For an interesting and relevant refutation of
the overemphasis on bias reduction within the positivist school of
research, see Briggs (1986:21-3)
discussion of bias theory and individual true value. In this piece Briggs argues bias can be eliminated, and
b) that through this process distortions in research responses can be
eliminated and absolute truth gained. While this may be relatively
straightforward, it is an unspoken feature of research that the concept of
an "individual true value" is achievable and that research can be validated
through its attempts to achieve this ideal type.
49 Seidman
(1991) lists a number of influencing factors: Race, Gender, Class,
hierarchy and status, and Age as influences in developing an "equitable
interviewing relationship".
50 The interviewee will make assessments of the
interviewer through their contact in the pre-interview process (such as on
the telephone) and by determining (or possibly misinterpreting) their
gender, ethnicity, and/or nationality based on their name.
51 The main concern regarding the legitimacy of
researchers was based on their preponderance to encounter commercial
researchers who were seen as unsavoury, time consuming and intrusive.
52 Not that this is impossible in the traditional
face to face interview, but more easily achieved using on online method.
53 Additionally, while the issues outlined by Donath may not be relevant to a
semi-structured, in-depth interview because of the lack of anonymity
between interviewer and interviewee, this may reduce the need to consider
the media impact on responses, such as those discussed by MacElroy in
The Effect of E-Personality on Research Results where communications
with anonymous interviewees, or interviewees who is only known in the
virtual environment (such as may be encountered in vox pop interviewing),
is seen as encouraging more forceful or aggressive behaviour, stronger
opinions, intense candour, cynicism or mechantilism.
BRADBURN, NM and S SUDMAN, 1980, Improving Interview
Method and Questionnaire Design: Response Effects to Threatening Questions
in Survey Research, Jossey-Bass, San Francisco.
BRIGGS, CL, 1986, Learning How to Ask: A sociolinguistic appraisal
of the role of the interview in social science research, Studies in
the Social and Cultural Foundations of Language No. 1, Cambridge University
Press, London.
BUSINESS RESEARCH CENTRE, 1998, Business Research Centre,
http://www.xbrg.com/centerbr.html,
Xerox Corporation (The Xerox Business Research Group), 29 May [linkdate].
BUSTON, K, 1997, "NUD*IST in Action: Its Use and its Usefulness
in a Study of Chronic Illness in Young People", Sociological Research
Online, Vol. 2 No. 3, http://www.socreso
nline.org.uk/socresonline/2/3/6.html.
CHRISTENSEN, NB, 1999, Inuit in Cyberspace: Practising and
Constructing Computer-mediated Space, Paper Prepared for the 3rd Annual
ARCUS Award for Arctic Research Excellence, http://home.worldonline.dk/~nb
c/arcus.html.
COUPER, MP and B ROWE, 1996, "Evaluation of a
Computer-Assisted Self-Interview Component -Assisted Personal Interview
Survey", Public Opinion Quarterly, Vol. 60, pp. 89-105.
COMMON KNOWLEDGE, 1997, Virtual Focus Groups, http://www.
commonknowledge.com/html/virtual_focus_groups.html.
COOMBER, R, 1997, "Using the Internet for Survey Research",
Sociological Research Online, vol. 2 no. 2, http://www.socresonline.org.uk/2/2/2.html.
DEXTER, LA, 1970, Elite and Specialised Interviewing,
Northwestern University Press, Evanston.
DONATH, J, 1996, Identity and Deception in the Virtual Community,
http://persona.www.media
.mit.edu/Judith/Identity, 2 March 1998 [linkdate].
DOUGLAS, JD, 1985, Creative Interviewing, Sage, Beverley
Hills.
FIGALLO, C, 1995, "The WELL: A
Regionally Based On-Line Community
on the Internet", in Public Access to the Internet, B. Kahin
and J Keller (editors), A Publication of the Harvard Information Infrastructure
Project, MIT Press, Massachusetts.
FRANGIAMORE, S, 1998 [unpublished], "Qualitative Analysis", Extracts
of Material Included in Research Proposals for Insights Online.
Frey, JH, 1983, Survey Research by Telephone, Volume 150
Sage Library of Social Research, Sage, Beverley Hills.
HAMMAN, RB, 1996, Cyborgasms: Cybersex Amongst Multiple-Selves
and Cyborgs in the Narrow-Bandwidth Space of America Online Chat Rooms,
MA Dissertation, Department of Sociology, University of Essex, http://www.socio.demon.co.uk
/Cyborgasms.html, 30 September.
HAMMER, D and A Wildavsky, 1989, "The Open-Ended,
Semistructured Interview: An (Almost) Operational Guide", Craftways:
On the Organisation of Scholarly Work, Transaction Publishers, New
Brunswick.
HEALY, G, 1997, "Dismissal Sparks Net Warning", The
Australian, June 11.
HOLSTEIN, JA and JF GUBRIUM, The Active Interview,
Qualitative Research Methods Series, Sage, Newbry Park.
INSIGHTS ONLINE, 1998, Insights Online - online focus groups
/ moderated chat sessions, http://www.insightsonline.com/olg.h
tm, 29 May [linkdate].
KAHN, RL and CF Cannell, 1957, The Dynamics of Interviewing:
Theory, Technique and Cases, John Wiley & Sons, New York.
KELLE, U, 1997, "Theory Building in Qualitative Research and
Computer Programs for the Management of Textual Data", Sociological
Research Online, Vol. 2 No. 2, http://www.socreso
nline.org.uk/2/2/1.html.
KING, G, RO KEOHANE, and S VERBA, 1995, Designing
Social Inquiry: Scientific Inference in Qualitative Research, Princeton
University Press, Princeton.
KRUEGER, RA, 1988, Focus Groups: A Practical Guide for Applied
Research, Sage, Newbury Park.
KVALE,S, 1996, InterViews: An Introduction to Qualitative
Research Interviewing, Sage, Thousand Oaks.
MARTIN, J and T MANNERS, 1995, "Computer Assisted Personal
Interviewing in Survey Research", in Information Technology for
the Social Scientist, Lee, RM (ed.), UCL Press, London.
McCRACKEN, G, 1988, The Long Interview, Qualitative Research
Methods, Volume 13, Sage Publications, Newbury Park.
MIMICHIELLO, V, et al, 1995, Indepth Interviewing, 2nd
Edition, Longman, Melbourne.
MIZRACH, S, Using Computers in Qualitative Research, http://www.clas.ufl.edu/users/seeker1/scholarly/comp-in-qual-research.html
, 31 March 1998 [linkdate].
MYERS, D, 1987, "'Anonymity is Part of the Magic': Individual
Manipulation of Computer Mediated Communication Contexts", Qualitative
Sociology, Vol. 10, No. 3, Fall, pp. 2521-66.
NEUMAN, WL, 1994, Social Research Methods: Qualitative and
Quantitative Approaches, Allyn and Bacon, Needham Hights.
OLDFIELD, RC, 1951, The Psychology of the Interview, Methuen,
London.
PFAFFENBERGER, B, 1988, Microcomputer Applications in Qualitative
Research, Qualitative Research Methods Series, Sage, Newbry Park.
PLATT, J, 1996, "Has Funding Made A Difference To Research
Methods?", Sociological Research Online, Vol. 1, No. 1, http://www.socreso
nline.org.uk/1/1/5.html.
PRETTY GOOD PRIVACY INC., 1997, PGP for Personal Privacy,
Version 5.5, Macintosh Users Guide, http://www.pgp.com,
San Matco.
REUTERS, 1998, "Study: Search Engines Fall Short", CNET
News.Com, http://www.news.com/News/
Item/0,4,20728,00.html, April 2.
ROSE, B, 1995, Internet Chat Quick Tour: Real-Time Conversations
& Communications Online, Ventana, Chapel Hill.
SARIS, WE, 1991, Computer-Assisted Interviewing, Quantitative
Applications in the Social Sciences Series, Sage, Newbry Park.
SEIDMAN, IE, 1991, Interviewing as Qualitative Research: A
Guide for Researchers in Education and the Social Sciences, Teachers
College Press, New York.
SELWYN, N and K ROBSON, 1998, "Using E-mail as a Research
Tool", Social
Research Update, Issue 21, Summer.
SLAUGHTER, MM, 1985, "Literacy and Society", International
Journal of Language, 56, pp. 113-39.
SMITH, MA, 1998, Voices from the
WELL: The Logic of the Virtual Commons, http://www.s
scnet.ucla.edu/soc/csoc/papers/voices/Voices.htm, 2 March [linkdate].
STRATEGIC FOCUS ONLINE, 1998, Strategic Focus Online - Information
About Online Focus Groups, http://www.sfionline.com, 29 May
[linkdate].
SUDUAU,S and N BROWN, 1984, "Improving Mailed
Questionnaire Design", Making Effective Use of Mailed
Questionaries, Lockhart (ed.), Jossey-Bass, San Francisco.
SUMMITT, PM and MJ SUMMITT, 1996, Creating Cool Interactive
Web Sites, IDG Books, Foster City.
THOMAS, R, 1995, "Online Services and CD-ROM", in
Information Technology for the Social Scientist, Lee, RM (ed.), UCL
Press, London.
WEISS, RS, 1994, Learning from Strangers: The Art and Method of
Qualitative interview Studies, The Free Press, New York.