Data collection is a process of collecting relevant information to gain insights, make in-depth analyses and make decisions. It is a fundamental process used in undertaking research and decision-making across diverse fields and professions. The importance of data collection and analysis extends beyond the confines of academia and is inherently used in research across industries like business, healthcare or manufacturing. Regardless of the industry, data collection is key to generating insights for making informed decisions and arriving at a valid conclusion.
In this blog, we shall go deeper into the nuances of data collection and analysis and learn the diverse sets of tools available for data collection and analysis.
Defining Data Collection
Data Collection is the methodical collection and measurement of information on subjects of interest that enables researchers to answer questions, test hypotheses, and assess the results. It involves collecting and evaluating information from diverse sources to find answers, assessing outcomes and predicting trends and probabilities. Identifying data types, sources and methods used, is an essential step that every researcher must ensure.
There are various methods and tools for data collection and analysis. However, every analyst or researcher needs to identify the research purpose and goals, the kinds of data to be gathered and the methods and procedures that will be employed in collecting, storing and processing the information. Data collection and analysis is an iterative process, requiring real-time monitoring to ensure the quality and reality of the results.
Importance of Data Collection
Data collection is essential for every industry today to gain insights and make informed decisions whether for business performance, answering pertinent questions or predicting future trends. In general, It is a fundamental process, and particularly for the following reasons:
i) For identifying patterns, trends and correlations that can give valuable insights into the desired area of study. For instance, business performance, market trends, epidemics, AI Impacts, Cloud Computing, IoT, etc.
ii) To make evidence-based informed decisions and not just on assumptions
iii) For tracking progress, assessing strategies and identifying the need for adjustments in meeting a certain goal
iv) To identify problems promptly
Data collection is a crucial part of research as it allows researchers to make decisions based on the available information and also to comprehend the value of the information in assisting the progress of the research work. Analyzing the collected relevant data is thus highly essential as it helps researchers establish a factual foundation for coming to a conclusion or building a verdict.
Now that we learned the importance of data collection and analysis, let us proceed further on the various data collection methods and tools that researchers typically employ in conducting their research.
What are the Different Methods of Data Collection
There are two broad categories of data collection: Qualitative and Quantitative
Qualitative Data Collection: This category is concerned with non-numerical data and is usually descriptive. Hence, the data collected in this format are in the form of words and sentences signifying subjective opinions, emotions, experiences and feelings. This type of data collection is often unstructured and features open-ended questions. This approach typically addresses the research questions of 'why' and 'How'. The qualitative methods include Group discussions, Interviews and Focus groups.
This approach is ideal for exploring the unintended consequences and effects of research. Qualitative methods are typically time-consuming and expensive and often subjective feelings cannot be used for generalizing with non-participants of the sample. Researchers using this method need to take great care and effort and must record any potentially valuable data accurately and systematically using suitable means like photographs, audiotapes, notes, sketches, etc. Researchers must also comply with the ethical principles of the research. There are three broad categories for data collection and evaluation under this method:
a) In-depth interview
b) Observation Methods
c) Document Review
Quantitative Data Collection: Contrary to the qualitative approach, quantitative data collection is numerical and can be computed mathematically. The quantitative data collection method uses various scales and addresses the 'What' questions of the research. The method involves using a systematic standardized approach and employing methods like surveys and asking questions. This method is comparatively cost-effective and easier to implement. Here in this method, samples are easily comparable and the size of the effect is easily measurable. The setback of the quantitative method is the limited capacity for investigation and explanation of similarities and unexpected differences. The common data gathering methods used in Quantitative data collection include:
i) Experiments or Clinical trials
ii) Recording well-defined events
iii) Acquiring relevant data from MIS ( Management Information Systems)
iv) Surveys with close-ended questions like interviews (telephonic/face-to-face), questionnaires,
v) Sending out questionnaires to a large number of people
Quantitative data collection is less time-consuming compared to the qualitative method. The subjects are straightforward and honest their responses are held anonymous.
Mixed Methods of Data Collection:
This method combines both quantitative and qualitative data collection methods and techniques within one research framework. The mixed methodology may be a mix of several types of methods or at different points in a study or a mixture of quantitative and qualitative. Employing this method may aid in optimizing the validity and reliability of the research. This method is typically ideal for highlighting complex research problems.
Types of Data and Different Methods of Data Collection
Let us discuss the various types of data and methods of collection that are employed across all the research methods.
Primary Data
Primary Data are the information that is gathered from the researcher's personal experience or first-hand experience. This type of data is more authentic, objective and reliable and it is typically a resource that has not been published, changed or altered. Hence, this type of data is more reliable than information gathered from secondary data or sources. Primary data are important for studies that require first-hand information and which cannot be relied on published resources like newspapers or other printed media. For instance, statistical surveys of the female working population of a certain community, etc.
Methods for Sourcing Primary data
The various methods of collecting primary data include:
Experiments: Experiments are ideal for scientific, medical, nutritional, psychological and other scientific research. This method requires a natural or artificial setting for researchers to collect data by performing logical study. The method involves the manipulation of variables to observe their impact on the result. Here, researchers monitor and control the condition and gather data to conclude cause-and-effect relationships.
Survey and Questionnaires: This is the most commonly employed method in social sciences, management or marketing studies. Surveys are conductible in numerous methods. The most common method used is a Questionnaire, where the researcher frames questions that address the study, and it can be open-ended or closed-ended. The questionnaire can be carried out online and the questionnaires are sent out to the sample group via electronic mail or in a pen-and-paper format where the respondents fill the paper physically.
Interviews: In this method, researchers interact directly with the subject in person, through video conference or over the phone. The questions for the interview are typically categorised as -
i) Structured where the respondents are asked predetermined and standardized questions
ii) Semi-structured that allows flexibility
iii) Unstructured where questions are open-ended, flexible and informal. It allows the researcher to establish a rapport with the respondent and gives more scope for quality insights.
Observations: In this method, the researcher observes and documents the subjects in their natural settings and studies their actions, ongoing behaviours or events. This method has to be carried out with thorough care and the observations must be made without bias. The key points to consider for carrying out an observational data collection and analysis include:
- Having a clear goal and objective
- Acquiring consent from the participant
- Making Fair and unbiased observation
- Observers must be hidden from the participant to avoid potential bias
- Clear and straightforward documentation of the observation
Observational data collection and analysis can be of various forms:
- Naturalistic Observation: where the researcher takes notes on what is seen without any interference from the researcher.
- Case studies: This study focuses on a single phenomenon, with a specific point of reference like an event or a person.
- Participant Observation: here the researcher becomes an active part of the sample group and takes part directly- community or event, and document data by understanding and sharing their experience.
- Controlled Observation: This involves documenting the study group in a systematically structured observation.
- Longitudinal Observation: This involves the researcher observing and recording people for a long time and is particularly used for researching variables that are visible over time.
Focus groups: This method involves bringing together small groups of people and making them discuss a specific topic in a moderated setting. The researcher documents the opinions and perceptions presented in the discussion.
Secondary Data
This method of data collection relies on already existing resources or data that has been collected prior by others in another research or other purposes. It is usually available in published in various forms like articles, books, journals or newspapers, biographies, etc. A good example would be the use of Census data for inferring information on a certain aspect like population or demographic study. This type of resource is essential and forms valuable information that records past events or about people that would be impossible to conduct again. Some of the major sources for secondary data include:
Published Sources: This includes data that are documented and published in the form of books, magazines, newspapers, articles/journals, government reports, etc.
Online Databases: This includes data available in several databases with access to information about significant areas like statistical information, social surveys, economic data, research articles, etc.
Institutional and Governmental records: These are the data that are available at the institutional level like government agencies, research institutions, etc that are accessible for research purposes.
Data available to the Public: These are data that are available for the public on various platforms like websites, social media etc. that are shared by individuals, communities or organizations.
Research Archives: Researchers can access certain research studies repositories from which they can obtain data, gain information and review or analyze them.
Tools for Data Collection and Analysis
We have discussed comprehensively on the numerous techniques of data collection and analysis. Let us now proceed to the most prominent tools used by researchers:
In-person surveys: This involves respondents being ask a set of questions by the researcher
Role-playing: Respondents are asked how they would react or behave in a situation by giving them an imaginary scenario and making them think and act as if it were a real situation.
Online/Web Surveys: One of the easiest surveys where respondents are given out online forms or questionnaires. This method however risk the chance of the respondents not being truthful or not giving honest answers at times.
Mobile Surveys: This type of collection is done by leveraging the advantage of mobile technologies like smartphones or tablets and send out research questions through mobile apps or SMS.
Phone Surveys: This requires the researcher or a third party making calls to each respondent.
Observation: particularly suitable and ideal for small-scale studies, researchers observe and record events or activities or behaviours of the sample group.
Sentence Completion: Researchers gather understanding and insights of the respondents ideas by making the complete a sentence and seeing how they finish the sentence.
Word Association: Respondents are given a set of words and they are asked about what comes to mind as they hear the words.
Besides the above tools, there are again some prominent data analysis tools that are dominantly used in research:
1). Box and Whisker Plot
2). Check Sheet
3). Control Chart
4). Design of Experiments (DOE)
5). Histogram
6). Scatter Diagram
7). Stratification
Those are the core ingredients of data colelction and analysis. It is also important that the researchers obtain data by making use of the methods accurately to ensure maintaining the integrity of the research. With the accurate employment of the research techniques and methods, there is less chance of error occurring.
Conducting your DBA research will be much easier if you have a concrete knowledge of all these methods and select the right methods that align with your research questions and goals. Ideally, Doctorate in Business Administration candidates are given extensive during their course work on the research methods. Completing research and coming up with an impactful thesis will also mean developing extensive knowledge across all these data collection and analysis tools and techniques.
Survey, focus groups, interviews, observations, forms, etc are the data collection and analysis methods that a researcher can employ in conducting their research. Each of the methods have its own merits and demerits, yet an accurate use of the methods must be prioritize. Researcher must ensure that their goals align with the selected methods and tools.