Data Collection

Methods
• Data Collection refers to the systematic process of gathering,
measuring, and analyzing information from various sources to get a
complete and accurate picture of an area of interest.
• Data Collection is the process of collecting information from relevant
sources to find a solution to the given statistical inquiry
• Data collection is a critical step in any research or data-driven
decision-making process, ensuring the accuracy and reliability of the
results obtained.
• By employing various methods of data collection researchers and
organizations can gather the necessary data to support their
objectives effectively.
What is Data Collection?
• Collection of Data is the first and foremost step in a statistical
investigation. It's an essential step because it helps us make informed
decisions, spot trends, and measure progress.
• Different methods of collecting data include
• Interviews
• Questionnaires
• Observations
• Experiments
• Published Sources and Unpublished Sources
• Statistical inquiry means an investigation by any agency on a topic in
which the investigator collects the relevant quantitative information.
• In simple terms, a statistical inquiry is a search for truth by using
statistical methods of collection, compiling, analysis, interpretation,
etc.
• The basic problem for any statistical inquiry is the collection of facts
and figures related to this specific phenomenon that is being studied.
• Therefore, the basic purpose of data collection is collecting evidence
to reach a sound and clear solution to a problem.
 Terms Related to Data Collection

• Data: It is a tool that helps an investigator in understanding the problem by

providing him with the information required. Data can be classified into two types;
viz., Primary Data and Secondary Data.
• Investigator: An investigator is a person who conducts the statistical enquiry.
• Enumerators: In order to collect information for statistical enquiry, an investigator
needs the help of some people. These people are known as enumerators.
• Respondents: A respondent is a person from whom the statistical information
required for the enquiry is collected.
• Survey: It is a method of collecting information from individuals. The basic purpose
of a survey is to collect data to describe different characteristics such as usefulness,
quality, price, kindness, etc. It involves asking questions about a product or service
from a large number of people.
Methods of Collecting Data
• Primary data - refers to information collected directly from first-hand
sources specifically for a particular research purpose.
• The data collected by the investigator from primary sources for the first time
from scratch is known as primary data.
• This data is collected directly from the source of origin. It is real-time data and
is always specific to the researcher's needs.
• The primary data is available in raw form. The investigator has to spend a long
time period in the collection of primary data and hence is expensive also.
• However, the accuracy and reliability of primary data are more than the
secondary data. This type of data is gathered through various methods,
including surveys, interviews, experiments, observations, questionnaires and
focus groups.
• One of the main advantages of primary data is that it provides current,
relevant, and specific information tailored to the researcher's needs, offering
a high level of accuracy and control over data quality.
Methods of Collecting Primary Data
There are a number of methods of collecting primary data, Some of the
common methods are as follows:
1. Interviews: Collect data through direct, one-on-one conversations
with individuals. The investigator asks questions either directly from the
source or from its indirect links.
Direct Personal Investigation:- The method of direct personal investigation involves
collecting data personally from the source of origin. In simple words, the investigator makes
direct contact with the person from whom he/she wants to obtain information. For
example, direct contact with the household women to obtain information about their daily
routine and schedule.

Suitability for Direct Personal Investigation

• Direct Personal Investigation is suitable in the following cases:
• When the area of investigation is limited.
• When detailed information has to be collected.
• When a maximum degree of accuracy is required.
• When the nature of enquiry is confidential.
• When importance is given to originality.
• Direct Personal Investigation satisfactory results to the investigator if the scope of the
enquiry is narrow, and he/she is fully dependable and unbiased.
1. Originality:
The data collected by the investigator using
Direct Personal Investigation is original in
character.
2. Reliable and Accurate:
As the investigator collects the information
himself, he can ensure that the
collected data is authentic and reliable. In
simple terms, the first-hand information
collected by the investigator is more reliable
than the information collected through other
sources.
3. Flexibility:
Direct Personal Investigation is a fairly elastic
method of collecting primary data as the
investigator can change the nature or way of
asking the questions according to the
respondent he is interviewing.
Besides, this method also helps in getting
different kinds of information as per the
need of the situation.
4. Uniformity:
With this method, there is uniformity in the
collection of information.
5. Economical:
If the field of investigation is limited, Direct Personal Investigation can
help in the collection of information economically.
6. Suitable for all Types of Questions:
This method is beneficial for the investigator as it allows the use of all
questions. He/she can also use open-ended questions and can clarify
any ambiguity in the questions asked.
7. Other Information:
The last advantage of using the Direct Personal Investigation method
for collecting primary data is that it also helps in collecting some
additional information along with the regular information.
This additional information can be helpful in the future investigation of
the interviewer.
Demerits of Direct Personal Investigation
Various disadvantages of Direct Personal Investigation are as follows:
1. Not Suitable for Wide Areas:
Direct Personal Investigation is not suitable for the investigator when the area of coverage is
considerably wide or when the investigator has to contact various respondents.
2. Expensive and Time-Consuming:
The Direct Personal Investigation method of collecting primary data is time-consuming and
expensive, especially when the field of investigation is large.
3. Trained Personal:
The success of this method depends entirely on the investigator as the information is
collected by him only. Therefore, it is essential that the investigator is thoroughly trained and
unbiased, otherwise, it would be difficult to collect information.
4. Personal Prejudice:
If the investigator collecting the information is prejudiced or biased, then it will affect the
accuracy of the collected information to a large extent and can hinder the whole
investigation. An unbiased investigator can easily influence the respondents to get the
answers they require.
Precautions for Direct Personal Investigation
While using the Direct Personal Investigation method for collecting primary
data, an investigator should take the following precautions:
1. He should be well-versed in statistical techniques.
2. He should have a good temperament.
3. The investigator should not be biased.
4. He should ask simple, straight, and unambiguous questions from the informants.
5. Ultimately, the investigator should be familiar with the tradition, culture, and
language of the area concerned with the investigation.
• Indirect Oral Investigation: In the indirect oral investigation method of collecting primary data, the
investigator does not make direct contact with the person from whom he/she needs information,
instead they collect the data orally from some other person who has the necessary required
information.
• Indirect Oral Investigation is a method of collecting primary data through which the investigator
approaches third parties who are in the possession of required information about the subject of
enquiry.
• It is used when the area of investigation is large or the respondents feel reluctant in parting
information with the investigator due to some reasons.
• Under this method, the investigator prepares a small list of questions related to the investigation,
and then asks questions from different persons and records their answers.
• The person from whom these questions are asked is known as a witness.
• For example, collecting data of employees from their superiors or managers. Usually, the police
department and enquiry committees appointed by the government conduct this type of enquiry.
• For example, we want to study the number of students of a college who drink alcohol. For this
purpose, the investigator cannot get information through direct personal investigation because the
students may not provide correct information, as drinking alcohol is regarded as a bad habit.
Therefore, to get information, the investigator has to contact the people who are close to the
respondent, like their friends, relatives, neighbours, or any other person who might know the
information.
Suitability
• Indirect Oral Investigation is suitable in the following cases:
• When the investigation problem is complex and needs the opinion of
an expert.
• When the investigation area is very large.
• When the investigator has to gather sensitive or secret information
about the informant.
• When the concerned informants are ignorant or not prepared to give
the information.
Merits:

1. Wide Coverage:
Indirect Oral Investigation method of collecting
primary data is suitable when the area of
investigation is large.
2. Free from Bias:
As the information collected from the persons are
well aware of the situation, this method is relatively
free from personal prejudice.
3. Economical:
This method is economical in terms of money, time,
and manpower.
4. Expert Opinion:
Another advantage of the Indirect Oral Investigation
method is that the investigator can seek the opinion
of the experts.
Demerits of Indirect Oral Investigation
Various disadvantages of Indirect Oral Investigation are as follows:

1. Indirect Information:
As the information collected through Indirect Oral Investigation is taken from other persons who are not
directly connected to the investigation, the chances of errors in the result are more.
2. Partiality of Witness:
The possibility of the informant providing information being biased or prejudiced is more.
3. Lack of Accuracy:
As compared to Direct Personal Investigation, it is possible that the degree of accuracy of the data
collected through Indirect Oral Investigation is lower.
4. Lack of Uniformity:
Data collected through Indirect Oral Investigation method may not be always comparable and
homogeneous.
5. Lack of Interest of Informants:
There is a huge possibility that the information collected from the informant is vague or unreliable. It is
because the interest of the person providing the information is not at stake.
Precautions for Indirect Oral Investigation
While using the Indirect Oral Investigation method for collecting primary data, an
investigator should take the following precautions:
1. The investigator should ensure that the number of witnesses is fairly large.
2. He should select only those witnesses who possess sufficient knowledge about
the proposed investigation.
3. The investigator should neither completely believe nor disbelieve the
information provided to him/her by the witnesses.
4. To ascertain the accuracy, the investigator should make efforts in making a good
cross-check system.
5. The investigator must ensure that the interviewers are not subjective in their
approach to investigation and that the witnesses are not biased against or in
favour of a specific point of view.
Difference between Direct Personal
Investigation and Indirect Oral Investigation
Basis Direct Personal Investigation Indirect Oral Investigation
It is a method of collecting primary data through It is a method of collecting primary data through
Meaning which the investigator contacts the informant which the investigator approaches third parties
directly to collect data by conducting an on-the- who are in possession of required information
spot enquiry. about the subject of enquiry.

Coverage This method is appropriate for a limited area. This method can be used to cover a broad range of
investigations.

In this method, the data collected is original in In this method, the data collected lacks originality
Originality character as the data is collected directly from the as the data is collected indirectly from the
source. respondents.

The information collected under this method is There is a risk of unreliable and inaccurate
Accuracy and Reliability more reliable and accurate. information because of the indirect collection of
data.

Cost This method is costlier. When compared with the direct personal
investigation method, this method is cost-effective.
2. Questionnaires: Collect data by asking people a set of questions, either
online, on paper, or face-to-face.
In this method the investigator prepares a questionnaire to
collect Information through Questionnaires and Schedules , while keeping
in mind the motive of the study.
The investigator can collect data through the questionnaire in two ways:
• Mailing Method: This method involves mailing the questionnaires to the
informants for the collection of data. The investigator attaches a letter with the
questionnaire in the mail to define the purpose of the study or research.
• Enumerator’s Method: This method involves the preparation of a questionnaire
according to the purpose of the study or research. However, in this case, the
enumerator reaches out to the informants himself with the prepared
questionnaire.
Advantage: Can reach a large audience quickly and cost-effectively.
Disadvantage: Responses may be biased or inaccurate; low response rates.
Suitable Use Case: Customer satisfaction surveys, market research.
3. Observations: The observation method involves collecting data by watching and
recording behaviors, events, or conditions as they naturally occur.
The observer systematically watches and notes specific aspects of a subject's behavior or
the environment, either covertly or overtly.
The observation method is a method of data collection in which the researcher keenly
observes the behavior and practices of the target audience using some data collecting tool
and stores the observed data in the form of text, audio, video, or any raw formats.
In this method, the data is collected directly by posting a few questions on the participants.
For example, observing a group of customers and their behavior towards the products. The
data obtained will be sent for processing.

Advantage: Provides real-time, authentic data without reliance on self-reported

information.
Disadvantage: Observer bias can influence the results, and the presence of an observer
might alter subjects' behavior.
Suitable Use Case: Studying user interactions with a product in a natural setting, monitoring
wildlife behavior, or assessing classroom dynamics.
4. Experiments: The experiment method involves manipulating one or more
variables to determine their effect on another variable, within a controlled
environment.
Researchers create two groups (control and experimental), apply the
treatment or variable to the experimental group, and compare the
outcomes between the groups.
Advantage: Allows for the establishment of cause-and-effect relationships
with high precision.
Disadvantage: Experiments can be artificial, limiting the ability to generalize
findings to real-world settings, and they can be resource-intensive.
Suitable Use Case: Testing the efficacy of a new drug, assessing the impact
of a new teaching method, or evaluating the effect of a marketing campaign.
The experimental method is the process of collecting data through performing
experiments, research, and investigation. The most frequently used experiment
methods are CRD, RBD, LSD, FD.
• CRD - Completely Randomized design is a simple experimental design used in data
analytics which is based on randomization and replication. It is mostly used for
comparing the experiments.
• RBD - Randomized Block Design is an experimental design in which the experiment
is divided into small units called blocks. Random experiments are performed on
each of the blocks and results are drawn using a technique known as analysis of
variance (ANOVA). RBD was originated from the agriculture sector.
• LSD - Latin Square Design is an experimental design that is similar to CRD and RBD
blocks but contains rows and columns. It is an arrangement of NxN squares with an
equal amount of rows and columns which contain letters that occurs only once in a
row. Hence the differences can be easily found with fewer errors in the experiment.
Sudoku puzzle is an example of a Latin square design.
• FD - Factorial design is an experimental design where each experiment has two
factors each with possible values and on performing trail other combinational
factors are derived.
5. Focus Group: The focus group method involves gathering a small group of
people to discuss a specific topic or product, facilitated by a moderator.
A group of 6-12 participants engages in a guided discussion led by a moderator
who asks open-ended questions to elicit opinions, attitudes, and perceptions.
Advantage: Provides in-depth insights and diverse perspectives through interactive
discussions, revealing the reasoning behind participants' thoughts and feelings.
Disadvantage: Results can be influenced by dominant participants or groupthink,
and the findings are not easily generalizable due to the small, non-representative
sample size.
Suitable Use Case: Exploring customer attitudes towards a new product, gathering
feedback on a marketing campaign, or understanding public opinion on social
issues.
6. Information from Local Sources or Correspondents:

In this method, for the collection of data, the investigator appoints

correspondents or local persons at various places, which are then
furnished by them to the investigator. With the help of correspondents
and local persons, the investigators can cover a wide area.
 Secondary Data
• Secondary data refers to information that has already been collected, processed, and
published by others.
• The data already in existence which has been previously collected by someone else for other
purposes is known as secondary data.
• It does not include any real-time data as the research has already been done on that
information. However, the cost of collecting secondary data is less.
• As the data has already been collected in the past, it can be found in refined form.
• The accuracy and reliability of secondary data are relatively less than the primary data.
• The chances of finding the exact information or data specific to the researcher's needs are
less. However, the time required to collect secondary data is short and hence is a quick and
easy process.
• Some examples of sources for the collection of secondary data are books, existing research
papers. journals, internal records, government records, articles, websites, government
publications, statistical databases, and company records. etc.
• The advantage of secondary data is that it is readily available and often free or less expensive
to obtain compared to primary data. It saves time and resources since the data collection
phase has already been completed.
 Methods of Collecting Secondary Data
Secondary data can be collected through different published and unpublished sources. Some
of them are as follows:
1. Published Sources
• Government Publications: Government publishes different documents which consists of
different varieties of information or data published by the Ministries, Central and State
Governments in India as their routine activity. As the government publishes these Statistics,
they are fairly reliable to the investigator. Examples of Government publications on Statistics
are the Annual Survey of Industries, Statistical Abstract of India, etc.
• Semi-Government Publications: Different Semi-Government bodies also publish data related
to health, education, deaths and births. These kinds of data are also reliable and used by
different informants. Some examples of semi-government bodies are Metropolitan Councils,
Municipalities, etc.
• Publications of Trade Associations: Various big trade associations collect and publish data
from their research and statistical divisions of different trading activities and their
aspects. For example, data published by Sugar Mills Association regarding different sugar
mills in India.
• Journals and Papers: Different newspapers and magazines provide a
variety of statistical data in their writings, which are used by different
investigators for their studies.
• International Publications: Different international organizations
like IMF, UNO, ILO, World Bank, etc., publish a variety of statistical
information which are used as secondary data.
• Publications of Research Institutions: Research institutions and
universities also publish their research activities and their findings, which
are used by different investigators as secondary data.
• For example National Council of Applied Economics, the Indian Statistical
Institute, etc.
2. Unpublished Sources
• Unpublished sources are another source of collecting secondary data. The data in
unpublished sources is collected by different government organizations and other
organizations.
• These organizations usually collect data for their self-use and are not published anywhere.
• For example, research work done by professors, professionals, teachers and records
maintained by business and private enterprises. The table below shows the production of
rice in India.
The table contains the production of rice in India in different
years.
It can be seen that these values vary from one year to
another. Therefore, they are known as variable.
A variable is a quantity or attribute, the value of which
varies from one investigation to another. In general, the
variables are represented by letters such as X, Y, or Z.
In the above example, years are represented by variable X,
and the production of rice is represented by variable Y.
The values of variable X and variable Y are data from which
an investigator and enumerator collect information
regarding the trends of rice production in India.
Conclusion
• Data collection is the backbone of any research or statistical investigation,
providing the necessary information to make informed decisions, identify
trends, and measure progress.
• By understanding the various methods of data collection—such as direct
personal investigation, indirect oral investigation, questionnaires,
observations, experiments, and focus groups—researchers can choose the
most suitable approach to gather primary data that is current, relevant,
and accurate.
• Similarly, using secondary data from published and unpublished sources
like government reports, trade associations, and research institutions can
save time and resources while offering valuable insights.
• Mastering these data collection techniques ensures the reliability and
validity of the research, ultimately leading to sound and actionable
conclusions.
 Difference between Primary and Secondary
Data
• Difference in Objective: The primary data collected by the investigator is
always for the specific objective. Therefore, there is no need to make any
adjustments for the purpose of the study. However, the secondary data
collected by the investigator has already been collected by someone else for
some other purpose. Therefore, the investigator has to make necessary
adjustments to the data to suit the main objective of the present study.
• Difference in Originality: As the primary data is collected from the beginning
from the source of origin, the data is original. However, the secondary data is
already present somewhere and hence is not original.
• Difference in Cost of Collection: The cost of collecting primary data is higher
than the cost of collecting secondary data in terms of time, effort and
money. It is because the data is being collected for the first time from the
source of origin. However, the cost of collecting secondary data is less as the
data is gathered from published or unpublished sources.