RESEARCH METHODOLOGY EEE 4209
LECTURE 7 & 8
Introduction
Research Design:
• Research design constitutes the blueprint for the collection, measurement, and
analysis of data in order to answer research questions within limited
resources.
• As such the design includes an outline of what the researcher will do from
writing the hypothesis and its operational implications to the final analysis of
data.
2
• The overall research design may be split into the following parts:
a) the sampling design which deals with the method of selecting items to be
observed for the given study;
b) the observational design which relates to the conditions under which the
observations are to be made;
c) the statistical design which concerns with the question of how many items are to
be observed and how the information and data gathered are to be analyzed;
d) the operational design which deals with the techniques by which the procedures
specified in the sampling, statistical and observational designs can be carried out.
3
• Features of a Good Research Design A good research design should be:
• Flexible, appropriate, efficient, and economical.
• Minimize bias and maximizes the reliability of the data collected and
analyzed.
• Give the smallest experimental error.
• Yields maximum information and provide an opportunity for considering
many different aspects of a problem
4
Data Collection
• The word data is the plural form of datum and refers to the facts, such as values or
measurements, observations or even just descriptions of things which are collected
during research.
• Data collection is very important in any type of research.
• Data collection impacts greatly on the research results, and inaccurate data collection
ultimately leads to invalid results.
• Data can be either quantitative or qualitative and classified into:
– Primary data
– Secondary data.
5
a) Primary data: Refers to the data collected by yourself or by your representatives at
the source. Are collected afresh and for the first time, and thus happen to be original
in character.
Primary data is usually current and may be more accurate. However, its more
difficult and time/energy consuming to collect.
b) Secondary data: Refers to the existing data which was originally collected. For
example, computerized database, company records or archives, publications, etc.
Secondary data is less expensive and more easier to collect than primary data.
However, it is not current and may be not accurate
6
Data Collection in Research
• The methods of collecting primary and secondary data differ since primary data
are to be originally collected, while in case of secondary data the nature of data
collection work is merely that of compilation.
• Primary data can be collected through the following methods:
Questionnaires
Interviews
Experiments
Observations
Simulation
7
The choice of which method to use depends on the following factors:
Nature, scope and object of research: This constitutes the most important factor
affecting the choice of a particular method to use in data collection.
The method selected should be such that it suits the type of enquiry that is to be
conducted by the researcher.
Availability of funds: Availability of funds for the research project determines to a
large extent the method to be used for the collection of data.
When funds at the disposal of the researcher are very limited, the researcher
have to select a comparatively cheaper method which may not be as efficient
and effective as some other costly method.
8
Availability of facilities and equipment: Experiments involves instrumentation
which requires facilities and equipment. If you do not have access to them, then
you may settle on other method especially simulation.
Time factor: Availability of time has also to be taken into account in deciding a
particular method of data collection. Some methods take relatively more time,
whereas with others the data can be collected in a comparatively shorter duration.
The time at the disposal of the researcher, thus, affects the selection of the method
by which the data are to be collected.
Precision required: Precision required is yet another important factor to be
considered at the time of selecting the method of collection of data.
9
Questionnaires/administered surveys
Three methods:
1. Face-to-face interviews
2. Self-administered questionnaires
3. Telephone interviews
Type of questionnaires
Self administered Interviewer administered
Completed by respondent Completed by researchers
Postal/mail Hand/self delivery Telephone
Structured interview
and collection
(market research)
• Face-to-Face Interviews (and intercept interviews)
• Subject responds to questions directly posed by researcher
(e.g., interview, phone survey)
Experimental Methods
• Experiments are performed in almost any field of enquiry and are used to study the
performance of processes and systems.
• The process is a combination of machines, methods, people and other resources
that transforms some input into an output that has one or more observable
responses.
• Experiments carried out for the purpose of collecting data to be analysed and
studied are carried out in the laboratory or in the field.
• Laboratory experiments can be standard testing methods, independently developed
procedures or laboratory scale model investigations.
13
• Standard testing methods are based on established standards and are commonly
used to test materials and systems to be used in or related to the research.
• The standard tests are usually used to gather preliminary data on the material to be
used in model testing or field experiments.
• In the case of numerical or computer modeling, data and results from standard
laboratory tests can be used as the specific data input for the model.
• For example in a computer structural model, data on material properties such as
strength, modulus and dimensions are required. These data has to be established or
ready before computer numerical model investigation can proceed
14
• Scientific research is about discovery of new things, methods, systems or theories.
It is almost inevitable that in the course of most experimental research, a researcher
will have to come up with one or more independent procedures that can be
calibrated and repeated.
• Laboratory scale model is a small scale, physical model of a larger actual or
prototype structure or systems. It is constructed in a laboratory and tested under
controlled and monitored conditions. The advantages of small scale models can be
their benefits in terms of controllable varied loading conditions, observable effect
of extreme/failure loading conditions, and the minimum cost of construction
15
• Experiments carried out in the field require careful planning and coordination. In
the field, it could be harder to control or to limit the various influences from
natural conditions.
• Thus, the following factors usually are considered when selecting an experimental
method:
experience in the use of instruments;
knowledge of calibration methods and awareness of the different errors to which
instruments are subject;
understanding of the relative merits and limitations of alternate instrumentation and
their applicability to different experimental situations
16
Simulation Method
• Simulation can be defined as a method for using computer software to model the
operation of real-world processes, systems, or events.
• The researcher develops a model of the phenomenon under investigation and then
chooses an appropriate simulation method.
• The model is run many times under various conditions to observe the outcome.
• In a simulation the researcher is experimenting with the model rather than the
actual phenomenon.
• Simulation involves the following generic steps:
17
• Research problem: Identify a research problem that is suitable for study by
simulation.
• Model design: Model design involves specification of the target to be modeled in
the simulation and the selection of an appropriate simulation method. There are a
number of different methods from which to choose depending on the problem
being investigated.
• Model design will usually involve some data collection to inform the parameters
for the model and the initial conditions for the simulation.
• Model building: The next step is building the simulation model. A number of
software programs are now available to support specific simulation methods but if
no suitable software package is available you will have to write the program
yourself
18
• Model verification: Verification involves running the simulation and testing
whether or not the model is working as it should. If there any problems with the
simulation these should be corrected.
• Run the simulation: Simulations can be thought of as virtual experiments during
which you run a series of experiments under different conditions that can be varied
as required. Variation allows different assumptions to be tested in order to answer
the research questions and also to test the sensitivity of the model to changes in
parameters.
19
• Model validation: Any model developed should be validated. Validation involves
confirming that the model is a good representation of the physical phenomenon.
Validation can be done by comparing results of the simulation with empirical or
experimental data.
• Validation can be a challenging process due to the nature of simulation and
potential limitations on available empirical data.
• Findings and conclusions: As with other research designs, your findings and
conclusions should be formulated in response to the research problem
20
Model Verification and Validation
• One of the most difficult problems facing the simulation analyst is determining
whether a simulation model is an accurate representation of the actual system being
studied ( i.e., whether the model is valid).
• If the simulation model is not valid, then any conclusions derived from it is of
virtually no value.
• Validation and verification are two of the most important steps in any simulation
project.
• Validation is the process of determining whether the conceptual model is an
accurate representation of the actual system being analyzed. Validation deals with
building the right model.
21
• Verification is the process of
determining whether a simulation
computer program works as
intended (i.e., debugging the
computer program).
• Verification deals with building the
model right.
• Consider the simplified version of
the model development process
shown in Fig. shown.
22
• The problem entity is the system (real or proposed), idea, situation, policy, or
phenomena to be modeled.
• The conceptual model is the mathematical/logical/verbal representation (mimic) of
the problem entity developed for a particular study. The conceptual model is
developed through analysis and modeling phase.
• The computerized model is the conceptual model implemented on a computer. The
computerized model is developed through a computer programming and
implementation phase, and inferences about the problem entity are obtained by
conducting computer experiments on the computerized model in the
experimentation phase.
23
• Conceptual model validation is defined as determining that the theories and assumptions
underlying the conceptual model are correct and that the model representation of the
problem entity is reasonable for the intended purpose of the model.
• Computerized model verification is defined as assuring that the computer programming
and implementation of the conceptual model is correct.
• Operational validation is defined as determining that the models output behavior has
sufficient accuracy for the models intended purpose over the domain of the models
intended applicability.
• Data validity is defined as ensuring that the data necessary for model building, model
evaluation and testing, and conducting the model experiments to solve the problem are
adequate and correct.
24
Some of the reasons due to which the models fail the validation tests are
a) Model-structure - In both the conceptual model and the simulation model,
mathematical simplifications might be inadequate for capturing complex
dynamics
b) Numerical solution - The solution of the simulation model might differ
dramatically from the ideal solution.
c) Inappropriate simulation software either too inflexible or too difficult to use
d) System noise - Failure to recognize random changes which exist in the real
system.
e) Wrong input data used
25
Simulation method is usually used:
• To optimize an existing design
• To verify analytical solutions (theories)
• To test new designs and theories
• When the real system is very complicated, small, big, dangerous or
destructive
26
Analysis of Data
27
