Inventory Time-Cost and Statistical Power: A Case Study of A Lao Rattan
Inventory Time-Cost and Statistical Power: A Case Study of A Lao Rattan
Abstract
A pilot study was conducted to determine the optimal survey design for an inventory of the commercially important rattan
Calamus poilanei in central Lao PDR. Simulations were used to estimate the coef®cients of variation (CVs) of population
density estimates for alternative sampling designs, a model was developed to determine the optimal survey design which
minimised survey time for a given survey precision and a statistical power analysis was used to determine whether these
surveys were suf®ciently sensitive to form part of a monitoring programme.
Line survey and plot enumeration times were quite high due to moderately dif®cult terrain. The CV (135% for a 5 m 50 m
plot) was markedly higher than in some comparable studies. The CV could be predicted well from plot size but plot shape
explained little additional variance. The optimum plot size varied but the 5 m 50 m plot was close to the optimal solution
over a wide range of situations. Surveys with a precision of 20% or better were predicted to be very time consuming. Power
analysis indicated that a survey precision of 5 or 10% was likely to be required if an annual monitoring programme was to be
useful in detecting a decline in the population. To achieve this precision, surveys would have to be even more time consuming,
and many `optimal' solutions were clearly impractical. For a resource of moderate value such as rattan cane, very prolonged or
costly surveys such as these are most unlikely to be economically justi®ed. # 2001 Elsevier Science B.V. All rights reserved.
Keywords: Survey techniques; Population density; Non-timber forest products; Power analysis; Lao PDR; Calamus poilanei
0378-1127/01/$ ± see front matter # 2001 Elsevier Science B.V. All rights reserved.
PII: S 0 3 7 8 - 1 1 2 7 ( 0 0 ) 0 0 5 8 9 - 2
314 T.D. Evans, O.V. Viengkham / Forest Ecology and Management 150 (2001) 313±322
representative data and make best use of limited and semi-evergreen forests in Lao PDR (personal
resources. This is usually done by carrying out pilot observations) and also occurs in Vietnam (Gagnepain
surveys and then performing an optimisation analysis and Conrard, 1937) and Thailand (specimens at
to select the best survey design (Prodan, 1968). The Royal Botanic Gardens, Kew). Voucher specimens
optimum varies according to the terrain, how patchily Oulathong 211 and Tom Evans 29 from the study site
a species is distributed and other factors. Examples of are held at both Kew and the Forest Research Centre,
such studies are common in the literature (Freese, Vientiane, Lao PDR.
1961; Arvanitis and O'Regan, 1967; Micosa-Tandug, A survey line 600 m long was marked in the forest,
1978; Taafe, 1979; Zeide, 1980; da Silva and de running perpendicularly away from a major stream
Vasconcelas, 1996; Stockdale and Wright, 1996). and along a slight ridge. The line was divided into
However, it is less often stated how much time the 100 m sections. At a random point along each 100 m
optimally designed survey would require or how section, a single inventory plot measuring 20 m
sensitive it would prove as part of a post-harvest 100 m was marked perpendicular to the survey line
monitoring programme. These are especially impor- and running away to either the left or right. Each plot
tant considerations for non-timber forest products was subdivided into 40 subplots of 5 m 10 m in
(such as rattan canes) since they usually have a much which all stems of Calamus poilanei longer than
lower value per hectare than timber. This means that 1 m (from the ground to the base of the petiole of
an expensive survey programme could jeopardise the the last fully expanded leaf) were counted. The time
overall pro®tability of the harvest. taken to mark out and then enumerate each plot was
This paper describes a pilot study of rattan popula- recorded. The survey team consisted of ®ve people,
tion density in a forest in central Laos. Optimal survey two to mark out the plots and three to enumerate
design and required survey times were predicted and a rattans. The total area enumerated was 1.2 ha which
power analysis was used to predict the sensitivity of was 10% of the total area sampled (12 ha).
possible monitoring programmes. The pilot survey
was conducted as part of the design process for a 2.2. Simulation of other sampling designs
larger survey in the same area. The detailed results will
prove valuable to others planning such surveys in the Alternative sampling designs were simulated using
region. More importantly, the general conclusions are the data from smaller portions of each 20 m 100 m
relevant to anyone planning inventory and monitoring plot. The sizes and shapes of the simulated plots are
of tropical non-timber forest products, since they shown in Table 1. The measure of plot shape used was
suggest that traditional density surveys can be an rectangularity, de®ned as the ratio of plot length to
inappropriate tool in some situations. width. Subplots with their long axis parallel to the
main transect line had a rectangularity <1. This is
appropriate because such plots ran across, not along
2. Methods the dominant habitat gradient and thus were expected
to capture a different amount of variation and so give a monitor a possibly declining population, Gerrodette
different degree of sampling error. (1987) gives an approximate relationship (his Eq. (20))
Each large 20 m 100 m plot was divided into between the rate of population decline, survey preci-
an integer number of smaller subplots (e.g. two sion, the frequency of surveys and the power. This
20 m 50 m plots, four 10 m 50 m plots or 20 equation was used to estimate how sensitive the
10 m 10 m plots), all of the same shape and area. optimal survey designs selected above would be in
Then one subplot was picked at random from each of various situations.
the six large plots. The set of rattan counts from the six
subplots was used to estimate the mean rattan density
and its standard deviation. This simulation process 3. Results
was repeated eleven times for each subplot size except
the two largest where only one simulation was done. 3.1. Pilot survey
The eleven estimates of density and standard devia-
tions were averaged and then used to estimate the The population density of Calamus poilanei stems
coef®cient of variation (CV) for individual plots. over 1 m tall was estimated as 20.0 stems/ha with 95%
Regression was used to determine an empirical con®dence limits of 8.70±31.3 stems/ha. Plot enu-
relationship between plot size, plot shape and CV. meration time averaged 600 min/ha, and the time to
Using only a single CV estimate for each plot size and measure and travel lines between plots averaged
shape avoided pseudoreplication. 18.5 min/100 m.
The optimal design is here considered to be the one Various linear combinations of explanatory and
which attains a given precision in the minimum total response variables were tried to determine which
survey time. The optimum design depends on a trade equation for predicting CV under other sampling
off between number of plots and plot CV. The opti- designs gave the best ®t to the data (Table 2). The
mum also varies depending on the total size of the quadratic combination preferred by Arvanitis and
forest, the survey precision required and the time O'Regan (1967) was not tried because it gave such
needed to survey lines and enumerate plots at a a modest improvement in ®t for their data. The pre-
particular site (Prodan, 1968). This is due to the ferred equation selected was
varying balance between total plot enumeration time
log
CV 0:292 0:263 log
area;
and travel time between plots as parts of the total
2
time budget. The optimum also depends on whether
R
adj 91:5% (1)
the shortest direct route is followed from plot-to-plot
or whether a set of parallel transect lines is laid out Table 2
and plots accessed along these. All these relationships Pilot survey for enhanced survey design of a solitary-stemmed
can be modelled mathematically as explained in rattan in central Laosa
Appendix A.
Explanatory variablesb Dependent R2(adj)
variable (%)
2.4. Power analysis
Area CV 63.5
Area, rectangularity CV 59.9
The power of a survey depends on the likelihood of log(area) CV 90.5
Type II errors or `false negatives' during statistical log(area), log(rectangularity) CV 91.0
testing. A higher likelihood of false negatives implies log(area) log(CV) 91.5
a lower power. This likelihood varies with the strength log(area), log(rectangularity) log(CV) 92.3
of the effect (thus a gentle decline in population a
Alternative explanatory variables for the coef®cient of
density is more likely to be overlooked than a steep variation in density estimates.
one). In the case of transect surveys being used to b
Area: subplot area.
316 T.D. Evans, O.V. Viengkham / Forest Ecology and Management 150 (2001) 313±322
This was the second best equation by a small margin approach recommended by Cohen (1988) and Rotten-
but was selected for ease of comparison with the berry and Wiens (1985). There is no standard accepted
results of Arvanitis and O'Regan (1967); Taafe level of power, perhaps because the measure is so
(1979) and Stockdale and Wright (1996). scarcely used and because the choice depends on the
relative costs of Type I and Type II errors (Peterman,
3.3. Optimisation of sampling design 1990). Three illustrative levels were chosen here, 0.95,
0.90 and 0.80 because these are the levels used in
The optimum plot size which minimised survey examples given by Steel and Torrie (1960); Gerrodette
time in each case was determined graphically. The (1987); Judd and McClelland (1989); Maxwell and
optima were not sharply de®ned in some cases and so a Delaney (1989) and Snedecor and Cochran (1989).
range of plot sizes gave very similar survey times. Calculations were performed for various possible
Examples of the optimum plot sizes, numbers of plots rates of decline and for series of up to ®ve surveys
and survey times required are given in Table 3 for four (Table 4). These results are not speci®c to the results of
sizes of forest, four levels of survey precision and two the present pilot survey and can be applied to any
alternative survey layouts. Survey times are those similar series of surveys if the precision of each survey
required by a team of ®ve people working 7 h/day. is known. The survey interval is not speci®ed but note
Precision is half of the 95% con®dence interval that the rate of decline is quanti®ed per survey interval.
expressed as a percentage of the survey mean. It is perhaps easiest to understand the data if one
considers ®rst an interval of 1 year. Thus, Table 4
3.4. Power analysis shows that, for example, if we require a power of 95%
then given a programme of two surveys, 1 year apart,
Results are presented as the minimum rate of each with a precision of 10%, the minimum rate of
decline which could be detected by a given survey decline which could be detected reliably is estimated
design at a given level of reliability (power), an as 23% per annum. In another example, at the end of a
Table 3
Pilot survey for enhanced survey design of a solitary-stemmed rattan in central Laosa
Table 5
Pilot survey for enhanced survey design of a solitary-stemmed rattan in central Laosa
Forest area (ha) Plot size, time (non-Zeide) Plot size, time (Zeide)
collected to determine whether Zeide's approach is not practical with wider plots. Long narrow plots are
more accurate. also preferable because they are less disorientating in
Micosa-Tandug (1978) identi®ed 0.01 ha as the dense forest (personal observation).
optimal plot size in her study of rattans in the Phi-
lippines, somewhat smaller than the optimum in Laos. 4.1.6. The time estimates are probably minima
Stockdale and Wright (1996) concluded that for a If multiple resources were surveyed or if more detail
200 ha forest block optimum plot sizes were was required (e.g. the stem lengths or sexes of rattans)
0.0025±0.025 ha for estimating rattan densities; the the survey time would increase further. It is also
Lao optimum falls in this range. important to note that the pilot survey covered an
The optimum plot sizes given in Table 3 are appro- area of only 12 ha. Rattans are often said to be patchily
priate for the particular resource studied. Other distributed on scales larger than this (J. Drans®eld,
resources are likely to show different degrees of personal communication, 1999), so the average CV for
clumping and occur in terrain of varying dif®culty, surveys over wider forest areas would be higher and
so it would be best to repeat the calculations using data the expected time to achieve a given accuracy perhaps
from a short pilot study such as this before conducting even higher than estimated here. However, for such
surveys over a very large area. large areas it might be more ef®cient to stratify the
area on the basis of topography and local knowledge
4.1.5. The effect of plot shape and sample each block separately.
Stockdale and Wright (1996) found that increased
rectangularity was an important predictor of decreased 4.2. Are traditional, plot-based inventories always
CV. Their results indicated that arranging plots so that appropriate?
they run downslope rather than across slope improved
precision at their study site because it increased 4.2.1. Inventories can be very time-consuming
within-plot variation and reduced between-plot varia- An important result of this study is that the time
tion. In contrast, this effect was not shown in the required to estimate the population density of this Lao
current study. Table 2 shows that adding log(rectan- rattan to a reasonable degree of accuracy is impracti-
gularity) as a variable explains only 0.8% more of the cally high (Table 3). This was not expected from a
variation in log(CV). This may be because the area had reading of the literature, although the problem is
irregular topography so some plots included very little brie¯y mentioned by Loetsch and Haller (1964).
habitat variation and others would have included much For example, in the study area a density estimate with
variation whatever their shape and size. the relatively low precision of 20% is predicted to
Given that 0.025 ha plots are required we recom- require 30 days of work in the forest for a team of 4±5
mend the dimensions 5 50 m. Such a plot has the people to survey 1000 ha (10 km2) and 229 days for an
advantage that it is narrow enough that only one side area of 10,000 ha (100 km2). Many individual Lao
of the plot needs to be precisely measured. People villages use areas of forest greater than 100 km2
counting plants along this marked line can simply (personal observation and IUCN-NTFP Project, Lao
estimate for most plants whether they fall in the plot, of®ce, unpublished data) but are most unlikely to be
and in cases of doubt can measure 5 m to one side or able to invest this much time in a single task involved
2.5 m to either side, as appropriate, to check. This is in improving the management of a single resource.
T.D. Evans, O.V. Viengkham / Forest Ecology and Management 150 (2001) 313±322 319
Table 6
Pilot survey for enhanced survey design of a solitary-stemmed rattan in central Laosa
Use of direct routes rather than transect lines would One potential solution to the high CV of a conven-
make surveys more technically dif®cult but would tional survey might be to use an adaptive survey
reduce the times stated above to 24 and 50 days, method, for example Adaptive Cluster Sampling
respectively. Even this degree of effort is unlikely (Thomson, 1990, Roesch, 1993). Such methods have
to be practical in many situations, especially if been used rarely in forestry applications, and not at all
required repeatedly for monitoring purposes. Econo- in non-timber forest product studies (J. Wong, perso-
mising on survey effort could reduce the precision of nal communication) but they deserve consideration
the results to such a degree that the data cease to be and ®eld testing.
useful.
The CVs recorded in this study are markedly higher 4.2.2. Monitoring surveys using these designs
than those recorded in several other published studies would have limited power
(Table 6). This suggests that the study species is a The power analysis in Table 4 indicates what kind of
particularly dif®cult one to inventory and that time surveys would be able to detect steep or gentle popu-
limitations would thus be less severe in some circum- lation declines. If we take the view that the risk of false
stances. For example, Stockdale and Wright (1996) positives and risk of false negatives should be equally
found that CVs were about 50±70% for most plot sizes likely, we require a power of 0.95. It appears that a
and they projected that rattan clumps in a 200 ha forest series of two surveys 1 year apart, each with precision
could be surveyed with 20% precision by a team of of 20%, could only reliably be expected to detect an
unspeci®ed size in 15±20 h using direct routes annual decline of 45% or more. Such a decline would
between plots. The same survey in Laos is predicted leave the population extinct in less than 3 years. Sensi-
to take a team of ®ve about seven times longer. This tivity this poor would have very limited value if it was
difference may also be partly due to higher travel and the main means of monitoring population levels.
enumeration times in Laos, but Stockdale and Wright Even so, in the Lao example, an enormous effort is
(1996) do not specify these. likely to be required to demonstrate this decline with
The high CV is a result of patchy distribution at the statistical signi®cance (30 days of work in the forest,
scale of the range of plot sizes used. Low density is not twice, by a team of 4±5, even for a forest of only 10 km2).
a cause, since for a given pattern of patchiness CV is Surveys with an individual precision of 5% could be
independent of density. Note that this study treated expected to detect a decline of 11% in the space of one
plots spread across 12 ha whereas Stockdale and survey interval or if carried out again in the middle of
Wright (1996) placed all their plots within 1.5 ha the interval, a decline of only 6% per interval. This is
and Micosa-Tandug (1978) within 1 ha. Thus, the closer to the degree of sensitivity likely to be required
present study probably detected additional sampling for monitoring purposes. Table 3 shows the great
variation at a level missed by those two studies amount of effort required to carry out such precise
but more relevant to the problems of a full-scale surveys in the Laos example. The same 10 km2 forest
survey. block would require over 150 days of work by the
320 T.D. Evans, O.V. Viengkham / Forest Ecology and Management 150 (2001) 313±322
Steel, R.G.D., Torrie, J.H., 1960. Principles and Procedure of Taafe, K.E., 1979. Computing Optimum Plot Size for Wildland
Statistics. McGraw-Hill, New York, USA. Inventories, Resource Inventory Notes BLM23, pp. 8±15.
Stockdale, M.C., Wright, H.L., 1996. Rattan inventory: determin- Taylor, B.L., Gerrodette, T., 1993. The uses of statistical power in
ing plot shape and size. In: Edwards, D.S., Booth, W.E., Choy, conservation biology: the vaquita and the northern spotted owl.
S.C. (Eds.), Tropical Rainforest Research Ð Current Issues. Conserv. Biol. 7 (3), 489±500.
Kluwer Academic Publishers, The Netherlands, pp 523±533. Thomson, S.K., 1990. Adaptive cluster sampling. J. Am. Stat.
Strayer, D.L., 1999. Statistical power of presence/absence data to Assoc. 85 (412), 1050±1059.
detect population declines. Conserv. Biol. 13 (5), 1034±1038. Zeide, B., 1980. Plot size optimisation. For. Sci. 26 (2), 251±257.