In
te
r
n
ation
a
l Jou
rn
al
o
f E
v
al
u
a
t
i
on
a
n
d
R
e
se
arc
h
in
Ed
u
c
ation
(
IJERE
)
Vol.
8
, No. 2, J
une
201
9
,
p
p
.
3
18
~3
29
ISSN
: 2252-
88
22,
D
O
I
:
10.11
59
1
/ijer
e
.
v8i
2.
149
86
318
Jou
rn
a
l
h
o
me
pa
ge
:
ht
tp:
//i
a
e
score
.
com
/
j
o
u
r
na
l
s
/
i
n
d
e
x
.
p
hp/IJ
ERE
Evaluati
on model
o
f ca
reer coun
selin
g
program in vocational
high school
S
r
i Tutur Mart
aningsih
1
,
Soen
arto
2
, Edi
I
s
t
i
y
on
o
3
1
Educa
tio
na
l R
e
se
arc
h
and
Ev
alua
t
i
o
n
,
Y
o
g
y
akart
a
S
ta
t
e
U
niversit
y
,
I
nd
onesia
1
U
n
i
v
ersi
tas A
h
m
a
d
D
a
hla
n
,
Ind
one
sia
2
D
e
pa
rtme
nt
o
f P
hysi
c
s Ed
uca
t
i
o
n,
Y
ogya
ka
rta S
t
ate
U
n
ive
r
si
t
y
,
I
ndo
ne
sia
3
D
e
par
t
m
e
nt
o
f Elec
tro
n
i
c
s
Ed
u
ca
ti
on,
Y
og
ya
ka
rta S
t
ate
U
n
ive
r
si
t
y,
Ind
one
sia
Art
i
cl
e In
fo
ABSTRACT
A
r
tic
le hist
o
r
y
:
R
e
c
e
i
v
e
d
Dec
9
, 2
0
18
Re
vise
d F
e
b 20,
201
9
Ac
ce
p
t
ed
M
ar 4
, 2
0
19
Vo
cati
onal
high
s
choo
l
gradu
a
tes
are exp
ected to
readi
l
y ent
e
r
the
work
f
i
e
ld,
n
e
ve
rthe
le
ss,
th
e
nu
mbe
r
o
f
u
n
e
mplo
y
m
e
n
t
fr
om
v
o
c
a
tio
na
l
hig
h
s
cho
o
l
grad
uat
e
s
i
s
s
t
i
ll
b
ig
.
Op
timi
z
in
g
a
car
eer
g
uid
a
n
ce
servi
ce
r
e
q
u
ires
c
o
m
plet
e
eval
uat
i
on
f
eedb
ack.
In
d
et
ail,
t
his
research
a
im
s
to:
id
en
t
i
f
y
in
g
a
co
ns
truct
in
s
t
rum
e
n
t
a
ppl
icab
le
t
o
evalu
a
te
a
career
g
uid
a
nce
pro
g
ram
at
vo
cati
onal
hi
gh
s
choo
l;
D
evel
op
ing
an
e
v
a
lu
ation
model;
and
E
x
ami
n
ing
the
m
easu
r
e
m
en
t,
s
tru
c
t
u
re
a
nd
t
he
e
ff
ecti
v
ity
o
f
the
m
o
d
e
l.
T
he
r
e
search’s
app
r
oach
a
nd
de
v
elop
m
e
nt
em
p
loy
Borg
&
Gal
l’s
M
o
d
e
l.
T
he
t
est
t
oward
th
e
pro
d
u
c
t
i
s
a
d
d
res
s
ed
t
o
nin
e
vocati
o
n
a
l
h
i
g
h
s
cho
o
ls
i
n
Y
ogyaka
rt
a.
T
he
v
a
li
d
i
ty
a
nd
r
e
l
ia
b
i
l
i
ty
i
ns
tr
u
m
e
n
ts
a
r
e
v
e
r
i
f
i
e
d
th
r
o
u
g
h
e
xp
e
r
t
j
udg
m
e
nt,
alp
h
a
Cronb
ach
a
naly
si
s,
E
x
p
lorato
ry
F
acto
r
A
n
a
ly
s
i
s
(EF
A
),
t
es
ti
ng
th
e
me
a
s
ur
e
m
e
n
t
m
o
de
l
,
a
nd
f
o
r
t
h
e
s
t
r
u
c
tu
r
a
l
m
o
d
e
l,
i
t
i
s
v
e
r
i
f
ie
d
b
y
me
a
n
s
of
part
ial
l
east
square
(
P
L
S)
S
ma
r
t
P
L
S
3.0.
T
he
p
roduct
constitute
s
a
car
ee
r
gu
id
ance
ev
al
ua
ti
on
m
o
d
el
a
t
vo
catio
nal
hig
h
s
cho
o
l,
c
o
m
plete
w
it
h
it
s
app
l
i
catio
n
,
m
an
ip
ul
a
t
i
on,
a
nd
a
nal
y
s
i
s
up
t
o
recom
m
e
nd
ati
on
c
o
nstruc
t
i
o
n
.
Th
e
resu
lt
o
f
t
h
e
EF
A
tes
t
s
hows
si
x
m
easu
r
em
ent
fact
ors
o
f
c
o
u
nse
l
in
g
serv
ice:
a
s
s
erti
v
e
n
e
ss
,
career
r
e
a
din
e
ss
,
se
lf-aw
a
reness
,
care
e
r
awaren
ess
,
work
c
haracteristi
cs
,
and
po
si
tive
attit
ude
towar
d
s
guidance
an
d
co
un
seli
ng
se
rvic
e
.
T
h
e
q
ua
li
ty
i
n
s
tru
m
e
n
t
p
r
od
uc
t
of
T
AD
IPHE
c
on
sis
t
s
o
f
t
h
e
targe
t
com
p
onen
t
(
3
i
t
em
s
)
,
as
sessm
en
t
(13
i
t
e
m
s),
de
s
i
g
n
(
1
3
i
t
e
ms
),
i
n
sta
l
la
ti
on
(22
items
)
proces
s
(4
4
it
e
m
s),
t
h
e
resu
lt
(
70
items
),
a
nd
eff
e
c
tive
n
ess
of
t
he
p
r
o
g
r
a
m
(
7
i
t
e
m
s
)
.
T
h
e
r
e
s
u
l
t
o
f
t
h
e
p
a
r
t
i
a
l
l
e
a
s
t
s
q
u
a
r
e
s
h
o
w
s
t
hat
al
l
predict
o
rs
c
ontr
ibute
(Q
2
)
as
m
uch
a
s
8
8.
91%
,
and
11
.
0
9
%
an
d
th
e
rest
m
ay
be d
eterm
i
ned
b
y
o
t
h
er v
ari
a
b
l
es
.
K
eyw
ord
s
:
Ca
ree
r
c
ounse
l
i
n
g
TADI
P
H
E
e
v
alua
t
i
o
n
m
ode
l
V
o
ca
tio
na
l
sc
h
o
o
l
Co
pyri
gh
t © 2
019 In
stit
u
t
e
of Advanced
En
gi
neeri
n
g
an
d
Scien
ce.
All
rights
res
e
rv
ed.
Corres
pon
d
i
n
g
Au
th
or:
Sr
i
Tutur Mar
t
a
n
in
gs
ih,
Un
iv
ersit
a
s Ahmad
Dah
l
an
,
K
a
pa
s stree
t
9
,
S
e
ma
ki
,
Y
ogy
aka
r
ta
5
516
6,
Ind
o
n
e
s
ia
.
Em
ail:
sm
ar
t
.
nin
g
si
h@
gm
ai
l.com
1.
I
N
TR
OD
U
C
TI
O
N
I
n
d
ones
i
a
w
i
l
l
b
e
n
ef
it
fr
om
t
he
d
e
m
ogra
p
h
i
c
b
o
n
u
s
w
i
t
h
in
2
0
25-
2
0
35,
w
i
t
h
the
num
ber
of
t
h
e
po
p
u
l
a
tio
n,
m
ore
or
l
e
s
s
2
5
0
m
il
lio
ns
o
f
w
h
ic
h
1
2
5
.
4
mill
ion
of
t
he
m
fresh
w
orkfor
ce.
A
mong
t
h
e
1
25.4
w
o
rkfor
ces,
1
18.4
m
i
l
l
i
o
n
a
r
e
acti
v
e
w
o
rker
s
bu
t
7
4
.09
8
.
4
85
pe
o
pl
e
(59.
07%
)
a
r
e
ele
m
e
n
ta
ry
s
c
h
o
o
l
grad
ua
t
e
s
[1].
L
ow
e
duc
ate
d
w
orkfor
ce
do
mina
t
e
s
t
h
e
co
nd
i
tio
n.
V
o
cati
ona
l
h
i
gh
sc
ho
ol
(
V
H
S
)
a
r
e
expec
t
e
d
to
p
r
o
d
u
c
e
r
e
a
d
y
sk
i
lle
d
w
o
rkers
t
o
f
u
l
fi
ll
th
e
nee
d
.
B
u
t
in
r
e
al
i
t
y,
t
he
num
ber
of
u
ne
m
p
lo
yme
n
t
in
2
0
1
6
rea
c
he
d
7
m
ill
io
n
pe
ople
,
a
n
d
1
.5
20.4
5
9
(
21.62
%
)
o
f
the
m
a
r
e
v
o
cational
school
g
ra
duates
[1].
T
here
a
r
e
some
p
rob
l
em
s
in
t
he
e
duc
a
tio
na
l
a
nd
t
r
ai
nin
g
s
ystem
s
a
t
t
h
e
v
o
c
a
t
i
ona
l
sc
h
o
o
l
s
[2
]
.
F
urther
more,
i
t
i
s
di
sc
o
v
ere
d
t
ha
t
51.5%
o
f
vo
cati
o
na
l
sc
hoo
l
gradua
t
e
s
a
r
e
u
nder
q
ua
lifi
e
d,
4
0%
w
el
l
q
u
al
ifie
d
a
n
d
8.5%
Evaluation Warning : The document was created with Spire.PDF for Python.
Int J
Eval & R
es E
d
u
c
.
IS
S
N
:
2252-
88
22
Ev
a
l
u
a
t
i
o
n m
odel
o
f
caree
r
c
o
u
n
se
l
i
n
g
pr
og
ram
at v
o
c
a
tio
na
l h
i
g
h
sc
ho
o
l
(Sri
T
u
t
u
r Ma
rt
an
ings
i
h
)
31
9
over
qua
lifie
d.
B
e
s
i
d
e
s
t
he
p
rob
l
em
s
of
l
i
n
k
and
ma
tc
h,
t
he
c
ur
r
i
c
u
l
u
m
a
n
d
i
t
s
a
c
a
d
e
m
i
c
i
m
p
l
e
m
e
n
t
a
t
i
o
n
,
s
o
f
t
ski
l
l
co
mp
et
e
n
ce
i
s
a
se
r
i
ou
s
p
r
ob
l
e
m.
D
e
v
el
opi
ng
s
tud
e
nts’
s
o
f
t
sk
i
l
l
is
t
he
t
as
k
of
c
a
r
ee
r
gu
i
d
ance
s
e
c
ti
o
n
.
T
h
i
s
i
s
in
t
e
g
r
a
t
e
d
w
i
t
h
o
t
h
er
p
ro
g
r
a
m
s
(
p
er
s
o
n
a
lit
y
,
s
o
ci
al
,
an
d
lear
nin
g
p
ro
gram
s).
A
c
a
re
er
guid
a
nce
pr
o
g
r
a
m
is
a
p
o
l
ic
y
i
m
ple
m
e
n
ta
ti
on
car
ried
o
u
t
co
nti
nuo
usly
a
nd
don
e
by
a
n
orga
niza
t
i
o
n
i
nv
o
l
v
i
ng
ma
ny
pers
ons.
O
p
tim
iz
i
ng
the
ca
ree
r
guid
an
ce
i
n
su
pport
i
n
g
t
h
e
su
cce
ss
o
f
educ
a
t
i
o
na
l
ac
hi
e
v
em
en
t a
t
V
H
S
depe
nds
o
n
m
a
ny fac
t
or
s am
ong ot
her
s
t
he pe
o
p
l
e
'
s per
cept
i
on, the
st
u
den
t
s'
att
itu
des,
t
he
o
rga
n
i
z
a
t
io
n,
a
nd
m
a
n
ag
er
i
a
l
s
u
pp
orts,
e
t
c
.
I
n
a
d
d
it
io
n,
a
dm
i
n
is
trat
i
v
e
an
d
no
n-su
bsta
nt
ia
l
ac
t
i
v
i
ti
e
s
o
f
t
e
n
domi
n
ate
the
pr
act
ice
.
T
he
c
ou
nse
lin
g
is
d
o
n
e
as
u
s
u
a
l
r
o
u
t
i
ne
s
a
n
d
far
from
t
arge
ti
ng
goa
ls.
P
e
rsiste
nt
i
mpr
o
v
e
me
n
t
o
f
c
a
re
er
gui
dan
c
e
a
t
V
HS
n
eeds
cons
truc
t
i
v
e
fe
e
d
bac
k
a
nd
a
c
o
n
s
truc
t
i
ve
,
prac
tic
al,
ob
jec
t
i
v
e,
a
n
d
com
p
re
hens
iv
e
eva
l
ua
t
i
o
n
s
ys
t
e
m
deve
lo
p
e
d
b
y
d
if
ferent
e
xper
t
s.
T
hi
s
r
e
search
t
ries
t
o
deve
l
op
a
n
e
va
lua
t
io
n
m
ode
l
of
c
a
r
ee
r
g
u
i
d
a
n
ce
p
r
ogra
m
f
or
V
H
S
st
ude
n
t
s
w
i
t
h
t
he
e
va
lua
t
i
o
n
c
o
mp
o
n
e
n
ts
of
g
oa
ls,
assessme
n
t,
d
esi
g
n,
i
ns
ta
lla
t
i
o
n
,
p
r
ocess,
out
com
e
,
a
nd
e
ffe
c
t
i
v
e
n
ess
of
t
he
p
rogr
am
.
The
qual
ity
and
ef
fec
t
i
v
en
e
s
s
o
f
t
he
e
va
lua
t
i
o
n
mode
l
a
r
e
expe
c
t
e
d
t
o
be
a
b
le
t
o
e
v
a
l
ua
te
car
eer
g
u
i
danc
e
at
V
HS
b
y
me
ans of re
l
ev
ant a
n
a
l
ys
i
s
.
T
h
is
r
e
s
e
a
rc
h
is
r
e
s
tric
t
e
d
to
t
he
s
tu
dy
of
c
ar
e
e
r
gui
da
nce
e
v
a
l
u
a
t
i
o
n
m
o
d
e
l
de
ve
l
o
pm
en
t
at
V
H
S
.
The
pro
b
lem
form
ulat
ion
i
n
cl
u
d
es
:
H
o
w
i
s
t
he
c
o
n
s
t
ruc
t
o
f
c
a
re
er
g
u
id
an
ce
p
ro
g
r
am
a
p
p
l
i
e
d
at
VHS;
Ho
w
i
s
t
h
e
form
o
f
ins
t
ru
m
e
ntal
t
oo
l
ne
ede
d
t
o
e
v
a
l
ua
t
e
t
he
c
a
r
ee
r
g
u
ida
n
c
e
a
t
VHS;
How
i
s
t
he
q
ual
ity
o
f
me
as
urem
ent
mode
l
for
ea
c
h
c
om
pone
nt
o
f
the
e
v
a
l
ua
t
i
on
m
od
e
l
i
s
d
e
ve
l
ope
d
;
H
o
w
i
s
t
he
q
ua
lit
y
of
T
A
D
I
PHE
ca
ree
r
-
cou
n
se
l
i
n
g
e
va
lua
t
ion
s
t
ruct
ur
e
m
odel
at
V
H
S
;
and
H
o
w
is
t
he
l
e
ve
l
o
f
e
ff
ecti
v
e
n
e
s
s
o
f
t
he
e
va
lua
t
i
on
model
to eva
lua
t
e
the
ca
ree
r
gui
da
nc
e pr
ogram
a
t
VH
S
.
T
h
e
pr
od
uc
t
o
f
t
he
r
e
s
ear
ch
w
il
l
be
i
n
t
h
e
for
m
o
f
a
car
eer
-cou
nse
l
in
g
p
r
ogra
m
e
val
u
at
io
n
m
ode
l
for
V
H
S
s
tu
den
t
s.
T
he
m
ode
l
to
d
e
v
e
l
op
is
c
a
l
le
d
TA
D
I
P
H
E
e
v
al
ua
t
i
on
m
odel.
T
A
D
I
PH
E
is
s
h
o
r
t
o
f
tar
g
et,
assessm
ent,
d
e
s
i
gn,
i
ns
ta
lla
t
i
on,
p
roce
ss,
resu
lt,
a
nd
e
ffe
c
t
i
v
e
n
ess.
T
he
i
n
s
trum
en
ts
a
re
v
erifie
d
t
h
eir
q
u
a
l
i
t
y,
val
i
d
it
y,
a
n
d
r
elia
b
ili
t
y
b
y
m
e
a
n
s
of
r
e
l
eva
n
t
ana
l
ys
is.
T
h
e
tr
y
ou
t
of
t
he
e
val
u
a
tio
n
m
o
d
e
l
i
s
d
o
n
e
a
t
V
H
S
i
n
Y
o
g
y
aka
r
t
a
m
unic
i
pa
li
ty.
T
h
e
eva
l
uat
i
o
n
ins
t
rum
e
nt
i
s
p
r
o
v
ide
d
w
i
t
h
a
g
u
i
d
e
f
o
r
p
r
o
c
e
d
u
r
e
s
o
f
u
s
e
,
d
a
t
a
ma
nip
u
la
t
i
o
n
,
data
a
na
l
y
sis, data prese
n
t
a
t
i
on,
a
nd
re
com
m
e
ndat
ion for
re
l
a
te
d
su
b
j
ec
ts.
The
e
a
se,
feasi
b
i
lit
y,
usefu
l
ne
ss
pr
inc
i
p
l
es
f
or
t
he
s
ch
oo
ls
a
n
d
s
ta
ke
h
o
lde
r
a
r
e
unde
r
c
onsi
d
e
r
at
io
n
i
n
d
e
v
e
l
o
p
i
n
g
the
pr
od
uct,
w
h
ic
h
is
a
n
e
x
ce
rpt
in
t
h
e
e
ffec
tive
n
ess
of
t
he
e
val
u
a
t
i
o
n
mode
l.
T
he
e
ff
ecti
v
e
n
e
s
s
of
t
he
e
val
u
a
tio
n
mode
l
w
ill
be ve
r
ifie
d
t
h
r
oug
h
assess
me
nt fr
o
m
di
f
f
ere
n
t users.
T
h
e
deve
l
opm
ent
of
car
eer
gui
da
nce
e
v
a
l
u
a
t
i
on
m
o
de
l
is
e
x
p
e
c
te
d
t
o
w
i
de
n
pers
pec
t
i
v
e
s
o
n
ca
ree
r
g
u
i
d
an
c
e
p
ro
gra
m
e
v
a
l
u
at
ion
a
t
VHS,
t
o
b
e
a
gu
id
elin
e
fo
r
ev
al
u
a
t
ion
proc
ess
s
t
a
r
ting
fr
om
p
l
a
nn
i
ng,
ana
l
ys
is,
an
d
i
n
ter
p
re
ta
tio
n
o
f
e
val
u
a
t
i
on
u
p
t
o
c
o
m
pos
i
ng
a
re
c
o
mm
enda
ti
on
i
n
r
e
la
ti
on
w
i
t
h
t
he
p
r
ogr
am
.
The
imp
l
em
en
tat
i
o
n
o
f
t
he
r
e
s
e
a
rc
h
i
s
e
xp
ec
t
e
d
t
o
b
e
ab
le
t
o
de
sc
ri
b
e
t
he
p
r
o
c
e
ss
of
d
e
v
el
o
p
in
g
a
qua
l
i
t
y
in
strum
e
n
t
o
f
t
h
e
e
v
a
l
ua
tio
n
pr
o
g
ram
.
T
he
r
esul
t
of
e
va
lu
a
t
i
o
n
o
p
e
r
a
t
i
o
n
a
l
te
st
s
how
s
t
h
e
qua
lit
y
o
f
c
a
r
ee
r
gu
ida
n
ce
a
t
V
H
S
.
F
u
rther
m
ore
,
t
he
m
a
n
i
pula
tio
n
a
n
d
t
h
e
ana
l
y
s
is
o
f
th
e
ev
a
l
u
a
ti
on
c
an
b
e
b
e
n
e
fi
ci
al
t
o
pro
duce
fe
e
dba
c
k
fo
r
the
i
m
p
rove
d an
d
sus
t
a
i
na
b
l
e
pro
g
ra
m.
T
h
e
resul
t
o
f
t
h
e
rese
arc
h
c
an
h
e
l
p
t
h
e
sc
ho
ol,
espe
c
i
a
lly
t
he
co
unse
l
or
t
o
e
v
a
l
ua
te,
a
nd
un
der
s
ta
nd
t
h
e
implem
e
n
ta
t
i
o
n
o
f
c
a
re
er
g
u
i
danc
e
pro
g
ra
m
at
V
H
S
,
probl
em
s
rela
t
e
d
t
o
i
t,
a
n
d
t
o
g
i
ve
a
s
ug
ges
t
i
o
n
for
th
e
bet
t
erm
e
nt
o
f
t
h
e
pro
g
ra
m.
T
he
d
e
v
e
l
o
p
e
d
e
val
u
a
tio
n
mode
l
c
a
n
b
e
a
st
a
n
d
a
rdi
z
ed
r
e
f
ere
n
ce
t
o
e
v
a
l
u
a
t
e
ca
ree
r
guida
nc
e
pr
ogr
am
s
a
t
V
H
S
.
G
u
ida
n
c
e
a
nd
c
ounse
l
i
n
g
teac
he
rs
c
a
n
m
a
k
e
use
o
f
T
ADIPHE
eva
l
ua
t
i
o
n
p
r
o
g
r
a
m
t
o
a
s
s
e
s
s
t
h
e
c
a
r
e
e
r
g
u
i
d
a
n
c
e
a
t
s
c
h
o
o
l
a
n
d
a
t
t
h
e
s
a
m
e
t
im
e
giv
e
f
eed
ba
ck
a
nd
r
e
c
om
me
ndati
on
t
o
rela
t
e
d
pa
rt
i
e
s for
t
h
e be
tterm
ent of
t
he pr
o
g
r
a
m
.
The
prod
uc
t
of a car
eer
g
u
i
danc
e e
v
al
u
a
ti
o
n
m
ode
l
f
o
r
VH
S
stude
n
t
s
is
a
n
eff
o
rt
t
o
mot
i
v
a
t
e
the
c
o
u
n
se
l
i
n
g
p
r
o
gram
b
e
tte
r
.
The
de
t
a
il
i
d
ea
l
imple
m
enta
ti
o
n
a
ct
i
v
it
y
i
s
ma
ximize
d
t
h
r
oug
h
e
v
al
ua
t
i
o
n
i
n
s
trume
n
t
s
o
t
ha
t
t
h
e
sc
h
o
o
l
s
c
a
n
u
s
e
i
t
a
s
t
h
e
r
e
f
e
r
e
n
c
e
t
o
g
u
a
r
a
n
t
e
e
t
h
e
ac
cou
n
t
ab
i
lit
y of
i
mp
lem
e
n
t
at
io
n o
f
c
a
r
ee
r gui
da
nc
e
p
r
o
g
ram
a
t
VH
S
.
2.
RESEARCH
M
ETH
O
D
Th
e
res
e
a
r
ch
o
n
c
a
re
er
gui
d
a
n
c
e
p
r
og
ram
at
VHS
b
elo
n
g
s
to
d
ev
el
opm
ent
rese
arc
h
,
ma
ki
ng
use
o
f
Bor
g
an
d
G
all r
e
sea
r
ch mode
l,
w
hich co
v
e
r
s 10 ste
p
s as t
he
fo
l
l
ow
ings
:
R
e
searc
h
a
n
d
in
form
a
t
io
n
co
l
l
e
c
t
i
n
g;
Pl
ann
in
g; D
e
v
e
lo
p pre
l
im
in
a
r
y form
o
f
pro
duc
t; Pre
lim
i
nary
fie
l
d
te
st
i
n
g; Ma
in
pr
o
d
u
c
t re
v
i
s
i
o
n
;
M
a
i
n
fie
ld
tes
tin
g; O
p
e
r
a
tio
n
a
l
prod
uc
t
rev
i
sio
n
; O
p
e
r
a
t
i
o
na
l
f
i
e
l
d t
e
st
i
n
g; Fi
na
l
p
r
od
uc
t
re
v
i
sio
n
;
D
i
ssem
i
n
a
t
i
o
n
a
n
d
im
p
l
e
m
en
ta
t
i
o
n
[3
].
T
h
e
d
e
v
el
opi
ng
p
ro
c
e
du
re
s
c
a
n
b
e
c
la
ssi
fi
e
d
i
nto
so
me
s
t
e
p
s
.
T
a
b
l
e
1
s
h
o
w
s
d
e
t
a
i
l
e
d
ac
t
i
v
i
ti
e
s
w
i
t
h
the
i
r pr
od
u
c
ts.
Evaluation Warning : The document was created with Spire.PDF for Python.
I
SSN: 2252-
8822
Int.
J
.
Ev
al. & R
es. Educ.
Vol.
8, No. 2, June
2
0
19:
3
18
- 3
29
32
0
Ta
ble
1.
T
he
p
roce
d
u
res of d
eve
l
opi
n
g
a
c
are
e
r
guida
nce
e
v
a
l
ua
t
ion
mo
del
at
VHS
Re
s
e
a
r
c
h
P
h
a
s
e
A
ct
ivity
P
roduc
t
Pre
limina
r
y
Re
sea
r
c
h
T
h
e
o
r
e
ti
c
a
l
A
na
l
y
sis,
t
he
s
t
u
d
y
o
f
poli
c
i
e
s
r
e
l
a
te
d
to
n
e
e
d
a
n
a
ly
sis,
d
e
t
e
r
m
i
ni
ng a m
o
d
e
l
Th
eo
r
e
t
i
c
al f
r
a
me
wo
r
k
De
s
c
ripti
on
o
f
n
e
e
ds
i
n
the
f
i
e
l
d
De
t
e
r
m
i
n
ing a th
e
o
r
e
ti
c
a
l
m
od
e
l
De
v
e
lop
m
e
n
t
De
v
e
lopi
ng i
n
strum
e
nts
Va
lida
ting a
nd
r
e
vi
sing
instr
u
m
e
nts
Da
t
a
c
oll
e
c
t
ion a
n
d
da
ta
a
n
a
l
y
sis
T
h
e instrume
nt of
e
v
a
l
u
a
tion m
o
d
e
l "
t
a
d
iphe”
E
xpe
rt
j
udgm
e
n
t and
instr
u
m
e
nt
v
a
l
i
d
a
tion,
Dra
f
t of the
v
a
lid
a
t
e
d
i
nstr
u
m
e
n
t.
T
r
y
out
L
i
m
it
e
d
t
ry
out,
va
li
d
a
ti
o
n
o
f
e
v
a
l
u
a
tion
m
o
d
e
l
instru
me
nt
,
empiri
c
a
l
t
r
y
o
ut
w
ith
ex
t
e
n
d
ed
s
u
b
j
ect
s
The
r
e
sult of li
m
ite
d try out;
Re
visi
on
o
f
i
nst
r
u
m
e
n
t
The
r
e
sult
of
t
ry
ing
out
w
i
t
h
e
x
t
e
nd
ed
s
ubje
c
t
s
Re
visi
on
o
f
t
he
t
r
y
i
ng
o
u
t
wit
h
e
xt
e
nde
d
subje
c
t
s
Fina
l
pro
t
oty
p
e
Di
ssem
i
n
a
tion
Se
m
i
n
a
r
of
r
e
s
ea
r
c
h
r
e
sult
Na
tiona
l/Inte
r
n
a
t
i
ona
l
Sem
i
n
a
r
Ve
r
i
f
i
ca
tion
of
e
f
f
e
c
tiv
e
n
e
ss
of
t
h
e
m
od
e
l
Fie
l
d
v
e
rific
a
tion
Soc
i
a
liza
tion
of e
v
a
l
u
a
tion m
o
d
e
l
Ve
rif
i
ca
tion
of
E
ffe
c
t
iv
e
n
e
ss
of
t
h
e
m
od
e
l
The
try
o
u
t
de
si
gn
inc
l
u
d
e
s
t
hree
pha
ses.
A
t
t
h
e
f
i
r
s
t
p
h
ase
o
f
t
r
yi
ng
o
ut
t
h
e
i
nit
i
a
l
i
n
s
t
r
u
m
e
n
t
deve
l
ope
d
by
the
rese
arc
h
er
i
s
disc
usse
d
w
i
th
e
xpe
rts
fro
m
di
ff
er
en
t
ex
pe
rt
i
s
e
to
g
e
t
i
np
u
t
i
n
re
l
a
t
i
o
n
t
o
th
e
form
at,
form,
la
ng
ua
ge,
a
n
d
e
d
it
in
g
of
t
he
i
n
s
t
r
ume
n
t
.
T
he
qua
n
t
i
ta
t
i
ve
d
a
t
a
fr
om
t
he
e
x
p
erts
a
re
a
nal
y
ze
d
by
me
ans
o
f
A
ike
n
's
I
n
d
e
x
a
s
fa
ce
va
lid
i
t
y
o
f
t
he
i
nstr
um
ent.
T
he
s
e
c
o
nd
ph
a
s
e
o
f
t
ry
o
u
t
i
s
the
lim
ite
d
t
r
y
ou
t
addre
sse
d
to
t
he
g
u
i
da
nce
a
nd
c
o
un
sel
i
ng
p
rac
tit
i
oner
a
nd
t
o
t
h
e
s
t
ud
e
n
ts.
The
sec
o
nd
p
h
ase
o
f
t
ry
o
ut
con
s
t
itu
tes
a
gu
ida
n
ce
a
n
d
c
o
uns
el
i
n
g
exper
t
a
nd
p
r
acti
t
i
o
ne
r
p
ro
ce
ss
ve
ri
fi
ca
t
i
on
r
el
at
ed
t
o
the
appr
opr
i
a
t
e
nes
s
,
rea
d
abi
l
i
t
y,
t
he
q
ua
li
ty
o
f
instrum
e
n
t
ite
m
s
.
The
th
ird
pha
se
o
f
try
o
u
t
is
t
he
f
ie
ld
t
ry
o
u
t
in
vol
v
i
n
g
w
ide
r
s
cope
s
uc
h
a
s
h
ea
dm
aste
r
,
d
epu
t
y
hea
d
m
a
ster
s,
c
oor
di
na
tors,
g
u
i
d
a
nce
a
nd
c
o
u
n
se
lin
g
teac
hers,
an
d
t
h
e
V
H
S
s
tude
n
t
s.
T
h
e
r
e
s
u
lt
of
t
he
t
ry
o
ut
i
s
d
i
re
ctly
u
se
d
to
a
na
lyz
e
t
he
qua
lit
y
of
t
he
c
a
r
ee
r
gu
ida
n
ce
p
r
o
gr
am
a
t
th
e
sc
h
o
o
l
.
The
n
u
m
b
er
o
f
su
b
j
ec
ts
f
or
d
e
v
e
l
o
p
i
n
g
e
va
lua
t
i
o
n
m
odel
i
s
9
68
per
s
o
n
s
con
s
is
tin
g
o
f
6
e
x
p
e
r
ts
i
n
eva
l
ua
tio
n,
g
u
i
da
nce
an
d
c
o
unse
l
i
ng,
e
d
u
c
a
tio
na
l
ma
na
g
e
m
e
nt,
lan
g
u
a
ge,
9
h
e
ad
mast
e
r
s,
8
d
ep
uty
h
eadmast
ers,
3
3
coo
r
di
n
a
to
rs
a
nd
gu
id
an
c
e
a
n
d
co
un
sel
i
ng
t
e
a
c
her
s
,
an
d
91
8
V
H
S
stude
n
t
s.
T
he
t
ech
n
i
q
u
e
a
n
d
the
i
n
s
t
r
u
me
nt
f
or
d
a
t
a
c
o
l
l
e
c
ti
o
n
use
foc
u
s
gro
u
p
d
i
sc
ussi
on,
i
n
t
erv
i
ew
,
and
que
st
ion
n
a
i
r
e
; e
s
pe
c
i
al
l
y
in d
e
t
e
rm
i
n
in
g t
h
e
qua
l
ity
o
f ins
t
r
u
m
ent m
o
d
e
l b
e
in
g
de
vel
o
pe
d
.
The
ana
l
ysi
s
o
f
i
n
strum
e
n
t
q
u
a
l
ity
v
erific
a
t
i
o
n
is
d
o
n
e
b
y
m
ean
s
of
v
a
l
id
ity
e
x
p
e
r
t
ju
dg
m
e
nt,
w
hos
e
sug
g
es
tio
n
is
u
se
d
as
t
he
r
e
a
s
o
n
f
or
i
ns
trum
ent
re
v
i
si
o
n
;
e
x
per
t
s
’
q
u
a
nt
ita
t
i
ve
d
ata
a
r
e
used
t
o
c
a
l
cu
la
te
A
i
ke
n’s
i
n
d
e
x
as
t
he
i
nd
ica
t
or
o
f
t
h
e
c
o
n
t
en
t
va
li
d
i
t
y
;
ins
t
rum
ent
'
s
re
lia
b
ili
t
y
i
s
a
n
a
l
yze
d
b
y
m
ean
s
o
f
relia
bi
l
ity
a
na
l
y
s
i
s
t
e
ch
n
i
q
u
e
from
A
l
pha
C
ro
nbac
h
d
a
n
t
hr
ou
gh
t
h
e
assi
st
an
c
e
o
f
SPSS
.
Th
e
in
st
ru
me
n
t
relia
bi
l
ity
c
r
ite
r
i
on
is
t
he
c
oe
ff
i
c
ie
n
t
a
lp
ha
i
nde
x
of
≥
0
.
7
0
[4];
t
he
e
xplor
a
tory
f
ac
t
o
r
an
a
l
y
s
i
s
i
s
don
e
by
mea
n
s
of
S
P
S
S
.
T
h
e
v
al
idi
t
y
t
est
e
m
pl
oys
t
h
e
e
xp
lo
ra
to
ry
f
a
c
t
o
r
a
n
a
l
y
s
i
s
(
E
F
A
)
w
i
t
h
t
h
e
h
e
l
p
o
f
S
P
S
S
com
p
u
t
e
r
p
ro
g
r
a
m
,
and
t
h
e
P
a
rtia
l
Leas
t
S
q
ua
re
(
P
L
S)
t
e
c
hn
i
que
o
f
a
na
lys
i
s
is
d
o
n
e
t
o
v
erify
the
i
n
s
t
r
u
me
nt
mode
l (o
uter
m
odel) a
n
d
to
ve
rify t
he
s
t
r
uc
tura
l m
odel
(i
nne
r m
odel).
The
fo
ur
i
n
d
i
cators
to
c
o
n
s
i
de
r
i
n
u
s
i
n
g
t
he
E
xp
lora
tor
y
F
ac
t
o
r
A
nalysis
(EF
A
)
te
chnique
a
re
Ka
i
s
er-Me
y
e
r-Ol
k
i
n
mea
s
ure o
f
sa
m
p
li
ng
ad
equa
c
y
(
KMO),
Bartle
t
t
’s t
e
s
t
o
f
sphe
ri
c
ity
,
an
ti
-im
age
correlati
on
,
and
fa
ct
o
r
l
o
a
di
ng
.
As
a
g
en
e
r
al
c
ri
t
e
rio
n
,
i
f
t
he
l
e
v
el
o
f
m
eaning
o
f
Barlett’s
te
s
t
o
f
sph
e
r
i
ci
ty
i
s
P
>
0.
05
a
n
d
t
h
e
an
t
i
-ima
ge
c
orr
e
lat
i
on
>
0
.
05,
i
t
in
dic
a
te
s
t
h
a
t
s
a
m
pl
e
da
t
a
a
re
l
i
a
bl
e
for
further
analys
is
[
5]
.
In
o
rder
t
o
se
e t
h
e
i
t
em
s,
w
hi
c
h
c
o
n
st
it
u
t
e
t
h
e
con
s
truc
t the
r
esu
l
t of
f
ac
t
o
r
l
o
ad
i
ng
is
c
o
n
s
i
de
red.
I
f
t
h
e
fa
ctor
loa
d
in
g
from
e
a
c
h
ite
m
≥
0.5
i
t
m
ea
ns
t
ha
t
t
h
e
i
t
em
i
s
w
e
l
l
v
a
l
ida
t
e
d
[
6].
F
r
om
t
he
h
i
g
he
st
f
ac
tor
l
o
ad
i
n
g
o
f
ea
ch
c
onstruc
t
,
i
t
ca
n
be
d
e
t
e
r
m
i
ned
t
h
e
fac
t
or
s,
w
h
i
ch
a
re
r
e
l
ev
ant
fo
r
t
h
e
co
nst
r
u
c
t
an
d
a
r
e
d
e
t
e
rmi
n
e
d
a
s
fa
ct
ors
suita
b
l
e
to
f
a
c
t
or
c
o
n
s
t
ruct
item
char
acte
r
ist
i
cs.
A
f
te
r
Ei
gen
fa
ctor
v
a
l
ue
i
s
o
b
ta
i
n
ed,
the
n
a
m
e
o
f
fa
ct
ors is de
t
e
r
m
i
ne
d b
y
se
e
i
n
g the
sup
p
o
rti
n
g in
st
r
u
me
n
t
i
te
ms
.
The
Pa
rtia
l
L
east
Sq
uar
e
s
A
n
al
ys
i
s
(
P
L
S
A
n
al
ys
is)
i
s
u
se
d
to
s
e
e
t
h
e
me
an
i
n
gful
nes
s
a
nd
t
h
e
fe
asib
il
i
t
y
of
m
odel
(fit
m
o
d
e
l)
by
me
ans
o
f
C
on
f
i
r
m
a
t
or
y
F
acto
r
A
n
a
l
ys
is
(
CF
A
)
t
ec
hn
i
q
ue
,
w
h
ic
h
be
com
e
s
a
pre
d
i
c
t
i
ve
m
ode
l
[7].
P
LS
a
na
l
y
s
i
s
i
s
u
s
e
d
due
t
o
t
h
e
l
i
m
ited
s
ub
je
c
t
s
of
t
he
t
ry
o
u
t,
e
spec
i
a
l
l
y
hea
d
ma
ste
r
s,
d
e
put
y
h
e
a
d
mast
e
r
s
,
c
oo
rdi
n
at
o
r
s,
a
n
d
gui
d
a
n
c
e
and
co
un
se
l
i
ng
t
e
a
c
h
e
r
s.
T
he
u
se
o
f
P
L
S
a
n
al
ys
i
s
i
s
done
t
o
pred
ic
t
the
re
l
a
t
i
on
sh
i
p
b
e
t
w
e
en
c
onstruc
t
s.
P
LS
a
nalysi
s
does
not
r
eq
ui
re
b
ig
s
a
m
p
l
e
s
n
ot
a
n
o
r
ma
l
di
stri
b
u
t
i
on
o
f
da
ta
[
6].
P
L
S
ana
l
ys
is
b
e
l
o
ngs
t
o
non-
par
a
me
t
r
i
c
st
ati
s
t
i
c
s
.
It
c
an
a
cco
mmo
d
a
t
e
a
l
imi
t
e
d
numbe
r
of
s
a
m
ple.
T
o
ana
l
yz
e
th
e
da
ta
t
h
i
s
resea
r
ch
u
se
s
S
m
art
P
L
S
3.0
P
r
ofe
s
si
ona
l
[8]
.
T
he
m
ode
l
i
ng
for
pred
ic
ti
ve
p
ur
pos
es
c
o
n
se
q
u
e
nce
h
a
s
t
h
e
c
ons
e
que
nce
t
h
at
t
he
t
e
s
t
c
a
n
b
e
do
ne
w
i
t
h
o
u
t
s
t
ro
ng
t
he
o
r
et
ical
bases
a
n
d
d
i
sr
egar
d
s
o
me
a
ssum
p
t
i
o
n
s
a
n
d
pr
ed
ict
i
v
e
m
o
del
ac
cur
acy
param
e
ter
s
s
een
f
rom
determinant
c
o
eff
i
ci
ent
v
a
lu
e [9
].
P
a
rti
a
l
Le
as
tS
qua
re
a
na
lys
i
s
i
s
a
s
truc
t
u
ra
l
e
q
u
i
vale
nt
(
S
E
M)
b
a
s
ed
on
varia
n
t
s
,
w
h
i
c
h
si
m
u
lta
ne
ous
l
y
m
easure
s
t
he
m
ea
surem
e
nt
m
odel
a
nd
a
t
t
he
s
am
e
t
im
e
str
u
c
t
ura
l
m
od
el.
The
me
asurem
ent
mode
l
i
s
u
sed
to
m
ea
sur
e
t
he
v
a
l
i
d
i
t
y
a
n
d
r
e
l
i
a
b
i
l
i
t
y
of
t
h
e
i
t
em
s
or
t
he
l
ate
n
t
va
ria
b
le
i
n
d
i
ca
tor
s
w
h
i
le
t
he
Evaluation Warning : The document was created with Spire.PDF for Python.
Int J
Eval & R
es E
d
u
c
.
IS
S
N
:
2252-
88
22
Ev
a
l
u
a
t
i
o
n m
odel
o
f
caree
r
c
o
u
n
se
l
i
n
g
pr
og
ram
at v
o
c
a
tio
na
l h
i
g
h
sc
ho
o
l
(Sri
T
u
t
u
r Ma
rt
an
ings
i
h
)
32
1
st
r
u
c
t
ura
l
m
od
el
i
s
u
s
ed
t
o
te
st
t
he
causa
lit
y
(H
ypot
hes
i
s
t
e
st
w
i
t
h
pre
d
ic
ti
o
n
m
ode
l).
The
e
v
a
l
ua
t
i
on
c
r
it
e
r
i
a
in
u
s
i
n
g
P
LS
a
na
lys
i
s
w
h
i
c
h
co
ver
s
i
nst
r
um
ent
m
ode
l
e
v
al
ua
ti
o
n
(o
uter
m
ode
l)
a
n
d
s
t
r
uc
t
u
ral
m
odel
eva
l
ua
tio
n
(i
nn
er
m
ode
l
)
a
n
d
a
ls
o
t
h
e
m
o
del
qua
l
ity
t
es
t
[1
0].
Mea
s
ur
em
ent
mo
de
l
eva
l
u
a
ti
o
n
(
o
u
ter
m
ode
l)
and
m
e
a
s
urem
ent
m
o
del
ev
a
l
ua
tio
n
use
S
m
art
P
L
S
3.0
by
m
ea
ns
o
f
ou
ter
mo
de
l
a
n
al
ys
is
i
.
e
.
b
y
see
i
n
g
con
s
truc
t
m
e
a
s
ure
m
e
n
t
i
n
d
i
cator
q
ual
i
t
y.
T
he
a
s
s
um
p
tio
n
use
d
i
n
t
h
e
r
e
s
e
a
r
c
h
i
s
t
h
a
t
t
h
e
m
e
a
s
u
r
e
m
e
n
t
in
dic
a
t
o
r
s
hou
l
d
b
e
h
i
g
h
ly
c
or
relate
d
w
i
t
h
t
h
e
c
o
n
struc
t
.
In
t
h
e
co
rre
l
a
t
i
o
n
an
a
l
y
s
i
s
,
t
h
e
loa
d
ing
f
a
ct
o
r
can
b
e
seen
f
r
o
m
e
ach
i
n
d
i
ca
t
o
r.
T
h
e
s
truc
t
u
ra
l
m
o
d
e
l
e
v
a
l
ua
tio
n
(
i
nne
r
m
o
del
)
.
In
t
e
s
t
i
n
g
t
h
e
s
t
r
uc
t
u
ral
m
ode
l
b
y
me
ans
of
P
LS
a
nal
y
s
i
s
R-sq
u
a
r
e
s
of
e
ach
e
nd
oge
n
la
ten
t
v
aria
ble
a
s
th
e
pre
d
i
c
tiv
e
stre
ng
th
o
f
the
s
t
r
u
ct
ural
mode
l.
V
I
F
i
n
d
e
x
s
how
s
w
h
ether
or
n
o
t
m
ult
i
c
o
l
l
i
n
ea
ri
t
y
,
f
2
s
how
s
t
h
e
in
flue
nc
e
o
f
e
xo
ge
n
o
us
v
a
r
iab
l
e
(pre
di
c
t
or)
to
t
he
e
ndo
ge
no
us
v
a
r
iab
l
e
(
l
a
t
en
t
varia
b
le
).
Q
2
is
t
h
e
c
oe
ffic
ie
nt
d
e
t
e
r
m
i
na
n
t
o
f
al
l
pre
d
ic
t
o
rs
t
o
the
la
t
e
n
t
v
ar
i
a
ble
,
w
h
i
c
h
s
h
o
w
s
t
he
c
o
n
tr
i
b
u
tio
n
of
a
l
l
p
r
e
dic
tors
t
ow
a
r
d
la
t
e
nt
v
aria
b
l
e
.
F
o
r
m
ula
Q
-
squ
a
r
e
(Q
2
)
i
s
:
Q
2
=
1
–
(
1
–
R
1
2
)
(
1
–
R
2
2
)
.
.
.
(
1
-
R
p
2
)
,
wher
e
R
1
2
,
R
2
2
.
.
.
R
p
2
i
s
R-squ
a
re
e
nd
og
en
v
a
r
i
a
bl
e
i
n
t
h
e
mode
l [1
1].
The
ef
fec
t
i
v
e
n
e
s
s
ve
ri
fica
t
i
o
n
of
e
v
a
l
u
a
t
i
o
n
m
odel
is
d
o
n
e
by
m
e
a
ns
o
f
a
que
st
ion
n
a
i
r
e
a
ddre
s
se
d
to
eva
l
ua
tio
n
user
s.
T
he
p
roc
e
ss
o
f
ver
i
f
i
c
a
t
i
on
of
t
h
e
e
va
l
u
a
t
i
o
n
m
o
d
e
l
i
s
don
e
af
t
e
r
t
h
e
eva
l
u
a
ti
on
in
st
rume
n
t
is
v
erifie
d
i
t
's
qua
l
ity
i
.
e
.
it
s
m
e
a
s
urem
ent
a
n
d
str
u
c
t
ural
m
o
del
s
a
r
e
v
e
r
i
f
ie
d.
F
urther
more
,
the
i
n
str
u
m
e
ntal
pro
duc
t
be
i
ng
de
ve
l
ope
d
i
s
c
omple
t
e
d
a
n
d
u
se
d
for
o
p
e
r
at
io
na
l
p
r
o
d
u
ct
v
e
r
ifica
t
i
on.
T
h
e
n
i
t
s
e
ffe
ct
ive
n
ess
i
s
a
n
al
y
zed
b
y
t
h
e u
s
e
r
s
.
3.
RESULT
S
A
N
D
DISCU
SSIO
N
Bef
o
re
d
e
v
e
l
o
p
in
g
the
ins
t
ru
m
e
nt
o
f
e
v
a
l
u
a
tio
n
m
o
del,
s
om
e
prel
imi
n
a
r
y
stu
d
ies
a
r
e
do
ne
s
uc
h
as
lite
rat
u
re,
fie
l
d
,
a
nd
lim
i
t
e
d
s
c
a
le
r
ese
a
rc
h
s
t
u
d
i
e
s
.
The
s
t
u
d
ie
s
ar
e
abo
u
t
the
impl
em
en
tat
i
on
of
t
he
c
a
r
ee
r
g
u
i
d
a
n
c
e
p
r
o
g
r
a
m
a
t
V
H
S
.
E
d
u
c
a
t
i
o
n
i
s
a
s
t
r
a
t
e
g
i
c
e
f
f
o
r
t
t
o
p
r
e
p
a
re
y
ou
ng
i
n
d
i
vi
du
a
l
s
to
d
ev
elo
p
t
h
e
m
se
l
v
es
in
o
rde
r
t
o
be
s
ucce
ssfu
l
i
n
t
h
eir
l
i
v
es,
in
c
l
udi
ng
the
i
r
suc
c
e
ss
i
n
t
h
eir
c
a
re
ers.
G
uida
n
c
e
a
nd
c
o
u
n
se
l
i
n
g
a
t
sc
ho
ol
w
ith
a
w
i
d
e
s
c
op
e
o
f
a
ut
ho
rit
y
a
nd
v
a
ri
o
u
s
wo
rk
f
i
e
ld
i
n
d
e
v
e
l
o
p
i
n
g
the
st
u
d
e
n
t
s
’
p
o
te
n
tia
ls,
o
p
en
w
i
der
op
por
tu
ni
t
i
e
s
t
o
i
m
pr
ove
t
he
i
r
r
ole
a
n
d
use
f
ul
ness
i
n
he
l
p
i
ng
t
he
s
tu
d
e
nt
s
d
e
ve
l
o
p
th
e
m
se
lve
s
a
nd
fa
ci
lita
te
t
he
m
to
b
e
rea
dy
for
the
i
r
car
eer
s
[12,
13]
.
G
u
ida
n
c
e
a
n
d
cou
n
s
e
li
ng
at
s
ch
o
o
l
t
o
ge
the
r
w
it
h
ot
her
rela
t
e
d
par
ties
e
ithe
r
i
ns
i
d
e
o
r
out
si
de
t
he
s
c
h
o
o
l
t
r
y
t
o
o
p
t
i
m
i
z
e
t
he
s
erv
i
ce
i
n
hel
p
in
g
the
s
t
ud
en
ts
p
repa
re
them
se
lves
t
o
a
c
hie
v
e
succe
s
s
i
n ca
ree
r
.
A
voca
t
i
o
nal
sc
ho
o
l
a
s
a
n
i
n
s
tit
u
tio
n,
w
hic
h
i
s
e
x
pec
t
e
d
t
o
be
a
b
le
t
o
pr
ov
i
d
e
y
o
u
n
g
r
ea
dy
w
orke
rs,
w
ho
ar
e
r
e
a
d
y
to
w
ork,
c
r
eat
i
v
e,
a
n
d
a
b
l
e
to
o
pen
w
o
rk
o
p
por
tu
n
it
i
e
s.
V
H
S
w
ith
i
t
s
m
ul
ti-face
t
e
duc
a
t
i
o
nal
ob
jec
t
i
v
es
p
ro
vi
de
s
tu
de
nts
w
i
t
h
a
cade
m
ic
a
nd
n
o
n
-a
ca
de
mic
com
p
ete
n
c
i
e
s
i
ncl
u
din
g
how
t
o
un
d
e
rstan
d
ca
ree
r
opp
or
tun
i
ti
e
s
,
sel
f
-p
ote
n
tia
l,
a
nd
l
i
m
i
t
a
tio
ns,
t
h
e
disc
repa
nc
y
be
t
w
e
e
n
the
i
r
c
a
re
er
i
dea
s
a
n
d
l
i
mit
a
ti
on
s.
T
he
se
t
hi
ng
s
sh
ou
ld
m
o
t
iv
a
t
e
t
h
em
t
o
ma
k
e
t
h
e
i
r
g
r
ea
t
effor
t
t
o
de
vel
o
p
th
e
i
r
po
t
e
ntia
l
s
t
o
m
eet
t
h
e
n
eed
.
Th
e
ro
l
e
o
f
co
mp
re
h
e
nsi
v
e
c
a
re
er
g
u
i
d
a
n
c
e
i
s
v
e
r
y
i
m
p
orta
nt
a
nd
sho
u
l
d
b
e
ca
rried
o
u
t
o
p
t
ima
l
l
y
and
co
n
tin
uo
us
ly.
Th
e
g
u
id
an
ce
a
n
d
c
oun
sel
i
ng
s
ervi
ce
a
s
st
ipu
l
a
t
e
d
i
n
the
reg
u
l
a
t
i
on
o
f
The
Minis
t
ry
O
f
Na
t
i
onal
Ed
uca
t
i
o
n
n
u
m
ber
27
t
h
e
y
e
ar
2008
[
14]
a
bo
u
t
c
ou
nse
l
o
r
a
nd
t
h
e
re
gu
la
t
i
on
o
f
Th
e
Mi
ni
st
ry
O
f
Ed
u
c
a
t
i
on
and Cu
lt
ure N
u
mbe
r
1
11 t
h
e year
2
01
3 [1
5
]
a
bo
ut gu
i
da
nc
e and
co
un
se
lin
g
at
e
l
e
me
nt
ary
a
n
d
mi
ddl
e
s
c
ho
ol
s
is
c
om
prehe
n
si
ve
g
u
i
da
nce
a
n
d
c
o
u
n
se
l
i
n
g
.
The
dem
a
n
d
s,
d
ut
y,
a
n
d
t
h
e
cha
lle
ng
e
of
c
ar
eer
gui
da
nce
grow
a
n
d
requ
i
r
e
st
ra
t
e
gi
c
e
f
fo
rt
s
uc
h
a
s
d
ev
e
l
op
in
g
co
un
seli
ng
w
i
t
h
a
c
l
e
a
r
g
o
a
l
,
a
n
d
b
a
s
e
d
o
n
a
s
s
e
s
s
m
e
n
t
s
o
t
h
a
t
it
m
ee
ts
t
he
d
e
m
and.
D
esigni
ng
the
progr
a
m
a
nd
the
ins
t
a
l
l
a
ti
on
s
u
ppo
rt
f
ro
m
t
h
e
i
n
st
it
uti
o
n
sh
oul
d
be
w
el
l
prepa
r
ed.
T
h
e
bet
t
e
r
m
e
nt
o
f
t
h
e
proc
ess
s
h
o
u
l
d
b
e
d
o
n
e
c
ont
i
nua
ll
y
t
o
a
ch
i
e
v
e
t
h
e
m
a
x
imu
m
l
e
v
el
o
f
su
cc
ess
a
n
d
th
e
p
r
og
ram
i
s
r
e
a
l
l
y
effe
ct
i
v
e.
A
cc
u
r
a
t
e
f
e
e
d
b
a
c
k
i
s
n
e
c
e
s
sary
t
o
g
u
aran
t
ee
th
e
ef
f
ect
i
v
e
n
e
s
s
of
t
h
e
p
r
og
ram.
E
f
f
e
c
t
iv
e
f
eed
b
a
c
k
c
a
n
o
nly
b
e
ach
i
e
v
e
d
t
h
ro
ugh
a
c
o
mp
rehe
ns
ive
e
v
a
l
uat
i
on
of
t
he
p
ro
gra
m
.
The
eva
l
ua
tio
n
of
t
he
c
o
u
n
se
li
n
g
s
er
vi
c
e
i
s
e
xpe
c
t
e
d
t
o
resu
l
t
i
n
a
r
e
c
om
me
ndat
i
on
,
w
h
ic
h
is
i
m
p
o
r
ta
n
t
f
o
r
t
he
bet
t
erm
e
nt
o
f g
u
i
d
a
n
ce
a
nd c
o
uns
el
i
ng ser
v
ic
es a
t
V
H
S
w
ith
diff
e
r
en
t spe
c
i
fic
char
ac
ter
i
s
t
ics.
V
H
S
st
ude
nt
s
are
at ad
o
l
esce
nt age
be
t
w
e
en
16 – 1
8
yea
rs
o
l
d
. T
h
e
i
r
d
ev
el
op
me
nt
t
o
a
c
hi
e
v
e
:
m
atu
r
it
y
in
r
el
igi
o
us
m
a
t
te
rs
(
reli
g
i
o
u
s
bel
i
e
f
a
n
d
p
r
a
c
tice
)
;
soc
i
a
l
m
a
tur
i
t
y
a
mo
ng
classm
ates
a
c
r
oss
ge
n
d
ers;m
a
tu
r
i
t
y
i
n
h
e
a
lt
hy
phy
si
ca
l
co
nd
iti
o
n
;
m
a
t
u
r
it
y
in
s
c
i
en
c
e
,
t
echn
o
l
o
gy
a
n
d
a
r
t
s
ma
tter
s
i
n
acc
orda
nc
e
w
i
th
t
he
curr
i
c
u
l
um,
ca
ree
r
,
and
furth
e
r
st
ud
y
a
nd
a
l
s
o
m
aturi
t
y
i
n
ge
ne
ral
so
ci
a
l
l
i
f
e;
m
a
t
u
r
it
y
in
c
a
r
ee
r
c
h
oi
ce;
ma
turi
t
y
i
n
em
ot
iona
l,
s
oc
ial,
i
n
t
el
lec
t
ua
l
,
a
nd
ec
on
omic
i
nde
p
e
nde
nce
;
m
aturi
t
y
in
a
tti
tu
des
in
t
he
ir
live
s
i
n
fa
mil
y
,
c
o
mmun
ity
a
nd
na
tio
na
l
c
i
t
i
z
e
n
s
h
ip
;
m
a
turi
t
y
i
n
soc
i
a
l
a
nd
in
te
lle
ctua
l
c
o
m
m
uni
c
a
t
io
n
as
w
e
ll
a
s
i
n
arts
a
pprec
ia
t
i
o
n
;
in
e
t
h
i
c
a
nd
val
u
e
syste
m
[
16
–
18]
V
a
rious
a
s
p
ec
t
s
o
f
deve
l
opm
ent
as
t
he
i
n
d
i
v
id
ua
l's
t
a
rge
t
s
of
d
eve
l
opm
e
n
t
sh
ou
l
d
b
e
prepa
r
ed
t
o
e
n
ter
the
w
o
r
k
f
ie
ld
a
s
w
e
ll
a
s
a
s
oc
ia
l
c
o
m
m
uni
t
y
.
A
s
V
HS
i
s
a
v
o
c
a
t
io
n
a
l
sch
o
o
l,
t
he
car
eer
gui
danc
e
an
d
cou
n
se
l
i
n
g
p
r
o
gr
am
g
e
t
s
first
pri
o
ri
t
y
c
om
par
e
d
w
i
t
h
o
t
h
er
p
rog
r
a
m
s
.
A
t
t
he
ir
c
a
r
ee
r
deve
l
o
pm
ent,
t
he
stude
n
t
s
a
r
e
in
t
heir
r
ealis
t
i
c
perio
d
w
it
h
cer
t
a
in
p
hase
s
in
i
t
suc
h
a
s
explora
t
ion,
c
rystal
l
i
z
a
t
i
o
n
,
and
Evaluation Warning : The document was created with Spire.PDF for Python.
I
SSN: 2252-
8822
Int.
J
.
Ev
al. & R
es. Educ.
Vol.
8, No. 2, June
2
0
19:
3
18
- 3
29
32
2
spec
ific
a
tio
n
p
h
a
s
e
s
[1
9].
A
t
t
h
i
s
per
i
o
d
t
he
y
nee
d
d
i
r
ec
ti
on
fo
r
the
i
r
c
ons
ol
ida
t
io
n
o
f
i
n
t
e
r
est
orie
nta
t
io
n,
ca
paci
t
y
,
and
val
u
es
t
ow
ards
t
he
c
a
r
ee
r,
w
hic
h
i
s
refle
c
t
ed
a
n
d
i
nt
eg
rat
e
d
sy
st
emati
c
a
l
ly
a
t
th
e
vo
cat
ion
a
l
fra
m
e
to
c
h
o
o
s
e
an
d
e
n
ter
the
re
l
e
va
n
t
w
ork
fiel
d.
T
he
c
are
e
r
g
ui
d
a
n
c
e
at
VHS
c
a
n
h
el
p
t
h
e
st
ud
e
n
t
s
,
wh
o
d
e
ci
d
e
to
en
t
e
r
t
h
e wo
rk
fi
e
ld
, p
r
e
p
are
t
h
emse
l
v
e
s
t
o
wo
rk
a
s t
hey
w
i
s
h
an
d
b
e in
de
pe
n
d
e
n
t
[20
–
22].
S
o
m
e
p
relim
in
a
r
y
stud
ies
s
h
o
w
t
ha
t
g
u
i
danc
e
and
c
o
u
n
sel
i
ng
serv
i
c
e
at
s
ch
ool
h
as
not
b
e
e
n
e
f
f
e
c
t
i
v
e.
I
t
n
e
e
d
s
a
g
o
o
d
w
i
l
l
i
n
g
n
e
s
s
t
o
c
o
n
s
t
a
n
t
l
y
i
m
p
r
o
v
e
a
n
d
d
e
v
e
l
o
p
s
ome
ne
ce
ssa
r
y
t
h
in
g
s
f
or
m
ore
effecti
v
e
se
rv
i
c
e.
D
u
e
t
o
th
i
s
f
a
c
t
e
v
al
ua
t
i
on
o
f
t
h
e
p
r
o
g
r
am
i
s
n
e
ce
ssa
r
y
to
g
et
f
eed
b
a
c
k
r
el
a
t
ed
t
o
t
h
e
we
akn
e
sse
s
o
f
the
gu
i
d
a
n
ce
a
nd
c
o
u
n
se
l
i
n
g
progra
m
.
In
s
pi
t
e
o
f
t
h
a
t
t
o
ca
rry
out
a
c
ompr
ehe
n
si
ve
e
v
a
l
u
a
t
i
o
n
pr
ogr
am
,
g
u
i
d
an
c
e
a
nd
c
o
un
seli
ng
t
e
ach
e
r
s
a
r
e
stil
l
l
ack
o
f
ca
p
aci
t
y
i
n
d
e
si
gnin
g
a
nd
c
arryin
g
out
a
n
ev
a
l
u
a
ti
on
pro
g
ra
m.
T
he
refore
a
n
e
v
al
ua
ti
on
m
ode
l
i
s
n
ec
essary
f
or
p
ra
ct
i
c
a
l
g
ui
da
nc
e
a
n
d
c
o
u
n
se
l
i
n
g
p
ro
gra
m
eva
l
ua
tio
n.
T
hi
s
rese
arc
h
foc
u
s
e
s
on
d
e
vel
o
p
i
n
g
a
car
eer gu
i
da
n
ce
e
va
l
u
at
ion
mode
l
at V
H
S
.
T
h
e
de
ve
lo
pm
ent
of
e
va
l
u
a
t
ion
m
o
de
l
be
gi
ns
w
ith
a
p
re
li
minar
y
s
t
udy
,
i
n
st
ru
me
nt
c
ra
f
t
i
n
g
,
t
r
y
o
u
t
t
o
see
t
h
e
q
u
a
lit
y
of
t
he
i
ns
tr
um
ent,
l
im
i
t
e
d
t
r
y
o
u
t,
a
n
d
w
ider
f
i
e
l
d
try
o
u
t
to
s
e
e
t
he
f
ea
si
b
ili
ty
o
f
t
h
e
implem
e
n
ta
t
i
o
n
of TADI
PHE eva
l
ua
t
i
o
n
m
o
d
el
t
o e
v
a
l
ua
te
car
ee
r g
ui
da
nc
e
pr
ogr
am
s at
V
H
S
.
The
e
v
a
l
uat
i
o
n
mode
l
bei
n
g
d
e
v
e
l
ope
d
is
e
x
p
e
c
te
d
to
b
e
e
f
fe
ct
ive
a
nd
pra
c
t
ic
a
l
f
or
t
he
d
e
s
crip
tio
n
o
f
t
he
q
ual
i
t
y
o
f
c
a
r
ee
r
gu
ida
n
ce
s
erv
i
ce
a
t
sc
h
o
o
l
c
om
prehe
n
si
ve
l
y
,
o
b
jec
t
ive
l
y,
c
omple
t
e
ly,
pra
c
tic
al
l
y
,
relev
a
ntl
y
,
co
ns
truc
ti
ve
ly,
and
e
ffe
c
t
i
v
e
l
y
.
T
he
w
ell-def
i
ne
d
desc
ript
i
o
n
of
car
eer
g
u
i
da
nc
e
serv
ice
and
the
rec
o
m
m
e
nda
ti
on
fro
m
i
t
i
s
expe
c
t
e
d
t
o
m
a
ke
i
t
ea
sy
f
or
its
i
m
p
ro
vem
e
nt
i
f
nec
e
s
s
ary.
I
n
o
rde
r
t
h
a
t
t
h
e
e
v
a
l
u
a
t
i
on
m
o
de
l
m
eets
the
requ
ire
m
e
n
ts,
a
prel
im
ina
r
y
FG
D
is
d
on
e
i
n
t
he
i
mp
lem
e
nta
tio
n
o
f
instrum
e
n
t
d
e
v
i
l
me
nt
i
ncl
u
din
g
t
h
e
eva
l
ua
tio
n c
o
mpo
n
e
n
ts
b
e
i
ng
deve
lope
d
for TA
D
I
P
H
E e
v
alua
t
i
o
n
m
o
de
l.
T
h
e
ge
ner
a
l
pu
rposes
o
f
ca
ree
r
g
u
i
da
nce
a
t
s
c
h
o
o
l
inc
l
ude
t
he
f
o
l
low
i
n
g
s:
t
he
s
tu
de
nts
c
a
n
m
aster
th
e
kn
ow
le
d
g
e
sel
f
-
a
w
a
reness
(a
bili
ty,
i
n
tere
st,
perso
n
al
i
t
y,
l
ife
ne
eds,
a
nd
v
a
lue
s
)
[2
3];
t
h
e
kn
ow
le
dge
o
f
w
o
rk
fie
l
d,
c
are
e
r
in
form
ati
o
n,
a
n
d
ca
ree
r
i
den
t
i
f
ic
ati
o
n
[
2
4,
2
5];
de
ve
l
o
p
i
ng
p
o
s
iti
ve
a
tt
i
t
ude
s
t
o
w
a
rds
w
o
r
k
f
ie
ld,
its
v
a
l
ues
an
d
the
re
a
d
i
n
ess
in
e
n
t
er
ing
t
h
e
work
f
ie
l
d
(
ca
ree
r
m
a
t
urity)
[2
6];
de
vel
o
pin
g
a
c
a
d
em
ic
com
p
ete
n
c
e
,
th
in
kin
g
c
a
p
ac
i
t
y
t
o
be
a
b
l
e
t
o
c
ho
ose
the
de
sir
e
d
releva
n
t
c
a
r
ee
r;
g
ain
i
ng
ca
ree
r
p
redisp
os
i
t
i
on,
pla
n
ni
ng
for
fu
ture
c
a
r
ee
r,
a
nd ga
i
n
in
g
ma
t
u
r
i
t
y
in
ch
o
o
sin
g
a
ca
ree
r
.
D
e
vel
o
p
i
ng
a
n eva
l
ua
tio
n
m
o
del
sho
u
l
d
c
o
n
s
ide
r
t
he c
ha
ra
c
t
e
r
is
t
i
c
s of car
eer
g
u
i
dance
i
m
pl
e
m
e
n
t
a
t
i
on
at
s
c
h
o
o
ls
i
n
Y
o
g
y
a
k
ar
ta,
whos
e
gu
ida
n
c
e
and
co
un
sel
i
ng
has
be
e
n
c
o
mpre
he
nsi
v
e
a
nd
is
b
ase
d
on
the
fo
l
l
ow
i
n
g
prin
cip
l
e
s
:
s
t
u
d
e
n
ts’
op
ti
m
u
m
d
e
ve
lo
pm
en
t
or
i
e
n
t
e
d
i
.
e.
c
o
m
plet
ing
c
a
r
eer
d
e
v
e
l
o
p
me
nt
t
a
s
ks;
h
e
lpi
n
g
i
n
div
i
d
u
a
l
s
i
n
c
h
oo
si
ng
a
nd
e
nt
e
r
in
g
wo
rk
f
i
e
l
d
s
ui
t
a
bl
e
for
t
h
eir
po
te
n
tia
ls
s
o
t
h
a
t
t
he
y
be
com
e
pro
duc
t
i
ve
w
orke
rs
a
n
d
p
ro
ud
o
f
the
i
r
w
o
rk;
he
lp
ing
i
n
d
i
v
i
dua
ls
i
n
fac
i
ng
c
om
p
l
ex
w
ork
fie
l
d
w
i
th
d
i
f
f
e
re
nt
cha
r
ac
t
e
ris
tics
re
qu
i
r
ing
ce
rtai
n
st
a
n
dards
i.e.
voca
t
i
o
n
a
l
sc
h
o
o
l
s
w
it
h
th
ei
r
dif
f
e
r
en
t
d
e
p
a
rt
ment
s
are
expe
c
t
e
d
t
o
fu
lfi
ll
t
h
e
nee
d
s
for
in
term
edia
t
e
l
e
v
e
l
w
orke
r
s
;
h
e
l
p
i
n
g
i
nd
i
v
i
d
ual
s
i
n
c
o
n
s
ide
r
in
g
pe
rso
n
al
ity
and
hum
an va
l
ues for the
i
r
w
o
rk,
i
n
ob
t
a
i
n
i
ng t
h
eir ri
gh
t
s
a
nd
f
u
lfil
l
i
n
g
t
heir
o
b
l
iga
t
io
n and res
p
e
c
t
i
ng
othe
rs’
rig
h
ts
a
nd
ob
l
i
ga
ti
on.
I
n
dev
e
l
o
p
i
n
g
t
he
e
va
l
u
at
ion
m
o
d
e
l
s
o
m
e
necessary
v
alues
for
differ
e
nt
p
r
o
f
e
ss
ions
a
r
e
con
s
i
d
ere
d
as
parts o
f
the
car
eer
gui
dance
e
v
a
l
ua
tio
n
mod
e
l
.
F
o
rm
ally,
t
h
e
ob
jec
t
i
v
es
o
f
the
c
a
re
er
guid
a
nce
pro
g
ra
m
at
v
oca
ti
o
n
al
s
cho
o
l
s
a
r
e
m
a
ni
fes
t
ed
i
n
t
h
e
Com
p
ete
n
c
y
S
tan
d
a
r
ds
f
or
S
tu
de
nt
s’
S
e
l
f-d
eter
mina
ti
o
n
d
ec
ree
d
b
y
In
do
n
e
si
an
G
u
i
d
a
n
c
e
and
Couns
eli
ng
A
ssocia
t
ion.
A
s
a
pr
ogr
am
f
or
V
H
S
s
tude
n
t
s
w
i
t
h
d
iffere
nt
d
epa
r
tm
ents,
i
n
t
e
rest
,
po
t
e
ntia
ls,
i
t
n
ee
ds
adj
u
s
t
m
e
n
t
rele
v
a
n
t
to
their needs.
In dev
e
l
opi
ng
t
h
e
ev
a
l
u
ati
o
n progra
m
me
it nee
d
s a
prel
i
m
ina
r
y a
s
se
ssm
ent
a
s
u
su
all
y
done
a
t
VHS
s
u
c
h
as
m
a
k
in
g
a
pro
b
l
e
m
c
h
eckl
i
s
t
,
A
TP,
a
nd
soc
i
om
etry.
In
T
A
D
I
P
H
E
eva
l
ua
t
i
o
n
mode
l
the
use
of
t
he
i
ns
t
r
u
m
e
n
t
,
a
s
w
e
l
l
as
t
he
a
sse
s
sm
ent
data
a
n
a
l
y
s
i
s
i
n
c
a
r
e
e
r
g
u
i
d
a
n
c
e
p
r
o
g
r
a
m
deve
l
opm
en
t,
a
re
c
onsi
d
e
r
ed
.
The
des
i
gn
of
p
lan
n
i
n
g
t
he
p
ro
gra
m
d
e
t
e
r
m
i
ne
s
the
q
u
al
i
t
y
o
f
t
he
p
rogram
implem
e
n
te
d
i
n
t
he
c
a
r
ee
r
gu
ida
n
ce
i
m
p
lem
e
nta
t
ion.
T
he
r
e
s
u
l
ts
o
f
c
are
e
r
g
u
i
d
a
n
c
e
s
e
rv
i
c
e
a
r
e
st
udi
ed
f
ro
m
the
as
pec
t
s
o
f
s
tu
de
nts’
p
o
t
e
n
t
i
a
l
s
i
n
r
e
l
a
tion
to
t
he
a
c
h
ie
vem
ent
of
t
he
o
b
j
e
c
t
i
v
es
o
f
ca
ree
r
guida
n
c
e
for
them
.
I
n
o
rder
t
ha
t
th
e
c
a
re
er
g
u
i
da
nc
e
pr
ogr
am
i
s
me
ani
n
g
f
ul
a
n
d
r
ele
v
a
n
t
t
o
t
he
s
tude
nts’
n
ee
ds,
it
i
s
nec
e
ssary
t
o
a
sse
ss
i
t
be
fore
d
e
s
i
g
n
i
ng
i
t
.
Th
e
re
sul
t
o
f
the
a
ss
ess
m
ent
is
u
sed
to
c
onsi
de
r
t
h
e
po
ssib
l
e
d
esi
g
n
of
t
he
p
r
ogram
.
The
im
pl
e
m
e
n
ta
t
i
o
n
o
f
pro
g
r
a
m
d
esi
gn
ca
n
be
s
er
vic
e
u
n
its
o
r
pla
n
ne
d
pr
ogram
s
e
r
vice
.
The
pla
n
ned
pr
ogra
m
be
c
om
es the
guide
line
for
the
i
m
plem
e
n
ta
ti
o
n
o
f
t
he
ca
r
ee
r
gu
i
d
a
n
ce
pr
ogram
.
T
h
e
pr
oc
ess
o
f
c
are
e
r
guida
nce
as
t
he
i
m
p
lem
e
n
t
a
t
i
o
n
of
c
om
pre
h
e
n
s
i
ve
g
ui
da
nce
and
c
o
unse
l
i
n
g
inc
l
ude
s
the
a
c
t
i
v
it
i
e
s
o
f
b
as
ic
s
erv
i
ce
s,
i
n
d
i
v
id
ua
l
w
o
rk
p
la
n
ni
n
g
,
resp
ons
ive
se
r
v
ice,
a
n
d
s
ys
tem
s
u
p
p
o
rt.
The
va
ri
o
u
s
car
eer
guida
nce
service
ca
n
inc
l
u
d
e
c
l
a
s
sica
l,
i
n
d
i
vi
dua
l,
a
nd
g
r
oup
se
rvice
eit
h
er
i
n
or
o
utsi
d
e
the
sch
o
o
l
a
c
t
ivi
tie
s.
I
dea
lly
,
a
car
eer
gui
dance
pro
g
ra
m
sho
u
l
d
no
t
on
l
y
f
oc
us
o
n
ac
adem
ic
m
atter
s
f
or
furt
her
s
t
ud
y
b
u
t
a
l
so
i
nc
l
ude
a
n
i
n
tro
duc
t
i
o
n
t
o
the
pr
oce
ss
a
nd
p
r
o
c
e
dure
o
f
g
e
t
t
i
ng
c
e
r
t
a
in
j
ob
s.
I
n
V
H
S
t
h
e
r
e
i
s
a
c
a
r
ee
r
d
e
v
e
l
o
p
m
en
t
cent
e
r
(C
DC
),
t
h
e
r
ol
e
i
s
t
o
co
mm
un
i
c
a
t
e
vs
g
r
a
d
u
a
tes
w
i
th
m
a
n
pow
er
com
p
an
ies
s
o
t
hat
t
h
e
gra
dua
te
s
ha
v
e
acc
ess
t
o
g
e
t
a
j
o
b
.
B
u
t
t
he
C
D
C
i
s
no
t
i
n
c
l
ude
d
in
t
he
car
eer
gui
danc
e
pro
g
ra
m
eval
u
a
ti
o
n
i
n
t
h
e
re
se
arc
h
d
ue
t
o
orga
ni
z
a
t
iona
lly
C
D
C
i
s
n
ot
p
art
o
f
c
are
e
r
gu
i
d
a
n
ce
service
.
The
pr
ocess
o
f
c
a
r
ee
r
gui
da
nc
e
pr
ogr
am
i
s
expe
c
t
e
d
t
o
he
lp
t
he
s
t
ude
nts
ge
t
t
h
e
i
r
suc
cess
in
t
heir
s
e
l
f-
Evaluation Warning : The document was created with Spire.PDF for Python.
Int J
Eval & R
es E
d
u
c
.
IS
S
N
:
2252-
88
22
Ev
a
l
u
a
t
i
o
n m
odel
o
f
caree
r
c
o
u
n
se
l
i
n
g
pr
og
ram
at v
o
c
a
tio
na
l h
i
g
h
sc
ho
o
l
(Sri
T
u
t
u
r Ma
rt
an
ings
i
h
)
32
3
aw
a
r
ene
s
s,
b
ei
ng
fa
mil
i
ar
w
it
h
w
o
r
k
f
ie
ld,
b
e
ing
rea
d
y
for
the
i
r
car
eer
s,
a
nd
in
o
b
t
a
i
n
i
n
g
n
ee
de
d
c
h
ar
ac
ters
f
o
r
work
f
ield.
T
h
e
ana
l
ys
i
s
o
f
pro
g
ra
m
eva
l
ua
ti
on
mo
de
l
s
how
s
di
ffere
n
t
spec
if
ic
a
tio
n
and
c
o
m
p
one
n
t
s
of
e
va
l
u
a
tio
n
foc
u
s.
T
he
e
va
lua
t
io
n
mo
de
l
de
p
e
n
d
s
o
n
t
he
f
oc
us
o
f
t
h
e
m
odel.
Th
e
fo
rmat
i
v
e
su
mma
t
i
v
e
ev
a
l
u
a
t
i
on
mo
d
e
l
f
o
c
u
s
s
e
s
o
n
t
h
e
p
h
a
s
e
s
d
u
r
i
n
g
o
r
a
t
t
h
e
e
n
d
o
f
t
h
e
p
r
o
g
r
a
m
.
T
h
e
N
a
t
u
r
al
I
nq
ui
ry
m
od
el
f
o
c
u
sse
s
on
t
h
e
implem
e
n
ta
t
i
o
n
o
f
the
s
i
t
u
a
tio
n
of
t
he
n
a
t
ura
l
p
r
o
cess.
C
IP
P
m
o
del,
M
ea
s
u
re,
CI
PP
O
mode
l
a
n
d
the
l
i
k
e
foc
u
s
m
o
re
o
n
the
c
o
mp
one
n
t
s
of
e
va
l
u
a
tio
n
imple
m
e
n
ta
tio
n.
T
he
e
v
al
ua
ti
on
mo
de
l
i
n
t
h
e
r
e
s
e
a
rc
h
foc
u
sse
s
on
t
h
e
c
o
m
p
le
t
e
ne
ss
of
c
om
po
ne
nt
s
an
d
the
a
ppr
opr
i
a
te
ness
of
t
h
e
c
h
ara
c
ter
i
st
ics
o
f
t
he
p
r
ogram
b
e
i
n
g
eva
l
ua
t
e
d
i.
e.
c
a
r
ee
r
gu
i
d
a
n
ce
p
ro
gra
m
a
t
VHS.
The
c
h
a
r
ac
t
e
ris
t
i
c
s
of
V
H
S
w
ith
its
d
if
fere
nt
d
e
p
ar
tm
ent
s
a
re
con
s
i
d
ere
d
i
n d
e
t
e
rm
i
n
in
g t
h
e
num
ber of
s
a
m
ple
s
bu
t
n
ot ye
t
c
on
si
d
e
re
d
for
t
h
e
an
aly
s
i
s
.
Th
e
c
a
re
er
g
u
i
d
a
n
c
e
pro
g
ra
m
foc
u
s
s
es
m
ore
o
n
d
e
v
e
l
op
ing
s
t
ude
n
t
s
'
s
of
t
s
k
i
lls
i
n
ge
ner
a
l
for
all
students
from
dif
f
e
rent
depa
r
t
me
n
t
s.
T
he
ir
s
pec
i
f
i
c
c
o
mpe
t
e
n
ce
i
s
de
ve
l
ope
d
thr
o
u
g
h
l
ea
rn
in
g
-
t
e
a
c
h
in
g
a
c
t
i
vi
ti
e
s
a
nd
t
h
r
ou
gh
coo
p
er
at
i
v
e
pr
actic
e
in c
o
m
p
a
ny
an
d i
n
d
u
s
t
ry wor
l
d
.
T
h
e
pr
el
imi
n
a
r
y
cons
truc
t
i
o
n
o
f
the
instr
u
m
e
nt
i
n
the
r
e
sea
r
ch
cov
e
r
s
f
our
s
ta
ge
s.
F
irst
l
y
,
the
rese
arc
h
er
c
on
st
r
u
c
t
s
a
re
sear
ch
i
n
s
t
r
ume
n
t.
T
he
i
nstr
ume
n
t
is
d
e
v
e
lo
p
e
d
f
r
o
m
d
et
ermi
nin
g
t
h
e
c
o
m
pone
n
t
s,
in
dic
a
t
o
rs
a
n
d
m
ain
p
o
i
n
t
s
to
b
e
de
vel
o
pe
d
in
t
o
i
nstrum
en
t
i
t
em
s.
T
hen
the
ite
ms
a
re
d
e
v
el
o
p
ed
i
n
ter
m
s
of
lan
g
u
age
,
a
ns
w
e
r
opt
io
ns
r
el
evan
t
to
t
he
r
e
s
po
nde
nt
s.
T
he
r
esul
t
of
t
his
p
h
a
s
e
i
s
t
he
i
nit
i
a
l
ins
t
rum
e
n
t
,
w
h
ic
h
in
t
h
e
n
e
x
t
pha
se,
is
d
isc
u
ss
ed
i
n
F
o
cus
G
r
ou
p
D
i
sc
ussi
o
n
.
S
e
co
nd
l
y
,
t
h
e
r
e
sea
r
che
r
h
o
l
ds
a
F
oc
us
G
rou
p
Di
sc
u
s
si
on
t
og
e
t
h
e
r
wi
th
l
ec
t
u
re
rs,
teache
rs,
practit
i
oner
s
,
a
n
d
e
v
al
ua
ti
on
a
nd
g
uid
a
n
c
e
an
d
couns
el
i
n
g
expe
r
t
s.
T
h
i
s
is
d
o
n
e
i
n
o
rde
r
t
o
ge
t
a
sug
g
e
s
t
i
o
n
f
or
t
he
i
m
p
r
o
v
e
m
ent
o
f
t
he
i
ns
trum
ent
i
t
e
m
s.
T
h
e
sug
g
es
tio
ns
a
r
e
c
on
side
red
for
t
h
e
im
pr
ove
m
e
nt
o
f
the
in
i
tia
l
i
nstr
um
ent.
T
he
n
t
h
e
i
n
str
u
m
e
nt
i
s
pr
ese
n
te
d
a
t
a
se
minar
for
in
strume
n
t
d
e
v
elo
p
me
n
t
.
T
h
ir
dl
y,
t
he
s
e
m
i
n
ar
i
s
h
e
l
d
a
t
t
e
nde
d
b
y
p
os
t
g
r
a
dua
te
s
t
ude
n
t
s
of
Y
o
g
y
a
k
a
r
t
a
S
t
a
t
e
U
n
i
v
e
r
s
i
t
y
(
Y
S
U
)
.
T
h
e
r
e
s
u
l
t
o
f
t
h
e
s
e
m
i
n
a
r
i
s
c
onsi
d
e
r
ed
t
o
e
d
it
t
h
e
in
strum
e
n
t
.
Th
e
n
i
t
is
val
i
d
at
ed
by
e
xpe
r
t
s
in
e
va
l
u
ati
on
sys
t
em
a
nd
in
g
ui
da
nce
and
c
ou
nse
l
i
n
g.
T
he
v
a
l
ida
t
ion
c
onc
er
ns
w
i
t
h
the
edi
t
i
o
n
a
n
d
w
i
t
h qua
n
t
i
t
a
t
ive
da
ta.
The
da
ta is a
n
a
l
yze
d
t
o det
e
r
m
i
ne
the
v
a
l
id
i
t
e
ms for furt
h
er
t
est.
S
o
m
e
s
ug
ge
sti
ons
f
r
o
m F
G
D
,
w
hi
c
h
c
o
n
c
e
rn
s w
ith in
i
t
i
a
l
in
s
trume
n
t
c
ove
r
s
t
he s
t
r
uc
t
u
re of sta
t
e
m
e
n
ts
a
n
d
t
h
e
l
a
yo
ut
o
f
i
n
st
ru
me
nt
n
e
e
d
si
mp
li
fi
ca
t
i
on
a
nd
i
nt
e
r
es
ti
n
g
a
p
pe
ara
n
ce;
e
qui
vale
nc
e
o
f
s
t
a
tem
e
n
t
s
w
i
t
h
the
i
r
answer
opt
i
o
n
s
.
It
n
eed
s
mor
e
a
tten
t
i
on;
t
he
w
i
d
e
ex
t
e
nt
of
t
he
a
n
s
w
e
r
sca
l
e.
T
his
i
s
i
n
acc
orda
n
c
e
w
i
th
the
e
xpe
rts
'
s
ugge
sti
on,
w
hi
c
h
e
m
phas
i
ze
s
mor
e
r
e
v
isi
o
n
;
c
ho
ice
o
f
w
o
rds
or
d
ict
i
on
(S
ome
incon
s
i
s
te
nt
term
in
olo
g
ie
s
nee
d
i
mpro
ve
me
nt
)
;
e
ffe
c
t
i
v
eness
of
s
e
n
te
nc
e
(The
e
ffec
ti
ve
ne
ss
o
f
se
nt
e
n
ce
s
h
o
u
l
d
be
t
he
pri
o
rit
y
n
o
t
t
he
numbe
r o
f
q
ue
st
i
o
ns or w
h
e
t
he
r t
h
e
r
e is som
e
t
h
i
ng
to ask); item
s
o
f t
o
o ge
ne
ral in
ter
p
reta
ti
o
n
.
The
y
n
ee
d
t
o
b
e
spe
c
i
fic
a
n
d
ope
ra
ti
o
n
;
a
to
o
b
i
g
n
u
mbe
r
o
f
i
t
e
m
s
(
S
o
m
e
s
i
m
i
l
a
r
i
t
e
m
s
n
e
e
d
b
e
e
l
i
m
i
n
a
t
e
d
)
;
and
co
ns
i
s
tenc
y of
q
ues
tio
n
and s
t
atem
en
t.
Base
d
on
the
F
G
D
sugges
t
i
o
ns,
t
h
e
re
sear
cher
r
e
v
i
s
e
s
t
he
i
nstr
u
m
e
nt
i
te
m
s
.
The
revis
i
on
co
ver
s
t
he
cha
nge
o
f sca
l
e
from seven t
o
fi
v
e an
d the
n
to f
our sca
les. The
se
v
e
n
sc
a
l
e
s are
c
o
nsi
d
er
ed t
oo w
i
de
w
hi
le for
the
fi
ve
s
c
a
l
es
t
he
re
i
s
a
ten
d
e
n
c
y
f
or
t
he
r
e
s
po
nde
n
t
s
t
o
c
ho
o
se
t
he
m
i
d
d
l
e
o
p
tio
n.
S
o
t
h
e
four
s
ca
le
s
a
r
e
c
o
nsid
e
r
ed
g
oo
d
fo
r
t
h
e
re
sp
ond
e
n
t
s
s
h
oul
d
thi
n
k
f
i
rst
b
e
fo
re
d
e
c
id
i
n
g
t
h
ei
r
c
hoi
c
e
.
Th
e
re
vi
si
on
al
so
inc
l
ude
s
the
ap
pro
p
ria
t
e
n
ess
o
f
q
uest
i
ons
a
n
d
opt
i
ona
l
a
n
s
w
er
s.
T
he
b
i
g
num
ber
o
f
ite
m
s
i
s
reduce
d
a
nd
the
addre
s
se
es
o
f
respo
n
d
en
ts
o
f
hea
d
m
a
ster
s,
d
ep
ut
y
he
a
d
m
a
sters,
c
oo
rdina
t
or,
gu
i
d
ance
a
nd
c
o
u
n
se
lin
g
teac
hers,
and
stude
n
t
s
are
incl
ude
d.
T
h
e
e
v
al
ua
t
i
o
n
t
o
w
a
rds
t
h
e
q
u
es
tio
nna
i
r
e
d
one
b
y
qua
nti
t
ati
v
e
e
x
p
erts
i
s
t
h
en
a
na
l
y
ze
d
b
y
m
ea
ns
o
f
A
i
ke
n
Inde
x
c
a
l
c
u
la
t
i
o
n
a
n
d
it
resu
l
t
s
in
t
he
s
elec
te
d
i
t
e
m
s
sh
ow
n
i
n
t
he
t
a
b
le
b
e
l
o
w
.
The
A
i
ken
in
de
x
criter
i
on
to
s
e
l
ec
t
the
va
lid
i
tem
s
i
s
≥
0.8
bu
t
0.7
is
s
ai
d
to
b
e
val
i
d
u
nd
e
r
c
ertai
n
c
ons
i
d
era
tio
n.
S
om
e
source
s
set t
h
e
go
o
d
con
te
nt
v
a
lid
it
y c
r
it
e
r
io
n as
h
av
in
g t
h
e
v
a
lid
it
y va
l
u
e
of
>
0
.5 [2
7
–
29]
.
3.1.
T
h
e
resu
l
t of tr
y
out
p
rodu
ct
3.
1.1.
Th
e
resu
l
t of c
on
ten
t
val
id
i
t
y
te
st
Th
e
re
sult
o
f
c
o
nt
en
t
v
a
li
di
ty
t
e
s
t
c
a
n
b
e
ch
e
c
k
e
d
at
t
h
e
A
i
k
en
i
nde
x
sum
m
a
ry
w
it
h
the
fo
llow
i
n
g
descr
i
pt
i
o
n
:
I
n
s
t
r
ume
n
t
1,
t
he
i
nstrum
en
t
w
h
ich
a
t
t
he
b
e
g
i
n
n
i
n
g
c
o
n
s
ist
s
o
f
60
i
t
e
m
s
is
r
e
d
uc
e
d
t
o
40
it
e
m
s
bec
a
u
s
e most o
f t
h
em
fu
l
fil
l
t
he criter
i
o
n
of ≥
0.8 and s
o
m
e
it
em
s ar
e dr
oppe
d due
t
o t
h
e criter
i
on
; I
n
strum
e
nt
II,
instrume
n
t
IIA
w
hich
f
or
me
rly
cons
is
ts
o
f
8
5
i
tem
s
i
s
re
duc
ed
t
o
4
5
i
te
ms
d
ue
t
o
t
h
e
c
r
iter
i
o
n
o
f
≥
0.
8.
F
r
om
75
it
e
m
s
of
i
ns
trume
n
t
I
I
B,
t
here
a
re
50
va
li
d
i
t
e
m
s
ba
se
d
on
t
h
e
c
r
iteri
on
;
I
n
str
u
m
e
nt
I
I
I
,
from
the
9
0
it
e
m
s
of i
ns
tru
m
e
n
t II
I,
82 of
t
hem
ar
e subst
a
nt
ia
l
l
y
va
l
i
d a
n
d
8
0 i
t
em
s
of
t
he
m
are
ve
rifi
ed in
furt
her
st
e
p
s.
3.
1.2.
T
h
e
resu
l
t of r
e
liab
ilit
y
test
The
re
sult
o
f
re
l
i
a
b
i
l
i
t
y
ana
lys
i
s b
y
m
e
a
ns of S
P
S
S
c
a
n be
sum
m
ari
z
ed
i
n
Ta
bl
e 2
.
Evaluation Warning : The document was created with Spire.PDF for Python.
I
SSN: 2252-
8822
Int.
J
.
Ev
al. & R
es. Educ.
Vol.
8, No. 2, June
2
0
19:
3
18
- 3
29
32
4
Tab
l
e 2.
The
summ
a
r
y
of
reliabi
l
ity
t
es
t
i
n
d
e
x of TA
D
I
P
H
E
eval
u
at
i
on i
n
st
r
u
me
n
t
m
ode
l
N
o
I
nst
r
um
e
n
t
/
C
o
m
pone
nt
S
ugg
e
s
tion
fo
r
M
e
a
s
ure
m
ent
C
r
onb
a
c
h
'
s
Al
pha
C
r
onba
c
h
'
s
A
l
p
h
a
Ba
s
e
d
on
St
a
n
d
a
rdize
d
It
e
m
s
Nu
m
b
e
r
of
It
e
m
s
I
t
emwithC
o
rre
l
a
tio
nI
n
d
e
x
>
0,
3
Nu
m
b
e
r
o
f
I
t
em
s
af
t
e
r
R
e
visi
on
1
Inst
rum
e
nt
I
0
.
855
0.
8
5
0
40
26
a
.
Ta
rge
t
0.
454
0.
4
8
0
10
3
b
.
I
n
st
a
lla
t
i
on
0.
892
0.
8
9
3
30
2
3
2
Inst
rum
e
nt
II
A
0.
944
0.
9
4
3
45
44
a
.
Asse
ss
m
e
nt
0
.
935
0.
9
3
5
13
1
3
b
.
de
sign
0.
919
0.
9
2
5
21
2
1
c
.
the
e
f
fe
ctive
n
e
ss o
f
the
pr
o
g
ram
0.
919
0.
9
2
5
11
1
0
3
Inst
rum
e
nt
II
B
0.
963
0.
9
6
6
50
45
P
r
o
c
e
ss
0.
963
0.
9
6
6
50
4
5
4
Inst
rum
e
nt
III
(
re
sult)
0
.
945
0.
9
4
7
80
7
3
73
3.2.
T
h
e
resu
l
t of
e
x
p
l
or
atory
fac
t
or
an
al
ysi
s
tes
t
(EFA)
Th
e
re
sult
o
f
Kai
s
er
M
ey
er
O
l
k
i
n
d
an
B
artl
et
t
e
s
t
f
o
r
me
a
s
u
r
e
m
e
nt
i
nst
r
ume
n
t
c
o
m
p
o
n
en
t
t
o
w
a
rd
s
TA
D
I
P
H
E e
v
alua
t
i
o
n
m
ode
l i
s
show
ed
i
ni
T
able
3
.
Ta
b
l
e
3.
K
MO
and
Bar
t
le
t
t
'
s t
e
st
K
a
i
s
e
r
-
M
e
y
e
r-Ol
k
i
n
M
ea
sur
e
o
f
Sampli
ng
Ade
quac
y
.
.
923
Ba
rtl
e
t
t
's Te
s
t
of
S
phe
ric
i
t
y
A
ppr
o
x
.
C
hi
-
S
q
u
a
r
e
2258
4.
293
df
3160
Si
g.
.
000
The
a
b
o
v
e-
me
nti
one
d
resu
l
t
o
f
K
M
O
sh
ow
s
t
h
e
a
p
pro
p
ria
t
ene
s
s
o
f
t
h
e
s
a
m
p
l
e
f
o
r
f
u
r
t
h
e
r
a
n
a
l
y
s
i
s
.
The
fa
c
t
or
a
na
l
y
s
i
s
resul
t
s
ho
w
s
t
ha
t
t
h
ere
a
r
e
6
fac
t
or
s
as a
result
of
c
are
e
r
gui
d
a
nce
for
the
s
t
ude
nt
s.
A
fter
a
ce
rtai
n
co
ns
ide
r
a
t
i
on
on
item
s
o
f
su
ppor
ti
n
g
f
a
c
t
o
rs
t
he
n
a
m
ing
o
f
f
acto
r
s
i
n
clu
d
e
s:
s
el
f
a
w
aren
ess
(1
1
i
t
e
ms
of
i
n
d
i
c
a
t
or),
c
ar
eer
r
ea
di
ne
ss
(21
i
t
em
s
of
i
nd
ica
t
or
),
c
are
e
r
a
wareness
(16
item
s
o
f
in
di
c
a
t
or),
a
w
a
r
e
ness
o
f
w
o
rk
c
har
a
c
t
er
istics
(
14
i
t
em
s
of
i
nd
ica
t
or
),
a
nd
a
ssert
ive
n
e
s
s
(
1
2
item
s
o
f
i
n
d
i
c
a
t
or),
a
nd
p
os
i
t
i
v
e
at
tit
ud
e
tow
a
rd
g
u
i
da
n
ce
and c
o
u
n
se
l
i
n
g
(
6 item
s
of
in
dic
a
t
o
r)
3.3.
T
h
e
resu
l
t of anal
y
s
i
s
of
parti
a
l
lea
s
t squa
r
e
(
P
L
S
)
3.
3.1.
T
h
e
R
e
sult of Mode
l Me
asu
r
e
m
en
t (
Ou
ter Mode
l
)
The
R
e
sult of Model Meas
u
rem
e
nt (
Ou
t
e
r Mod
e
l
) i
s
showe
d
i
n
Ta
bl
e
4.
Tab
l
e
4.
S
igni
ficanc
e
a
nd M
u
ltic
ol
i
n
ea
ri
t
y
o
f Me
as
urem
ent
m
odel
C
o
m
pone
nt
/
Var
i
ab
le
Nu
m
b
e
r
o
f
I
n
i
tia
l
It
e
m
s
p.
Va
l
u
e
s
N
o
t
S
i
gn
t
<
1.
96
Nu
m
b
er
o
f
S
i
gnific
a
nt
i
t
e
m
s
t
>
1.
96
VI
F O
u
ter
>5
P
e
r
cen
t
a
g
e
o
f
Multi
c
o
lline
a
r
it
y
Ta
rge
t
1
1
0.
0
5
8
3
0
0
Assess
men
t
1
5
0
.
0
5
0
1
5
8
5
3
.
3
*
)
Desig
n
2
4
0
.
0
5
2
2
2
6
2
5
*
)
In
s
t
a
l
l
a
t
i
on
23
0
.
0
5
6
17
7
30.
43
*
)
P
r
o
c
e
ss
4
3
0
.0
5
3
4
0
2
7
6
2
.
8
*
)
Re
sult
8
0
0.
0
5
0
8
0
0
0
T
h
e
ef
f
e
ct
i
v
en
e
s
s
of
t
he
p
rogra
m
13
0
.
0
5
3
10
0
0
R
e
mark
*
)
It is n
e
c
e
ss
ary
to
re
c
o
n
s
id
e
r
th
e
it
e
m
s
to
b
e
m
o
r
e si
gnif
i
ca
nt
A
m
easur
e
m
ent
m
ode
l
i
s
a
n
o
u
t
e
r
mode
l,
w
hic
h
c
on
ne
c
t
s
a
ll
ma
nif
est
va
ri
able
s
or
i
n
d
i
ca
t
o
r
wit
h
t
he
late
n
t
v
aria
ble
.
T
he
q
ua
li
t
y
o
f
me
as
ure
m
e
n
t
m
ode
l
ca
n
be
v
erifi
ed
f
ro
m
co
mp
o
s
ite
rel
i
abi
lit
y
Ave
r
ag
e
Var
i
ance Extr
acted
(
A
V
E
)
,
a
n
d
Cro
n
bac
h a
l
ph
a
i
n
d
e
x
.
F
r
om
t
he
r
e
s
u
l
t
of
m
ea
surem
e
nt
m
ode
l
go
o
dne
ss
t
e
st
on
e
a
c
h
TA
D
I
P
H
E
c
o
mpo
n
e
n
ts
v
iew
e
d
fr
o
m
r
e
l
i
a
b
ili
t
y
c
om
po
si
te
v
a
lue
,
A
V
E
,
a
nd
Cr
on
b
a
ch
A
l
pha
f
or
a
ll
mea
s
u
r
emen
t
f
i
tn
e
ss crit
eri
a
a
s sh
o
w
n
in
Ta
b
l
e
5
.
Tab
l
e
5.
T
he
r
e
s
u
lt o
f
T
A
D
I
P
H
E Mea
s
urem
ent m
ode
l
qua
lit
y tes
t
Evaluation Warning : The document was created with Spire.PDF for Python.
Int J
Eval & R
es E
d
u
c
.
IS
S
N
:
2252-
88
22
Ev
a
l
u
a
t
i
o
n m
odel
o
f
caree
r
c
o
u
n
se
l
i
n
g
pr
og
ram
at v
o
c
a
tio
na
l h
i
g
h
sc
ho
o
l
(Sri
T
u
t
u
r Ma
rt
an
ings
i
h
)
32
5
C
o
m
pone
nt
C
onstruc
t
C
o
m
posit
e
Re
li
a
b
i
lit
y
A
V
E
C
r
onbac
h
Al
pha
C
r
ite
ria
i
s
goo
d
i
f
>
0
,7
>
0
.5
>
0
.7
T
a
r
g
e
t
S
truc
ture
0
.
106
0
.
221
0
.
465
A
c
h
i
e
v
e
m
ent
S
t
r
a
t
e
g
y
0
.
722
0
.
379
0
.
537
Asse
ss
m
e
nt
I
nst
r
um
e
n
t
0
.
921
0
.
598
0
.
920
Ma
king
use
of
d
a
t
a
0
.
901
0
.
646
0
.
902
De
sign
P
la
nni
n
g
0
.
912
0
.
557
0
.
918
Ma
t
e
r
i
a
l
a
n
d
s
ourc
e
0
.
801
0
.
449
0
.
796
A
d
m
i
nis
t
r
a
tion
sy
s
t
e
m
0
.
821
0
.
404
0
.
829
I
n
sta
lla
t
i
on
R
o
l
e
o
f
Hea
d
m
a
st
e
r
0
.
859
0
.
607
0
.
777
R
o
l
e
o
f
De
puty
Hea
d
m
a
ste
r
0
.
835
0
.
432
0
.
802
R
o
l
e
o
f
the
ho
m
e
roo
m
tea
ch
e
r
0
.
865
0
.
457
0
.
826
Ma
n
a
ge
m
e
nt
0
.
841
0
.
585
0
.
730
R
o
l
e
o
f c
oordina
t
o
r
&
G
u
id
a
n
c
e
a
nd c
ounse
ling
Tea
c
h
e
r
0
.
993
0
.
5
34
0
.
786
Proce
s
s
T
h
e
ac
tivity
o
f
Gui
d
a
n
c
e
a
nd C
o
u
n
s
e
l
i
ng
T
e
ac
he
r
0
.
939
0
.
612
0
.
939
S
y
st
e
m
s
uppo
rt
0
.
935
0
.
447
0
.
934
Im
pl
e
m
enta
tion
0
.
898
0
.
458
0
.
893
Re
sult
a
s
s
e
rti
v
e
n
e
ss
0
.
805
0
.
259
0
.
805
C
a
r
e
e
r
R
ea
dine
ss
0
.
838
0
.
249
0
.
837
S
e
lf
A
w
a
re
n
e
s
s
0
.
758
0
.
234
0
.
770
C
a
r
e
e
r
A
wa
r
e
n
e
ss
0
.
870
0
.
245
0
.
871
W
o
r
k
C
r
i
t
e
ri
a
0
.
900
0
.
409
0
.
900
P
o
sitive
At
titud
e
t
owa
r
ds Prog
r
a
m
0
.796
0
.373
0
.796
T
h
e
ef
f
e
c
t
i
v
en
e
s
s
o
f
the
progr
a
m
R
e
sult
Re
f
l
e
c
tion
0
.
801
0
.
450
0
.
694
E
duc
a
tion
a
l
I
m
p
a
c
t
0
.
670
0
,
313
0
.
497
T
h
e
c
r
i
t
e
r
i
a
o
f
m
o
d
e
l
q
u
a
l
i
t
y
u
s
e
d
i
n
t
a
b
l
e
5
a
b
o
v
e
a
r
e
:
A
V
E
v
a
lue
o
f
c
on
str
u
c
t
>
0
.
5
0
,
com
posi
t
e
relia
bi
l
ity
>
0.
7
0
, a
nd Cro
nbac
h
A
lp
ha >
0.70
T
h
e
f
o
l
l
o
w
i
n
g
i
s
a
n
e
x
a
m
p
l
e
o
f
a
n
a
n
a
l
y
s
i
s
r
e
s
u
lt
o
f
t
h
e
a
s
s
e
s
s
m
e
nt
c
omp
one
n
t
m
easure
m
e
n
t
m
o
de
l.
F
i
gure
1
sh
ow
s
the
re
sul
t
o
f
ou
ter
l
o
a
d
i
n
g
a
n
al
ys
i
s
by
me
a
n
s
o
f
p
ar
ti
a
l
l
e
a
st
s
quare
,
w
h
ic
h
i
n
dica
te
s
t
h
e
ou
t
e
r
p
a
r
t
o
f
t
h
e
m
o
d
e
l
c
o
n
n
e
c
t
s
a
l
l
i
n
d
i
c
a
t
o
r
s
(
y
e
l
l
o
w
r
e
c
t
a
n
g
l
e
)
w
i
t
h
t
h
e
l
at
ent
v
a
ri
able
(
b
l
u
e
c
i
r
cl
e).
Al
l
assessm
ent
m
e
asure
m
e
n
t
c
o
n
s
truc
t
i
n
dica
t
o
rs
r
esult
i
n
l
o
a
din
g
f
ac
tor
0
.
70
w
i
t
h
p
<
0
.
05,
w
hi
c
h
m
eans
a
l
l
i
n
d
i
c
a
t
o
r
s
a
r
e
s
i
g
n
i
f
i
c
a
n
t
.
T
h
e
c
o
rrela
ti
o
n
a
mo
ng
b
l
u
e
c
i
rcles
s
how
s
t
h
e
res
u
l
t
o
f
the
in
ne
r
m
ode
l
o
f
com
p
o
n
e
n
t
a
s
se
ssm
e
nt,
w
h
i
c
h
is
a
l
s
o
s
i
g
n
i
f
ica
n
t
(p
<
0
.05)
.
F
i
g
u
r
e
1
reve
als
t
h
e
r
e
su
lt
o
f
a
sses
s
me
nt
com
p
o
n
e
n
t m
e
a
s
ur
em
ent m
o
d
e
l.
F
i
gure
1.
A
sse
s
sm
ent
com
p
o
n
e
n
t
me
asure
m
e
n
t
m
o
de
l
The
assessm
en
t
c
o
mp
one
n
t
m
e
a
sure
me
nt
m
odel
c
onsis
ts
o
f
tw
o
pr
ed
ic
tors
i
.
e
.
a)
t
he
i
ns
t
r
ume
n
t
use
d
d
ur
in
g
t
h
e
assessm
en
t,
a
nd
b
)
tak
i
ng
a
dva
n
t
a
g
e
o
f
d
ata
o
b
t
ai
ne
d
from
da
ta
f
i
l
l
i
n
g
i
n
ac
tiv
it
y.
E
a
c
h
pred
ic
tor
(la
t
e
n
t
var
i
a
b
le)
as
s
how
n
i
n
t
h
e
y
e
llow
re
ctan
g
l
es.
The
r
e
ar
e
8
in
dica
tor
s
,
w
h
i
c
h
a
r
e
si
gn
i
f
i
c
ant
for
Evaluation Warning : The document was created with Spire.PDF for Python.
I
S
S
N: 2
2
5
2
-
88
22
I
n
t
.
J.
Ev
al.
&
Res.
Ed
u
c
.
Vo
l.
8
,
No
.
2
,
J
u
n
e
2
0
19: 3
18
-
3
29
32
6
m
e
a
s
ur
ing i
n
st
r
u
m
e
nt (
p
>
0
.
0
5
)
.
T
he da
t
a ta
ki
n
g
a
d
v
a
n
ta
ge
is m
e
a
sur
e
d b
y
me
a
ns of
5
ind
i
c
a
t
or
s,
w
hic
h
a
l
l
o
f
th
em are sig
n
i
f
i
cant (p>0
.
05
)
.
The
tw
o
pr
ed
i
c
tor
s
(
i
n
t
he
b
l
u
e
cir
c
le
)
ca
n
be
u
se
d
t
o
m
easur
e
assessm
e
nt
c
om
po
ne
nt
s
due
t
o
t
h
e
r
e
sult
o
f
t
he
a
nal
y
s
i
s
r
e
s
u
l
t
o
f
t
h
e
s
t
r
u
c
t
ur
al
m
o
d
el
(
i
n
ne
r
m
o
del)
(
p
>
0.
05)
.
Thus,
t
h
e
m
odel
c
a
n
be
u
se
d
t
o
e
v
al
ua
te
a
c
ar
eer
c
om
pone
nt
a
sse
ssme
n
t
as
s
how
n
i
n
F
i
gur
e
2.
F
i
gur
e
2.
M
o
d
e
l
of
P
r
ogr
a
m
E
ff
ec
t
i
ve
ness
C
om
po
ne
nt
M
ea
sur
e
m
e
nt
At
t
h
e
d
e
s
ig
n
c
o
mp
on
en
t
me
a
s
u
r
emen
t
mode
l
,
t
h
e
r
e
a
re
s
ome
i
n
d
i
c
a
t
o
r
s,
w
h
i
ch
a
re
n
ot
s
ig
ni
fi
c
a
nt
i.
e
.
i
nd
i
c
a
t
or
s
2A
,
38,
2
A
3
9
,
2A
4
0,
2
A
45.
T
he
y
sh
ow
p
>
0
.
05.
T
h
e
c
o
r
r
e
lat
i
on
am
on
g
bl
ue
c
ir
c
l
es
s
h
o
w
t
h
e
r
e
sult
of
t
he
d
e
s
i
gn
c
o
mp
o
n
en
t
in
ne
r
m
odel,
w
hic
h
i
s
also
s
ign
i
f
i
cant
(p
<0
.0
5
)
3.
3.
2.
Result
o
f
stru
ctura
l
mo
d
el q
ua
lity
The
tes
t
of
s
t
r
u
ctur
a
l
m
o
d
el q
ua
li
ty
a
lso
nam
e
d as
I
nne
r
M
o
de
l
ver
i
f
i
e
s
the
r
ela
t
i
ons
h
i
p
a
m
ong
l
a
t
e
n
t
va
r
i
a
b
les
i
n
t
h
e
m
odel
bei
n
g
deve
lo
pe
d.
T
he
r
ela
t
i
o
n
s
h
i
p
betw
e
e
n
l
a
t
e
nt
v
a
r
i
a
bl
es
o
r
ex
og
en
ou
s
v
a
ri
a
b
l
e
s
(
v
a
r
i
a
bl
e
o
f
c
a
u
s
e
)
a
n
d
en
doge
n
o
u
s
v
ari
a
bl
es
c
a
n
b
e
se
en
.
Th
e
c
rit
e
rion
o
f
s
t
ru
ctu
r
al
m
od
el
q
u
a
lity
i
s
verif
i
ed
fro
m
mu
lt
i
c
ol
lin
e
a
ri
t
y
(
VIF),
R
2
v
al
ue,
c
o
e
f
f
i
c
i
e
n
t
es
tim
ati
on
(
i
nne
r
l
o
a
d
i
ng)
,
i
n
f
l
uenc
e
sta
n
d
ard
(
f
2
)
,
a
nd
Q
2
of
t
he
e
n
t
i
r
e
m
ode
l.
T
able
6
d
e
s
cr
ibes
t
he
r
e
s
ult
of
S
t
r
uctur
a
l
M
ode
l
Q
u
al
i
t
y
Test
o
n
Each
C
om
p
one
n
t
.
Tab
l
e
6.
Resu
l
t
of
s
tr
uc
tur
a
l
mode
l
q
u
al
i
t
y
t
e
s
t
on
e
ach
c
om
p
o
n
ent
St
r
u
c
t
ur
a
l
E
quiva
le
n
c
e
f
2
(
E
ffe
c
t
s
i
z
e
)
R
2
M
ode
l
Qua
lity
La
te
nt
V
a
r
i
a
bl
e
e
ndoge
n
La
te
nt
Vari
a
b
l
e
e
k
soge
n
I
nne
r
V
I
F
Va
lue
s
I
n
flue
nc
e
of
p
re
di
c
t
or
on
la
te
nt v
a
r
i
a
bl
e
S
t
r
e
ngth
ofPre
d
ic
tiv
e
La
te
n
t
V
a
r
ia
b
l
e
Ta
rge
t
A
1
<
5
0.
184
w
e
a
k
0
.
155
w
ea
k
A
2
<
5
0.
072
w
e
a
k
0
.
665
good
A
sse
ss
m
e
nt
A
8
<
5
0
.
231
m
o
d
e
r
a
t
e
0
.
543
m
od
e
r
a
t
e
A
9
<
5
0
.
190
w
e
a
k
0
.
140
w
ea
k
D
e
sign
A
10
<
5
0
.
773
big
0.
278
w
ea
k
A
11
>
5
**)
0
.
804
big
0.
868
good
A
12
<
5
0
.
939
big
0.
882
good
Insta
l
la
ion
A
3
>
5
**)
0
.
779
big
0.
837
good
A
4
>
5
**)
0
.
785
big
0.
492
m
od
e
r
a
t
e
A
5
<
5
0
.
657
big
0.
798
good
A
6
<
5
0
.
676
big
0.
499
m
od
e
r
a
t
e
A
7
<
5
0
.
605
big
0.
292
w
ea
k
Proce
ss
A
15
>
5
**)
0
.
783
big
0.
768
good
A
16
<
5
0
.
669
big
0.
540
m
od
e
r
a
t
e
A
17
<
5
0
.
667
big
0.
132
w
ea
k
Evaluation Warning : The document was created with Spire.PDF for Python.
Int J
Eval & R
es E
d
u
c
.
IS
S
N
:
2252-
88
22
Ev
a
l
u
a
t
i
o
n m
odel
o
f
caree
r
c
o
u
n
se
l
i
n
g
pr
og
ram
at v
o
c
a
tio
na
l h
i
g
h
sc
ho
o
l
(Sri
T
u
t
u
r Ma
rt
an
ings
i
h
)
32
7
S
t
r
u
ct
u
r
al
E
q
u
i
v
a
l
e
n
c
e
f
2
(
Eff
e
ct
s
i
z
e
)
R
2
M
ode
l
Qua
lity
La
te
n
t
V
a
r
ia
b
l
e
e
ndoge
n
La
t
e
nt
Va
ria
b
le
e
k
soge
n
Inne
r
VIF
Va
lu
e
s
In
f
l
ue
nce
of
p
r
e
di
c
t
or
on
l
a
te
n
t
v
a
r
ia
b
l
e
S
t
re
ngth
ofPre
d
ic
ti
v
e
La
t
e
nt
V
a
r
ia
bl
e
Re
sult
A18
<
5
0.
509
b
ig
0
.
542
m
od
e
r
a
t
e
A
19
<
5
0.
687
b
ig
0
.
271
w
ea
k
A
20
<
5
0.
499
b
ig
0
.
768
good
A
21
<
5
0.
463
b
ig
0
.
422
m
od
e
r
a
t
e
A
22
<
5
0.
495
b
ig
0
.
453
m
od
e
r
a
t
e
A
23
<
5
0.
640
b
ig
0
.
325
m
od
e
r
a
t
e
Ef
p
ro
A
13
<
5
0.
671
b
ig
0
.
623
m
od
e
r
a
t
A
14
<
5
0.
560
b
ig
0
.
752
good
Re
ma
rk: **)
t
he
r
e
is m
u
l
t
i
c
o
l
lin
e
a
r
ity so tha
t
r
e
v
i
e
w of ea
c
h
s
p
e
c
i
fi
c
a
tion
i
s
n
ec
e
s
s
a
r
y
t
o
b
e
mea
ningful
The
pred
ic
t
i
ve
s
treng
t
h
o
f
e
a
c
h
eva
l
ua
t
i
on
com
p
o
n
e
n
t
i
n
T
A
D
I
P
H
E
m
ode
l
is
s
how
n
in
R
2
fo
llo
wed
by
t
h
e
calc
u
la
tio
n
of
Q
2
w
ith
t
h
e
f
ormula
√
,
w
h
ic
h
show
s
the
con
t
ri
bu
t
i
o
n
o
f
a
l
l
pred
ic
tors
t
o
wa
rd
l
at
en
t
va
ri
ab
l
e
s
as
s
hown
in
T
abl
e
7
.
Th
e
goo
dn
e
ss
o
f
F
i
t
(Go
F
)
on
P
LS-S
EM
i
s
c
a
l
c
ul
a
t
e
d
m
anu
a
ll
y
by m
e
a
n
s o
f
[30].
A
globa
l c
r
i
t
e
r
i
o
n
of g
oo
dne
ss-
o
f-fi
t (
G
oF
) ca
n be
propo
sed
as
t
h
e
g
e
o
me
tric
m
e
a
n
o
f
t
he
a
vera
ge
c
om
muna
lit
y
a
n
d
a
v
era
g
e
th
e
R
2
[
1
0
]
,
[
3
0
]
,
[
3
1
]
r
e
s
u
l
t
i
n
G
o
F
=
0
,
4
7
5
2
;
V
a
lue
G
o
F
sm
all
=
0,
1
;
G
oF
m
edium=
0,2
5
;
a
n
d
G
oF
b
ig
=
0
,
38.
Th
us,
t
h
e
m
odel
c
a
n
be
s
ai
d
t
o
f
it
the
criter
i
on.
The
re
s
ult o
f
TA
D
I
P
H
E
Eval
uat
i
on
Mo
de
l is sh
o
w
ed
i
n
Ta
bl
e
7.
Ta
ble
7.
C
alc
u
l
a
ti
on
Re
s
u
lt
of R
2
an
d Q
2
TA
D
I
PH
E
Evalua
t
i
on M
o
de
l
No
K
o
n
str
u
c
t
r
R
2
V
a
l
u
e
1
-
R
2
Q
2
1
Ta
rge
t
0
.
425
0
.
1806
0
.
8194
0
.
8891
2
A
sse
ss
m
e
nt
0
.
312
0
.
0973
0
.
9027
3
D
e
sign
0
.
414
0
.
1714
0
.
8286
4
In
s
t
a
l
l
a
t
i
on
0
.
777
0
.
6037
0
.
3963
5
Proce
ss
0.
301
0
.
0906
0
.
9094
6
Re
sult
0
.
048
0
.
0023
0
.
9977
7
E
f
fec
tiv
e
n
e
s
s
0.
705
0
.
4970
0
.
5030
If
e
ac
h
com
p
one
n
t
i
s
co
ns
i
d
ere
d
,
som
e
c
om
po
ne
nt
s
are
class
i
fie
d
a
s
low
bu
t
s
i
gn
ifica
n
t
.
T
he
ca
l
c
u
l
a
tio
n Q
2
=
0.8
8
9
1
(
t
he
p
os
iti
on
o
f
a
ll c
o
m
p
o
n
e
n
ts are
ve
r
y stro
n
g
8
8.
91
%
)
s
o
t
ha
t i
t
s
ai
d
tha
t
TA
D
I
P
H
E
mode
l
i
s
fe
a
s
i
b
l
e
for
c
a
re
er g
uida
nce a
t
V
H
S
. The res
t
or
1
1
.09
%
m
a
y be
d
e
t
e
r
m
i
ne
d by o
t
her
pre
d
i
c
t
o
rs use
d
in t
h
i
s
rese
arc
h
. The
F
ig
ur
e
4 is sh
o
w
e
d
the
A
n
al
ys
is re
s
ul
t
of
all TA
D
I
PH
E
eva
l
ua
tio
n
mode
l
.
F
i
gure
4.
TA
D
I
P
H
E
e
valua
tio
n m
odel
Evaluation Warning : The document was created with Spire.PDF for Python.