In
te
r
n
ation
a
l Jou
rn
al
o
f E
v
al
u
a
t
i
on
a
n
d
R
e
se
arc
h
in
Ed
u
c
ation
(
IJERE
)
V
o
l.7,
N
o.2,
Ju
n
e
20
1
8
,
pp. 127~
131
ISSN
: 2252-
88
22,
D
O
I
:
10.11
59
1
/ijer
e
.
v
7.
i
2
.13
0
2
2
127
Jou
rn
a
l
h
o
me
pa
ge
: h
t
t
p
:/
/
i
a
e
s
core.
c
om
/
j
ou
rna
l
s
/in
dex
.
p
h
p
/IJERE
The Effectiven
ess of S
cience
Textbook Base
d
on Science
Technology Society f
o
r
E
l
ementary School Level
Aliffah
Kartik
asari
1
, R
oemi
n
t
oyo
2
, S
ri Yamtinah
3
1
M
a
st
er P
rog
r
a
m
of Elem
e
ntary
Schoo
l T
eacher Train
ing
and
Ed
u
cat
io
n, S
eb
elas
M
aret U
n
i
versity
, Ind
on
esi
a
2,
3
P
os
tg
r
a
du
a
t
e
D
e
p
a
r
t
me
n
t
,
S
e
b
e
la
s
M
a
r
e
t
U
n
iv
e
r
si
ty
,
I
nd
on
e
s
i
a
Art
i
cl
e In
fo
ABSTRACT
A
r
tic
le hist
o
r
y
:
Re
ce
i
v
e
d
A
pr 30,
2
0
1
8
Re
vise
d Ma
y
2
7
, 201
8
Ac
ce
p
t
ed
M
a
y
3
0
,
2
018
Th
is
s
tu
dy
r
ep
o
r
ted
a
q
u
asi
-
exp
e
rim
e
nt
al
i
n
v
esti
gati
ng
t
he
d
ev
e
lo
pm
en
t
of
S
c
ien
ce
tex
t
bo
o
k
b
as
ed
o
n
S
c
i
e
nce
T
echn
o
lo
gy
a
nd
S
oci
e
ty
f
or
e
l
em
entary
sc
ho
ol.
The
s
t
u
d
y
e
m
p
l
oy
e
d
q
u
a
si
e
xp
e
r
im
e
n
t
d
e
sign
.
Po
pu
la
tion
in
t
his
st
ud
y
was
all
fo
urt
h
-g
rad
e
s
tu
den
t
s
of
e
lem
e
n
t
ary
sch
o
o
l
s
i
n
G
a
tak
Subdi
s
tr
i
c
t
and
the
sample
o
f
t
h
e
s
t
ud
y
w
a
s
tw
o
s
c
ho
ols
as
a
n
e
x
p
eri
m
en
tal
clas
s
and
cont
rol
class.
T
h
e
r
es
earch
s
am
p
l
e
was
taken
by
ran
d
o
m
s
a
mpli
ng
tech
ni
que.
Th
e resu
lts of
this
research
sh
o
w
e
d t
h
at
th
e
re was
a
n im
pro
v
em
ent
of
s
tu
den
t
ach
ievem
e
n
t
b
ef
ore
and
af
ter
t
h
e
i
m
p
l
ementat
i
o
n
o
f
s
cien
ce
te
xtbo
o
k
b
a
s
e
d
o
n
S
c
ie
n
c
e
Te
chn
o
lo
gy
a
nd
S
o
c
ie
ty
.
Th
e
stud
y
c
o
n
cl
uded
th
at
t
h
e
d
ev
e
l
opm
ent
of
a
s
cien
ce
t
e
xt
bo
ok
b
a
sed
o
n
S
cien
ce
T
ec
hn
olo
g
y
S
o
ci
ety
in
e
lem
e
n
t
ary
scho
ol
i
s
a
p
p
r
op
riat
e
to
u
s
e
f
or l
earni
ng
.
K
eyw
ord
:
Elem
en
tary
s
cho
o
l
Sci
e
n
c
e t
e
ch
nol
ogy
so
c
i
e
t
y
S
c
i
e
nce
te
xt
b
o
o
k
Co
pyri
gh
t © 2
018 In
stit
u
t
e
of Advanced
En
gi
neeri
n
g
an
d
Scien
ce.
All
rights
res
e
rv
ed.
Corres
pon
d
i
n
g
Au
th
or:
A
liffa
h
K
a
r
t
ika
s
a
r
i
D
e
pa
rtme
nt
o
f
Ele
mt
ary
S
choo
l Te
ac
her
Traini
n
g
and
E
duc
ati
o
n,
Se
belas Ma
ret
U
n
ive
r
sity,
Jl
.
I
r
. S
u
tam
i
N
o.
36A
,
Jebr
es,
S
u
ra
karta, Ja
w
a
Tenga
h,
Indo
ne
s
i
a
,5
7
126
.
Em
ail:
aliffa
h.
ak@
g
m
a
i
l
.c
o
m
1.
I
N
TR
OD
U
C
TI
O
N
Ed
uca
t
i
on
is
a
v
ery
imp
o
rta
n
t
part
t
o
deve
lo
p
t
h
e
ab
ili
ty
a
n
d
c
hara
cter
o
f
a
nat
i
o
n
b
ase
d
on t
h
e
goa
l
s
and
idea
l
s
t
o
be
ach
ie
ve
d
b
y
t
he
n
a
t
io
n.
E
d
u
c
a
t
i
on
i
s
u
sefu
l
fo
r
de
ve
l
opi
ng
s
t
ude
n
t
s'
i
n
t
el
l
i
ge
nce,
w
hic
h
con
s
is
t
s
o
f
i
n
t
e
llec
t
ua
l,
s
p
i
ri
t
u
al,
e
m
o
t
io
na
l,
s
oc
ia
l,
a
n
d
k
i
n
e
s
t
h
e
t
i
c
i
nt
elli
g
e
n
c
e.
T
h
u
s
ed
u
cati
on
ca
n
b
u
i
l
d
huma
n
,
t
h
a
t
h
um
an
h
um
an.
To
r
esp
o
nd
t
o
g
lo
ba
l
cha
llen
g
e
s
,
Ind
o
n
esi
a
n
s
n
ee
d
to
h
a
v
e
h
i
gh
-l
e
v
e
l
t
hi
nki
ng
ski
l
l
s
,
wh
i
c
h
can
b
e
re
ali
zed
w
i
t
h
s
ci
e
n
c
e
e
d
u
c
a
t
i
o
n
.
S
ci
en
c
e
e
d
u
c
a
tio
n
can
b
e
r
eali
z
e
d
t
hro
u
g
h
v
ar
i
o
us
efforts,
o
ne
o
f
t
h
e
m
w
i
t
h
scie
nc
e
lear
nin
g
.
Sc
i
e
nce
le
arn
i
ng
h
a
s
trem
endo
us
p
o
t
e
n
t
i
a
l
i
n
bu
i
l
di
ng
t
h
e
n
a
ti
o
n
.
S
c
i
e
nt
ifi
c
a
l
ly
l
it
e
r
a
t
e
per
s
on
un
dersta
n
d
a
n
d
b
e
aw
a
r
e
of
n
eed
s
o
f
t
h
e
c
o
mmu
n
i
t
y
t
o
be
a
b
l
e
to
p
artic
i
p
at
e
t
e
c
hno
log
i
ca
l
o
r
i
e
n
t
ed
e
co
nomy
[
1
].
S
c
i
e
n
c
e
,
t
e
ch
no
l
ogy
,
an
d
so
c
i
et
y
(S
TS)
w
a
s
a
te
r
m
i
ndic
a
t
i
ng
r
e
for
m
teac
h
i
ng
t
o
p
ro
vi
de t
he
se
ne
e
d
s [2]
.
S
c
ienc
e
is
o
n
e
o
f
t
h
e
req
u
ire
d
s
ubje
c
t
s
in
I
nd
o
n
es
ia
n
e
d
ucat
i
o
n
c
u
r
r
i
c
u
l
u
m
,
e
s
p
e
c
i
a
l
l
y
f
o
r
elem
en
tar
y
s
c
hoo
l
le
ve
l.
L
e
a
rni
n
g
sc
i
e
nce
i
n
e
lem
e
n
t
ary
sc
ho
o
l
l
e
v
e
l
i
s
a
imed
t
o
i
n
cul
cat
e
th
e
b
a
si
c
con
c
ept
s
of
l
e
a
rn
i
ng
sci
e
nc
e
s
o
t
ha
t
it
i
s
bene
ficia
l
f
o
r
s
tu
de
nts
to
s
o
lve
t
h
e
pr
ob
l
e
m
s
i
n
t
h
e
fu
tur
e
.
The
o
b
j
ec
tive
of
educ
a
t
i
o
n
i
s
n
ot
o
n
l
y
t
o
o
b
t
ain
c
o
g
n
i
t
ive
va
lue
b
u
t
a
l
s
o
t
o
cre
ate
a
n
e
duca
tio
na
l
c
u
ltur
e
t
ha
t
i
n
c
u
l
c
ate
s
un
dersta
n
d
i
n
g
an
d
pr
ob
l
e
m
-
so
l
v
i
ng.
T
o
a
c
h
i
e
ve
t
hese
o
b
j
ec
ti
ves,
t
he
a
ppr
opr
iate
t
eac
hin
g
m
ater
i
a
ls
a
re
requ
ire
d
s
o
t
h
at
s
tude
nts
ca
n
m
a
ster
t
he
c
ompe
t
e
nc
ies.
The
m
a
t
eri
a
l
dev
e
lop
m
ent
g
u
i
d
eli
n
es
e
x
p
l
a
in
t
hat
deve
l
o
p
i
ng
t
ea
c
h
in
g
ma
t
e
ria
l
s
sh
o
u
ld
c
o
n
si
de
r
t
h
e
de
ma
n
d
s
of
t
h
e
c
u
rri
cul
u
m
.
I
t
me
ans
t
h
at
t
he
d
e
v
e
l
o
p
in
g
teac
h
i
ng
ma
terial
s m
u
st be
in
a
c
c
orda
n
c
e
w
ith
t
he
im
p
l
e
me
nt
a
tio
n
of the
c
urr
i
c
u
l
u
m
[3].
Base
d
on
2
0
1
3
C
u
rric
u
lum
,
t
he
t
eac
h
i
ng
m
a
teria
l
s
c
ons
is
t
s
o
f
te
ac
her's
b
o
ok
a
n
d
s
t
ude
n
t
's
t
e
x
t
b
oo
k.
The
c
o
re
a
nd
b
a
si
c
c
o
m
p
e
t
en
cie
s
h
a
v
e
ha
d
be
en
a
rr
ange
d
by
t
he
g
o
v
e
rnmen
t
s
o
t
h
at
a
ll
s
ch
ool
s
can
ach
i
e
ve
the sa
me
re
s
ult
s
a
t t
h
e en
d o
f
ea
c
h com
p
e
t
e
n
cy.
Thus, t
he d
e
v
el
o
p
in
g o
f
t
e
achi
n
g m
a
te
ria
l
s sh
o
u
ld re
f
er to th
e
Evaluation Warning : The document was created with Spire.PDF for Python.
I
SSN: 2252-
8822
IJERE
V
ol
.
7,
N
o.
2,
June
2
0
18 :
1
2
7
– 1
31
12
8
curr
i
c
u
l
um.
In
t
h
i
s
c
a
se,
tea
c
h
i
n
g
m
a
ter
i
a
l
i
s
te
xt
boo
k.
T
e
x
t
b
o
ok
s
are
boo
k
s
c
ont
a
i
ni
ng
mat
e
ri
a
l
s
th
a
t
h
av
e
bee
n
s
e
l
e
c
t
ed
i
n
par
tic
ular
f
ie
ld
o
f
sc
ienc
e,
s
ys
tem
a
tica
l
ly
o
r
ga
n
i
zed
t
o
s
u
pp
ort
t
e
ach
i
ng
and
le
arn
i
n
g
p
r
o
cess
[4].
A
goo
d
te
xt
b
o
o
k
s
hou
ld
b
e
arr
a
nged
s
y
s
t
em
atica
l
ly
a
nd
e
a
s
y
-t
o-u
n
d
er
sta
n
d
for
s
t
ude
n
t
s.
T
oo
m
a
ny
vi
sua
l
d
is
p
l
ays
can
m
ake
d
i
f
f
icu
l
t
f
o
r
stude
nts
t
o
u
n
d
ersta
nd
t
he
c
o
n
c
e
p
t
of
s
c
i
enc
e
[
5].
The
de
ve
l
o
pm
ent
o
f
tex
t
bo
oks
i
s
e
xpe
c
t
e
d
t
o
ful
f
i
l
l
t
he
n
ee
d
of
c
o
n
c
e
p
tua
l
k
n
o
w
l
e
d
ge,
i
d
en
t
i
f
y
i
n
g
m
i
s
unde
rsta
n
d
i
n
gs,
and
d
e
si
gni
ng
t
ea
c
h
ing
mat
e
ri
a
l
s [
6
].
The
deve
l
o
p
i
n
g
o
f
te
x
t
b
ook
sho
u
l
d
be
b
as
e
d
o
n
the
s
t
ud
ent
nee
d
s
B
as
e
d
on
the
inte
r
v
i
e
w
s
w
it
h
t
e
a
c
h
e
rs,
it
w
as
r
ev
e
a
l
ed
t
h
a
t
t
h
e
t
e
xt
boo
k
l
a
ck
o
f
ma
t
e
ria
l
.
T
h
e
e
x
i
stin
g
t
e
xt
book
,
t
e
a
c
h
e
r'
s
and
st
ud
ent'
s
b
ook
s
h
a
v
e
b
een
i
nt
eg
rat
e
d
wi
th
s
ev
era
l
o
t
h
er
s
ubj
e
c
t
s
.
In
f
ac
t
, the c
o
n
t
e
n
t o
f
sc
i
ence
t
e
x
t
b
oo
k is de
p
thle
ss.
It
ca
n
be
s
e
e
n
f
r
o
m
the
co
n
t
e
n
t
of
t
he
m
ate
r
ia
l
of
t
he
s
t
u
de
n
t
s’
b
o
o
k.
M
os
t
of
t
he
c
on
te
n
t
s
are
in
t
he
f
or
m
of
stude
n
t
perf
o
rm
ance
a
n
d
d
isc
u
ssio
n
she
e
t
whic
h
lea
ds
t
o lack
o
f
i
n
c
u
l
cat
i
n
g
t
h
e b
a
si
c
co
n
cept
of
sci
e
n
c
e
. On
e
teac
her
re
v
eal
e
d
t
ha
t
t
h
e
presen
ta
ti
on
o
f
t
h
e
2
0
1
3
c
ur
ricu
lum
t
e
x
tb
ook
i
s
a
l
re
ady
go
od
a
n
d
st
ud
e
n
t
cen
t
e
r
orie
nte
d
t
ha
t
a
i
ms
t
o
m
a
ke
s
t
u
den
t
s
ac
t
i
ve
d
u
r
in
g
t
h
e
lea
r
n
i
ng.
H
o
w
e
v
er,
th
e
l
a
ck
o
f
ma
te
ri
al
cau
se
s
st
ud
en
t
s
hav
i
ng
less
t
h
e
basic
c
once
p
t
s
o
f
le
ar
ni
n
g
s
cienc
e
.
There
f
ore,
it
i
s
n
e
c
e
ssa
ry
t
o
have
a
s
up
p
l
e
m
e
n
t
t
e
xtb
o
o
k
tha
t
is use
d
a
s a
c
o
mpani
o
n b
o
o
k
t
o
overc
o
m
e
the
prob
l
e
m.
The
de
ve
lo
pm
ent
o
f
s
c
i
e
n
ce
t
ex
t
b
o
o
k
b
ase
d
on
Sc
i
e
nce
T
echn
o
l
o
g
y
S
oc
iet
y
c
a
n
i
mpr
ove
s
t
ude
n
t
s'
u
n
d
e
rst
a
nd
ing
o
f
s
c
i
e
n
ce
c
onc
ep
t
[
7
].
S
ci
e
n
c
e
T
e
c
h
n
o
l
ogy
S
o
c
i
e
t
y
use
s
d
a
i
l
y
c
omm
u
n
i
t
y
i
ss
ues
t
o
i
m
p
ro
ve
st
u
d
e
nt
s'
a
bi
l
ity
i
n
sol
v
in
g
the
p
r
obl
ems
[8
].
T
hu
s, l
e
a
r
ni
ng
s
c
i
en
c
e
b
as
e
d
o
n
Sc
i
e
n
c
e
Te
c
h
nol
ogy
S
o
c
i
e
ty
can
be
u
se
d to de
v
elo
p
cr
i
t
i
ca
l
an
d sc
ie
nt
i
f
i
c
t
h
i
nki
ng
an
d be
c
o
me
tec
hno
lo
gic
a
l
l
y
l
i
t
era
t
e c
iti
ze
ns [9].
I
n
t
h
i
s
r
e
sea
r
ch,
the
de
v
e
lop
m
ent
o
f
s
cie
n
ce
t
e
x
t
b
o
o
k
s
b
ase
d
o
n
s
ci
en
c
e
t
e
c
h
nol
ogy
s
o
c
i
e
t
y
i
s
arr
a
nged
ba
sed
on
the
s
t
ude
n
t
's
p
rob
l
e
m
s
e
n
vi
r
onme
n
t
.
T
h
e
p
r
obl
em
i
s
simp
l
e
,
su
c
h
a
s
h
o
w
t
o
m
ai
nt
a
i
n
the
sch
o
o
l
e
n
v
iron
m
e
nt.
Thus,
st
ude
n
t
s
ca
n
s
i
mpl
y
s
olve
t
he
p
rob
l
em
s.
T
he
r
esu
lts pre
se
n
t
e
d
i
n
thi
s
s
t
u
dy
a
r
e
th
e
implem
e
n
ta
t
i
o
n
of scie
nc
e te
chn
o
l
o
g
y
s
o
c
ie
ty ba
s
e
d
te
x
tb
o
oks
i
n
t
he le
a
rn
in
g proc
es
s.
2.
RESEARCH
M
ETH
O
D
The
tex
t
bo
oks
d
e
v
el
o
p
ed
i
n
th
is
e
x
p
erim
en
t
ha
ve
b
ee
n
va
li
da
ted
by
s
evera
l
e
xp
e
r
t
s
,
c
o
n
s
i
s
ti
ng
o
f
S
c
i
e
nce
ma
t
e
ri
als
e
x
per
t
s,
l
i
n
gu
ists,
an
d
des
i
g
n
e
x
p
erts.
T
h
e
v
a
l
i
d
a
t
or
c
o
n
s
ists
o
f
lec
t
ur
ers
a
nd
pr
ac
ti
t
i
o
n
e
r
s,
who
a
r
e ex
pe
ri
ence
d prim
ary sch
o
o
l
tea
cher
s.
R
an
ki
n
g
c
ri
t
e
ria i
s: 4 = ve
r
y
g
o
od,
3
=
g
o
o
d,
2
= less g
o
od,
1
=
no
t g
o
o
d
.
Expe
rt m
ater
ial exp
e
rt va
lida
t
io
n re
su
l
t
s c
a
n
b
e
s
ee
n
in Ta
ble 1.
Tab
l
e
1. Resu
l
t
s
of
Ex
pert Te
x
t
boo
k
V
a
li
da
t
i
o
n
C
o
m
pone
nt
D
e
s
c
r
iption
of
S
c
i
e
n
c
e
T
e
x
tbook
Ba
s
e
d
on
S
c
i
e
n
c
e
Tec
hnol
o
g
y
S
o
c
i
e
t
y
V
a
l
i
d
a
t
o
r
R
es
u
l
t
Av
er
ag
e
L
ec
ture
r
P
r
a
c
t
i
tion
e
r
M
a
t
e
r
i
a
l
s
Su
b
t
an
ce o
f
s
ci
e
n
c
e
m
at
er
i
a
ls
3
.8
8
3
.
8
4
3
.8
6
A
pplic
a
t
ion
of
s
c
i
enc
e
t
e
c
hnology
s
o
c
ie
ty
i
n
te
xtbook
3
.
78
3
.
8
0
3.
79
La
ngua
g
e
L
a
ngua
g
e
a
ssign
m
e
nt
3
.
8
7
3
.
88
3
.
8
7
The
use
of
c
o
m
m
u
nica
tiv
e
la
ngu
a
g
e
3
.
86
3
.
8
4
3.
85
D
e
sign
B
ook
c
o
v
e
r
d
e
sign
3.
87
3
.
8
2
3.
85
D
e
s
i
gn
th
e
c
ont
e
n
t
of
t
he
b
ook
3
.
78
3
.
7
0
3.
74
Th
is
s
t
u
d
y
w
a
s
a
qua
si
-
e
x
p
e
r
im
enta
l
s
t
ud
y
us
ing
pr
e
t
est-
pos
tte
s
t
c
o
nt
r
o
l
gro
u
p
de
si
g
n
[
10].
Th
e
stud
y
de
si
gn
w
a
s
to
c
om
par
e
e
xpe
r
i
me
nt
a
l
a
nd
c
o
n
t
ro
l
gr
o
ups.
Th
e
e
x
perim
e
nta
l
g
rou
p
i
s
a
gro
up
g
i
ve
n
t
h
e
trea
t
m
en
t
o
f
t
e
x
t
b
oo
ks
b
a
s
e
d
o
n
sc
ie
nce
tec
hno
lo
g
y
s
oc
ie
t
y
,
w
h
i
le
t
h
e
c
o
n
tr
ol
g
r
o
u
p
i
s
a
grou
p
ta
u
g
h
t
by
th
e
exi
s
ti
ng
t
e
x
t
b
o
ok.
The
r
ese
a
rch des
i
g
n
c
an b
e
see
n
in Ta
b
l
e
2.
Tab
l
e
2.
R
e
s
ear
ch de
s
i
g
n
Group
R
e
s
e
a
r
ch
A
ct
i
v
it
y
Expe
r
i
m
e
nt
a
l
g
rou
p
(
N
=
20)
C
ontrol
group
(N
=
20)
O
1
O
1
X
1
X
2
O
2
O
2
O
1
:
Pr
etes
t
O
2
:
Postte
st
X
1
:
T
rea
t
m
e
nt
u
si
ng sc
i
e
nce
te
x
t
bo
ok
base
d
on
S
c
ience
Te
ch
n
o
lo
gy
S
o
c
i
e
t
y
X
2
:
u
sin
g
t
he
e
xis
tin
g
t
e
x
t
bo
o
k
Evaluation Warning : The document was created with Spire.PDF for Python.
IJERE
I
S
S
N
:
2252-
88
22
The
Eff
e
c
tive
n
e
s
s
of Sc
ienc
e
T
e
x
t
bo
ok
Base
d
on Sc
ie
nc
e
Te
chn
o
l
o
g
y
S
o
c
i
ety
fo
r ....
(
Aliff
ah
Kar
tik
a
s
ar
i
)
12
9
The
da
ta
w
er
e
c
o
l
l
e
c
te
d
fro
m
t
he
p
re
t
e
s
t
a
nd
post
t
es
t
sc
ore,
b
o
t
h
e
x
p
e
r
im
enta
l
a
n
d
c
ontr
o
l
gro
u
p
.
Be
s
i
de
s,
t
he
i
n
s
trum
en
t
used
2
5
m
u
l
t
i
p
l
e
q
u
e
stio
ns.
The
n
,
tw
o
s
t
e
ps
a
nalyses
wer
e
u
sed
to
a
nalys
i
s
the
data.
First,
i
nde
pe
n
d
e
n
t
sa
mp
le
t
-te
s
t
em
pl
oye
d
to
c
a
l
cu
la
te
t
h
e
s
ig
n
i
f
ican
t
d
i
ffer
ence
o
f
p
o
s
t
tes
t
s
c
o
re
.
Ha
ving
kn
ow
n
t
h
a
t
t
he
t
re
atme
nt
w
as
g
ive
n
s
i
g
n
i
fic
a
nt
e
ffec
t
o
n
t
he
i
m
pro
v
i
n
g
s
tu
de
nt
s’
l
e
a
rni
ng
sc
ie
nc
e
o
u
tc
ome
s
,
the
n
t
he
n
ex
t
s
t
ep
w
as
t
o
m
e
asure
t
h
e
impr
ove
me
n
t
b
e
t
w
e
en
b
e
f
or
e
an
d
afte
r
tre
a
tm
en
t.
T
he
i
m
p
ro
ve
m
e
nt
resul
t
wa
s
ca
l
cula
te
d us
in
g t
h
e
Norm
alized
G
ain (
N
-Ga
i
n)
[1
1
].
The
criter
i
a
us
ed
i
n
N
-
G
a
in
a
re
gui
ded by
th
e
assessm
ent
st
anda
r
d
s
w
h
ic
h
desc
ri
b
e
d
in
T
able 3
[
1
2
].
Tab
l
e
3
sh
ow
s
tha
t
i
f
N
-
G
a
i
n
s
cor
e
i
s
less
tha
n
0
.3,
it
b
e
l
o
n
g
s
t
o
l
o
w,
i
f
th
e
scor
e
i
s
b
etw
e
en
0
.3-0.
7
b
e
l
ong
s
t
o
m
e
d
i
u
m
,
a
n
d
i
f
i
t
i
s
m
o
r
e
t
h
a
n
0
.
7
b
e
l
o
n
g
s
t
o
h
i
g
h
c
a
t
e
g
o
r
y
.
S
c
i
e
n
ce
t
ex
tbo
o
k
s
b
as
e
d
o
n
Sc
i
e
n
c
e
Tec
h
nol
og
y
S
o
cie
t
y
c
a
n
be
s
aid
impr
o
v
e
scie
n
ce
l
e
arn
i
n
g
o
u
t
c
o
m
e
s
if
N
-G
a
i
n
sc
ore
rea
c
he
s
at
l
ea
st
me
dium
cate
g
o
r
y.
Tab
l
e
3
.
N-
G
ain S
c
ore
Criteri
a
N-Ga
in
C
a
t
e
gori
g
<
0
.3
Lo
w
0.
7>
g≥
0
.
3
Me
diu
m
g
≥
0
.7
H
ig
h
3.
RESULT
S
A
N
D
ANALY
S
IS
P
r
etest a
n
d
p
o
s
t
te
st sc
o
re
f
ro
m
both e
x
peri
m
e
ntal a
nd co
n
t
ro
l g
r
oup
ca
n be
s
een
i
n
Tab
l
e
4.
Ta
b
l
e
4.
P
retest a
nd p
o
s
t
t
e
st
s
core
f
rom
experim
e
nta
l
a
nd c
ontr
ol
g
ro
up
C
l
a
ss G
r
ou
p
Sc
or
e
M
i
ni
m
u
m
S
c
ore
Ma
xi
m
u
m
Sc
ore
Mea
n
Tre
a
t
m
e
nt
P
re
te
st
3
6
88
61.
71
P
ostte
st
6
0
92
76.
38
C
ontrol
Pre
t
e
s
t
36
8
0
52
P
ostte
st
4
4
84
60.
54
The
m
e
t
h
od
u
se
d
to
g
e
t
t
he
m
ean
d
i
ffe
re
nc
e
is
t
he
i
n
d
e
p
e
n
d
e
nt
s
ampl
e
t
-
t
e
st
.
Th
e
si
gni
fi
ca
n
c
e
l
e
vel
of
e
f
f
ec
t
i
ve
ne
s
s
t
e
s
t
a
l
pha
i
s
0.05.
D
e
c
is
ion
-
ma
ki
n
g
o
f
tes
t
r
e
sul
t
s
by
c
o
mpa
r
in
g
t
h
e
tc
o
u
n
t
a
n
d
t
ta
ble
val
u
es
and
com
p
ar
i
n
g
t
h
e
s
i
g
n
i
f
i
c
a
n
ce
v
a
l
ue
u
se
d
SPSS
software
w
ith
a
l
pha
o
u
t
pu
t.
T
h
e
t
e
s
t
re
sults
o
f
in
de
p
e
nde
n
t
sa
mp
l
e
t
-t
est
ca
n
b
e
see
n
in
Ta
b
l
e
5
.
Ta
b
l
e
5.
Inde
pe
nde
n
t
sam
p
le
t
-
t
es
t
result
Expe
r
i
m
e
nt
a
l
C
ontrol
t
ob
s
.
t
ta
ble
S
ign.
al
pha
76.
381
60.
545
5
.
489
1
.
681
0
.
000
0.
0
5
Ba
se
d
o
n
T
ab
l
e
5
,
it
c
a
n
be
s
ee
n
t
h
a
t
t
he
a
ve
rage
p
os
tt
e
s
t
expe
r
i
m
e
n
t
a
l
g
ro
up
i
s
76.
38
1
w
h
i
l
e
t
h
e
me
an
p
ostte
st
c
on
tro
l
g
ro
up
i
s
6
0.54
5.
T
h
i
s
m
e
a
n
s
t
h
at
t
he
m
e
a
n
o
f
th
e
exp
e
ri
me
nt
a
l
g
rou
p
po
st
t
e
st
i
s
hi
gh
e
r
tha
n
t
he
c
on
tro
l
g
rou
p
.
Re
s
u
lt
s
of
t
he
t
t
es
t
us
in
g
i
n
de
pen
d
en
t
s
a
m
pl
e
t
-
te
st
o
bt
ai
n
e
d
t
-
c
o
unt
5
,4
89
w
h
i
c
h
i
s
grea
ter
tha
n
t
-
t
ab
le
(
1.68
1).
H
a
vi
ng
s
ee
n
fr
om
t
he
s
ig
n
i
ficanc
e
l
eve
l
o
f
t-te
st,
t
h
e
l
e
v
e
l
of
s
ign
i
fic
a
n
ce
i
s
low
e
r
t
h
a
n
α
(
0.00
0
<0.0
5)
.
The
ne
xt
s
te
p
is
t
o
c
o
mpa
r
e
the
me
a
n
of
p
osttes
t
e
x
p
eri
m
ental
gr
ou
p
a
nd
t
h
e
con
t
ro
l
gro
up.
B
a
s
e
d
o
n
Ta
bl
e
3,
i
t
ca
n
be
s
ee
n
tha
t
t
h
e
m
ean
o
f
p
o
s
t
te
st
e
x
p
e
r
im
en
tal
gro
u
p
is
h
ighe
r
tha
n
the
c
o
ntr
o
l
gr
o
u
p
(76.
38
1
>
6
0.
545)
.
To
f
i
n
d
ou
t
h
o
w
t
h
e
i
m
pro
v
e
me
nt
d
iffer
e
nce
bo
t
h
g
rou
p
s,
N
-G
ain
te
st
w
a
s
done.
The
resul
t
o
f
N
ga
in
t
e
s
t
ca
n be
o
bse
r
ve
d
in Ta
b
le
6
.
Ta
be
l 6.
The
a
na
lys
i
s o
f
N
-Ga
i
n
A
v
era
g
e
Impr
ovem
e
n
t
Ave
r
a
g
e
E
k
spe
r
i
m
e
n
t
a
l
group
C
ontrol
group
Pr
e
t
est
Postt
e
st
N-
G
a
in
61.
71
76.
38
0.
558
52
60.
54
0.
266
Evaluation Warning : The document was created with Spire.PDF for Python.
I
SSN: 2252-
8822
IJERE
V
ol
.
7,
N
o.
2,
June
2
0
18 :
1
2
7
– 1
31
13
0
F
r
om
T
able
6
,
i
t
i
s
reve
ale
d
t
ha
t
t
h
ere
is
i
m
p
ro
vem
e
nt
f
rom
pre
te
st
a
n
d
pos
ttes
t
s
c
o
r
e
i
n
bo
th
expe
r
i
me
n
t
a
l
a
nd
c
o
ntr
o
l
gr
o
up.
M
e
a
nw
hi
le
,
the
im
prove
m
e
nt
o
f
e
x
p
e
r
im
e
n
t
a
l
gro
up
i
s
m
ore
si
g
n
i
f
ica
n
t
t
h
an
con
t
ro
l
gro
u
p
.
A
s
w
ritten
in
t
he
t
a
b
l
e
,
t
h
e
e
xper
i
m
e
nta
l
g
r
oup
ge
ts
0
.55
8
w
h
ile
c
on
tro
l
g
ro
up
gets
0
.2
66.
I
t
ca
n
be
p
ro
ofe
d
t
ha
t
t
h
e
i
m
ple
m
entat
i
o
n
o
f
S
cienc
e
T
ech
n
o
l
o
g
y
S
o
c
i
et
y
ba
sed
te
x
t
bo
ok
is
m
ore
effec
tive
th
a
n
t
h
e
exi
s
ti
ng
t
ext
boo
k
.
The
use
of
t
e
a
c
hi
n
g
m
o
d
u
l
e
s
t
o
im
pr
ove
s
t
ude
n
t
a
c
h
i
e
v
e
m
e
nt
s
ho
u
l
d
b
e
w
i
d
e
l
y
u
s
e
d
i
n
v
a
r
i
o
u
s
leve
ls
o
f e
duc
a
t
i
ona
l cla
sse
s
[13].
Te
ache
r
s s
h
o
u
l
d
de
ve
l
o
p
me
t
h
o
d
s
t
h
a
t
mat
c
h
t
h
e book
s
u
s
ed
[14
].
By
u
si
ng
sc
i
e
n
c
e
t
e
c
hnol
ogy
s
o
c
i
e
t
y
m
e
t
h
o
d
s
i
n
th
e
l
e
a
r
n
i
n
g
p
roc
e
ss
,
i
t
c
a
n
i
n
cre
a
s
e
s
t
u
d
e
nts'
a
bil
i
ty
i
n
so
lvi
n
g
pro
b
lem
s
.
The
i
n
te
rac
tio
n
a
m
ong
a
c
t
i
on,
p
ar
t
i
c
i
pa
tio
n,
a
n
d
c
o
n
c
ep
t
u
al
iz
ati
o
n
bec
o
m
e
s
the
i
n
strum
e
n
t
i
n
th
e
deve
l
opm
en
t
o
f
l
ea
rn
i
ng
sc
i
e
nce
[15].
Ba
se
d
o
n
T
ab
le
3
,
the
sco
re
w
hi
ch
o
bt
ai
n
e
d
by
t
he
e
x
p
e
ri
ment
a
l
g
ro
up
is
h
i
gher
t
h
a
n
t
he
c
o
n
t
rol
gro
up.
T
h
i
s
s
how
s
t
h
a
t
t
he
u
se
o
f
sc
ienc
e
tec
h
n
o
l
o
gy
c
o
mm
un
ity
t
ec
h
nol
o
gy
base
d
tex
t
bo
ok
m
o
re
i
s
e
f
fe
c
t
i
v
e
t
o
i
mpr
ove
s
tu
de
n
t
l
ear
nin
g
o
u
t
c
o
me
s
.
The
cha
n
ge
s
i
n
t
he
t
e
x
t
b
o
ok
ma
ke
s
tude
n
t
s
mor
e
i
n
t
er
este
d
in
s
tud
y
i
n
g
s
cie
n
ce
an
d
he
lp
s
t
u
den
t
s
to
r
elate
l
ea
rni
ng
s
c
i
e
n
c
e
wit
h
d
ai
ly
l
if
e.
W
it
h
th
e
s
e
cha
nge
s,
i
t
can
i
m
p
rove
st
u
d
e
nt
s'
u
nde
rsta
n
d
i
n
g
an
d
l
e
a
rn
in
g ou
tc
om
es
[
1
6
].
The
use
of
S
cienc
e
Tec
hno
l
o
g
y
S
oc
i
e
t
y
e
nco
u
rage
s
te
ac
he
rs
t
o
us
e
a
m
o
re
e
xp
l
i
c
it
m
e
tho
d
o
lo
gy
tha
n
t
ra
di
t
i
ona
l
class-or
ien
t
e
d
t
e
x
tb
oo
ks.
Thus
t
he
s
t
ude
n
t
s
ha
ve
t
he
o
pp
or
tun
i
ty
t
o
in
v
e
st
iga
t
e
t
h
e
pr
ob
l
e
ms
tha
t
e
x
i
st
i
n
e
v
ery
d
a
y
l
i
f
e
[
17].
In
c
lassroom
-or
i
e
n
t
e
d
tra
d
i
t
i
ona
l
te
x
t
bo
o
k
s,
t
ea
che
r
s
use
m
o
re
i
m
p
li
c
i
t
teac
h
i
ng
m
et
h
o
d
o
l
og
ie
s.
T
he
y
be
cam
e
t
h
e
c
ourse
d
ire
c
t
o
r
i
n
ste
a
d
o
f
be
ing
a
fac
i
l
ita
t
o
r.
T
eac
hers
o
n
l
y
foc
u
s
on
t
e
x
tb
o
oks
a
nd
ha
v
e
no
f
l
e
xib
i
l
i
t
y
d
uri
n
g the
co
urse.
S
t
u
d
en
t
s w
o
rk
in
g on
a g
ive
n
p
r
o
blem
ha
v
e
n
o
r
e
l
a
t
i
on
to
s
t
ude
n
t
life
or
l
oca
l
s
ocia
l
issue
s
[
18
]
.
I
n
ap
p
l
y
i
n
g
S
T
S
l
e
ar
ni
n
g
,
te
a
c
he
rs
s
h
o
u
l
d
h
a
ve
s
pec
i
a
l
s
k
ill
s
i
n
educ
a
t
i
o
n
pro
g
r
am
s [19].
Th
e
u
s
e
of
s
c
i
en
c
e
t
ech
nol
o
g
y
so
ci
et
y
b
a
s
e
d
t
e
xtb
ook
can
i
mp
ro
v
e
the
s
t
ude
n
t
s
'
a
t
tit
ude
s
be
c
o
m
i
n
g
mor
e
pos
iti
ve
i
n
lear
ni
ng
sc
i
e
nc
e.
T
he
a
tti
t
ude
s
ar
e
at
t
h
e
t
i
m
e
o
f
l
e
a
r
n
i
n
g
an
d
a
t
t
itu
des
t
o
w
a
r
d
t
e
a
c
he
rs.
St
u
d
e
nt
s
who
are
t
a
ugh
t
u
s
in
g
sci
e
n
ce
t
ech
nol
ogy
s
o
c
i
e
t
y
a
re
m
o
re
c
a
p
ab
le
t
o
ma
st
e
r
t
he
c
o
n
ce
pts
t
h
a
n
stude
n
t
s
w
h
o
a
r
e
tau
g
h
t
u
s
i
n
g
c
o
nve
n
tio
na
l
w
a
y
.
S
o,
t
he
s
c
i
enc
e
-
p
roc
e
ss
s
k
i
l
l
s
ac
quir
e
d
a
r
e
eve
n
h
ig
he
r
[20
]
.
S
c
i
e
nce
Te
ch
n
o
lo
gy
S
o
c
i
e
t
y
has
sever
a
l
a
d
van
t
a
g
es,
such as
broa
de
n
st
u
d
en
ts
'
k
n
o
w
l
e
d
ge
i
n
lea
r
n
i
ng scie
nc
e
as
w
ell
a
s
l
e
a
rni
n
g
m
o
re
e
ffe
c
ti
ve
ly,
ma
k
i
n
g
s
tu
de
nt
s
aw
are
of
th
e
pr
ob
l
e
m
s
,
help
i
ng
st
ude
n
t
s
to
m
a
k
e
joy
f
ul
lear
n
i
n
g
;
so,
it ca
n c
h
an
ge
t
he
par
adi
g
ms
a
nd
tho
u
g
h
t
s
in
l
ea
r
n
ing
scie
nce
o
v
er
the
y
ear
s
[21].
4.
CONCL
U
S
ION
B
a
sed
on
t
h
e
r
es
ul
t
s
a
n
d
hypo
t
h
es
es
t
h
a
t
h
a
v
e
b
e
e
n
d
e
t
e
rmi
n
e
d
,
i
t
c
a
n
b
e
co
nc
lu
de
d
t
h
at
T
e
x
tb
o
ok-
base
d
S
c
ience
Te
ch
no
l
o
g
y
S
ocie
t
y
i
s
mor
e
e
ffect
i
v
e
t
o
i
m
p
rove
s
tu
de
n
t
l
ea
rn
ing
o
u
t
c
o
m
e
s.
T
he
s
tat
i
s
tic
a
l
ana
l
ys
is
r
e
s
u
l
t
sh
ow
s
a
sign
ific
a
n
t
di
ffe
re
nc
e
be
tw
ee
n
t
h
e
p
o
st
t
e
st
c
on
t
r
o
l
g
ro
up
s
th
at
u
se
s
th
e
e
x
isti
ng
tex
t
bo
ok
w
ith
t
he c
l
a
ss t
h
at
u
s
e
s
t
e
x
t
b
o
ok-ba
sed d
i
sco
v
e
r
y l
e
a
r
ni
ng.
ACKNOW
LEDG
E
MEN
T
S
A
c
kn
ow
le
dgm
e
n
t
a
r
e
g
i
ven
to
a
l
l
t
hose
w
ho
ha
ve
h
e
l
pe
d
i
n
t
he
w
r
it
i
n
g
of
t
h
i
s
scie
n
t
i
f
ic
a
r
t
ic
l
e
,
espec
i
al
ly
t
o
t
h
e m
e
ntors
w
ho ne
ve
r ge
t tire
d
to
g
u
ide
an
d
g
i
ve
i
npu
t
a
n
d
f
eed
b
a
ck
t
o
t
h
e re
se
arc
h
ers.
REFE
RENCES
[1]
S
of
owora,
O
.
A
.
&
Ad
eko
m
i,
B
.
2
0
1
2
.
Im
provin
g
s
ci
e
n
ce,
t
ech
n
o
l
ogy
a
n
d
m
a
t
hem
a
t
i
cs
e
du
cati
on
in
N
igeri
a
:
A
case
s
t
u
dy
of
O
baf
e
m
i
A
wolowo
U
ni
versity,
Il
e-If
e
.
Afri
can
Jo
u
r
na
l
of E
d
u
c
atio
nal
S
t
ud
ies
in
M
a
th
ematics
and
Sci
e
nces
,
1
0
,
1
-
8
.
[2]
Dri
v
er, R., Leach
, J
.
, M
i
ll
er,
R., &
S
c
ott
,
P. 20
00.
Y
o
un
g p
e
op
le
’
s
ima
g
e
s
of
sc
ie
n
c
e
. Bu
ckin
gh
am
: O
p
en
Un
i
vers
ity
Pre
s
s.
[3
]
De
pd
ikn
a
s.
2
00
8.
Gu
ida
n
ce o
n
th
e devel
opm
ent
of
t
e
ach
i
ng
ma
terials
.
Direct
orate
G
e
neral
o
f
M
an
agem
ent
of
P
r
im
ary
and
S
e
c
o
nd
ary
E
d
u
cation.
[4]
M
u
s
l
ich
,
M
as
nur.
20
15
.
Te
x
t
Bo
ok
Wri
t
ing
.
Y
ogyak
a
rta:
A
r-Ruzz
Med
i
a.
[5]
Coo
k
,
M.
2
00
8.
S
tud
e
nts’
c
om
preh
ens
i
on
o
f
s
c
ie
nce
con
c
e
p
ts
d
e
pict
ed
i
n
textb
ook
ill
u
s
t
ra
t
i
o
n
s.
Electr
onic Jour
na
l
of
Sci
e
nce E
d
u
c
ati
o
n
,
12
(1
)
,
1
–1
4.
[6]
G
M
S
i
nat
r
a
and
S
H
Brou
gh
to
n.
2
0
1
1
.
B
ridgin
g
R
eadi
n
g
Co
m
p
r
ehen
si
on
a
n
d
C
on
cept
u
al
C
han
g
e
in
S
cien
c
e
Ed
ucati
on: T
he
P
ro
mis
e
o
f Ref
u
tation
Text
Read.
R
e
s.
Q. Int. Re
ad.
A
s
s
o
c.
46
(
4)
[7]
Bin
a
dja,
A
.
2
006.
Gui
d
elin
es f
o
r
th
e Develo
p
m
e
nt
of
a S
A
BS
Syl
l
a
b
u
s
a
nd
App
r
o
a
ch
(
S
c
i
en
ce, En
vir
o
n
m
ent,
T
echn
o
lo
gy an
d
S
o
ciet
y)
o
r
(
S
ci
e
n
ce, E
n
vir
o
n
m
e
n
t, T
echn
o
lo
g
y
a
n
d
So
c
i
e
t
y
)
L
e
ar
ning
Ma
te
ria
l
s S
p
e
c
i
al Issu
an
c
e
of
M
I
P
A
M
e
di
a U
N
NE
S
.
S
e
m
a
ran
g
:
S
E
T
S
Lab
orato
r
y.
S
emaran
g S
t
ate U
n
i
v
ersity
.
[8
]
Su
ya
tn
a
,
A
.
,
&
A
ng
gra
i
n
i
,
D.
2
01
7.
E
ffo
r
ts
t
o
Ha
nd
le
W
a
s
te
th
rou
gh
S
c
ien
c
e
,
En
viro
n
m
en
t
,
T
echn
o
lo
gy
a
n
d
S
o
ci
ety
(
SET
S
)
E
ff
o
r
ts
t
o
Han
d
le W
ast
e
t
hrou
gh
S
cien
ce
,
E
nvi
ro
nmen
t ,
T
e
c
h
n
o
l
o
g
y
an
d
So
c
i
e
ty
(SE
TS).
[9]
P
e
dret
ti
200
3
T
e
achi
ng
Sci
e
nce,
Tech
no
lo
gy,
S
o
ci
ety a
nd En
v
i
ro
n
m
ent
(
S
T
S
E)
E
d
uca
t
i
o
n
Evaluation Warning : The document was created with Spire.PDF for Python.
IJERE
I
S
S
N
:
2252-
88
22
The
Eff
e
c
tive
n
e
s
s
of Sc
ienc
e
T
e
x
t
bo
ok
Base
d
on Sc
ie
nc
e
Te
chn
o
l
o
g
y
S
o
c
i
ety
fo
r ....
(
Aliff
ah
Kar
tik
a
s
ar
i
)
13
1
[10]
C
ress
well
,
J.
W
.
2008.
P
l
anning, Conducting,
and Evalua
ti
ng
Quan
titat
i
ve and qual
i
t
a
t
ive
rese
arch F
o
urth ed
.
Bos
t
on:
P
ears
o
n
Ed
ucat
ion.
[11
]
M
elt
z
er,
D.
E
.
2
0
0
2
.
Th
e
Relat
i
o
n
s
h
ip
b
e
t
w
een
M
at
hem
a
tics
P
r
eparat
ion
an
d
Concep
tu
al
L
earni
ng
G
ai
ns
i
n
Physics:
a
P
ossible
Hidden
V
ar
ia
bl
e
i
n
D
i
a
gno
stic
P
retest
S
co
re
s,
Amer
ican Journal on
P
h
ysics
,
v
o
l
.
7
0,
p
p
.
1
259-
12
68
.
[12
]
H
ak
e,
R
.
R.
1
99
8.
I
nt
eracti
v
e-Engag
e
m
e
n
t
v
s
Trad
iti
o
n
a
l
M
e
th
ods:
A
Si
x-T
h
o
u
sa
n
d
-s
tu
dent
S
u
r
v
e
y
of
M
e
c
h
a
ni
cs
Tes
t
D
ata f
o
r Introd
uc
tory
Phy
sic
s
Co
u
r
s
es
.
Am
erican
Jour
na
l o
n
Phys
ics
, v
o
l
. 6
6,
pp
. 64
-
74
.
[13
]
K
u
l
l
d
el,
N
.
200
7
.
A
u
t
hent
ic
T
each
ing
and
Learn
i
n
g
t
h
r
ou
gh
S
ynth
e
ti
c
Bi
o
l
ogy
.
Journal o
f
Biolog
i
cal
E
n
gineering
Vol
.
1 (
8
)
,
1-6.
[14
]
An
derss
o
n
,
B
.
200
0.
N
ati
o
n
a
l
eval
uati
on
f
o
r
t
h
e
i
m
p
ro
vem
e
nt
o
f
s
c
ien
c
e
teach
in
g.
I
n
R.
M
ill
a
r
,
J
.
L
each,
&
J
.
Os
bor
n
e
(Eds
.),
Imp
r
ovi
n
g
sc
i
e
nce ed
u
c
at
io
n: Th
e con
t
ri
buti
o
n
of
res
e
arch
(pp
.
6
2-78
).
B
i
r
m
i
n
g
ham
,
U
K:
O
p
e
n
Unive
r
sit
y
Pres
s
.
[1
5]
T
al
,
R.
T
.,
D
or
i,
Y
.
J.,
Keiny
,
S
.,
&
Zo
l
l
er,
U
.
2
00
1
.
A
ss
es
s
i
n
g
c
oncep
tu
al
c
h
a
ng
e
of
t
echers
in
vo
lv
e
d
i
n
ST
ES
edu
catio
n
and
cu
rricul
u
m
devleo
pm
ent
-
Th
e
S
TEMS
p
r
o
j
ect
a
ppro
a
ch.
Int
e
rn
ati
o
n
a
l
Jo
u
r
nal
of
Sc
i
e
nce
Educat
ion
,
23
(3),
2
47
–2
62.
[
1
6
]
A
b
u
a
l
r
o
b
,
M
.
M
.
A
.
,
&
D
a
n
i
e
l
,
E
.
G
.
S
.
2
0
1
3
.
T
h
e
D
e
l
p
h
i
T
e
chn
i
qu
e
in
I
den
t
if
y
i
ng
Learni
ng
O
b
j
ecti
v
es
f
or
t
he
Dev
e
lop
m
ent
o
f
S
cien
c
e
,
Tech
no
log
y
a
nd
S
oci
e
ty
M
od
u
l
e
s
f
or
P
ale
s
t
i
n
i
a
n
Nin
t
h
Grad
e
S
c
ien
ce
Curri
cul
u
m
.
In
te
rn
at
io
na
l J
o
urna
l o
f
S
c
ie
n
c
e
Ed
u
c
at
io
n
,
3
5
(15
)
,
2
538
–2
55
8.
[17
]
A
kcay,
H.
,
Yager,
R
.
E.
,
Is
kan
d
er,
S
.
M
.
,
&
T
u
r
gu
t,
H
.
201
0.
C
han
g
e
in
s
t
u
d
e
nt
b
eliefs
a
b
o
u
t
a
tt
it
udes
t
o
w
a
rd
sci
e
nce
i
n
g
rades
6-9.
A
s
ia-
P
a
c
if
ic
Fo
rum
on
Sc
i
e
nc
e
Le
a
r
n
i
ng
a
n
d Te
a
c
hing
,
11(1
)
,
1
-18.
[1
8]
S
in
gh
,
A.
,
Yag
e
r,
S
.
O.,
Yu
t
a
k
o
m
,
N.,
Yag
e
r,
R
.
E
.
&
A
l
i
,
M
.
M
.
201
2.
C
ons
tru
c
ti
v
i
st
t
eachi
ng
p
r
acti
ces
u
s
e
d
b
y
fiv
e
t
each
er
l
eaders
f
o
r
the
Iow
a
c
h
a
u
t
au
qu
a
pro
f
essio
n
al
d
ev
el
op
m
e
nt
p
rogram
.
In
te
rna
t
io
na
l J
o
u
r
na
l
of
En
viro
n
m
ent
a
l &
S
c
i
e
nce
E
duc
a
t
i
on,
7
(2
)
, 19
7
-
2
16
.
[19
]
T
sai,
C
.
C.
(
20
06
).
R
ein
t
erp
r
et
in
g
and
recons
tru
c
ti
ng
s
c
ie
n
ce:
t
each
ers
’
v
i
e
w
chan
ges
t
o
w
a
rd
t
h
e
n
at
ure
of
s
c
i
en
c
e
by
cou
rses
o
f
s
c
ien
ce edu
c
a
t
io
n.
T
e
achi
ng
an
d
T
e
a
c
her
Ed
ucatio
n
,
22
, 3
63
-37
5
.
[20]
Ak
cay,
H
.
,
&
Y
a
ger,
R
.
E.
201
0.
T
he
i
m
p
act
o
f
a
S
c
ien
ce/Tech
no
l
o
gy/S
o
ci
ety
teachi
n
g
app
r
oach
o
n
s
t
u
d
e
n
t
learn
i
ng
i
n fi
ve d
om
ain
s
.
Jou
r
nal
o
f
Sc
i
e
nce E
duca
t
i
o
n
an
d
T
ech
nol
og
y
,
1
9
(
6),
6
0
2–6
11
.
[21]
Das
s
,
P
.
M
2005
U
s
i
n
g
a
S
c
ience
T
echn
o
l
ogy
S
oci
e
ty
A
pp
roach
T
o
Prep
are
Re
f
o
rm
-Ori
en
ted
Scien
ce
Tea
c
hers
:
Th
e Case of
a S
econ
d
ary
S
c
ience
Met
h
o
d
s Cou
r
se.
Is
su
es i
n
T
e
a
c
her
Ed
ucatio
n
,
1
4
(1
),
9
5–
108
B
I
OGRAPHIES
O
F AUTHO
RS
A
l
iffah
Kartik
as
ari
gradu
a
ted
f
r
o
m
E
le
m
e
nt
ary Sch
o
o
l
t
eacher T
r
aini
ng
a
nd
Ed
u
c
a
t
i
o
n
a
t
Se
be
la
s
M
a
re
t
U
n
v
e
rsity
in
20
15
.
Curre
n
t
ly
,
she
i
s
stu
dy
in
g a
t
t
h
e
sam
e
dep
artm
ent f
o
r m
a
ster
d
e
gree at
S
ebelas
M
aret U
n
i
vers
ity
.
H
er research
i
n
t
erest is cr
eate
text
bo
ok
s f
o
r ele
m
ent
a
ry
s
c
hoo
l
stu
d
en
ts
.
Ro
emi
n
t
o
y
o
i
s
a
d
o
cto
r
o
f
educati
on
m
a
nagem
e
n
t
.
He
a
l
s
o
teachin
g
in
E
l
e
m
e
ntary
S
c
h
ool
t
eacher
T
rai
n
i
n
g
and
Edu
cati
o
n
at
S
eb
e
l
as
M
a
r
et
U
n
v
ersi
ty.
Th
e
f
i
el
d
h
e
m
as
t
e
re
d
was
th
e
m
a
nag
e
m
e
nt
o
f
ed
ucat
ion
.
H
e
ha
s
pu
b
l
is
hed
wid
e
ly
in
vari
ou
s
re
f
erred
jo
urnal
.
S
r
i
Y
a
mtin
ah
i
s
a
do
cto
r
o
f
educati
o
n
ev
alu
a
t
i
o
n
.
S
h
e
is
a
l
s
o
t
eachi
n
g
i
n
E
l
e
men
t
ary
S
c
h
ool
t
eacher
T
rain
in
g
and
Ed
ucat
io
n
at
S
eb
elas
M
aret
U
n
v
ers
i
t
y
.
S
h
e
is
m
aster
i
n
t
he
f
i
e
ld
o
f
ed
ucati
o
n
a
l
e
v
alu
a
ti
on.
S
he
h
as
p
ubl
is
hed
wi
dely
i
n
vari
ou
s
ref
e
rre
d
jou
r
na
l
a
n
d
p
r
e
s
e
n
te
d
pa
p
e
r
i
n
n
ati
onal and
int
e
rn
ati
o
n
a
l co
nferenc
e
s
.
Evaluation Warning : The document was created with Spire.PDF for Python.