Indonesi
an
Journa
l
of El
ect
ri
cal Engineer
ing
an
d
Comp
ut
er
Scie
nce
Vo
l.
9,
No.
2,
Februa
ry 20
18,
pp.
417
~
42
3
IS
S
N: 25
02
-
4752, DO
I: 10
.11
591/ijeecs
.v9.i
2.pp
417
-
423
417
Journ
al h
om
e
page
:
http:
//
ia
es
core.c
om/j
ourn
als/i
ndex.
ph
p/ij
eecs
Effecti
ve Sampl
ing
-
B
ased
Assessm
ent Met
hod for
Eva
lu
atin
g
Electri
cal Engine
er
in
g Pr
ogramm
e Perfo
rm
ance
W. Ma
ns
or
1
, B
. N
.
Sh
ei
k
h
Rahimul
lah
2
,
M.
N. Taib
3
,
N.
M
oham
ad
Z
aini
4
,
M.
F.
Abdul
L
at
ip
5
,
A.
R.
M
ah
mu
d
6
1
,2,3,4,5,6
Faculty of Elect
rical
E
ng
i
neer
i
ng, Un
iversiti
Tekn
olo
gi M
ARA
,
40450 S
hah A
l
a
m
, S
el
ango
r,
Ma
la
ysi
a
1,
2
Com
pu
ta
ti
on
al
Intel
li
gen
c
e D
et
ect
io
n
RI
G,
PLS
C
ORE,
Unive
rsiti
Tekno
l
og
i M
ARA
,
40450 S
hah A
l
a
m
, S
el
ango
r,
Ma
la
ys
ia
Art
ic
le
In
f
o
ABSTR
A
CT
Art
ic
le
history:
Re
cei
ved
Oct
9
, 2
01
7
Re
vised
Dec
2
0
, 2
01
7
Accepte
d
Ja
n
11
, 2
01
8
Chal
le
ng
es
in
t
he
conve
nt
iona
l
wa
y
of
m
ea
suring
progra
m
m
e
outc
om
e
inc
lud
e
la
rg
e
dat
a
sets
to
be
proc
essed,
a
l
a
rge
amount
of
m
anpowe
r,
oper
ating
cost
in
cre
m
ent
and
ti
m
e
consum
ing.
A
sam
pli
ng
-
base
d
appr
oac
h
to
eva
lu
at
e
the
p
er
form
anc
e
of
a
p
rogra
m
m
e
is
proposed
and
a
m
at
hemat
ic
a
l
m
odel
is
deve
lo
ped
to
determ
in
e
the
ove
rall
pro
gra
m
m
e
outc
om
e
score
.
The
cri
t
eri
a
for
cour
se
select
ion
and
per
c
ent
ag
e
of
student
s
considered
in
the
assess
m
ent
,
was
designe
d
to
acce
l
era
t
e
th
e
pro
ce
ss
.
Th
e
results
obta
ined
from
the
implementation
of
sam
pli
ng
base
d
appr
o
ac
h
in
th
e
assess
m
ent
have
show
n
tha
t
the
progra
m
m
e
is
s
ucc
essful
and
th
e
student
s
have
ac
hi
eve
d
the
req
uire
d
knowle
dge
and
skill
s.
The
sam
pli
ng
-
b
ase
d
appr
o
ac
h
i
s
ca
pab
le
o
f
demons
tra
ti
ng
th
e
progra
m
m
e
an
d
the stude
nts’
a
chi
ev
ement.
Ke
yw
or
d
s
:
Course
Ou
tc
om
es
De
-
M
orga
n
Learn
i
ng Outc
om
es
Pr
og
ram
m
e A
s
sessm
ent
Pr
og
ram
m
e O
ut
com
es
Copyright
©
201
8
Instit
ut
e
o
f
Ad
vanc
ed
Engi
n
ee
r
ing
and
S
cienc
e
.
Al
l
rights re
serv
ed
.
Corres
pond
in
g
Aut
h
or
:
W.
Ma
nsor
,
Faculty
of Elec
tric
al
Engineer
ing
,
Un
i
ver
sit
i Te
knol
og
i M
ARA
,
4045
0
S
ha
h A
lam
, S
el
angor,
Ma
la
ysi
a
Em
a
il
:
wah
ida
h231@salam
.u
itm
.ed
u.
m
y
1.
INTROD
U
CTION
In
t
he
im
ple
mentat
ion
of
e
ducat
ion
syst
em
that
fo
c
us
es
on
ac
hievi
ng
the
s
pecified
outc
om
es,
the
qu
al
it
y
of
a
program
m
e
has
to
be
m
on
it
or
e
d
co
ntinuo
us
ly
.
Assessm
ent
of
pro
gr
am
m
e
per
f
or
m
ance
is
cr
ucial
in
the
m
on
it
or
i
ng
pr
ocess
t
o
i
den
ti
fy
t
he
require
d
im
pr
ove
m
ent
an
d
to
pr
ov
i
de
s
olu
ti
ons
f
or
seve
ral
iss
ues
[1
-
3].
The
so
l
ution
s
ca
n
be
de
sign
e
d
once
the
analy
sis
of
root
cause
f
or
the
issues
is
determ
ined
fr
om
br
ai
ns
to
rm
ing
an
d resea
rc
h.
Ther
e
are
var
i
ou
s
ways
of
e
valuati
ng
t
he
achievem
ent
of
a
pro
gr
am
m
e.
Sin
ce
Ou
tc
om
e
Ba
sed
Ed
ucati
on
(
OB
E)
was
int
rod
uc
ed,
t
he
pro
gr
a
m
m
e
ou
tc
om
e
m
easur
em
ent
was
us
e
d
a
nd
a
set
of
perfor
m
ance
crit
eria
was
es
ta
blished
to
de
ci
de
w
hether
the
pro
gr
am
m
e
has
achiev
ed
it
s
go
al
.
Direct
m
easur
e
m
ents,
ind
irect
m
easur
em
ents o
r
bo
t
h
ways we
re em
plo
y
ed
in ev
ery course to
pro
duce the scor
e fo
r
eac
h
pro
gram
m
e
ou
tc
om
e [4
-
5].
In
t
he
pro
gr
a
m
m
e
assess
m
e
nt,
m
easur
em
e
nt
of
pro
gr
am
m
e
ou
tc
om
es
(P
O
)
was
ca
rri
ed
out
f
r
om
var
i
ou
s
c
ourse
s
and
each
co
ur
se
c
on
tri
bu
te
s
data
fr
om
var
io
us
act
ivit
ie
s
wh
ic
h
res
ults
in
la
rg
e
data
to
be
processe
d.
Mo
reover
,
la
rg
e
a
m
ou
nt
of
m
an
powe
r
is
required
a
nd
it
ta
ke
s
a
lon
g
ti
m
e
t
o
achie
ve
the
r
esults,
wh
ic
h
will
in
crease
the
op
erati
ng
c
os
t
if
the
m
easur
em
ent
is
carrie
d
out
offli
ne
an
d
m
anu
al
ly
.
The
pro
gr
am
m
e
ass
essm
ent
can
be
done
e
ff
ic
ie
ntly
us
in
g
a
pro
pe
r
te
ch
nique.
It
is
belie
ve
d
tha
t
a
sam
pling
ba
sed
appr
oach
of
m
easur
in
g
the
PO
with
the
on
li
ne
syst
em
as
the
m
ec
han
ism
,
m
ay
help
to
acce
le
rate
the
pro
gr
am
m
e ass
essm
ent p
ro
ces
s.
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2502
-
4752
Ind
on
esi
a
n
J
E
le
c Eng
&
Co
m
p
Sci,
Vo
l.
9
,
No.
2
,
Fe
bruary
2
01
8
:
41
7
–
42
3
418
Nu
m
erous
re
ports
ha
ve
desc
ribe
d
the
outc
om
es
of
the
cou
rse
a
nd
pro
gr
am
m
e
assess
m
ents.
Most
repor
t
fo
c
us
e
d
on
t
he
ty
pes
of
as
sessm
ents
and
te
c
hn
i
ques
us
ed
i
n
m
easur
i
ng
t
he
c
ourse
ou
tc
om
e
s
an
d
pro
gr
am
m
e
ou
tc
om
es
at
the
course
le
vel
[
7,
8].
T
her
e
is
no
re
port
detai
le
d
ou
t
t
he
m
at
he
m
at
ic
al
m
od
el
us
e
d
in
the
determ
i
nation
of
the
overall
PO
at
th
e
program
m
e
l
evel.
So
m
e
repor
ts
re
vealed
t
hat
aver
a
ging
of
P
O
scor
e
w
as
us
e
d
in
the
fi
nal
decisi
on
of
th
e
pro
gram
at
tainm
ent
however,
it
is
not
cl
ear
that
the
ty
pes
of
aver
a
ging tec
hniq
ue
em
plo
ye
d
in
the
w
ork [
9].
This
pap
e
r
des
cribes
t
he
pro
gr
am
m
e
assessm
ent
process
and
the
sam
pling
base
d
m
et
ho
d
us
e
d
i
n
evaluati
ng
the
perf
or
m
ance
of
Ele
ct
rical
Eng
i
neer
i
ng
De
gr
ee
Pro
gr
am
m
e.
In
t
his
ap
proac
h,
on
ly
s
el
ect
e
d
nu
m
ber
of
stu
de
nts
an
d
co
urs
es
wer
e
c
onsid
ered
i
n
the
m
e
asur
em
ent.
A
m
a
the
m
at
ic
a
l
m
od
el
fo
r
determ
ining
the
final
PO
s
cor
es
was
de
ve
lop
e
d
a
nd
em
plo
ye
d
in
the
pro
gr
am
m
e
as
sessm
ent.
The
eff
ect
ive
ness
of
t
he
m
et
ho
d
was
e
xam
ined
by
im
ple
m
enting
it
in
assessi
ng
the
PO
of
the
Ele
ct
rical
En
gin
eeri
ng
Degre
e
Pr
og
ram
m
e.
2.
RESEA
R
CH MET
H
OD
The
pro
gr
am
m
e
assessm
ent
proces
s
use
d
i
n
the
fac
ulty
includes
a
fe
w
st
ages
s
uc
h
as
pe
rfor
m
ance
ind
ic
at
or
desig
n,
pe
rfor
m
ance
assessm
ent
m
at
rix
prepa
ra
ti
on
,
data
e
ntr
y,
PO
m
easurem
ent
an
d
a
na
ly
sis
,
Com
pleti
on
of
CQI
repo
rt
,
PO
at
ta
inm
ent
analy
sis
&
Re
por
ti
ng
,
A
ppr
oval
of
the
Pr
opose
d
Ac
ti
on
s,
Mon
it
ori
ng
a
nd
Im
pr
ov
em
en
t
as
sho
wn
in
Figure
1.
All
l
evel
of
aca
de
m
ic
sta
ff
sta
rting
f
ro
m
le
ct
urer
to
the
facu
lt
y m
anag
em
ent took part
in the a
ssessm
ent pr
ocess.
At
the
facu
lt
y
le
vel,
the
perform
ance
ind
ic
at
or
f
or
e
ac
h
program
m
e
ou
tc
om
e
was
design
e
d
a
nd
discusse
d
in
t
he
w
orks
hop
be
fore
the
progra
m
m
e
is
assessed.
The
re
a
re
t
welve
POs
f
or
each
pro
gram
m
e
as
li
ste
d
in
Ta
ble
1.
The
pe
rform
ance
assess
m
ent
m
at
rix
w
as
prepa
red
an
d
discuss
e
d
at
the
Ce
ntre
f
or
Stud
ie
s
le
vel.
I
t
des
cri
bes
the
sel
ect
e
d
co
urses
f
or
e
ach
P
O
m
easur
em
ent,
m
et
ho
d
of
assessm
en
t,
nam
e
of
the
per
s
on
in ch
a
r
ge
a
nd ot
her
s
[
10
]
.
Figure
1. The
Pr
og
ram
m
e A
s
sessm
ent Pr
oce
ss
.
The
PO
m
easur
em
ent
was
ca
r
ried
out
by
the
co
ur
s
e
c
oor
din
at
or
wh
e
reas
the
P
O
at
ta
inm
ent
a
naly
sis
was
pe
rfor
m
ed
by
the
progra
m
m
e
coo
r
din
a
tor.
A
we
b
-
ba
sed
syst
em
was
dev
el
op
e
d
to
assist
the
aca
dem
ic
sta
ff
in
m
easur
in
g
the
PO
a
nd
exam
ining
the
pro
gram
me
perf
or
m
ance.
The
syst
em
us
es
a
m
at
hem
at
ic
al
m
od
el
to
cal
cu
la
te
the
PO
sc
or
es
aut
om
atical
ly
and
e
ff
ic
ie
ntly
.
The
proc
ess
of
dev
el
oping
the
m
at
he
m
at
ic
al
m
od
el
is
sh
own
in
Fig
ur
e
2.
Be
fore
the
m
a
them
a
ti
cal
m
o
del
was
de
sig
ne
d,
the
te
ch
nique
em
plo
ye
d
in
the
creati
on
of
t
he
m
od
el
was
firs
t
discu
ssed
with
t
he
e
xter
nal
exam
iner
an
d
s
ta
ti
sti
c
ia
n
.
T
w
o
te
c
hn
i
qu
es;
the
P
O
aver
a
ging
a
nd
the
De
Mo
rg
a
n
P
r
ob
a
bili
ty
t
heorem
wer
e
e
xam
ined
by
a
pply
ing
t
hem
on
a
fe
w
sam
ples
a
nd
the
res
ults
were
analy
sed.
T
he
op
ti
m
u
m
te
c
hn
i
qu
e
was
em
plo
ye
d
i
n
the
m
od
el
dev
el
op
m
ent.
The
m
od
el
was
then
im
ple
m
ented
in t
he pr
ogr
a
m
m
e assess
m
ent and it
s
feas
ibil
it
y was ex
a
m
ined
.
Figure
2. Proce
ss of
Dev
el
oping M
at
hem
at
ical Mod
el
for Pr
ogram
m
e O
utcom
es Mea
su
re
m
ent.
Evaluation Warning : The document was created with Spire.PDF for Python.
Ind
on
esi
a
n
J
E
le
c Eng &
Co
m
p
Sci
IS
S
N:
25
02
-
4752
Eff
ect
iv
e S
amp
li
ng
-
B
as
e
d
A
ss
essme
nt Meth
od fo
r Ev
aluati
ng Elec
tri
cal E
ngineeri
ng
…
(
W. M
an
s
or
)
419
Table
1.
Keyw
ord of t
he
Twe
lve
P
Os
PO
Keyw
ord
PO1
En
gin
eeri
ng Knowled
ge
PO2
Pr
oble
m
A
naly
sis
PO3
Desig
n
S
ol
utio
ns
PO4
Investi
gatio
n
PO5
Tech
niques, R
eso
ur
ces
&
T
ools
PO6
So
ci
et
al
, H
e
al
th &
Sa
fety
I
ss
ues
PO7
En
vironm
ent & Sustai
na
bili
t
y
PO8
Ethic
s
PO9
Com
m
un
ic
at
io
n
PO10
Indivi
du
al
& T
ea
m
W
ork
in
Mult
idisci
plina
ry Sett
ing
PO11
Lifel
ong Lea
r
ni
ng
PO12
Pr
oject
Ma
nage
m
ent & F
i
nance
It
is
im
po
rtan
t
to
sel
ect
th
e
su
it
able
c
ourses
f
or
the
pro
gr
am
m
e
assessm
ent
bef
ore
the
P
O
m
easur
em
ent
i
s
carrie
d
ou
t.
The
c
rite
ria
use
d
in
t
he
sel
ec
ti
on
of
c
ourses
wer
e
t
he
c
or
e
co
ur
ses
t
hat
di
rectl
y
addresse
d
t
he
pro
gr
am
m
e
outc
om
es
and
t
he
m
ini
m
u
m
num
ber
of
co
urse
s
sel
ect
ed
for
e
ach
P
O
was
th
ree.
In
the
PO
m
eas
ur
em
ent
fo
r
a
n
ind
i
vidual
course,
the
P
O
sco
re
was
m
easur
ed
fro
m
a
few
assessm
ent
com
po
ne
nts
f
or
exam
ple,
the
exam
inati
on
quest
io
n,
re
port
and
a
ssig
nm
e
nt
that
ad
dr
e
ss
the
sel
ect
ed
P
O.
In
this
sam
pling
base
d
ap
proac
h,
only
30%
of
the
ov
e
rall
stu
den
ts
wer
e
sel
ect
ed
in
the
m
easur
em
ent
if
the
total
nu
m
ber
of
t
he
stud
e
nts
is
10
0
a
nd
a
bove
,
a
nd
f
ro
m
this
pe
rcen
ta
ge,
t
he
pro
portion
of
good,
m
od
erat
e
an
d
weak st
ude
nts
was 0.
33.
T
he PO
for
a
n
i
nd
i
vidual co
urse,
PO
I
was
cal
c
ul
at
ed
usi
ng E
quat
ion
(1).
N
m
P
N
PO
N
m
m
I
,
.
.
.
2
,
1
1
1
(1)
wh
e
re
N
is
the
total
n
um
ber
of assessm
ents
us
e
d
in
the m
easur
em
ent and
P
is t
he pe
rcent
age of
t
he
a
ve
rag
e
m
ark
fo
r
eac
h assessm
ent, which
is
g
i
ven by
Equati
on (2).
K
j
x
M
KM
P
K
j
j
f
,...
2
,
1
%
100
1
1
(2)
wh
e
re
k
is
total
the
nu
m
ber
of
stud
e
nt
in
vo
l
ved
i
n
the
m
ea
su
rem
ent,
M
j
is
a
m
ark
scor
e
d
by
each
stu
de
nt
an
d
M
f
is
the
fu
ll
m
ark
f
or
the
a
ssessm
ent.
Table
2
sho
ws
exam
ple
of
PO
scor
e
cal
culat
ion
f
or
a
n
ind
i
vidual
course
us
i
ng th
e ab
ov
e
equati
on
s
.
Table
2.
E
xam
ple of selec
te
d PO
Me
as
urem
ent for
a
n
I
ndivid
ual Co
urse
.
Co
u
rse Na
m
e
Co
u
rse 1
Selecte
d
Pr
o
g
ra
m
m
e
Ou
tco
m
e
PO1
PO5
Selecte
d
Co
u
rse O
u
tco
m
e
CO1
CO3
No
Su
b
jects
Exa
m
Qu
estio
n
1
Ass
ig
n
m
en
t 1
Exa
m
Qu
estio
n
3
Ass
ig
n
m
en
t 2
Fu
ll
m
a
rk M
f
= 20
Fu
ll M
ark
M
f
=
10
0
Fu
ll
m
a
rk
M
f
=
20
Fu
ll
m
a
rk
M
f
=
10
0
1
Stu
d
en
t 1
17
80
18
95
2
Stu
d
en
t 2
20
86
10
98
3
Stu
d
en
t 3
19
70
15
85
4
Stu
d
en
t
4
18
75
12
80
5
Stu
d
en
t 5
15
95
17
60
6
Stu
d
en
t 6
16
88
16
75
7
Stu
d
en
t 7
10
96
17
78
8
Stu
d
en
t 8
17
78
16
68
9
Stu
d
en
t 9
9
60
9
56
10
Stu
d
en
t 10
12
65
8
54
Total
153
793
138
749
Percentag
e; P
7
6
.5 %
7
9
.3 %
6
9
%
7
4
.9 %
PO sco
re
PO1
=
7
7
.8%
PO5
=7
1
.97
%
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2502
-
4752
Ind
on
esi
a
n
J
E
le
c Eng
&
Co
m
p
Sci,
Vo
l.
9
,
No.
2
,
Fe
bruary
2
01
8
:
41
7
–
42
3
420
The
overall
P
O
sco
re
for
m
ulti
ple
courses
was
com
pu
te
d
us
in
g
m
at
he
m
at
ic
al
m
od
el
wh
ic
h
w
as
der
i
ved
from
De
Mo
rg
a
n
P
r
ob
a
bili
ty
Theorem
fo
r
m
utu
al
ly
exclusive
e
ve
nts
as
s
how
n
in
(3).
The
De
Mor
gan
Pro
ba
bili
ty
Theo
rem
has
bee
n
us
ed
in
res
earc
hes,
for
e
xam
ple
to
proof
th
e
ci
r
cuit
lowe
r
bound
f
or
autom
at
ic
le
ar
ning
al
go
rithm
an
d
f
or
detect
ing
an
d
diag
nos
ing
fa
ults
f
ound
in
hea
vy
-
duty
diesel
en
gin
e
s
[
11,
12
]
.
I
n
prob
a
bili
ty
,
even
ts
t
hat
are
not
as
so
ci
at
ed
t
og
et
her
or
occ
ur
s
epar
at
el
y
are
sai
d
to
be
m
utu
al
ly
exclusi
ve
[
13
]
.
The
rati
onal
e
of
us
in
g
De
M
orga
n
Pro
bab
il
it
y
theor
em
is
t
hat
the
PO
sc
ore
f
or
eac
h
co
urse
is
m
easur
ed
f
r
om
dif
fer
e
nt
st
udents,
act
ivit
ie
s,
ty
pes
of
asses
sm
ent
and
m
eth
ods
of
as
sess
m
ent.
The
re
for
e,
th
e
PO
sc
or
e
fro
m
m
ulti
ple
cou
rses
can
not
be
ave
ra
ged.
The
prob
a
bili
ty
of
ac
hieving
the
ta
r
geted
le
vel
of
pro
gr
am
m
e o
utcom
es,
PO
m
is
giv
e
n by
=
1
−
(
′
(
0
)
′
(
1
)
.
.
.
′
(
−
1
)
)
k
P
x
x
P
x
P
PO
m
'
'
'
...
2
1
1
(3)
wh
e
re
m
is
P
O’s
numb
er
,
k
is
the
num
ber
of
co
ur
se
s
se
le
ct
ed
in
the
m
easur
em
ent,
P’
(1
)
is
per
ce
nt
age
of
course
1
not
a
chievin
g
the
K
PI
,
P’
(2
)
is
th
e
pe
rcen
ta
ge
of
c
ourse
2
is
not
ac
hieving
t
he
KPI,
P’
(k
)
is
the
per
ce
ntage
of c
ourse k
of
no
t
achievin
g
t
he KPI.
Re
wr
it
ing
the
equ
at
io
n
us
in
g
PO
te
rm
and
t
he
pr
ob
a
bili
ty
theo
rem
PO
_
C
k
=
1
-
P
’
(
k)
wh
ic
h
is
th
e
per
ce
ntage
of
achievin
g
t
he
KP
I
is
eq
ual
to
on
e
m
inu
s
the
per
ce
ntage
of
no
t
ac
hievi
ng
t
he
K
PI
(Bli
tz
ste
in
et
al
. 2015), yi
el
ds (
4)
,
a m
or
e
de
ta
il
elabo
rati
on
of
the
overall
PO cal
culat
io
n.
1
0
0
_
1
.....
1
0
0
_
1
1
0
0
_
1
1
2
1
k
m
C
PO
x
x
C
PO
x
C
PO
PO
(4)
wh
e
re
P
O
_
C
1
i
s
the
PO
sc
ore for
co
urse
1,
P
O
_
C
2
is
the
P
O
sco
re
f
or
co
ur
se 2
a
nd
P
O
_
C
k
is
the
PO
s
cor
e for
course
k.
F
or
exam
ple,
ref
e
r
rin
g
to
Ta
ble
3,
i
f
th
ere
are
four
c
ourses
w
ere
sel
ect
ed
in
the
m
easur
em
ent
of
PO1
a
nd
the
P
O
sc
or
e
f
or
c
ourse
1;
PO
_
C
1
is
80%,
f
or
co
ur
se
2;
PO
_
C
2
is
70%,
f
or
co
ur
se
3;
PO
_
C
3
is
60%
,
and f
or co
urse
4; P
O
_
C
4
is
50
%, the
n usin
g (
4) the
overall
P
O1 for
the
pro
gr
am
m
e is 83
.
2%.
Table
3.
O
ver
a
ll
PO
Sc
ore Ca
lc
ulate
d
f
r
om
PO
of
Sele
ct
ed
Co
ur
ses
Co
u
rse
Na
m
e
PO Score
PO1
PO2
PO3
PO4
PO
n
Co
u
rse 1
80%
-
75%
-
PO
n
_C
1
Co
u
rse 2
70%
-
79%
-
PO
n
_C
2
Co
u
rse 3
60%
-
-
75%
PO
n
_C
3
Co
u
rse 4
50%
-
100%
-
PO
n
_C
4
Co
u
rse 5
-
92%
-
90%
PO
n
_C
5
Co
u
rse 6
-
88%
-
80%
PO
n
_C
6
Co
u
rse 7
-
90%
-
82%
PO
n
_C
7
:
:
:
Co
u
rse k
:
:
:
-
:
:
:
60%
:
:
:
90%
:
:
:
-
:
:
:
PO
n
_C
k
Ov
erall
P
O
sco
re
8
3
.20
%
9
9
.96
%
100%
9
9
.5%
PO
m
The
m
at
he
m
atical
m
od
el
was
first
i
m
ple
m
ented
in
2012
wh
e
re
the
pe
rfor
m
ance
of
six
pro
gr
am
m
es
was
evaluate
d
base
d
on
the
pro
gr
a
m
m
e
ou
tc
om
e.
Be
fore
t
he
m
a
them
a
ti
cal
m
o
del
wa
s
us
ed
,
i
t
was
te
ste
d
on
a
fe
w
sel
ect
ed
co
urse
s
in
a wor
kshop b
y
the H
ea
d
of
Pro
gr
am
m
e
s
a
nd O
utc
om
e
Ba
sed
Ed
ucati
on
(
OBE)
com
m
ittee
to
ens
ur
e
e
rror
fr
ee
a
nd
c
orre
ct
cal
culat
ion
.
On
ce
it
was
c
onfirm
ed
that
th
e
m
at
he
m
at
ic
a
l
m
od
el
an
d
the
web
-
base
d
syst
em
wer
e
f
un
ct
io
ni
ng
well
,
a
w
or
ks
ho
p
was
c
on
du
ct
e
d
to
trai
n
the
c
ourse
co
ordinat
or
s
to
use
the
web
-
based
syst
e
m
fo
r
m
ea
su
ri
ng
t
he
P
O
an
d
for
c
om
pleti
ng
the
CQI
repo
rt
wh
ic
h
wa
s
ge
ner
at
e
d
autom
at
ic
ally.
The
PO
at
ta
in
m
ent
analy
sis
was
presente
d
to
the
facu
lt
y
m
anag
em
ent
a
nd
discuss
e
d
in
the
Cl
os
in
g
de
Lo
op
(CDL
)
wor
ks
ho
p
ev
ery
se
m
est
er.
Acti
ons
to
be
ta
ken
to
im
pr
ove
the
pro
gr
a
m
m
e
ou
tc
om
es
and
t
o
so
lve
issues
re
la
te
d
to
c
urric
ulu
m
,
te
achin
g
delive
ry
a
nd
the
im
ple
m
enta
ti
on
of
OBE
w
ere
ide
ntifie
d
in
th
e
pre
-
CDL
w
ork
sh
op.
T
hese
pro
posed
act
io
ns
we
re
furthe
r
disc
us
se
d
in
the
CD
L
wor
ks
ho
p
for
a
pp
roval.
Mon
i
to
rin
g of
the act
io
ns
tak
en was ca
rr
ie
d ou
t
by the
m
anag
em
ent in th
e
dep
a
rtm
ent an
d facult
y l
evels
.
Evaluation Warning : The document was created with Spire.PDF for Python.
Ind
on
esi
a
n
J
E
le
c Eng &
Co
m
p
Sci
IS
S
N:
25
02
-
4752
Eff
ect
iv
e S
amp
li
ng
-
B
as
e
d
A
ss
essme
nt Meth
od fo
r Ev
aluati
ng Elec
tri
cal E
ngineeri
ng
…
(
W. M
an
s
or
)
421
3.
RESU
LT
S
A
ND D
I
SCUS
S
ION
Figure
3
s
how
s
one
of
the
PO
sc
ore
ob
ta
ined
from
the
sel
ect
ed
c
our
ses.
E
ve
n
th
ough
t
her
e
is
var
ia
ti
on
in
th
e
PO
sc
or
e
,
usi
ng
the
m
at
hem
at
ic
al
m
od
el
,
the
overall
P
O
ca
n
be
deter
m
ined.
Fig
ur
e
4
s
how
s
the
PO
at
ta
inm
ent
of
one
of
t
he
pr
ogra
m
m
es
wh
ic
h
was
ob
ta
ine
d
us
in
g
the
m
ath
em
atical
m
o
del
an
d
sam
pling
-
base
d
a
ppro
ac
h.
Ea
ch
P
O
has
e
xc
eeded
the
key
perform
ance
in
dicat
or
(
KP
I
)
t
arg
et
(a
sc
or
e
gr
eat
er
than 6
5%) w
hi
ch
s
hows
the
pro
gr
am
m
e is success
fu
l.
The
pe
rce
ntag
e
of
stu
den
t
popula
ti
on
i
n
achievin
g
the
P
O
sco
re
of
gre
at
er
than
65%
in
on
e
of
the
pro
gr
am
m
es
is
sho
wn
in
Fig
ure
5.
M
or
e
tha
n
98%
of
the
s
tud
e
nts
hav
e
a
chieve
d
t
he
re
qu
i
red
kn
ow
le
dg
e
a
nd
sk
il
ls.
These
resu
lt
s
dem
on
strat
e
that
the
sam
pling
ba
sed
a
ppro
ac
h
enab
le
s
t
he
achievem
ent
of
t
he
pro
gr
am
m
e
to
be
e
valuate
d
a
nd
t
he
e
f
fecti
ven
es
s
of
the
OB
E
im
ple
m
entat
ion
in
the
pro
gram
m
e
to b
e
ex
am
ined
.
The
sam
pling
base
d
a
ppro
ac
h
prov
i
des
se
ve
ral
be
nef
it
s.
W
it
h
a
sm
all
nu
m
ber
of
sam
ples
us
e
d
in
th
e
work,
t
he
perf
or
m
ance
of
t
he
pro
gr
am
m
e
can
be
a
naly
sed
and
the
pe
rcent
age
of
t
he
st
udent
popula
ti
on
that
m
eet
s
the
ta
rg
et
ed
KPI
co
uld
be
determ
ined
in
the
sp
eci
fie
d
tim
e
fr
a
m
e.
Sam
pling
base
d
ap
pro
ac
h
has
been
us
e
d
widely
in
sever
al
ap
plica
ti
on
s
t
o
pro
vide
cl
ear
pictu
re
on
the
pe
rfo
rm
ance
a
nd
qu
al
it
y
of
the
instr
um
ents
and
ser
vices.
Bl
anco
et
al
.
[
14
]
has
us
e
d
s
a
m
pling
base
d
ap
proac
h
to
identify
qual
it
y
of
se
rv
ic
e
f
or
w
e
b
serv
ic
e
orche
s
trat
ion
.
Be
ga
n
et
al
[
15]
has
em
plo
ye
d
sa
m
pl
ing
base
d
appr
oach
to
de
te
rm
ine
the
pl
ann
e
d
sta
rting
ti
m
e o
f
each
a
ppoi
ntm
ent.
Figure
3. A
Sa
m
ple
of
P
O
Sc
or
e
Co
ntribute
d
from
the
Sele
ct
ed
Co
urses
.
Figure
4. P
O
A
tt
ai
n
m
ent
of
t
he
Pro
gr
am
m
e
Me
asur
e
d Usin
g
Sam
pling
ba
sed
Me
th
od
and the
Ma
t
he
m
at
ic
al
Mod
el
Em
bed
ded
in t
he
On
-
li
ne
Syst
e
m
.
68,43
81,83
72,62
74,12
82,87
79,62
0
50
100
Cou
rse1
Cou
rse2
Cou
rse3
Cou
rse4
Cou
rse5
Cou
rse6
PO Score
Selected
Courses
V
aria
ti
on
of PO
4 s
c
or
e
ob
t
ained
fr
om
t
he
sele
ct
ed
Co
ur
ses
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2502
-
4752
Ind
on
esi
a
n
J
E
le
c Eng
&
Co
m
p
Sci,
Vo
l.
9
,
No.
2
,
Fe
bruary
2
01
8
:
41
7
–
42
3
422
Figure
5. The
Perce
ntage
of
Stud
e
nt P
opula
ti
on
in
Ac
hie
vin
g
PO
Scores a
bo
ve
t
he
Tar
gete
d Value
.
4.
CONCL
US
I
O
N
The
pro
gr
am
m
e
assessm
ent
proces
s
a
nd
the
m
easur
em
ent
of
P
O
us
i
ng
the
sam
pling
base
d
a
ppr
oach
hav
e
bee
n
des
cribe
d
in
this
pap
e
r.
A
m
at
h
e
m
at
ic
al
m
od
el
,
w
hich
was
der
i
ved
base
d
on
the
prob
a
bili
ty
theo
rem
,
has
been
de
velo
ped
an
d
us
ed
in
the
web
-
base
d
syst
e
m
to
assist
in
the
final
decisi
on
of
the
PO
s
core
.
The
i
m
ple
m
entat
ion
of
the
s
a
m
pling
base
d
app
r
oac
h
in
the
assessm
ent
pr
ovide
s
a
good
in
dicat
ion
on
the
pro
gr
am
m
e
and
th
e
stu
de
nts
’
perform
ance.
U
sin
g
the
c
rite
ria
f
or
the
assessm
ent,
the
sam
pling
base
d
appr
oach
dem
on
st
rates
that
the
pro
gr
am
m
e
is
su
ccess
fu
l
a
nd
t
he
s
tud
e
nts
h
ave
gaine
d
t
he
re
qu
i
red
knowle
dge a
nd sk
il
ls.
ACKN
OWLE
DGE
MENT
This
work
was
suppo
rted
by
Acad
em
ic
and
Re
search
Assi
m
il
a
ti
on
Sc
he
m
e
(A
RA
S)
,
Ma
la
ysi
a
(
600
-
RM
I/DANA
5/
3/ARAS
(
7/2015
)
.
T
he
a
uthors
w
ou
l
d
li
ke
to
e
xpre
ss
the
ir
gr
at
it
ude
to
Faculty
of
Ele
ct
rical
En
gin
eeri
ng
f
or
pro
vid
in
g
e
qu
i
pm
ent
fo
r
t
his
resea
rch,
the
fac
ulty
sta
ff
f
or
pro
vid
in
g
the
data,
the
OBE
com
m
it
te
e fo
r t
heir
assist
an
ce
and to
Unive
rs
it
i Teknolo
gi
MARA,
Mal
ay
sia
, for fina
nci
al
suppor
t
REFE
RE
NCE
S
[1]
Alle
ha
ibi
K
H
,
Albaqa
m
i
N
N.
A
Unifie
d
Qu
al
i
t
y
Control
Mode
l
for
E
-
L
ea
rning
S
y
stems
,
In
te
rn
ati
onal
Journal
of
El
e
ct
rica
l
and
C
omputer
Engi
n
e
ering
(
IJE
CE)
2
017;
7(3):
1355
-
1366.
[2]
Verm
a
S
K,
T
hakur
R
S.
Fu
zzy
As
sociation
Rule
Mining
base
d
Model
to
Pred
ic
t
Studen
ts’
Perform
anc
e
,
Inte
rnational
Jo
urnal
of El
e
ct
ri
c
al
and
Comput
er
Engi
n
ee
ring
(
IJE
CE)
,
2017;
7(4
):
2223
-
2231.
[3]
W
ei
X,
Min
G,
Ye
T,
W
ang
H,
Educ
a
ti
on
Tr
aining
and
As
sessment
for
Medic
al
Staff
in
Net
work
Inform
at
ion
Sharing
Model
,
TEL
KOMNIKA,
2016;
14(2):
388
-
395.
[4]
La
ng,
C.
R
.
&
G
ura
ca
k
,
H.
Assess
ment
methods
f
or
the
upcoming
AB
ET
a
cc
redi
ta
ti
on
cri
te
ria f
or
Computer
Sci
en
c
e
progr
ams
.
IEE
E F
ronti
ers
in
Edu
ca
t
ion
Confer
en
ce
,
2008
:
S4G
-
6
–
S4G
-
11.
[5]
Stepha
nch
ic
k,
P
.
,
Kari
m
,
A.
O
utc
ome
-
based
p
rogr
am
a
ss
ess
m
ent
:
a
practica
l
approach
.
IE
EE
Frontie
rs
in
Educ
a
ti
on
,
1999
:
13d1
-
2
–
13d1
-
6.
[6]
Schoepp
K.,
Da
nahe
,
M
.
,
Kran
ov
A.
The
computi
ng
professio
nal
skil
ls
ass
essm
ent
:
an
innovative
method
fo
r
ass
essing
AB
ET’
s stude
nt
ou
tc
om
es
.
IE
EE Global
Engi
ne
eri
ng
Edu
ca
t
ion
Confer
en
ce
,
2016:
45
-
52.
[7]
Bassi
S,
Chandn
a
V.
K.
&
Sing
h
S.
Ana
ly
sis
o
f
course
out
come
s
of
HVE
–
A
to
ol
for
ass
essm
ent
of
Program
me
Outcome
s
.
I
EE
E
3rd
Int
ern
a
ti
ona
l
Confer
ence
on
MO
OCs
,
Innova
ti
on
and
T
ec
hno
l
og
y
in Educ
at
io
n,
2015:
35
-
37.
[8]
Raj
a
ee
N,
Mohd
Sabri
M
F,
Hon
g
Ping
K,
Huja
Hus
in
M.
Assessme
nt
of
student
l
earning
outc
ome
s
in
digi
tal
signa
l
proce
ss
ing
course
in
PKE
K
,
UNI
MAS.
I
EEE
5
th
c
onfe
ren
c
e
on
En
gine
er
ing
Edu
cat
ion
,
2013
:
21
-
25
.
[9]
Mokhtar
S
A,
Z
ulfa
dli,
Sham
sul
Anuar
S
M,
Put
eh
S.
Inf
orm
ati
on
Syste
m
Mod
el
for
the
measur
e
ment
of
le
arnin
g
outc
ome
a
tt
ainm
ent
.
Int
ern
ationa
l
Confer
ence
on
Engi
ne
eri
ng
Tec
hnolog
y
and
T
echnoprene
uship,
2014:
37
-
40.
[10]
Rashid,
M.,
H.
The
proc
ess
of
outc
om
e
base
d
ed
uca
t
ion,
implementation,
assessment
and
eva
lu
a
t
ion,
UiTM
Press
,
2012.
[11]
Chen
R.
,
Kab
an
et
s
V.,
Kolokol
ova
A.,
Shal
ti
e
l
R,
Zuc
k
erman
D.
Mini
ng
c
ircu
it
lowe
r
bound
proofs
for
Me
ta
-
algorit
hms
.
IE
E
E
Proce
edi
ng
in Com
puta
ti
onal
Com
ple
xity
,
201
4:
262
-
273.
Evaluation Warning : The document was created with Spire.PDF for Python.
Ind
on
esi
a
n
J
E
le
c Eng &
Co
m
p
Sci
IS
S
N:
25
02
-
4752
Eff
ect
iv
e S
amp
li
ng
-
B
as
e
d
A
ss
essme
nt Meth
od fo
r Ev
aluati
ng Elec
tri
cal E
ngineeri
ng
…
(
W. M
an
s
or
)
423
[12]
Morgan
I,
Li
u
H,
Tormos
B,
Sal
a
A.
De
tecti
on
a
nd
diagnosis
of
inc
ipient
faults
i
n
heavy
-
duty
di
e
sel
eng
ine
s.
Cr
-
inserte
d
TiO2
th
in
fi
lms
for
che
m
ic
al
gas
sensor
s
.
IEE
E
Tra
nsac
tions
in
Industria
l
El
e
ct
roni
cs,
201
0:
57(10),
3522
-
3532.
[13]
Bli
zstein
J K
.
,
Hw
ang
J.
In
troduction
to
Probabi
li
t
y
.
CRC
Press,
2
015.
[14]
Bla
nco
,
E
.
,
Card
ina
l
e,
Y
.
,
Vidal,
E.
A
sam
pli
ng
b
ased
approach
t
o
ide
n
ti
f
y
QoS
f
or
web
servi
ce
o
rche
stration
.
Th
e
12th
Int
ern
ation
al
Conf
ere
n
ce o
n
Inform
at
ion
In
te
gra
ti
on
and
W
eb
-
base
d
Appl
icati
ons
&
Servi
ces
,
2010:
25
-
32
.
[15]
Bega
n
M
A,
Le
vi
R,
Que
y
ran
ne
M.
(
2012).
Te
chn
ic
a
l
Note
-
A
sam
pli
ng
b
ase
d
appr
oa
ch
to
appoi
ntmen
t
sche
duli
ng
.
Ope
rations R
ese
arch
,
2012:
60(3):
67
5
-
681.
Evaluation Warning : The document was created with Spire.PDF for Python.