Int
ern
at
i
onal
Journ
al of Ele
ctrical
an
d
Co
mput
er
En
gin
eeri
ng
(IJ
E
C
E)
Vo
l.
9
, No
.
5
,
Octo
ber
201
9
, pp.
4344
~4
354
IS
S
N: 20
88
-
8708
,
DOI: 10
.11
591/
ijece
.
v9
i
5
.
pp
4344
-
43
54
4344
Journ
al h
om
e
p
age
:
http:
//
ia
es
core
.c
om/
journa
ls
/i
ndex.
ph
p/IJECE
The
imp
act
of
IT
investm
ent on fi
rm perf
orman
ce
based on
MCDM
tec
hn
iqu
es
An
s
ar Dagh
ouri
, K
h
alif
a Manso
uri
, M
ohamme
d Q
badou
ENSET
of
Moh
a
m
m
edi
a,
Univer
sit
y
Hass
an
II
of
Casablanc
a
,
Morocc
o
Art
ic
le
In
f
o
ABSTR
A
CT
Art
ic
le
history:
Re
cei
ved
N
ov
1
, 2
01
8
Re
vised
A
pr 17
, 2
01
9
Accepte
d
Apr
29
, 201
9
In
the
re
ce
nt
p
ast
y
ea
rs,
r
ese
a
rch
ers
have
pr
e
sente
d
conf
li
c
ting
result
s
reg
ard
ing
th
e
impact
of
info
rm
at
ion
te
chno
log
y
inv
estment
on
firm
per
form
anc
e
.
Al
m
ost
al
l
studie
s
on
informati
on
t
ec
hnolog
y
produ
ct
ivit
y
and
it
role
for
companie
s
per
form
a
nce
ar
e
base
d
o
n
dat
a
co
llected
and
m
et
a
-
ana
l
y
sis
and
do
not
offe
r
a
m
et
h
odolog
y
or
proto
t
y
p
e
of
ana
l
y
sis
in
an
y
f
ie
l
d
Thi
s
stud
y
pr
ese
nts
an
attempt
to
adopt
a
m
ult
i
-
c
riteria
d
ec
isi
on
m
aki
ng
appr
oac
h
to
ev
aluate
the
non
-
f
in
a
ncial
pe
rform
anc
e
of
companies
using
two
famous
m
et
hods.
Furthermore
,
our
result
s
tr
y
t
o
inve
stig
ate
th
e
eff
ects
of
informati
on
t
echnolog
y
inve
st
m
ent
s
on
firms
’
non
-
fina
n
ci
a
l
per
form
anc
e
.
Finding
show
tha
t
inve
stm
ent
in
informati
on
s
y
stems
is
not
nec
essar
i
l
y
rel
a
te
d
to ac
hi
ev
ing
a
good
non
-
f
ina
nc
ia
l
per
form
anc
e
a
t
th
e
f
irm l
eve
l
.
Ke
yw
or
d
s
:
Decisi
on m
aking
Firm
p
erfor
m
a
nce
Mult
i
-
crit
eria
Non
-
fina
ncial
perform
ance
Tech
no
l
og
y i
nvest
m
ent
Copyright
©
201
9
Instit
ut
e
o
f Ad
vanc
ed
Engi
n
ee
r
ing
and
S
cienc
e
.
All
rights re
serv
ed
.
Corres
pond
in
g
Aut
h
or
:
An
sa
r Da
ghour
i
,
ENS
E
T
of
M
oham
m
edia,
Un
i
ver
sit
y Ha
s
san II
of Casa
bl
anca
,
Ca
sablanca
20
000, Mo
ro
cc
o
.
Em
a
il
:
dag
h.
a
nsa
r@gm
ai
l.com
1.
INTROD
U
CTION
An
in
vestm
ent
is
an
asset
or
it
e
m
acqu
ired
w
it
h
the
go
al
o
f
gen
e
rati
ng
inc
om
e
or
apprecia
ti
on
;
it
can
be
with
m
on
ey
or
ca
pital
in
orde
r
to
gain
prof
it
able
ret
urns
.
Investm
ents
can
be
cl
assi
fied
acco
r
ding
to
their
obj
ect
ives
[
1
]
,
re
placem
ent
of
eq
uip
m
ent,
inc
rease
d
pro
du
ct
io
n
pro
du
ct
ivit
y,
strat
egic
in
ve
s
t
m
ent,
and
fina
ncial
i
nv
e
stm
en.
In
ve
sti
ng
in
in
for
m
at
ion
te
chnolog
y
(
IT)
is
a
ty
pe
of
inv
est
m
ent
widely
reg
a
r
ded
as
hav
i
ng
e
norm
ou
s
pote
ntial
fo
r
gaining
com
petit
ive
adv
anta
ge
in
the
past
three
de
cades
[2
-
5]
.
H
ow
e
ver,
t
her
e
has
a
deb
at
e
of
I
T
i
nv
est
m
e
nt
ef
fects
on
f
irm
’s
per
f
orm
ance.
The
m
ajo
rity
of
resea
r
cher
s
c
onfirm
that
IT
inv
est
m
ent
has
a
posit
ive
i
m
pact
on
firm
per
form
ance
[6
,
7]
,
the
m
os
t
of
stud
ie
s
a
re
bas
ed
on
data
coll
ect
ed
and
relat
es
to
fina
ncial
perform
ance.
The
m
ai
n
obj
ect
ive
of
this
m
anu
s
cript
is
to
de
ve
lop
a
m
ulti
-
crit
eria
decisi
on
s
uppo
rt
ap
proac
h
in
order
to
bu
il
d
a
hiera
rch
ic
al
m
od
el
to
evalu
at
e
the
no
n
-
fin
ancial
pe
rfor
m
ance
at
the
firm
le
vel
an
d
the
n
t
o
a
naly
ze
the
c
ontribu
ti
on
of
th
e
inv
e
stm
ent
i
n
the
IT
to
t
he
reali
zat
ion
of
this
perform
ance.
This
stu
dy
f
oc
us
es
on
tw
o
a
xe
s:
it
validat
es
the
interest
of
m
ul
ti
-
crit
eria
decisi
on
m
aking
(MCDM)
in
a
co
ntext
th
at
is
no
t
tra
diti
on
al
ly
theirs
,
nam
el
y
the
evaluati
on
of
the
pe
rfor
m
ance
us
i
ng
a
com
bin
at
ion
of
tw
o
fam
ou
s
a
nd
the
m
os
t
use
d
MC
DM
m
et
hods
:
AHP
a
nd
T
OP
S
IS
,
al
so
it
i
nv
est
igat
es
the
im
pact
of
I
T
inv
est
m
ent
on
the
no
n
-
fina
ncial
perform
ance
of
com
pan
ie
s
op
e
rati
ng
in
th
ree
sect
ors
s
el
ect
ed
f
or
this
s
tud
y
.
The
struc
ture
of
this
pa
per
is
as
fo
ll
ow
s:
sect
ion
2
off
ers
a
li
te
ratur
e
rev
ie
w
of
previ
ou
s
stu
die
s
about
non
-
fina
ncial
perform
ance
and
IT
in
vestm
ent
to
dem
on
s
trat
e
the
pur
pose
of
this
pa
per.
I
n
the
sec
ti
on
of
m
et
ho
ds,
the
two
us
e
d
M
CDM
m
et
ho
ds
are
e
xp
la
in
ed.
Ne
xt
sect
ion
,
prese
nts
the
res
ults
of
wor
k
m
et
h
odology
with
discussi
ons
of f
i
nd
i
ng
s
. T
he
n,
t
he
c
on
c
lud
in
g rem
ark
s
are pre
sente
d.
Evaluation Warning : The document was created with Spire.PDF for Python.
In
t J
Elec
&
C
om
p
En
g
IS
S
N: 20
88
-
8708
Th
e i
mpact
of IT invest
men
t
on fi
r
m
p
erf
orm
an
ce
base
d o
n MC
DM
te
c
hn
i
qu
e
s
(
Ansar
Dagh
ou
ri
)
4345
2.
LIT
ERATUR
E REVIE
W
2
.
1.
Non
-
financi
al
perf
ormance
Ba
sed
on
the
sta
te
of
the
ar
t,
perform
ance
is
def
ine
d
as
the
com
bin
at
ion
of
ef
fecti
ve
ness
a
nd
eff
ic
ie
ncy
[
8
]
it
can’
t
be
defi
ned
as
a
si
m
ple
no
ti
on
;
it
is
a
con
cept
tha
t
enco
m
passes
sever
al
dim
ension
s
.
Gen
e
rall
y,
we
can
sub
div
i
de
to
fina
ncial
an
d
no
n
-
fina
ncial
per
f
orm
ance.
In
our
case,
we
are
i
nterest
ed
to
non
-
fina
ncia
l
pe
rfor
m
ance.
N
on
-
fi
nan
ci
al
pe
rfor
m
ance
can
te
ll
m
anag
ers
a
bout
wh
at
is
goin
g
to
ha
ppen
wit
h
the
fina
ncial
r
esults
in
t
he
f
ut
ur
e
ye
ars
[
9
]
.
This
ty
pe
of
pe
rfor
m
ance
inc
lud
es
a
ny
qu
a
ntit
at
ive
m
easur
es
o
f
ind
ivi
du
al
or
entit
y’s
perform
ance
that
is
no
t
ex
presse
d
in
m
on
et
a
ry
un
it
s
[
10
]
.
Per
for
m
ance
m
easur
em
ent
[
11
]
is
hard
bec
ause
it
descr
ib
es
and
im
p
leme
nts
the
strat
eg
y
that
is
no
t
dir
ect
ly
ob
serv
a
bl
e,
the
m
on
it
or
ing o
f orga
nizat
ion
a
nd the im
pr
ovi
ng coo
rd
i
natio
n,
w
hich
a
re i
nfl
ue
nced by
un
con
t
ro
ll
able e
ve
nts.
I
n
this
sect
ion,
w
e
will
presen
t an
ov
e
r
view of
previ
ous stu
dies r
el
at
e
d
to
non
-
fina
ncial
m
easur
es:
-
By
rev
ie
wi
ng
pr
e
vious
st
ud
i
es
relat
ed
t
o
non
-
fi
nan
ci
al
pe
rfor
m
ance,
we
ha
ve
f
ound
di
ff
e
ren
t
i
nd
ic
at
or
s
su
c
h
as
[12
-
14]
:
pr
oduct
qual
it
y,
custom
er
s
at
isfact
ion
,
on
tim
e
delivery,
i
nnovat
ion
m
easur
es
,
at
ta
inm
e
nt
of strate
gic
obje
ct
ives, m
ark
et
sh
a
re
, e
ff
ic
ie
nc
y, pro
du
ct
ivit
y, em
plo
ye
e sati
sfacti
on
.
-
The
m
os
t
no
n
-
fina
ncial
in
di
cat
or
s
us
e
d
a
nd
ci
te
d
a
re
[
15
-
17
]
,
c
us
t
om
er
sat
isfact
ion,
m
ark
et
s
ha
re,
e
m
plo
ye
e fee
dback
, hum
an
re
so
urces
, a
nd pr
oduct
qu
al
it
y.
-
The
Ba
la
nced
Scoreca
r
d
de
velo
ped
by
K
aplan
a
nd
No
r
ton
[
18
]
pro
vid
es
fina
ncial
and
no
n
-
fina
nc
ia
l
m
easur
em
ents an
d f
oc
us
ed
on
cu
st
om
er’
s po
int o
f view.
-
Abdel
-
Ma
ksoud
[
19
]
pr
opose
d
a
m
od
el
inv
ol
ving
f
iv
e
non
-
fi
nan
ci
al
pe
rfor
m
ance
in
dicat
or
s:
c
us
to
m
er
sat
isfact
ion
,
pr
oduct
qu
al
it
y,
and on
-
tim
e d
el
ivery, effic
ie
nc
y and util
iz
at
ion an
d
em
plo
ye
e m
or
al
e.
-
Ph
il
ips
a
nd
L
ouvieris
[
20
]
introd
uced
three
m
ajor
s
uccess
facto
rs
:
qu
al
it
y
of
serv
ic
e,
cust
om
er
relat
ion
s
hip m
anag
em
ent and
cu
st
om
er p
r
of
i
li
ng
.
-
All
these
st
udie
s
confirm
ed
that
non
-
fi
nanci
al
per
f
orm
ance
is
ve
ry
im
portant
when
evaluati
on
fir
m
’s
perform
ance ev
en
in
t
he fina
ncial
secto
r
[21
-
23]
.
2
.
2
.
IT i
n
ves
tmen
t
a
n
d f
ir
m
per
f
orm
an
ce
The
relat
ion
be
tween
IT
i
nv
es
t
m
ent
and
firm
perf
or
m
ance
ha
s
bee
n
in
vesti
gated
si
nce
1980
[
24
-
27]
.
The
m
ajo
rity
of
res
ults
stud
i
es
co
nf
irm
the
IT
in
vestm
ent
’s
im
pact
on
fi
rm
per
form
ance.
Ma
ny
the
oret
ic
al
par
a
dig
m
s
in
evaluati
ng
the
I
T’s
co
ntri
bu
ti
on
to
fi
rm
per
form
ance
hav
e
c
it
ed
in
li
te
rature:
theor
et
ic
al
m
od
el
of
IT
res
ource
s
[
28
]
,
ge
ne
ral
pur
pose
te
c
hnology
the
or
y
[
29
]
,
the
ne
oclassi
cal
theo
ry
[
30,
31
]
,
the
re
so
urce
-
base
d
theo
ry
[
32
]
an
d
the
producti
vity
par
a
dox
the
or
y
[
24
]
.
The
fin
dings
of
al
l
stud
ie
s
can
be
gro
up
i
ng
t
o
three
possibil
it
ie
s:
stud
ie
s
c
onfirm
ing
th
e
posit
ive
ef
fects
of
I
T
in
vest
m
ent
on
firm
perform
ance
[
2,
3,
5,
33
-
36]
,
st
ud
ie
s
co
nf
irm
ing
t
he
I
T
pa
ra
dox
[37
-
39]
an
d
stud
ie
s
(m
ino
r
it
y)
hav
e
fou
nd
no
im
pact
of
IT
inv
est
m
ent o
n
firm
p
erfor
m
ance
[
40
-
41]
.
3.
MCD
M
METHOD
S
Ther
e
are
a
num
ber
of
MC
DM
m
et
ho
ds
m
ul
ti
ple
crit
eria
[42
-
44]
that
can
be
us
ed
to
facil
it
at
e
decisi
on
-
m
aking
process
.
In
this
work
we
us
e
d
a
com
bin
ed
ap
proac
h
of
two
m
os
t
po
pula
r
m
et
ho
ds
nam
el
y
AHP a
nd TOP
SI
S m
et
hods
.
3
.
1.
AHP
met
hod
The A
HP
proc
edure
requires
the foll
owin
g
s
te
ps
[45
-
47]
:
-
Con
st
ru
ct
the
m
at
rix
Uij
of
order
m
if
the
com
par
ed
entit
ie
s
are
crit
eria,
or
of
orde
r
n
if
the
com
par
e
d
entit
ie
s ar
e alt
ern
at
ives
-
Con
st
ru
ct
the
com
par
ison
m
at
rices
whose
values
a
re
obt
ai
ned
by
trans
form
ing
the
judgm
ents
into
nu
m
erical
valu
es
accor
ding
t
o
the
Saat
y
sc
al
e
(S
cal
e
of
Bi
nar
y
Com
par
iso
ns
)
,
res
pect
ing
the
pr
i
ncip
le
of r
eci
pr
ocity
{
∑
=
=
1
⋯
=
1
∑
=
1
(1)
3
.
2
.
TOPSIS
met
h
od
The
T
OPSI
S
proce
dure c
onsi
sts of the
foll
owin
g
ste
ps
[48
-
51]
:
-
Norm
al
iz
e p
erfor
m
ance:
′
=
(
)
√
(
(
)
2
)
(2)
Wh
e
re: i=
1…
m
an
d
j
=
1…n
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2088
-
8708
In
t J
Elec
&
C
om
p
En
g,
V
ol.
9
, N
o.
5
,
Oct
ober
20
19
:
4344
-
4354
4346
-
Ca
lc
ulate
the prod
uct of
norm
al
iz
ed
pe
rfor
m
ance:
′′
=
∗
′
(3)
∑
=
1
=
1
Wh
e
re: i=
1…
m
an
d
j
=
1…n
-
Determ
ine the
po
sit
ive
and t
he
n
e
gative i
dea
l solutio
ns
:
∗
=
{
′′
,
=
1
⋯
=
1
⋯
}
;
∗
=
{
∗
,
=
1
⋯
}
=
{
1
∗
,
2
∗
…
∗
}
; (4)
∗
=
{
′′
}
−
=
{
′′
,
=
1
⋯
=
1
⋯
}
;
∗
=
{
−
,
=
1
⋯
}
=
{
1
−
,
2
−
…
−
}
;
(5)
−
=
{
′′
}
-
Ca
lc
ulate
the s
epar
at
io
n
m
easur
es:
∗
=
√
∑
(
′′
−
∗
)
2
=
1
∀
:
=
1
⋯
;
−
=
√
∑
(
′′
−
−
)
2
=
1
∀
:
=
1
⋯
;
(6)
-
(7)
-
Ca
lc
ulate
the rel
at
ive closene
ss co
e
ff
ic
ie
nt t
o
the
ideal s
olut
ion
:
∗
=
∗
∗
+
−
∀
:
=
1
⋯
0
≤
∗
≤
1
;
(8)
-
Ra
nk the alt
er
na
ti
ves.
4.
IMPLEME
N
TATION
4
.
1.
Purp
os
e
of st
u
dy
The
st
ud
y
fo
c
use
s m
ai
nly on
the c
on
tri
bu
ti
on o
f IT i
nv
est
m
ents in
ac
hievi
ng the
firm
’s
no
n
-
fina
ncial
perform
ance
.
The
pur
pose
is
to
prov
i
de
a
new
m
et
ho
do
log
y
to
eval
ua
te
the
non
-
fina
ncial
perform
a
nce
of
firm
s
us
ing
tw
o
MC
DM
m
eth
ods
nam
el
y
AHP
an
d
T
O
PSI
S
.
T
he
fir
s
t
m
et
ho
d
wa
s
us
e
d
to
cal
cul
at
e
the
weig
hts
of
each
crit
erio
n
in
evaluati
ng
no
n
-
fina
ncial
pe
rfor
m
ance,
sub
s
equ
e
ntly
;
the
firm
s
wer
e
evaluati
ng
us
in
g
the
TO
PSI
S
m
et
ho
d.
Fu
rt
her
m
or
e,
t
his
wor
k
anal
yz
es
the
relat
i
on
s
hi
p
betwee
n
IT
in
vestm
e
nt
and
non
-
fina
ncial
perform
ance
at
fir
m
le
vel.
We
exam
ine
al
so
the
interac
ti
on
bet
ween
a
set
of
non
-
fi
nan
ci
al
ind
ic
at
ors a
nd
the d
e
gree
of
I
T in
vestm
ent.
The
pa
per
im
plem
ents
the
researc
h
m
et
ho
dolo
gy
in
th
ree
sect
ors,
nam
el
y:
finan
ci
al
sect
or,
const
ru
ct
io
n
i
ndus
t
ry
sect
or
a
nd
ser
vice
c
ompanies
,
c
ho
se
n
base
d
on
their
va
riat
ion
i
n
th
e
us
e
of
in
f
orm
at
ion
te
chnolo
gies.
The
m
ajo
rity
of
pr
e
vious
stud
ie
s
hav
e
dea
lt
with
the
finan
ci
al
perform
ance
of
firm
s
[52
-
54]
,
in
or
der
t
o
overc
om
e
this
def
ic
ie
ncy,
thi
s
stu
dy
ai
m
t
o
int
rod
uce
a
ne
w
te
ch
niqu
e
for
e
valuati
ng
an
d
analy
zi
ng
the
non
-
fina
ncial
f
irm
’s
per
form
a
nce
us
i
ng
m
ulti
-
crit
eria
decisi
on
m
aking
m
eth
ods
a
nd
it
s
re
la
ti
on
with
IT
in
vest
m
ent.
4
.
2
.
Work me
t
hod
ology
The
w
ork
m
eth
od
ology
as
s
how
n
in
Fi
gur
e
1,
c
on
sist
s
of
f
our
m
ai
n
ste
ps
as
s
umm
a
rized
i
n
t
he
fo
ll
owin
g
fi
gure:
s
te
p
1:
r
e
view
pr
e
vious
stud
ie
s
relat
i
ng
t
o
no
n
-
fin
ancial
perfor
m
an
ce,
inf
orm
at
ion
te
chnolo
gy
inve
st
m
ent
and
their
con
tri
bu
ti
on;
s
te
p
2:
c
hoos
e
the
sect
or
s
in
wh
ic
h
w
e
will
app
ly
our
ap
proac
h,
we
sel
ect
ed
3
s
ect
or
s;
s
te
p
3:
i
den
ti
fy
the
e
va
luati
on
crit
eria
and
s
ub
-
c
rite
ria
con
si
der
e
d
a
s
the
m
os
t
i
m
p
or
ta
nt
non
-
fina
ncial
perf
or
m
ance m
e
asur
e
s;
s
te
p 4:
a
pp
ly
AHP m
eth
od;
s
te
p 5:
a
pply
TO
PS
IS
m
eth
od;
s
te
p 6:
a
c
hi
eve
the
final
ra
nk
i
ng
res
ults
of
s
tud
ie
s
firm
s;
s
t
ep
7:
d
e
fine
i
nvest
m
ent
value
s
of
each
al
te
r
native
a
nd
s
te
p
8
-
9:
analy
ze
the
c
on
t
rib
ution
of
IT
in
vestm
ents
in
the
ac
hievem
en
t
of
non
-
fi
nan
ci
al
pe
rfor
m
ance
of
firm
s
belo
ng
i
ng on s
tud
ie
s sect
or
s
. T
he desc
riptio
n of eac
h st
ep wil
l be
giv
e
n
i
n
the
foll
owin
g sec
ti
on
s
.
Evaluation Warning : The document was created with Spire.PDF for Python.
In
t J
Elec
&
C
om
p
En
g
IS
S
N: 20
88
-
8708
Th
e i
mpact
of IT invest
men
t
on fi
r
m
p
erf
orm
an
ce
base
d o
n MC
DM
te
c
hn
i
qu
e
s
(
Ansar
Dagh
ou
ri
)
4347
Figure
1
.
Wo
r
k
m
e
tho
dolo
gy
4
.
3
.
Implem
ent
ati
on
To
validat
e
ou
r
wor
k
m
e
tho
dolo
gy,
we
ch
oose
to
w
ork
on
firm
s
op
erati
ng
in
three
sect
or
s
sel
ect
e
d
for
the
rea
sons
m
entioned
pre
viously
.
T
her
e
f
or
e
,
our
first
obj
ect
iv
e
was
t
he
ch
oice
of
crit
eria
an
d
sub
-
c
r
it
eria
that
will
be
use
d
du
rin
g
this
researc
h.
T
he
eval
uation
crit
eria
wer
e
ta
ken
f
ro
m
pr
e
vious
stu
di
es
an
d
researc
hers
rel
at
ed
to
no
n
-
finan
ci
al
pe
rfo
r
m
ance
evaluat
ion
[
55,
56
]
.
The
hie
rar
c
hic
al
m
od
el
con
t
ai
ns
6
crit
eria an
d 1
9 sub
-
c
rite
ria as
sh
ow
n
in
Ta
ble 1
.
Table
1
. Hie
ra
r
chical
re
pr
ese
nt
at
ion
of c
rite
ria
Main C
rite
ria
Su
b
Criter
ia
Cu
sto
m
er
(
C
1
)
Cu
sto
m
er
Nu
m
b
er
(
C
11
)
,
Cu
sto
m
erSa
tisf
actio
n
(
C
12
)
an
d
Co
m
p
lain
tsNu
m
b
er
(
C
13
)
Exp
an
sio
n
and
M
arket Sh
are
(
C
2
)
Bran
ch
eNu
m
b
er
(
C
21
),
NewProd
u
ctsNu
m
b
er
(
C
22
)
an
d
NewServic
e
(
C
23
)
E
m
p
lo
y
e
es (
C
3
)
He
ad
co
u
n
t
(
C
31
),
Avera
g
eAg
e
(
C
32
),
Satisf
actio
n
(
C
33
)
an
d
T
rainin
g
Inv
estm
e
n
t
(
C
34
)
Service Qualit
y
(
C
4
)
On
Ti
m
e
Deliv
er
y
(
C
41
),
Co
m
m
u
n
icatio
n
Cap
ab
ility
(
C
42
),
RateDela
y
(
C
43
),
Av
aila
b
ility
(
C
44
)and
Acc
ess
(
C
45
)
Env
iron
m
en
t
(
C
5
)
Tot
alPap
erCo
n
su
m
p
tio
n
(
C
51
)
an
d
E
n
erg
y
Use
(
C
52
)
Secu
rity (
C
6
)
Ris
k
Rate
(
C
61
)
an
d
Bre
ak
d
o
wn
(
C
63
)
Data
colle
ct
ion
was
c
onduct
ed
am
on
g
fift
y
firm
s
in
each
sect
or
an
d
the
wei
gh
ts
of
crit
eria
an
d
su
b
-
c
rite
ria
we
re
cal
culat
ed
usi
ng
AHP
m
eth
od.
T
he
reafte
r,
T
OP
S
IS
m
eth
od
was
a
pp
li
ed
an
d
base
d
on
t
he
decr
easi
ng
val
ues
of
cl
os
e
ne
ss
coeffic
ie
nt
al
te
rn
at
ives
ar
e
ranked
f
r
om
m
os
t
valuab
le
to
worst.
T
he
seco
nd
par
t
co
nce
rn
s
the
stud
y
of
the
relat
ionshi
p
between
IT
inv
e
stm
ent
and
firm
’s
no
n
-
fi
nan
ci
al
pe
rf
o
r
m
ance.
This
w
ork
e
nri
chies
the
de
ba
te
on
the
perform
ance
evaluati
on
by
ad
opti
ng
a
m
ulti
-
crit
eria
appr
oa
ch
to
evaluate
non
-
fi
nan
ci
al
perf
orm
ance
of
firm
s
an
d
t
o
st
ud
y
it
s
relat
io
n
with
IT
i
nv
est
m
ent.
Ther
e
are
tw
o
cases
to
disti
ng
uish
;
the
prese
nce
of
a
p
os
it
ive
or
neg
at
ive
im
pa
ct
.
Furthe
rm
or
e,
this
wor
k
in
directl
y
co
ntrols
tw
o
m
ai
n
factors
that
can
infl
ue
nce
the
co
ntri
bu
ti
on
of
IT
inv
e
stm
ent
in
the
achie
vem
e
nt
of
non
-
fina
ncial
perform
ance
at
the
firm
le
vel
wh
ic
h
are
t
he
siz
e
of
firm
and
it
s
sect
or.
Th
is
o
bs
e
r
vation
is
confirm
ed
by
the
resu
lt
s
of the
stud
y.
4
.
4
.
Prop
os
ed
fr
am
ew
ork
To
im
ple
m
ent
our
w
ork
m
et
h
odology,
we
propose
a
prot
otype
of
f
ram
ewo
r
k
that
co
ns
is
ts
of
3
pa
rts
as sho
wn in
Figure
2
.
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2088
-
8708
In
t J
Elec
&
C
om
p
En
g,
V
ol.
9
, N
o.
5
,
Oct
ober
20
19
:
4344
-
4354
4348
Figure
2.
Pro
pose
d
f
ram
ewo
r
k'
s ar
chite
ct
ure
In
te
r
fac
e:
after
authe
ntica
ti
on,
the
f
ram
ewo
rk
us
er
ca
n
st
art
the
us
e
of
app
li
cat
io
n
an
d
ente
r
th
e
evaluati
on
data
w
it
h
t
he possi
bili
ty
to
m
od
ify
crite
ria an
d
s
ub
-
crit
eria;
-
Data Ba
se:
it
s r
ole is to st
or
e
the v
a
rio
us
dat
a that wil
l be used
in t
he
ne
xt
ste
ps
of e
va
lua
ti
on
or that
will
serv
e
s as a
rc
hiv
es t
o
m
ake com
par
ison
s.
W
e
chose t
o work
with S
QL
Lit
e as the size
of
da
ta
is reduce
d;
-
Functi
on
al
Pa
rt:
it
s
pu
r
pos
e
is
to
exec
ute
the
ste
ps
of
our
w
or
k
m
et
ho
do
l
ogy
based
on
t
he
i
m
ple
m
entat
io
n
of
A
HP
a
nd
T
OP
S
IS
m
et
hods
known
by
the
c
o
m
plexity
of
the
ir
cal
culat
ion
s
.
The
pro
po
se
d
syst
e
m
beg
in
wh
e
n
th
e
us
e
r
choose
t
he
sec
tor
that
will
be
evaluate
d.
T
he
first
m
ai
n
step
on
this
par
t
is
the
im
ple
m
en
ta
ti
on
of
AHP
m
e
tho
d,
th
rough
t
he
se
ver
a
l
interfaces
w
hich
us
e
c
om
bo
boxes
to
i
np
ut
values,
the
ot
her
s
inte
rf
aces
le
ad
to
cal
culat
e
the
weigh
t
s
of
crit
eria
(
m
ai
n
crit
eria
an
d
su
b
-
c
rite
ria).
T
he
sec
ond
ste
p
aim
s
to
i
m
ple
m
ent
the
TOPSIS
m
et
ho
d
ba
sed
on
t
he
da
ta
inp
ut
i
n
by
fr
am
ewo
r
k’s
use
r.
The
final
ste
p
c
on
sist
s
on
the
analy
ses
of
re
la
ti
ons
hip
betwee
n
IT
inv
est
m
ent
an
d
firm
’s
non
-
fina
ncial
perform
a
nce.
A
pr
oto
ty
pe
wa
s
de
velo
ped
i
n
Ja
va
pr
ogram
m
ing
la
ngua
ge;
we
c
oul
d
no
t
incl
ud
e
al
l
the
interfaces
in
the
arti
cl
e
to
no
t
e
xceed
the
nu
m
ber
of
pag
es
in
dicat
ed,
we
pr
ese
nt
e
so
m
e interface
s
a
s s
how
n
in
Figure
3.
Figure
3. Proto
ty
pe
interf
aces
5.
ANALY
SIS
RE
SU
LT
S
5
.
1
.
AHP
met
hod
analysis
The
prot
otype
of
resu
lt
in
g
s
yst
e
m
sta
rt
by
aski
ng
use
rs
to
de
te
rm
ine
the
le
vel
of
im
portance
of
chosen cr
it
eria
(sub
-
crit
eria) c
om
par
ed
to o
t
he
rs.
Based
o
n
t
he
data, the cal
culat
ion
m
et
ho
d
of
AHP can beg
i
n
to
obta
in
t
he
weig
ht
of
eac
h
crit
eri
on
an
d
s
ub
-
crit
eri
on.
T
he
hiera
r
chical
struct
ure
for
e
valuati
ng
the
non
-
fi
na
ncial
perform
ance
as
sh
ow
n
in
Fi
gure
4
.I
t
s
hould
be
note
d
t
hat
the
val
ues
of
this
st
ud
y
we
re
ob
ta
ine
d by cal
culat
ing
t
he
a
ve
rag
e
v
al
ues gi
ven b
y t
he
e
xperts res
ponsi
bl
e in eac
h of t
he
thr
ee
secto
rs.
Evaluation Warning : The document was created with Spire.PDF for Python.
In
t J
Elec
&
C
om
p
En
g
IS
S
N: 20
88
-
8708
Th
e i
mpact
of IT invest
men
t
on fi
r
m
p
erf
orm
an
ce
base
d o
n MC
DM
te
c
hn
i
qu
e
s
(
Ansar
Dagh
ou
ri
)
4349
Figure
4. Hiera
rch
ic
al
str
uctu
r
e f
or
t
he non
-
fi
nan
ci
al
perf
orm
ance ev
al
uation
Starti
ng
by
th
e
fina
ncial
sec
tor
a
nd
im
ple
m
enting
the
A
HP
e
quat
i
on
s
(1),
t
hroug
h
t
he
propose
d
prototype
inter
faces,
the
nor
m
al
iz
ed
weight
vector
of
m
a
i
n
crit
eria
is:
W=
(0
.
36
;
0.2
0;
0.17
;
0.1
6;
0.0
7;
0.0
3)
as sho
wn in
Figure
5
,
the m
os
t valua
ble c
rite
rio
n wit
h
the
weig
ht of
0.3
6 i
s “Custom
er”.
Figure
5. Sect
or'
s
weig
ht cr
it
e
ria
In
the
c
onstruc
ti
on
in
du
st
ry
sect
or
,
the
pr
i
ori
ty
vector
of
c
rite
ria
weig
hts
is:
W
=
(
0.32
;
0.
19;
0.1
7;
0.16
;
0.11
;
0.0
4)
as
s
how
n
i
n
Fig
ure
5
,
th
e
highest
wei
ght
is
0.3
2
w
hi
ch
co
rr
e
spo
nds
to
the
fi
rst
crit
erion
pr
ese
ntin
g
cus
tom
er.
Con
cer
ning
the
thir
d
sect
or
,
t
he
m
ain
crit
eria
wei
ght
is:
W
=
(0.43;
0.2
0;
0.17
;
0.12
;
0.04
;
0.0
2)
as s
how
n
in
Fig
ure
5
,
the
first c
rite
rio
n
sti
ll
h
a
vin
g t
he g
reatest
value.
Fr
om
these
res
ults,
we
ca
n
c
on
cl
ud
e
t
hat
f
or
the
e
valuati
on
of
non
-
fi
na
ncial
perform
a
nce
of
firm
s,
the
m
os
t
do
m
i
nan
t
crit
eri
on
i
s
the
custom
er
reg
a
rd
le
ss
of
t
he
sect
or
or
th
e
siz
e
of
the
c
om
pan
y.
It
is
a
l
og
ic
al
resu
lt
giv
e
n
th
e
i
m
po
rtance
of
the
custom
ers
who
are
the
m
ark
of
a
ser
vi
ce
qu
al
it
y
and
a
go
od
i
m
age
of
the
firm
,
and
then
we
hav
e
th
e
oth
e
r
crit
eria.
Sti
ll
analy
z
ing
the
resu
lt
s
of
AH
P
m
et
ho
d
i
m
ple
m
entat
i
on,
we
no
ti
ce
a
n
inc
r
ease
in
weig
ht
for
t
he
la
st
two
crit
eria
na
m
el
y
env
iro
nm
ent
and
secu
rity
in
the
c
onstructi
on
industry
sect
or
that
ha
ve
pa
ss
ed
f
ro
m
0.04
t
o
0.1
1
a
nd
0.0
2
to
0.0
4
w
h
ic
h
is
norm
al
giv
en
t
he
par
ti
cu
la
riti
es
of this sect
or
be
ing
a
r
is
k fact
or an
d
it
s im
pact o
n t
he
e
nvir
on
m
ent.
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2088
-
8708
In
t J
Elec
&
C
om
p
En
g,
V
ol.
9
, N
o.
5
,
Oct
ober
20
19
:
4344
-
4354
4350
5
.
2
.
TOPSIS
met
h
od
analysis
Fr
om
the
pair
wise
com
par
ison,
the
norm
al
iz
ed
weig
ht
of
crit
eria
an
d
su
b
-
c
rite
ria
are
ob
ta
ine
d.
The
n,
we
ha
ve
pr
oc
es
s
to
the
TOP
S
IS
m
et
h
od
im
ple
m
enta
ti
on
,
the
pr
oce
ss
is
beg
un
da
ta
values
base
d
on
each
al
te
rn
at
iv
e.
Give
n
the
la
rg
e
nu
m
ber
of
al
te
rn
at
ives,
we
ch
os
e
to
di
sp
la
y
j
ust
one
exam
ple
as
sh
own
i
n
Table
2.
T
o
fa
ci
li
ta
te
the
ta
sk
of
data
e
ntry
by
eval
uato
rs,
we
c
ho
s
e
to
w
ork
with
inte
rval
s
of
val
ues
to
m
ake
the ev
al
uatio
n.
Table
2.
Scori
ng
al
te
r
native1
Criteria
Su
b
-
Criteria
Valu
es
Criteria
Su
b
-
Criteria
Valu
es
C
1
C
11
A
C
2
C
21
C
C
12
AC
C
22
AA
C
13
F
C
23
E
C
3
C
31
A
C
4
C
41
A
C
32
AA
C
42
AC
C
33
F
C
43
D
C
34
G
C
44
I
C
45
L
C
5
C
51
B
C
6
C
61
EA
C
52
AA
C
62
HB
Fr
om
the
data
of
this
al
te
r
na
ti
ve,
we
perf
or
m
the
conve
rsion
to
f
orm
su
c
h
a
decisi
on
m
at
rix
as
sh
ow
n
i
n
Ta
ble
3
.
T
o
ra
nk
t
he
diff
e
re
nt
al
te
rn
at
ives,
w
e
i
m
ple
m
ent
in
order
the
(
2)
-
(
8).
We
c
on
ti
nue
t
he
process
of
cal
culat
ing
t
he
distance
betwee
n
t
he
values
of
e
ach
al
te
r
native
against
t
he
posit
ive
ideal
so
l
ution
and the
ne
gativ
e ideal
s
olu
ti
on
. Fur
t
her
,
the
r
ank
i
ng of alt
er
natives
of the
s
tud
y i
s
obta
ine
d.
Table
3.
D
eci
si
on
m
at
rix
(alt
ern
at
ive
1)
Cr
iteria
Su
b
-
Criteria
Valu
es
Criteria
Su
b
-
Criteria
Valu
es
C
1
C
11
1
C
2
C
21
3
C
12
3
C
22
1
C
13
3
C
23
2
C
3
C
31
1
C
4
C
41
1
C
32
1
C
42
3
C
33
3
C
43
1
C
34
1
C
44
3
C
45
3
C
5
C
51
2
C
6
C
61
2
C
52
1
C
62
1
5
.
3
.
IS inv
e
stme
nt
an
d
f
ir
m
perf
orm
an
c
e
This
st
ud
y
is
ba
sed
on
data
of
fifty
fi
rm
s
belonging
t
o
t
he
t
hr
ee
stu
died
se
ct
or
s,
eac
h
with
a
dif
fer
e
nt
inf
or
m
at
ion
te
chnolo
gy
co
nsum
ption
rate. W
e
first
pr
opose
a
hierar
c
hic
al
m
od
el
to
ev
al
uate
the
non
-
fina
ncia
l
perform
ance
of
these
fi
rm
s
us
ing
MC
DM
m
e
tho
ds.
Si
nc
e
the
m
ajo
rity
of
resea
rch
stu
dying
the
co
rrel
at
ion
betwee
n
in
for
m
at
ion
syst
e
m
inv
est
m
ent
and
fina
ncial
pe
rfor
m
ance
w
or
ke
d
with
fi
nan
ci
al
perfor
m
ance,
we
ch
os
e
to
t
reat
non
-
fi
nanci
al
per
f
or
m
ance.
Subse
quen
tl
y,
we
stud
ie
d
the
c
orrelat
ion
betwee
n
th
e
tw
o
var
ia
bles;
the
r
esults
f
ro
m
pr
e
vious
researc
he
s
are
m
ixed.
I
n
gen
e
ral
way,
firm
s
inv
est
on
I
T
to
achie
ve
bette
r
com
petit
ive
adv
anta
ges
thr
ou
gh
re
duci
ng
c
os
ts,
but
the
I
T
budget
is
var
ie
d
f
ro
m
one
sect
or
to
an
oth
e
r
.
Give
n
the
num
ber
of
firm
s
in
each
sect
or,
te
n
com
pan
ie
s
f
r
om
each
sect
or
wer
e
sel
ect
ed
base
d
on
the
re
su
lt
s
of the
non
-
fi
na
ncial
p
e
rfor
m
ance e
valuati
on
(the first t
hree,
the
four ave
ra
ges
a
nd the
last
thr
ee
).
The
fina
ncial
s
ect
or
is
co
ns
id
ered
as
t
he
biggest
in
vesto
r
i
n
the
IT.
The
Fi
gure
6
s
how
s
t
he
resu
lt
s
of
the
IT
in
vestm
ent
per
ce
nta
ge
com
par
ed
to
the
firm
’s
tur
nove
r.
It
ca
n
be
con
cl
ud
e
d
tha
t
m
or
e
than
80
%
of
fina
ncial
firm
s
inv
e
st
bet
we
en
21
an
d
60
%
of
thei
r
tu
r
nove
r
in
inf
or
m
at
ion
syst
em
s;
w
hich
is
a
huge
inv
est
m
ent
give
n
the
la
r
ge
t
urn
ov
e
r
of
ba
nk
s
.
T
he
c
urv
e
sho
ws
the
r
ank
i
ng
of
t
he
firm
'
s
non
-
fi
nan
ci
al
perform
ance
accor
ding
t
o
the
IT
in
vestm
ent
as
sho
wn
in
F
igure
6
,
we
fi
nd
that
t
he
im
pact
of
IS
i
nv
e
s
t
m
ent
do
e
s
not
al
wa
ys
ensure
the
perform
ance
of
the
c
om
pan
y,
as
sho
wn
c
oncretel
y
t
he
ex
a
m
ple
of
the
B3
ba
nk
wh
ic
h
is
ranke
d
thir
d
pe
rform
ance
rati
ng
but
in
retu
rn
in
ve
sts
only
a
pe
r
centage
betwe
en
1
-
20%.
U
nlike
the
B9
bank
w
hic
h
inv
est
s
61
-
80%
of
it
s
turno
ver
but
is
ranke
d
am
on
g
the
la
st
thre
e
firm
s
in
te
r
m
s
of
perform
ance.
These
tw
o
co
nt
rad
ic
tory
e
xa
m
ples
le
ad
us
to
belie
ve
that
there
are
oth
er
factor
s
that
in
flue
nce
the contri
bu
ti
on
of I
T
in
vestm
ent in ac
hiev
ing
t
he non
-
fin
ancial
p
e
rfor
m
ance.
Evaluation Warning : The document was created with Spire.PDF for Python.
In
t J
Elec
&
C
om
p
En
g
IS
S
N: 20
88
-
8708
Th
e i
mpact
of IT invest
men
t
on fi
r
m
p
erf
orm
an
ce
base
d o
n MC
DM
te
c
hn
i
qu
e
s
(
Ansar
Dagh
ou
ri
)
4351
Figure
6. Fina
nc
ia
l
sect
or
res
ul
ts
Con
ce
rn
i
ng
t
he
con
st
ru
ct
io
n
industry
sect
or,
as
show
n
i
n
Fig
ur
e
7
,
only
6%
of
the
firm
s
in
the
const
ru
ct
io
n
in
du
st
ry
inv
est
be
tween
21
an
d
40%
of
their
tu
rno
ver
in
inf
or
m
at
ion
syst
e
m
and
al
m
os
t
al
l
firm
s
con
t
rib
ute
between
1
an
d
21
%
of
their
tu
r
nove
r
in
the
in
ve
st
m
ent,
a
resul
t
that
pr
ov
e
s
m
or
e
than
this
sec
tor
us
es
al
m
os
t
n
o
com
pu
te
r
an
d
eve
n
m
or
e
do
e
s
no
t
belie
ve
that
with
the
us
e
of
inf
orm
ation
syst
em
i
t
can
i
m
pr
ove the
p
e
rfor
m
ance of it
s co
m
pan
ie
s.
Figure
7. Co
nst
ru
ct
io
n
in
dustr
y sec
tor res
ults
Fo
r
the
res
ults
of
the
st
ud
y
of
the
im
pact
of
I
S
in
ves
tm
ent
on
perform
ance,
we
fin
d
t
he
sa
m
e
rem
ark
as
the
first
sec
tor;
I
S
in
vestm
ent
is
no
t
al
wa
ys
a
factor
in
the
firm
'
s
no
n
-
fina
ncial
perform
ance,
C1
ra
nk
e
d
first
pe
rfor
m
an
ce
on
ly
in
vests
1
-
20
%
of
it
s
tur
nover
ye
t
C
5
is
am
on
g
the
m
ino
rity
of
c
om
pan
ie
s
that
inv
e
st
betwee
n 21
-
40% but it
is not
ranke
d
am
on
g
the f
ir
st.
The
la
st
sect
or
is
the
on
e
t
hat
ens
ur
es
t
he
balance
bet
ween
t
he
two
pr
e
vious
one
s,
it
inv
est
s
m
od
eratel
y
in
inf
or
m
at
ion
syst
e
m
s
and
this
is
cl
ea
r
from
t
he
res
ults
sho
wn
i
n
Fig
ure
8
,
eve
n
if
we
no
t
ic
e
an
increase
of
nu
m
ber
in
the f
irst t
ran
che
wh
ic
h
co
ncerns
1
-
20% I
T in
vestm
ent; t
his can
b
e
ex
plaine
d
by the f
act
that
in
this
sa
m
e
sect
or
,
the
r
e
are
com
pan
ie
s
that
belie
ve
m
or
e
than
the
value
c
reated
by
the
IT
but
he
sit
at
e
d
in term
s o
f
i
nvestm
ent.
Figure
8. Ser
vi
ce
com
pan
ie
s s
ect
or
res
ults
Evaluation Warning : The document was created with Spire.PDF for Python.
IS
S
N
:
2088
-
8708
In
t J
Elec
&
C
om
p
En
g,
V
ol.
9
, N
o.
5
,
Oct
ober
20
19
:
4344
-
4354
4352
The
c
ontrib
ution
of
IT
in
ve
st
m
ent
in
the
achievem
ent
of
non
-
fina
ncia
l
perf
or
m
ance
of
se
rv
ic
e
com
pan
ie
s
is
on
e
of
t
he
obje
ct
ives
of
t
his
stu
dy,
in
the
Figure
7
,
we
a
lway
s
com
e
ba
ck
to
the
rem
ark
we
m
ade
since
th
e
beg
i
nn
i
ng
of
the
analy
sis
of
t
his
co
rr
el
at
io
n
and
it
is
that
th
e
inv
est
m
ent
in
IS
does
not
al
ways
ens
ur
e
the
pe
rfor
m
ance
of
t
he
com
pan
ie
s,
we
no
ti
ce
t
he
com
pan
y
S
6
w
hich
in
vests
be
tween
61
-
80%
of
it
s
tur
nover
but
sti
ll
no
t
ranke
d
the
first;
it
co
nfi
rm
s
m
or
e
that
a
su
ccess
fu
l
c
om
pan
y
is
no
t
necessa
rily
the
one
that i
nv
e
sts t
he
m
os
t i
n
inf
orm
at
ion
syst
em
s.
6.
CONCL
US
I
O
N AND PE
RSPE
CTIVES
This
stu
dy
us
e
s
data
from
150
com
pan
ie
s
operati
ng
in
th
r
ee
sect
or
s
to
de
te
rm
ine
the
con
t
rib
ution
of
IT
inv
est
m
ent
in
the
ac
hiev
e
m
ent
of
non
-
fina
ncial
firm
’
s
per
f
orm
ance.
This
pap
e
r
proposes
a
fr
am
ewor
k
base
d
on
MC
D
M
m
e
tho
ds t
o
analy
ze firm
’s
perform
ance; c
rite
ria and
sub
-
crit
eria wer
e cho
s
en
f
ro
m
p
re
vious
researc
hes.
Ba
sed
on
the
res
ul
ts
ob
ta
ine
d,
w
e
can
c
oncl
ude
that
the
weig
ht
’s
crit
eria
a
nd
sub
-
c
rite
ria
ch
ang
e
from
on
e
sect
or
to
an
ot
her
.
Fo
r
e
xam
ple,
weig
ht’s
crit
er
ia
of
en
vironme
nt
and
sec
ur
it
y
increases
w
he
n
we
hav
e
passe
d
from
finan
ci
al
s
ect
or
or
ser
vice
com
pan
ie
s
to
con
str
uctio
n
industry,
s
o
it
i
s
unfair
to
est
ablish
a
g
ene
ric m
od
el
to ev
al
uate the
non
-
fina
ncial
fi
rm
’s
per
f
or
m
ance
belo
ng
i
ng
in d
i
ff
e
ren
t se
c
tors.
This
pap
e
r
al
so
i
nv
est
ig
at
es
the
c
orrelat
ion
bet
ween
I
T
in
vestm
ent
an
d
non
-
fi
na
ncial
firm
’s
perform
ance.
This
relat
ion
i
s
qu
al
ifie
d
as
a
ver
y
com
plica
te
d
issue,
it
can
be
in
flue
nc
ed
by
m
any
factor
s:
sect
or’s
ty
pe,
f
irm
’s
siz
e,
e
m
plo
ye
e’s
s
kill
s
and
firm
’s
org
anizat
ion
al
c
ultur
e.
C
om
ing
ba
ck
to
the
first
sect
or
chosen
,
it
is
th
e
m
os
t
con
su
m
er
com
pu
te
r
se
ct
or
,
that
is
cl
ear
from
IT
inv
estm
ent
per
cen
ta
ge;
m
or
e
than
8
0%
of
fina
ncial
fir
m
s
inv
est
bet
ween
21
a
nd
60%
of
their
t
urn
ov
e
r
in
i
nfor
m
at
ion
syst
em
s,
wh
ic
h
is
a
huge
inv
est
m
ent,
un
fortu
natel
y,
thi
s
not
e
ns
ure
a
good
perform
a
nce;
we
ha
ve
f
inancial
fi
rm
’s
w
ho
in
vest
he
avily
on
IS
but
t
he
re
are
ra
nked
at
la
st
am
on
g
th
e
ot
her
s
on
te
rm
of
non
-
fi
nan
ci
al
pe
rfor
m
ance,
s
o
the
I
S
inv
est
m
ent
don’
t
en
sure
a
go
od
p
er
f
or
m
ance,
the
sam
e
re
m
ark
is
valid
f
or
the o
the
rs
t
wo
sect
or
s
. W
hat
var
ie
s
is
the
IT
i
nv
est
m
ent
values;
f
or
the
c
onstr
uc
ti
on
i
ndus
try
s
ect
or
,
94%
of
f
irm
s
inv
est
jus
t
betwee
n
1
a
nd
20%
of
thei
r
tur
nove
r
on
I
T
inv
e
stm
ent
wh
ic
h
is
m
ediocr
e
giv
e
n
the
firm
’s
siz
e
and
t
heir
tur
nove
r
.
Ser
vice
com
pan
ie
s
in
vest
m
od
eratel
y
on
i
nfor
m
at
ion
syst
em
s.
To
su
m
m
a
rize,
the
res
ults
of
this
stu
dy
s
ho
w
that
inv
est
m
ent
in
info
rm
at
ion
te
chn
ologies
is
no
t
necessa
rily
relat
ed
to
su
pe
rio
r
non
-
fi
nan
ci
al
pe
rform
ance,
on the
oth
e
r ha
nd, IT in
vestm
ent d
e
pe
nd on t
he
siz
e a
nd the
ty
pe
of t
he
fi
r
m
s.
The
w
ork
do
ne
in
this
arti
cl
e
has
yi
el
ded
interest
ing
res
ults.
In
fact,
the
a
ppr
oach
dev
el
op
e
d
f
or
th
e
const
ru
ct
io
n o
f
a p
e
rfor
m
ance ev
al
uatio
n
m
od
el
h
as
sho
wn
the interest
of
a h
ie
ra
rch
ic
al
m
od
el
f
or m
od
el
ing
a
vague
co
nce
pt
su
c
h
as
perfor
m
ance
and
th
us
to
stud
y
the
con
t
rib
ution
of
IT
inv
e
stm
ents
.For
the
f
uture
work,
we
will
wor
k
on
a
la
r
ger
sa
m
ple
to
ver
i
fy
the
accuracy
of
our
res
ults
and
e
ve
n
on
oth
e
r
sect
ors
wh
il
e
identify
in
g
a
pro
pieta
ry v
al
ua
ti
on
m
od
el
fo
r e
ach
on
e
.
REFERE
NCE
S
[1]
B
.
Huijie,
"A
Stud
y
on
L
eve
r
age
and
Firm
Inve
stm
ent
:
Chine
se
E
vide
nc
e,
"
Progra
m
Ec
onom
ic
s
of
Innova
ti
on
and
Grow
th
Ro
y
al
In
stit
ute of Te
chno
log
y
(KTH),
201
0.
[2]
J
.
Sangjoon,
"Th
e
nexus
bet
we
en
IT
inve
stm
ent
a
nd
banki
ng
per
f
orm
anc
e
in
Kore
a,
"
Global
E
con
Re
v
ie
w
,
vo
l.
35
,
no.
1
,
pp
.
67
-
96
,
2006.
[3]
S
.
O
.
Kw
on,
"I
m
pac
t
of
IT
inv
estment
on
firm
per
form
anc
e
:
Focusing
on
four
m
oder
at
ors,"
Ma
ster'
s
the
sis,
Kor
ea
adva
nc
ed
Inst
it
u
te
of
Sci
enc
e
an
d
Technol
og
y
,
2
007.
[4]
J
.
K
.
Kim
,
J
.
Y
.
Xiang,
and
S
.
Le
e
,
"Th
e
impa
ct
of
I
T
in
evt
m
ent
on
f
irm
per
f
orm
anc
e
in
Ch
i
na:
An
empiri
cal
inve
stigation
of
t
he
Chine
se
el
e
c
troni
cs
industr
y
,
"
Technol
ogic
al
Forec
as
ti
ng
an
d
Soci
al
Chang
e
,
vol
.
76,
no.
5
,
pp.
678
-
687
,
20
09.
[5]
L
.
Klei
s
,
P
.
Chwelos,
R
.
V
.
Rami
rez
and
I
.
Cockb
urn,
"Inform
at
io
n
te
chnol
og
y
an
d
int
agi
b
le
outp
ut:
The
impa
ct
o
f
IT
inv
estment
o
n
innovation
pro
duct
ivit
y
,
"
Infor
mation
Syst
ems R
ese
arch
,
vol
.
2
3,
n
o
.
1
,
pp
.
42
-
59,
2012
.
[6]
E
.
Br
y
njol
fss
on
and
L
.
M
.
Hitt,
"
Para
dox
lost
?
Fi
rm
-
le
vel
evi
d
ence
on
the
ret
urns
t
o
informati
on
s
y
stems
spendig
,
"
Manage
ment
S
cienc
e
,
vo
l. 42, no
.
2
,
pp
.
541
-
558
,
1996.
[7]
J
.
Dedri
ck
,
V
.
Gurbaxa
ni
and
K
.
L
.
Krae
m
er
,
"Inf
orm
at
ion
techno
l
og
y
and
ec
onom
ic
per
form
an
ce
:
a
critical
r
evi
ew
oh
the e
m
pirica
l
evi
den
ce,"
ACM
Computing
Surv
ey
s
,
vo
l. 35, no.
1,
pp
.
1
-
28
,
200
3.
[8]
H
.
A
.
Bassioni,
A
.
F
.
P
ric
e
an
d
T
.
M
.
Hass
an
,
"P
erf
orm
anc
e
Mea
surem
ent
in
Construct
ion
F
irms
,
"
Journal
of
Manage
ment in Engi
ne
ering
,
vol
.
20
,
no
.
2
,
pp
.
4
2
-
50,
2004
.
[9]
M
.
Kenne
rl
y
an
d
A
.
Nee
l
y
,
"A
fra
m
ework
of
t
he
fa
ct
ors
aff
ec
t
ing
the
evol
u
ti
o
n
of
per
form
ance
m
ea
surem
ent
s
y
stems
,
"
Int
ernati
onal Journal of
Operations
&
Product
ion
Man
ageme
nt
,
vol
.
22
,
no
.
11
,
pp
.
122
2
-
1245,
2002
.
[10]
J
.
Bogićević,
V
.
Dom
anovi
ć
and
B
.
Krs
tić,
"
The
Role
Of
Finan
c
ia
l
And
Non
-
Financ
i
al
Per
form
anc
e
Ind
icator
s
I
n
Ent
erp
r
ise
Sus
ta
i
nabi
lit
y
Eva
lu
at
i
on
,
"
Е
КОНО
МИКА
,
vo
l. 62, no
.
3
,
pp
.
1
-
13
,
20
16.
[11]
M
.
A
.
Mali
na
and
F
.
H
.
Selto,
"Choice
and
cha
nge
of
m
e
asure
s
in
p
erf
o
rm
anc
e
m
ea
surem
ent
m
odel
s,"
Mana
gement
A
c
count
ing
Resear
ch,
vo
l. 15, pp. 4
41
-
469,
2004
.
Evaluation Warning : The document was created with Spire.PDF for Python.
In
t J
Elec
&
C
om
p
En
g
IS
S
N: 20
88
-
8708
Th
e i
mpact
of IT invest
men
t
on fi
r
m
p
erf
orm
an
ce
base
d o
n MC
DM
te
c
hn
i
qu
e
s
(
Ansar
Dagh
ou
ri
)
4353
[12]
S
.
Data
r,
S
.
C
.
Kulp
and
R
.
A
.
La
m
ber
t,
"Ba
lancing
Perform
a
nce
Mea
sures,"
Journal
of
Acco
unti
ng
Re
search
,
vol.
39
,
no
.
1
,
pp
.
75
-
92
,
2001
.
[13]
S
.
Ibra
him
and
C
.
Ll
o
y
d
,
"The
a
ss
oci
at
ion
be
twe
en
non
-
fina
n
ci
a
l
per
form
anc
e
m
e
asure
s
in
exe
cu
tive
compensat
ion
cont
ra
ct
s
and
e
ar
nings mana
geme
nt,
"
Journal
of
A
cc
ount
ing
and
P
ubli
c
Policy
,
vo
l
.
30
,
pp
.
256
-
27
4,
2011
.
[14]
C
.
D
.
I
tt
ner
,
D
.
F
.
La
r
cke
r
and
M
.
W
.
Me
y
er
,
"
Subjec
ti
v
ity
and
t
he
W
e
ight
ing
o
f
Perform
anc
e
Mea
sures:
Ev
idence
from
a
Ba
la
nc
ed
Score
c
ard
,
"
The
Account
ing
R
evie
w
,
vol
.
78
,
no
.
3,
pp
.
725
-
758
,
2003.
[15]
R
.
S
.
Kapla
n
an
d
D
.
P
.
Norton,
"The
Bal
an
ce
d
Score
ca
rd
–
Mea
sures
tha
t
Drive
Perform
anc
e,
"
Har
vard
Busine
ss
Rev
iew
,
pp.
70
-
7
9,
1992
.
[16]
H
.
Rei
jone
n
and
R
.
Kom
ppula
,
"P
erc
ept
ion
of
succ
ess
and
it
s
eff
ec
t
on
sm
al
l
firm
per
form
anc
e,
"
Journal
of
Small
Busine
ss
and
En
te
rpr
ise
Dev
el
op
ment
,
vo
l. 14, no
.
4
,
pp
.
689
-
701
,
2007.
[17]
S
.
Mila
n
and
R
.
Aluç,
"P
erf
o
rm
anc
e
succ
ess
fac
tors
of
non
-
fina
nc
ia
l
per
for
m
anc
e
m
ea
sure
m
ent
,
a
li
t
era
tu
re
rev
ie
w,"
Bac
h
elor T
hesis
A
cc
ou
nti
ng,
auditing
a
nd
cont
ro
l, Jul
y
2017.
[18]
R
.
Kapla
n
and
D
.
Norton,
"U
sing
the
ba
la
nc
ed
score
ca
rd
as
a
st
rat
eg
ic
m
ana
g
ement
s
y
st
em,"
Har
v
ard
Busine
ss
Re
v
ie
w
,
pp.
75
-
8
5,
1996
.
[19]
A
.
Abdel
-
M
aks
oud
,
D
.
Dugda
l
e
and
R
.
Lu
ther,
"N
on
-
fina
n
cial
per
fo
rm
anc
e
m
ea
surem
ent
i
n
m
anuf
ac
tur
in
g
companie
s,"
The
Brit
ish
Account
i
ng
Revie
w
,
vo
l.
37,
pp
.
261
-
297
,
2005.
[20]
P
.
Phili
ps,
P
.
Lo
uvie
ris,
"P
erf
or
m
anc
e
Mea
sure
m
ent
Sy
st
ems
in
Touri
sm
,
Hos
pi
ta
lit
y
,
and
Le
isu
re
Sm
al
l
Medium
-
Size
d
Ent
erp
r
ise
s: A
Balanc
ed
S
cor
ecard
Perspe
c
ti
ve
,
"
Journal
of
Tr
ave
l
R
ese
arch
,
vol
.
44
,
pp
.
201
-
211,
2005
.
[21]
T
.
Zhel
y
uk
and
C
.
L
.
Popa,
"N
on
-
fina
nc
ia
l
m
ea
s
ure
m
ent
s
in
banki
ng
industri
es
of
Sw
ede
n,
Rom
ani
a
and
Ukrai
ne
,
"
Master
Th
esis
,
T
he
Dep
a
rtment
o
f
Business Adm
ini
strat
ion
Lund
Univer
sit
y
,
2009
.
[22]
P
.
V
.
Gijsel
,
"T
he
importanc
e
o
f
non
-
fina
ncial
p
erf
orm
anc
e
m
eas
ure
s
during
the
ec
onom
ic
cri
sis
,
"
Master
The
sis
,
Ti
lburg
Univer
si
t
y
:
School
of
Econom
ic
s a
nd
Ma
nage
m
ent
,
2012.
[23]
C
.
Strandb
erg
,
"N
on
-
fina
nci
a
l
m
et
ric
s
in
the
f
ina
nc
ia
l
sec
tor
,
"
in
Nat
ional
Cr
edi
t
Union
Social
Re
spons
ibilit
y
Forum
,
2014.
[24]
R
.
Solow,
"W
e’d
better
watc
h
o
ut,
"
New
Y
ork
Ti
mes B
ook
Revi
e
w
,
Jul
1987
.
[25]
J
.
Barney
,
"F
irm
Resourc
es
and
Sus
ta
ine
d
Co
m
pet
it
ive
Adva
nta
ge
,
"
Journal
of
Manage
m
en
t
,
vol
.
17,
no
.
1,
pp.
99
-
120
,
199
1.
[26]
E
.
Br
y
njol
fss
on
and
L
.
M
.
Hit
t,
"Be
y
ond
Com
puta
ti
on
:
Inform
at
ion
Technol
og
y,
Organi
z
at
ion
al
Tra
nsform
at
io
n
and
Business Pe
rform
anc
e,
"
Jou
rnal
of Ec
onomi
c
P
erspec
tives
,
v
ol.
14
,
no
.
4
,
pp
.
23
-
48,
2000
.
[27]
J
.
Dedri
ck
,
V
.
Gurbaxa
ni
and
L
.
K
.
Krae
m
er
,
"
I
nform
at
ion
T
ec
hnolog
y
and
Ec
onom
ic
Perfo
rm
anc
e:
a
Cr
it
i
c
al
Revi
ew
of
th
e E
m
piri
ca
l
Evi
d
en
ce
,
"
ACM
Computing. Survey
,
vo
l.
35
,
no
.
1
,
pp
.
1
-
28,
2003
.
[28]
S
.
Aral
and
P
.
W
ei
ll
,
"IT
As
set
s,
Organi
z
at
ion
a
l
Capa
b
il
i
ti
es
,
a
nd
Firm
Perf
orm
anc
e:
How
Re
source
Allo
ca
t
io
ns
and
Organi
zatio
nal
Diffe
ren
ce
s
Expl
ai
n
Perform
anc
e
Vari
at
ion
,
"
Journal
of
Or
g
anizati
onal
Scie
nce
,
vol
.
18,
no.
5,
pp.
763
-
780
,
20
07.
[29]
P
.
Guerri
eri
and
P
.
C
.
Padoan,
"M
odel
li
ng
ICT
as
a
Gene
ral
Purpos
e
Te
chnolog
y
,
"
Coll
egi
u
m
,
Speci
a
l
Edi
t
io
n,
Europe
an
Com
mi
ss
ion
and
Co
ll
e
ge
of Europe
,
no
.
35
,
2007
.
[30]
K
.
J
.
Stiroh
,
"C
om
pute
rs,
Producti
vi
t
y
,
and
Inp
ut
Subs
ti
tution,"
Ec
onomi
c
Inqu
iry
,
vo
l.
36
,
no.
2,
pp
.
175
-
191
,
1998.
[31]
A
.
M
.
Jam
al
i
,
H
.
Voghouei,
N
.
G
.
Nor,
"T
he
Role
of
Inf
orm
at
io
n
Techn
olog
y
on
th
e
Grow
th
of
Firm
s:
A
Value
Added
Considera
ti
on
,
"
Journal
of
Theoretical
and
A
ppli
ed
Informati
on
Technol
ogy
,
vol.
57,
no.
3
,
pp.
313
-
325
,
20
13.
[32]
T
.
L
ia
ng
,
J
.
You
and
C
.
Li
u,
"
R
esourc
e
-
base
d
per
s
pec
t
ive
on
infor
m
at
ion
technolo
g
y
and
firm p
erf
orm
anc
e:
A m
eta
ana
l
y
sis,"
Indust
rial
Manage
men
t
&
Data
Syste
m
s
,
vol. 110, no. 8
,
pp
.
1138
-
1158
,
2010.
[33]
R
.
Indj
iki
an
an
d
D
.
S
.
Sieg
el
,
"The
impact
o
f
inve
stm
ent
in
IT
on
e
conomic
p
erf
orm
anc
e
:
Im
pli
cations
f
or
deve
lop
ing
coun
tri
es,
"
World
De
v
,
vo
l. 33, no
.
5,
pp.
681
-
700
,
20
05.
[34]
M
.
Campbell
,
"
W
hat
a
diff
ere
n
ce
a
y
e
ar
m
ake
s
:
Ti
m
e
l
ag
eff
ect
of
informati
on
te
chno
log
y
inv
estment
on
firm
per
form
anc
e
,
"
C
omput
Elec
t
Co
mm
un
,
vol. 22, n
o.
3
,
pp
.
237
-
25
5,
2012
.
[35]
E
.
Berghout
and
C
.
-
W
.
Ta
n,
"U
nder
standi
ng
th
e
i
m
pac
t
of
business
ca
ses
on
IT
in
vestment
dec
isio
ns:
An
ana
l
y
si
s
of
m
unic
ipal
e
-
g
over
nm
ent
proj
e
ct
s,"
In
f
Manag
,
vol.
50
,
pp
.
489
-
506,
2013
.
[36]
A
.
Saunder
s
and
E
.
Br
y
njol
fss
on,
"V
al
uing
infor
m
at
ion
te
chno
lo
g
y
re
la
t
ed
intang
ibl
e
assets
,
"
MIS
Q
,
vol.
40,
no.
1
,
pp.
83
-
1
10
,
201
6.
[37]
M
.
C
.
Anderso
n,
R
.
D
.
B
anker
and
S
.
Ravi
n
dra
n,
"Th
e
new
produc
ti
v
ity
pa
rad
ox,
"
Comm
un
ACM
,
vol
.
4
6,
pp.
91
-
94
,
2003
.
[38]
S
-
M
.
Huang,
C
-
S
.
Ou,
C
-
M
.
Ch
en
and
B
.
Li
n
,
"
An
empiric
al
stu
d
y
of
r
elati
onshi
p
bet
wee
n
IT
in
vestment
and
f
irm
per
form
anc
e
:
A
res
ourc
e
-
bas
ed
p
erspe
ctive
,
"
Eur
J
Oper
Re
s
,
vol.
173,
pp
.
984
-
99
9,
2006
.
[39]
S
.
Otim,
K
.
E
.
Dow
,
V
.
Grover
,
J
.
A
.
W
ong,
"The
impa
ct
of
i
nform
at
ion
tech
nolog
y
inve
stm
e
nts
on
downs
ide
risk
of
the
fir
m
:
Alte
rna
ti
v
e
m
ea
surem
ent
of
the
business
val
ue
of
IT
,
"
J
Manag
Inf
Sys
,
vol.
29,
no.
1
,
pp.
195
-
193
,
20
12.
[40]
J
.
Ho,
A
.
Wu
and
S
.
X
.
Xu,
"Corporat
e
gov
ern
anc
e
and
ret
urns
on
informati
on
te
chno
log
y
inves
tment:
Evi
den
c
e
from
an
emergi
n
g
m
ark
et,"
Strat
Manag
J
,
vol
.
32
,
no
.
6
,
pp
.
595
-
623,
2011
.
[41]
L
.
Motiwa
ll
a
,
M
.
R
.
Khan
a
nd
S
.
Xu,
"A
n
int
ra
-
a
nd
int
er
-
industr
y
ana
l
y
sis of
e
-
bu
siness e
ffe
ctiven
ess,"
Inf
Manag
,
vol.
2
,
pp
.
651
-
6
67,
2005
.
[42]
E
.
K
.
Za
vadska
s,
Z
.
Turskis
and
S
.
Kildi
ene
,
"
Stat
e
of
art
surve
y
s
of
over
vie
w
s
on
MCD
M/M
AD
M
m
et
hods,"
Technol
.
E
con.
Dev
.
Ec
on
,
pp
.
1
65
–
17
9,
2014
.
[43]
M
.
Vela
squez
a
nd
P
.
T
.
Heste
r
,
"A
n
Anal
y
sis
of
Multi
-
Criteria
Dec
ision
Makin
g
Methods,
"
Inte
rnational
Journ
al
of
Operations
R
ese
arch
,
vol. 10, no. 2, pp. 56
-
66
,
Ma
y
2013.
Evaluation Warning : The document was created with Spire.PDF for Python.