Inter
national
J
our
nal
of
Electrical
and
Computer
Engineering
(IJECE)
V
ol.
15,
No.
1,
February
2025,
pp.
356
∼
364
ISSN:
2088-8708,
DOI:
10.11591/ijece.v15i1.pp356-364
❒
356
ReRNet:
r
ecursi
v
e
neural
netw
ork
f
or
enhanced
image
corr
ection
in
print-cam
watermarking
Said
Boujerfaoui
1
,
Hassan
Douzi
1
,
Rachid
Harba
2
,
Khadija
Gourrame
1,2
1
IRF-SIC
Laboratory
,
F
aculty
of
Sciences,
Ibn
Zohr
Uni
v
ersity
,
Ag
adir
,
Morocco
2
PRISME
Laboratory
,
Polytech
Orl
´
eans,
Orl
´
eans
Uni
v
ersity
,
Orl
´
eans,
France
Article
Inf
o
Article
history:
Recei
v
ed
Jun
16,
2024
Re
vised
Sep
3,
2024
Accepted
Oct
1,
2024
K
eyw
ords:
Corner
detection
F
ourier
transform
Geometric
distortions
Image
w
atermarking
Neural
netw
orks
Print-cam
process
ABSTRA
CT
Rob
ust
image
w
atermarking
that
can
resist
camera
shooting
has
g
ained
consid-
erable
attention
in
recent
years
due
to
the
need
to
protect
sensiti
v
e
pri
nted
infor
-
mation
from
being
captured
and
reproduced
without
authorization.
Indeed,
the
e
v
olution
of
smartphones
has
made
identity
w
atermarking
a
feasible
and
con
v
e-
nient
process.
Ho
we
v
er
,
this
process
also
intr
oduces
challenges
lik
e
perspecti
v
e
distortions,
which
can
signicantly
impair
the
ef
fecti
v
eness
of
w
atermark
detec-
tion
on
freehandedly
digitized
images.
T
o
meet
this
challenge,
ResNet50-based
ensemble
of
randomized
neural
netw
orks
(ReRNet),
a
recursi
v
e
con
v
olutional
neural
netw
ork-based
correction
method,
is
presented
for
the
print-cam
process,
specically
applied
to
identity
images.
Therefore,
this
paper
proposes
an
im-
pro
v
ed
F
ourier
w
atermarking
method
based
on
ReRNet
to
rectify
perspecti
v
e
distortions.
Experimental
results
v
alidate
the
rob
ustness
of
the
enhanced
scheme
and
demonstrate
its
superiority
o
v
er
e
xisting
methods,
especially
in
handling
perspecti
v
e
distortions
encountered
in
the
print-cam
process.
This
is
an
open
access
article
under
the
CC
BY
-SA
license
.
Corresponding
A
uthor:
Said
Boujerf
aoui
IRF-SIC
Laboratory
,
F
aculty
of
Sciences,
Ibn
Zohr
Uni
v
ersity
BP
8106,
Dakhla
District,
Ag
adir
80000,
Morocco
Email:
said.boujerf
aoui@edu.uiz.ac.ma
1.
INTR
ODUCTION
T
oday
,
data
plays
a
fundamental
pillar
for
industries
and
b
usi
nesses,
fortied
by
the
ongoing
sur
ge
in
technological
progress
[1].
These
adv
ances
ha
v
e
impro
v
ed
the
ef
cienc
y
of
data
transfer
,
b
ut
ha
v
e
also
introduced
challenges
such
as
unauthorized
data
manipulation,
af
fecting
cop
yright
protection
and
data
inte
grity
.
As
a
result,
industries
are
no
w
f
aced
with
the
imperati
v
e
task
of
seeking
real-time
solutions
for
secure
data
processing.
Since
the
1990s,
digital
w
atermar
k
i
ng
has
emer
ged
as
an
important
research
direction,
particularly
with
the
rise
of
smartphones,
making
w
atermarking
algorithms
viable
for
mobile
systems
to
meet
industrial
security
challenges
[2].
Print-cam
image
w
atermarking
[3]
in
v
olv
es
embedding
a
w
atermark
i
nto
an
image
intended
to
be
printed
on
a
paper
medium
and
then
freehandedly
captured
using
a
smartphone
camera.
This
uncontrolled
operation
introduces
major
challenges
link
ed
to
perspecti
v
e
distortions
and
desynchronization
problems
[4],
as
freehand
captures
at
v
arying
angles
can
distort
the
w
atermark
and
introduce
artif
acts.
These
alterations
complicate
w
atermark
detection,
making
it
dif
cult
or
inaccurate
[5].
The
print-cam
w
atermarking
process
is
illustrated
in
Figure
1.
J
ournal
homepage:
http://ijece
.iaescor
e
.com
Evaluation Warning : The document was created with Spire.PDF for Python.
Int
J
Elec
&
Comp
Eng
ISSN:
2088-8708
❒
357
W
a
t
er
mar
k embedding
I
mage r
eady f
or
det
ec
tion
P
r
in
t the image
C
aptur
e
the
p
r
i
n
t
ed
image
Figure
1.
Print-cam
w
atermarking
process
Image
w
atermarking
approaches
ha
v
e
adv
anced
using
spatial
and
fre
q
ue
n
c
y
domains
[6],
[7]
such
as
discrete
cosine
transform
(DCT)
[8],
discrete
w
a
v
elet
transform
(D
WT)
[9],
and
discrete
F
ourier
trans-
form
(DFT)
[10],
each
with
distinct
adv
antages
and
li
mitations.
T
o
deal
with
geometric
distortions,
v
arious
strate
gies
ha
v
e
been
de
vised,
including
frame
synchronization
mechanisms
[11],
con
v
e
x
optimization
frame-
w
ork
[12]
and
pseudo-random
sequences
[13].
Deep
learning-based
approaches,
using
con
v
olutional
neural
netw
orks,
automate
w
ater
marking
by
learning
correlations
between
w
atermark
ed
and
original
images
and
e
x-
ploiting
imperceptible
perturbations
for
data
hiding
[14].
Ho
we
v
er
,
research
specic
to
print-cam
scenarios
remains
limited,
focusing
mainly
on
learning-based
techniques
such
as
ne-tuned
se
gmentation
[15],
[16],
distortion
mapping
frame
w
ork
[17],
[18],
in
v
ariance
layers
[19],
and
3D
rendering
distortion
netw
orks
[20].
Image
w
atermarking
f
aces
signicant
challenges
in
print-cam
scenari
os
due
to
perspecti
v
e
distorti
o
ns
caused
by
the
joint
ef
fect
of
rotation,
translation,
scaling
(RST),
and
tilt
angle.
Despite
their
critical
impact
on
w
atermark
rob
ustness,
only
a
fe
w
approaches
ha
v
e
been
conducted
for
this
process.
Accordingly
,
le
v
er
-
aging
deep
learning
methodologies
and
geometric
transf
ormation
modeling
could
impro
v
e
the
rob
ustness
of
w
atermarking
schemes
in
o
v
ercoming
these
distortions.
This
paper
introduces
randomized
neural
netw
orks
(ReRNet),
a
deep-l
earning-based
method
to
ad-
dress
perspecti
v
e
distortions
found
in
ID
images
during
the
print-cam
process.
ReRNet
locates
the
ID
image
corners
us
ing
a
recursi
v
e
con
v
olutional
neural
netw
ork,
enabling
projecti
v
e
transformation
for
image
recti-
cation
and
accurate
w
atermark
alignment.
As
a
result,
an
impro
v
ed
rob
ust
image
w
atermarking
technique
is
proposed
to
address
print-cam
attacks.
This
approach
combines
a
F
ourier
transform-based
embedding
method
[21]
with
ReRNet,
emplo
yed
for
rectifying
image
distortions.
The
F
ourier
-based
approach
is
selected
for
its
pro
v
en
ability
to
withstand
the
geometric
attacks
common
in
the
print-cam
process
[22].
W
e
conducted
prac-
tical
e
xperiments
on
a
selection
of
framed
ID
images,
which
were
subjected
to
real
print-cam
attacks
using
a
printer
and
tw
o
smartphones.
The
performance
of
the
impro
v
ed
w
atermarking
met
hod
w
as
then
e
v
aluated
and
compared
with
e
xisting
competiti
v
e
methods.
The
rest
of
the
paper
is
or
g
ani
zed
as
follo
ws:
section
2
presents
the
complete
w
atermarking
method,
including
ReRNet
architecture.
Section
3
co
v
ers
the
e
xperimental
results.
Finally
,
section
4
concl
ud
e
s
the
paper
.
2.
PRINT
-CAM
W
A
TERMARKING
SCHEME
First,
the
w
atermark
is
embedded
into
the
original
image.
Once
the
w
atermark
ed
image
is
printed
and
captured
by
a
camera,
perspecti
v
e
distortions
are
corrected
using
the
proposed
correction
technique.
Finally
,
in
the
detection
phase,
we
determine
whether
or
not
the
w
atermark
is
present
in
the
corrected
image.
The
components
of
the
impro
v
ed
w
atermarking
scheme
are
described
belo
w
.
2.1.
F
ourier
-based
embedding
The
w
ate
rmark
is
embedded
into
the
image
DFT
magnitude,
specically
along
a
circular
area
with
a
dened
radius
r
.
The
embedding
process
af
fects
the
luminance
components
of
the
original
image,
k
eeping
the
chrominance
components
unmodied.
T
o
impro
v
e
the
detection
rate,
a
l
o
w-pass
lter
is
emplo
yed
on
the
embeddable
DFT
coef
cients
[21].
Hence,
the
w
atermark
W
is
inserted
into
the
ltered
coef
cients
as
(1):
M
W
=
M
f
+
α
×
W
(1)
Here,
M
W
is
the
w
atermark
ed
coef
cients,
M
f
represents
the
ltered
coef
cients,
and
α
is
the
insertion
strength.
α
is
adjusted
to
achie
v
e
the
desired
peak
s
ignal-to-noise
ratio
(PSNR)
of
40
dB.
In
v
erse
DFT
is
ReRNet:
r
ecur
sive
neur
al
network
for
enhanced
ima
g
e
corr
ection
in
print-cam
...
(Said
Boujerfaoui)
Evaluation Warning : The document was created with Spire.PDF for Python.
358
❒
ISSN:
2088-8708
applied
to
the
w
atermark
ed
image
to
obtain
its
luminance,
and
the
nal
color
image
is
then
reco
v
ered
using
the
unmodied
chrominance.
2.2.
F
ourier
-based
detection
During
the
detection
phase,
only
the
w
atermark
ed
image
and
the
initial
w
atermark
are
used,
without
the
need
for
the
original,
unw
atermark
ed
image.
Firstly
,
the
luminance
of
the
rectied
image
under
goes
DFT
processing.
Ne
xt,
coef
cients
are
e
xtracted
from
the
m
agnitude
along
the
predened
radius.
Finally
,
the
maxi-
mum
norm
alized
cross-correlation,
denoted
as
C
max
,
is
calculated
between
the
original
w
atermark
W
and
the
e
xtracted
DFT
coef
cients
F
as
(2):
C
max
=
max
0
≤
j
≤
1
P
N
−
1
i
=0
(
W
(
i
)
−
W
)(
F
(
i
+
j
)
−
F
)
q
P
N
−
1
i
=0
(
W
(
i
)
−
W
)
2
P
N
−
1
i
=0
(
F
(
i
+
j
)
−
F
)
2
!
(2)
Where
N
is
the
w
atermark
length,
W
and
F
are
respecti
v
ely
the
means
of
the
w
atermark
sequence
and
the
means
of
the
e
xtracted
coef
cients
.
If
C
max
e
xceeds
a
certain
threshold
t
,
the
w
atermark
is
considered
present.
2.3.
Print-cam
perspecti
v
e
corr
ection
T
o
impro
v
e
the
resilience
of
the
w
atermarking
system
ag
ainst
perspecti
v
e
attacks
during
the
print
cam
process,
a
correcti
v
e
technique
is
carried
out
as
a
complementary
measure.
In
this
section,
we
present
ReRNet,
a
neural
netw
ork-based
method
to
detect
the
corners
of
the
wireframe
around
the
ID
image.
Our
approach
addresses
the
challenge
as
a
k
e
y
point
detection
issue.
These
pi
v
otal
points
correspond
to
the
four
corners
of
the
image
frame:
the
top
left
corner
(TL),
top
right
corner
(TR),
bottom
right
corner
(BR),
and
bottom
left
corner
(BL).
An
o
v
ervie
w
of
the
proposed
correction
method
can
be
seen
in
Figure
2.