Libreswan on Debian Wheezy: Difference between revisions

From Libreswan
Jump to navigation Jump to search
(Created page with "I am sharing how to compile libreswan 3.21 on Debian Wheezy and the details. You need 3 workarounds on Wheezy to compile. The workaround for #1 is very specific to Wheezy (li...")
 
No edit summary
 
(40 intermediate revisions by 3 users not shown)
Line 1: Line 1:
I am sharing how to compile libreswan 3.21 on Debian Wheezy and the details.
= Executive Summary =


You need 3 workarounds on Wheezy to compile. The workaround for #1 is very
<pre>
specific to Wheezy (libc < 2.19 and kernel < 3.12). Later distributions
# enable workarounds and compile:
fixed issues #1 and #2. #3 has different workarounds depending on your
echo USE_GLIBC_KERN_FLIP_HEADERS=true >> Makefile.inc.local
libunbound2 version.
echo "USE_SYSTEMD_WATCHDOG=false" >> Makefile.inc.local
echo "USE_DNSSEC=false" >> Makefile.inc.local
echo "USE_NIC_OFFLOAD=false" >>  Makefile.inc.local
make deb
</pre>


1. Debian Wheezy has a conflict between netinet/in.h and linux/in6.h It got
= Details about the issues of libreswan on Debian Wheezy =
worse by commit 07a01d3 to xfrm.in in libreswan. The issue has a long
history.  It is partly due to UAPI ABI out of sync and partly due to
updating local copy of xfrm.h with commit 07a01d3 while supporting
nic-offload for mellonex cards. We could have worked around 07a01d3,
however, it was easy to keep xfrm.h in sync with kernel UAPI copy 4.12
which seemed to work in most cases(glibc 2.19+ kernel 3.12+); except Wheezy!


You need 3 workarounds to compile on Debian Wheezy. The workaround #1 is very specific to Wheezy (libc < 2.19 and kernel < 3.12). Later distributions fixed issues #1 and #2. #3 is because libunbound is too old.
== conflict between netinet/in.h and linux/in6.h ==
It got worse by commit 07a01d3 to xfrm.in in libreswan. The issue has a long  history.  It is partly due to UAPI ABI out of sync and partly due to updating local copy of xfrm.h with commit 07a01d3 while supporting nic-offload for Mellanox cards. We could have worked around 07a01d3, however, it was easy to keep xfrm.h in sync with kernel UAPI copy 4.12 which seemed to work in most cases(glibc 2.19+ kernel 3.12+); except Wheezy!
<pre>
                 -c /home/build/libreswan/programs/pluto/kernel_netlink.c
                 -c /home/build/libreswan/programs/pluto/kernel_netlink.c
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
Line 38: Line 42:
The local copy
The local copy
programs/pluto/linux-copy/linux/xfrm.h is updated linux kernel 4.12
programs/pluto/linux-copy/linux/xfrm.h is updated linux kernel 4.12
</pre>


Workaround : remove the following line from
=== Workaround : enable header files workaround ===
programs/pluto/linux-copy/linux/xfrm.h
<pre>
 
echo USE_GLIBC_KERN_FLIP_HEADERS=true >> Makefile.inc.local
#include <linux/in6.h>
</pre>
 
=== Details about the conflict ===
more details about this issue:
==== glibc 2.19+ ====
https://sourceware.org/bugzilla/show_bug.cgi?id=15850
https://sourceware.org/bugzilla/show_bug.cgi?id=15850 If you have glibc 2.19+ you may have flip the two lines in
If you have glibc 2.19+ you may have flip the two lines in
programs/pluto/kernel_netlink.c
programs/pluto/kernel_netlink.c
 
<pre>
52 #include "linux/xfrm.h" /* local (if configured) or system copy */
52 #include "linux/xfrm.h" /* local (if configured) or system copy */
51 #include "libreswan.h" /* before xfrm.h otherwise break on F22 */
51 #include "libreswan.h" /* before xfrm.h otherwise break on F22 */
</pre>


With kernel 3.12 and libc-dev 2.19+ has made more efforts fix this issue
===== Why not commit this =====
We default to ensure newer systems compile properly. If there is a conflict with older systems, we write workarounds for the older code. Ideally, we get to remove ancient workarounds after a long long time without the need to keep old version workarounds forever.
 
===== How does this work on RHEL/CentOS 7.3 or even 6.8 =====
Most likely they have backports to fix this. 7.3 has kernel 3.10 and glibc 2.17
 
==== With kernel 3.12 and libc-dev 2.19+ =====
Kernel made more efforts fix this issue
https://github.com/torvalds/linux/commit/cfd280c91253cc28e4919e349fa7a813b63e71e8
https://github.com/torvalds/linux/commit/cfd280c91253cc28e4919e349fa7a813b63e71e8


NOTE: Fedora 22 keep the order in kernel_netlink.c
== Can't link with libsystemd ==
 
This error is with debian.  
2. /usr/bin/ld: cannot find -lsystemd
<pre>
/usr/bin/ld: cannot find -lsystemd  
collect2: error: ld returned 1 exit status
collect2: error: ld returned 1 exit status
 
This error is with. This is not new in 3.21, an old one.
  Package: libsystemd-daemon-dev
  Package: libsystemd-daemon-dev
  Source: systemd
  Source: systemd
  Version: 44-11+deb7u5
  Version: 44-11+deb7u5
</pre>


Workaround: USE_SYSTEMD_WATCHDOG=false e.g. libreswan src directory
=== Workaround: USE_SYSTEMD_WATCHDOG=false ===
in libreswan src directory  
<pre>
echo "USE_SYSTEMD_WATCHDOG=false" >> Makefile.inc.local
echo "USE_SYSTEMD_WATCHDOG=false" >> Makefile.inc.local
 
</pre>
FYI: debian stretch seems to have proper libsystemd-dev
FYI: debian stretch seems to have proper libsystemd-dev


3. Wheezy libunbound2 (1.4.17) does not support libevent, (NOTE: this is not
== Wheezy libunbound2 (1.4.17) do not support libevent ==
re-compiling issue, you need > 1.5x)
(NOTE: this is not re-compiling issue, you need > 1.5x)
 
<pre>
/home/build/libreswan/lib/libswan/unbound.c:187: undefined reference to
/home/build/libreswan/lib/libswan/unbound.c:187: undefined reference to
`ub_ctx_create_event'
`ub_ctx_create_event'
Line 81: Line 97:
Source: unbound
Source: unbound
Version: 1.4.17-3+deb7u2
Version: 1.4.17-3+deb7u2
</pre>
==== Workaround : USE_DNSSEC=false ====
<pre>
echo "USE_DNSSEC=false" >> Makefile.inc.local
</pre>
If you have libunbound version less than 1.5.0 disable is the only way.
libunbound2 1.5.0  above should be compiled with --with-libevent --enable-event-api


Workaround : USE_DNSSEC=false e.g
NOTE: to compile libunbound2 + libevent on Wheezy your best bet is upstream. unbound-1.6.0 from jessie-backports has unmet dependencies on Wheeezy. Strech package is not dowards compaitable.
echo "USE_DNSSEC=false" >> Makefile.inc.local
 
= Fixed in.h/in6.h conflict in #master =
If you have have master with commit a7d8a0bbb9cff171b9d0ba5ee36293f92a1b1eba on Debian Wheezy disable NIC Offload and use system's xfrm.h. Then you can compile.
 
== nic-offload disable commit to v3.21 ==
<pre>
git clone https://github.com/libreswan/libreswan
cd libreswan
git checkout v3.21
git cherry-pick a7d8a0bbb9cff171b9d0ba5ee36293f92a1b1eba


If you have libunbound version less than 1.5.0 disable is the only way.
echo USE_XFRM_HEADER_COPY=false >>  Makefile.inc.local
libunbound2 1.5.0  above should be compiled with --with-libevent
echo USE_NIC_OFFLOAD=false >>  Makefile.inc.local
--enable-event-api
echo USE_DNSSEC=false >> Makefile.inc.local
echo USE_SYSTEMD_WATCHDOG=false >> Makefile.inc.local
</pre>


NOTE: to compile libunbound2 + libevent on Wheezy your best bet is upstream.
unbound-1.6.0 from jessie-backports has unmet dependencies on Wheeezy.
Strech packges is not dowards compaitable.


FYI: libunbound2 related bugs and feature requests to support libevent + in
https://github.com/libreswan/libreswan/commit/a7d8a0bbb9cff171b9d0ba5ee36293f92a1b1eba
other distributions.


Debian feature requests
= Kernel headers 4.16 later : uapi/if_ether.h error: redefinition of 'struct in6_addr' struct in6_addr  =
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=871675
Kernel 4.16 got a fix that could cause error:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=859584


RH bugs
<pre>
https://bugzilla.redhat.com/show_bug.cgi?id=1434662 RHEL 6.10
In file included from /<<PKGBUILDDIR>>/programs/pluto/linux-copy/linux/xfrm.h:4:0,
https://bugzilla.redhat.com/show_bug.cgi?id=1434661 RHEL 7.4
                from /<<PKGBUILDDIR>>/programs/pluto/kernel_netlink.c:55:
/usr/include/linux/in6.h:33:8: error: redefinition of 'struct in6_addr'  struct in6_addr {
          ^~~~~~~~
In file included from /<<PKGBUILDDIR>>/linux/include/libreswan.h:76:0,
                  from /<<PKGBUILDDIR>>/programs/pluto/kernel_netlink.c:54:
/usr/include/netinet/in.h:211:8: note: originally defined here  struct in6_addr
        ^~~~~~~~
<pre>


Libreswan bug report:
https://www.spinics.net/lists/stable/msg215023.html
https://github.com/libreswan/libreswan/issues/117

Latest revision as of 18:49, 18 June 2018

Executive Summary

# enable workarounds and compile:
echo USE_GLIBC_KERN_FLIP_HEADERS=true >> Makefile.inc.local
echo "USE_SYSTEMD_WATCHDOG=false" >> Makefile.inc.local
echo "USE_DNSSEC=false" >> Makefile.inc.local
echo "USE_NIC_OFFLOAD=false" >>  Makefile.inc.local
make deb

Details about the issues of libreswan on Debian Wheezy

You need 3 workarounds to compile on Debian Wheezy. The workaround #1 is very specific to Wheezy (libc < 2.19 and kernel < 3.12). Later distributions fixed issues #1 and #2. #3 is because libunbound is too old.

conflict between netinet/in.h and linux/in6.h

It got worse by commit 07a01d3 to xfrm.in in libreswan. The issue has a long history. It is partly due to UAPI ABI out of sync and partly due to updating local copy of xfrm.h with commit 07a01d3 while supporting nic-offload for Mellanox cards. We could have worked around 07a01d3, however, it was easy to keep xfrm.h in sync with kernel UAPI copy 4.12 which seemed to work in most cases(glibc 2.19+ kernel 3.12+); except Wheezy!

                -c /home/build/libreswan/programs/pluto/kernel_netlink.c
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
In file included from
/home/build/libreswan/programs/pluto/linux-copy/linux/xfrm.h:4:0,
                 from
/home/build/libreswan/programs/pluto/kernel_netlink.c:52:
/usr/include/linux/in6.h:30:8: error: redefinition of 'struct in6_addr'
In file included from /home/build/libreswan/linux/include/libreswan.h:212:0,
                 from
/home/build/libreswan/programs/pluto/kernel_netlink.c:51:
/usr/include/netinet/in.h:198:8: note: originally defined here

dpkg -S linux/in6.h
linux-libc-dev:amd64: /usr/include/linux/in.h

dpkg -S netinet/in.h
libc6-dev:amd64: /usr/include/netinet/in.h

Package: libc6-dev
Source: eglibc
Version: 2.13-38+deb7u10

The local copy
programs/pluto/linux-copy/linux/xfrm.h is updated linux kernel 4.12

Workaround : enable header files workaround

echo USE_GLIBC_KERN_FLIP_HEADERS=true >> Makefile.inc.local

Details about the conflict

glibc 2.19+

https://sourceware.org/bugzilla/show_bug.cgi?id=15850 If you have glibc 2.19+ you may have flip the two lines in programs/pluto/kernel_netlink.c

52 #include "linux/xfrm.h" /* local (if configured) or system copy */
51 #include "libreswan.h" /* before xfrm.h otherwise break on F22 */
Why not commit this

We default to ensure newer systems compile properly. If there is a conflict with older systems, we write workarounds for the older code. Ideally, we get to remove ancient workarounds after a long long time without the need to keep old version workarounds forever.

How does this work on RHEL/CentOS 7.3 or even 6.8

Most likely they have backports to fix this. 7.3 has kernel 3.10 and glibc 2.17


With kernel 3.12 and libc-dev 2.19+ =

Kernel made more efforts fix this issue https://github.com/torvalds/linux/commit/cfd280c91253cc28e4919e349fa7a813b63e71e8

Can't link with libsystemd

This error is with debian.

/usr/bin/ld: cannot find -lsystemd 
collect2: error: ld returned 1 exit status
 
 Package: libsystemd-daemon-dev
 Source: systemd
 Version: 44-11+deb7u5

Workaround: USE_SYSTEMD_WATCHDOG=false

in libreswan src directory

echo "USE_SYSTEMD_WATCHDOG=false" >> Makefile.inc.local

FYI: debian stretch seems to have proper libsystemd-dev

Wheezy libunbound2 (1.4.17) do not support libevent

(NOTE: this is not re-compiling issue, you need > 1.5x)

/home/build/libreswan/lib/libswan/unbound.c:187: undefined reference to
`ub_ctx_create_event'
collect2: error: ld returned 1 exit status

apt-cache show libunbound2
Package: libunbound2
Source: unbound
Version: 1.4.17-3+deb7u2

Workaround : USE_DNSSEC=false

echo "USE_DNSSEC=false" >> Makefile.inc.local

If you have libunbound version less than 1.5.0 disable is the only way. libunbound2 1.5.0 above should be compiled with --with-libevent --enable-event-api

NOTE: to compile libunbound2 + libevent on Wheezy your best bet is upstream. unbound-1.6.0 from jessie-backports has unmet dependencies on Wheeezy. Strech package is not dowards compaitable.

Fixed in.h/in6.h conflict in #master

If you have have master with commit a7d8a0bbb9cff171b9d0ba5ee36293f92a1b1eba on Debian Wheezy disable NIC Offload and use system's xfrm.h. Then you can compile.

nic-offload disable commit to v3.21

git clone https://github.com/libreswan/libreswan 
cd libreswan 
git checkout v3.21
git cherry-pick a7d8a0bbb9cff171b9d0ba5ee36293f92a1b1eba

echo USE_XFRM_HEADER_COPY=false >>  Makefile.inc.local
echo USE_NIC_OFFLOAD=false >>  Makefile.inc.local
echo USE_DNSSEC=false >> Makefile.inc.local
echo USE_SYSTEMD_WATCHDOG=false >> Makefile.inc.local


https://github.com/libreswan/libreswan/commit/a7d8a0bbb9cff171b9d0ba5ee36293f92a1b1eba

Kernel headers 4.16 later : uapi/if_ether.h error: redefinition of 'struct in6_addr' struct in6_addr

Kernel 4.16 got a fix that could cause error:

In file included from /<<PKGBUILDDIR>>/programs/pluto/linux-copy/linux/xfrm.h:4:0,
                 from /<<PKGBUILDDIR>>/programs/pluto/kernel_netlink.c:55:
/usr/include/linux/in6.h:33:8: error: redefinition of 'struct in6_addr'  struct in6_addr {
           ^~~~~~~~
In file included from /<<PKGBUILDDIR>>/linux/include/libreswan.h:76:0,
                  from /<<PKGBUILDDIR>>/programs/pluto/kernel_netlink.c:54:
/usr/include/netinet/in.h:211:8: note: originally defined here  struct in6_addr
         ^~~~~~~~

https://www.spinics.net/lists/stable/msg215023.html