Project

General

Profile

Actions

Bug #7235

open

4860 has not got significant IPsec performance rising with enabled HW acceleration

Added by Constantine Kormashev almost 8 years ago. Updated about 3 years ago.

Status:
New
Priority:
Normal
Assignee:
Category:
IPsec
Target version:
-
Start date:
02/08/2017
Due date:
% Done:

0%

Estimated time:
Plus Target Version:
Release Notes:
Affected Version:
2.3.2
Affected Architecture:

Description

During IPsec performance tests on 4860 I did not observe significant IPsec performance increasing if HW acceleration is enabled.
Average rising are:
10% for AES128CBC
7% for AES128GCM

In comparison with 2440, 2440 gives:
56% for AES128CBC
54% for AES128GCM

4860 tests:
128 GCM 34000pps

kldstat
Id Refs Address            Size     Name
 1    3 0xffffffff80200000 225edc0  kernel
 2    1 0xffffffff82611000 3646     ichwd.ko

last pid: 62291;  load averages:  4.48,  3.20,  1.62    up 0+00:10:24  06:51:23
55 processes:  2 running, 52 sleeping, 1 waiting
CPU 0: 19.3% user,  0.0% nice, 33.1% system, 27.6% interrupt, 20.1% idle
CPU 1:  0.0% user,  0.0% nice,  0.0% system, 99.2% interrupt,  0.8% idle
CPU 2: 17.3% user,  0.0% nice, 52.0% system,  0.0% interrupt, 30.7% idle
CPU 3: 16.1% user,  0.0% nice, 53.1% system,  0.0% interrupt, 30.7% idle
Mem: 55M Active, 40M Inact, 183M Wired, 38M Buf, 7613M Free
Swap: 8192M Total, 8192M Free

  PID USERNAME  THR PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
   12 root       45 -72    -     0K   720K WAIT    3   6:24 130.13% intr
77387 root       17  20    0   249M 14632K uwait   2   6:54 106.30% charon
   11 root        4 155 ki31     0K    64K RUN     3  20:54  82.03% idle
18291 root        2  20    0 30144K 17988K usem    3   4:44  80.76% ntpd
    0 root       32  -8    -     0K   512K -       0   1:30   2.59% kernel

128 GCM 36500pps
kldstat 
Id Refs Address            Size     Name
 1    6 0xffffffff80200000 225edc0  kernel
 2    1 0xffffffff82611000 7577     aesni.ko
 3    1 0xffffffff82619000 3646     ichwd.ko

last pid: 98195;  load averages:  4.41,  3.26,  1.77    up 0+00:09:07  07:06:31
55 processes:  4 running, 51 sleeping
CPU 0: 12.2% user,  0.0% nice, 32.2% system, 33.7% interrupt, 22.0% idle
CPU 1: 19.6% user,  0.0% nice, 55.7% system,  0.0% interrupt, 24.7% idle
CPU 2: 17.3% user,  0.0% nice, 57.3% system,  0.0% interrupt, 25.5% idle
CPU 3:  0.0% user,  0.0% nice,  100% system,  0.0% interrupt,  0.0% idle
Mem: 52M Active, 37M Inact, 183M Wired, 30M Buf, 7619M Free
Swap: 8192M Total, 8192M Free

  PID USERNAME  THR PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
25406 root       17  92    0   249M 14692K CPU1    1   8:44 106.54% charon
    0 root       32  -8    -     0K   512K -       0   0:47 100.00% kernel
16732 root        2  20    0 30144K 17988K kqread  2   6:21  80.57% ntpd
   11 root        4 155 ki31     0K    64K RUN     3   9:51  77.98% idle
   12 root       45 -72    -     0K   720K RUN     3   9:17  28.37% intr

128 CBC 34000pps

kldstat
Id Refs Address            Size     Name
 1    3 0xffffffff80200000 225edc0  kernel
 2    1 0xffffffff82611000 3646     ichwd.ko
last pid: 66419;  load averages:  4.54,  2.28,  1.03    up 0+00:08:24  07:23:31
55 processes:  3 running, 51 sleeping, 1 waiting
CPU 0: 18.0% user,  0.0% nice, 33.7% system, 27.1% interrupt, 21.2% idle
CPU 1:  0.8% user,  0.0% nice,  0.0% system, 98.8% interrupt,  0.4% idle
CPU 2: 20.8% user,  0.0% nice, 51.0% system,  0.0% interrupt, 28.2% idle
CPU 3: 20.4% user,  0.0% nice, 43.5% system, 18.0% interrupt, 18.0% idle
Mem: 52M Active, 38M Inact, 182M Wired, 26M Buf, 7621M Free
Swap: 8192M Total, 8192M Free

  PID USERNAME  THR PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
25895 root       17  92    0   249M 14296K CPU0    0   3:56 101.76% charon
   12 root       45 -72    -     0K   720K WAIT    3   1:27  92.04% intr
   11 root        4 155 ki31     0K    64K RUN     3  21:23  78.86% idle
18871 root        2  20    0 30144K 17988K usem    1   2:42  75.49% ntpd
    0 root       32  -8    -     0K   512K -       0   3:07  39.26% kernel

128 CBC 36500pps

kldstat 
Id Refs Address            Size     Name
 1    6 0xffffffff80200000 225edc0  kernel
 2    1 0xffffffff82611000 7577     aesni.ko
 3    1 0xffffffff82619000 3646     ichwd.ko

last pid: 97408;  load averages:  5.05,  3.99,  2.54    up 0+00:14:56  07:12:20
55 processes:  3 running, 51 sleeping, 1 waiting
CPU 0: 14.9% user,  0.0% nice, 26.7% system, 36.1% interrupt, 22.4% idle
CPU 1: 18.4% user,  0.0% nice, 53.3% system,  0.0% interrupt, 28.2% idle
CPU 2: 14.9% user,  0.0% nice, 59.2% system,  0.0% interrupt, 25.9% idle
CPU 3:  0.0% user,  0.0% nice,  100% system,  0.0% interrupt,  0.0% idle
Mem: 53M Active, 38M Inact, 184M Wired, 36M Buf, 7616M Free
Swap: 8192M Total, 8192M Free

  PID USERNAME  THR PRI NICE   SIZE    RES STATE   C   TIME     CPU COMMAND
25406 root       17  92    0   249M 14908K CPU1    1  14:30 103.47% charon
    0 root       32  -8    -     0K   512K -       0   4:21 100.00% kernel
16732 root        2  20    0 30144K 17988K usem    1  10:30  85.35% ntpd
   11 root        4 155 ki31     0K    64K RUN     3  16:21  79.59% idle
   12 root       45 -72    -     0K   720K WAIT    3  12:38  27.78% intr

uname -a
FreeBSD pfSense.localdomain 10.3-RELEASE-p9 FreeBSD 10.3-RELEASE-p9 #1 5fc1b19(RELENG_2_3_2): Tue Sep 27 12:25:49 CDT 2016     root@factory23-amd64-builder:/builder/factory-232/tmp/obj/builder/factory-232/tmp/FreeBSD-src/sys/pfSense  amd64
Actions #1

Updated by Kris Phillips about 3 years ago

The 4860 is end of sale and end of support, so may be time to put this one to bed regardless. We should re-run performance metrics here as I suspect there has been improvement.

Actions #2

Updated by Sean McBride about 3 years ago

I have a 4860 running newest pfsense, and I use IPSec. How could I do performance measurements?

Actions #3

Updated by Kris Phillips about 3 years ago

Sean McBride wrote in #note-2:

I have a 4860 running newest pfsense, and I use IPSec. How could I do performance measurements?

Hello Sean,

You can run tests on throughput using the iPerf3 package. I have two SG-2440s I can run tests to compare the results that you take.

Actions

Also available in: Atom PDF