Enterprise Storage Engine & Axonwall Vault • v0.13.0

ZFS NAS Storage & Axonwall Vault Edition

Axonwall integrates native OpenZFS on Linux with enterprise-grade NAS file, block, and immutable S3 object storage configured under nas: in /etc/axonwall/storage.yaml. Provision Stripe/Mirror/RAID-Z/dRAID pools with NVMe SLOG/L2ARC tiers, serve SMB3, NFSv4, and iSCSI targets, or run Axonwall Vault Edition with SeaweedFS S3 Object-Lock COMPLIANCE WORM immutability.

ZFS Storage Pools, Special NVMe VDEVs, Checkpoints & TRIM

OpenZFS pools combine raw block devices into unified self-healing storage pools protected by 256-bit Fletcher4 or SHA-256 checksums. Beyond SLOG, L2ARC, and Hot Spares, Axonwall supports Special Allocation VDEVs (specialDisks on mirrored NVMe to store all ZFS metadata, dedup tables, and small blocks below specialSmallBlocks), point-in-time Pool Checkpoints (zpool checkpoint / -d), and on-demand NVMe TRIM (zpool trim):

Mirror (RAID-1 / RAID-10)

Optimal for databases, VMs, and iSCSI block storage. Provides maximum IOPS, fast rebuild times, and survives loss of one disk per mirror vdev.

RAID-Z1 / RAID-Z2 / RAID-Z3

Single, double, or triple distributed parity (similar to RAID-5/6/7). Best capacity utilization for bulk media, backups, and file archives.

dRAID (Distributed Spare)

Distributes spare capacity across all member drives simultaneously, reducing multi-terabyte disk resilver times by up to 80%.

Special Allocation VDEV

Dedicated mirrored NVMe VDEV storing ZFS metadata, DDT, and small files (special_small_blocks) so HDD RAID-Z pools browse at flash speed.

Automated zpool create invocation with Special NVMe VDEV by axonwalld
bash
# Axonwall automatically invokes zpool with enterprise flags & optional Special VDEV:
zpool create -f \
  -o ashift=12 \
  -o autotrim=on \
  -O compression=zstd \
  -O acltype=posixacl \
  -O xattr=sa \
  -O dnodesize=auto \
  -O normalization=formD \
  -O mountpoint=/mnt/tank \
  tank raidz2 /dev/disk/by-id/scsi-disk{1..4} \
  special mirror /dev/disk/by-id/nvme-meta0 /dev/disk/by-id/nvme-meta1

Native AES-256-GCM Dataset Encryption & Block Volumes (Zvols)

Create granular filesystems and ZVOL block volumes tailored to each workload, with per-dataset Native OpenZFS Encryption (aes-256-gcm or aes-256-ccm via PBKDF2 passphrase or raw 32-byte key) and zero-downtime key load/unload via Web Console, axonwallctl nas unlock|lock, or MCP:

  • Encrypted Vault & Compliance Datasets: Enable encryption: aes-256-gcm with raw zfs send -w replication so standby HA peers store ciphertext without needing plaintext keys.
  • PostgreSQL / MySQL Datasets: Set recordSize: 16K with NVMe SLOG and specialSmallBlocks: 32K.
  • Virtual Machines & K3s Volumes: Set recordSize: 64K or create thin-provisioned type: zvol volumes for block access.
  • Large Media & Backup Archives: Set recordSize: 1M with compression: zstd.

Samba SMB3, Time Machine mDNS, WSDD2, NFSv4 & iSCSI

SMB3 VSS, Apple Time Machine mDNS & WSDD2

Axonwall configures Samba with native vfs_shadow_copy2 hooked directly into periodic ZFS snapshots so Windows clients browse historical versions in File Explorer, plus wsdd2 for instant Windows 11 Network Neighborhood discovery.

Enabling timeMachine: true activates vfs_fruit (fruit:time machine = yes, optional timeMachineMaxSizeGb) and automatically publishes _smb._tcp + _adisk._tcp Avahi mDNS records for zero-click macOS Finder discovery.

NFSv4 Exports & iSCSI Targets

Serve NFSv4 exports with CIDR restrictions and root squashing. For virtualized hypervisors (Proxmox, VMware ESXi), Axonwall configures Linux LIO (targetcli) iSCSI targets backed by ZFS zvols with CHAP authentication and ALUA multi-pathing.

Snapshots, Rollback, S.M.A.R.T. & Encrypted Cloud Sync

Configure automated hourly/daily/weekly ZFS snapshots, instant rollback (zfs rollback -r, with Root-on-ZFS zroot/rpool protection), scheduled smartd short/long self-tests & pool scrubs, HA zfs send -w -I mTLS streaming, and encrypted rclone offsite Cloud Sync tasks (Backblaze B2, AWS S3, Wasabi, Cloudflare R2, SFTP) in /etc/axonwall/storage.yaml:

S.M.A.R.T. Self-Tests & Scrub Schedules

Declarative scrubSchedules and smartSchedule generate systemd timers and /etc/smartd.conf thermal/wear alerts across SATA, SAS, and NVMe drives.

Offsite Cloud Sync (rclone + crypt)

cloudSyncTasks synchronize ZFS datasets to S3, B2, R2, Wasabi, or SFTP targets with bandwidth caps and client-side encryption.

/etc/axonwall/storage.yaml — Complete NasConfigSchema (nas:)
yaml
nas:
  enabled: true
  workgroup: WORKGROUP
  serverString: Axonwall Enterprise ZFS NAS
  wsddEnabled: true
  avahiTimeMachineEnabled: true
  pools:
    - name: tank
      topology: raidz2
      dataDisks:
        - /dev/disk/by-id/scsi-disk1
        - /dev/disk/by-id/scsi-disk2
        - /dev/disk/by-id/scsi-disk3
        - /dev/disk/by-id/scsi-disk4
      specialDisks:
        - /dev/disk/by-id/nvme-meta0
        - /dev/disk/by-id/nvme-meta1
      logDisks:
        - /dev/disk/by-id/nvme-slog0
      cacheDisks:
        - /dev/disk/by-id/nvme-l2arc0
      spareDisks:
        - /dev/disk/by-id/scsi-spare0
      compression: zstd
      ashift: 12
      autotrim: true
  datasets:
    - name: shares
      pool: tank
      type: filesystem
      compression: zstd
      quotaGb: 4096
      recordSize: 128K
      specialSmallBlocks: 32K
      encryption: aes-256-gcm
      keyFormat: passphrase
      replicateToHaPeer: true
    - name: vm-block01
      pool: tank
      type: zvol
      sizeGb: 256
      recordSize: 64K
      replicateToHaPeer: true
  snapshotPolicies:
    - dataset: tank/shares
      interval: hourly
      keepCount: 24
      replicateToHaPeer: true
      enabled: true
  scrubSchedules:
    - pool: tank
      scheduleCron: "0 2 * * 0"
      enabled: true
  cloudSyncTasks:
    - name: nightly-b2-vault
      dataset: tank/shares
      provider: b2
      bucketOrPath: axonwall-offsite-dr
      scheduleCron: "30 3 * * *"
      clientSideCrypt: true
      bandwidthLimitMbps: 250
      enabled: true
  smbShares:
    - name: Engineering
      dataset: tank/shares
      readOnly: false
      vssShadowCopy: true
      timeMachine: true
      timeMachineMaxSizeGb: 1024
  nfsExports:
    - dataset: tank/shares
      allowedCidrs:
        - 10.0.10.0/24
      readOnly: false
      noRootSquash: false
  iscsiTargets:
    - iqn: iqn.2026-11.com.axonwall:tank-vm-block01
      zvol: tank/vm-block01
      portalPort: 3260
  s3:
    enabled: true
    port: 8333
    objectLockCompliance: true

Axonwall Vault Edition (Immutable S3 Object-Lock Backup Appliance)

Selectable directly inside the unified axonwall-debian13-amd64.iso installer (edition: vault) or provisioned on any ZFS-enabled Axonwall host, Axonwall Vault Edition transforms the appliance into a ransomware-proof, air-gap-ready S3 backup target powered by SeaweedFS S3 Gateway over TLS on port 8333.

S3 Object-Lock WORM COMPLIANCE Mode

Compatible out-of-the-box with Veeam Backup & Replication, Restic, Kopia, Velero (K3s), and CloudNativePG WAL archiving. Enforces RFC-compliant S3 Object-Lock in strict COMPLIANCE retention mode backed by immutable OpenZFS snapshots and the internal PKI CA.

Host-Mode Perimeter Hardening

Vault Edition automatically disables WAN packet forwarding and locks ingress strictly to TLS S3 (tcp/8333), Web Console (tcp/2966), and administrative SSH, isolating backup repositories from lateral compromise.

Axonwall Vault Provisioning & Verification CLI
bash
# Provision SeaweedFS S3 Vault on ZFS pool 'tank' with Object-Lock COMPLIANCE mode (port 8333)
sudo axonwall-vault-provision --pool tank --port 8333 --object-lock COMPLIANCE

# Inspect SeaweedFS S3 health, TLS certificate trust, ZFS dataset immutability, and bucket retention
sudo axonwall-vault-status

OpenZFS ARC/L2ARC/ZIL Kernel Kstat Telemetry & MCP Storage Governance

axonwalld continuously parses in-kernel OpenZFS SPL kstats from /proc/spl/kstat/zfs/arcstats, /proc/spl/kstat/zfs/zil, and per-pool /proc/spl/kstat/zfs/<pool>/io—correlating them with eBPF fexit/vfs_fsync latency histograms:

1. ARC & L2ARC Hit Ratios

Tracks size vs. c_max, demand-data hits/misses, NVMe l2_hits / l2_size, and memory_throttle_count under K3s/KVM memory pressure.

2. ZIL & SLOG Synchronous Commits

Measures zil_commit_count, zil_commit_writer_count, and intent-log transaction allocation modes (itx_indirect_bytes vs. itx_copied_bytes) for database WAL & NFS sync writes.

3. MCP Storage Telemetry & Snapshots

Exposed via axonwall://nas/storage-telemetry, mcp_inspect_nas_storage (mcp:nas:read), and non-destructive mcp_nas_snapshot_or_scrub (mcp:nas:manage).