Files
Michael Crosby b438e97b93 Add cloud-hypervisor VMM backend for Linux hosts (#782)
apple/containerization currently runs containers in per-container VMs on
macOS hosts via Virtualization.framework. This adds a second VMM backend
so the same Swift orchestration layer (LinuxContainer / LinuxPod /
Vminitd gRPC contract) runs on Linux hosts via cloud-hypervisor + KVM.

**CloudHypervisor Swift package** (`Sources/CloudHypervisor/`) — a thin
client for cloud-hypervisor's REST-over-UDS API, layered on
AsyncHTTPClient. Endpoints cover VMM / VM lifecycle / hotplug (disk, fs,
net, vsock, remove-device). Cross-platform (compiles on macOS for unit
tests; consumed at runtime only by the Linux side of Containerization).

**CH backend in Containerization** — one cloud-hypervisor subprocess per
VM, gated behind `#if os(Linux)`. CHVirtualMachineManager /
CHVirtualMachineInstance mirror the VZ shape behind the existing
VirtualMachineManager / VirtualMachineInstance protocol. CHProcess and
VirtiofsdProcess manage the binaries; CHHotplugProvider handles
virtio-blk and virtio-fs runtime hotplug (with one virtiofsd per unique
source-hash tag, refcounted across containers).

**Linux host networking** — BridgeManager brings up a Linux bridge with
an IPv4 subnet and (opt-in via `--enable-nat`) iptables MASQUERADE +
scoped FORWARD rules. LinuxBridgedNetwork enslaves a fresh TAP per
container to the bridge. State is recorded under `/run/containerization`
so `cctl bridge delete` reverses exactly what create did. Bridge
teardown verifies the link kind via sysfs to refuse deleting non-bridge
interfaces.

**cctl run / bridge** — end-to-end Linux container run path (image pull,
ext4 rootfs assembly, VM boot, container exec) plus `cctl bridge
create|delete` for the host network plumbing.

**Build & dist** — `make linux-build` / `make linux-integration` build
and exercise the host side inside an apple/container `--virtualization`
dev container. `make dist-x86_64` produces a deployment tarball (cctl +
cloud-hypervisor + virtiofsd + initfs + kernel) cross-compiled from the
aarch64 dev container; pipeline documented in `docs/x86_64-build.md`.
Static-musl C deps and the Zig cross compiler are pinned by SHA256.

The host orchestrator runs as root. Per-VM runtime state lives under
`/run/containerization/ch/<UUID>` with mode 0700; UDS sockets inside are
bound with mode 0600. Vminitd's gRPC channel inherits that trust
boundary — socket-file perms are the auth.

Sandbox flags are upstream-secure by default. Two per-component opt-outs
exist for the apple/container dev-container case (where the host seccomp
profile SIGSYS-kills CH and virtiofsd):
- `CONTAINERIZATION_NO_CH_SECCOMP=1` — `cloud-hypervisor --seccomp
false`.
- `CONTAINERIZATION_NO_VIRTIOFSD_SANDBOX=1` — `virtiofsd --sandbox
none`. Each emits a one-shot `logger.warning` at process start. Legacy
alias `CONTAINERIZATION_RELAXED_SANDBOX=1` flips both. cctl spawns both
binaries with `setsid` and a minimal env allowlist (PATH / HOME /
RUST_LOG / RUST_BACKTRACE) so the parent's secrets don't leak to
children.

`make linux-integration` runs the cross-platform integration suite
against a real cloud-hypervisor VM inside the dev container. Linux runs
the cross-platform subset (`process true`/`false`/`echo hi`, virtiofs
round-trip, hotplug); the macOS suite is unchanged.

Signed-off-by: michael_crosby <michael_crosby@apple.com>
2026-07-02 11:20:22 -04:00

76 lines
3.4 KiB
Swift

//===----------------------------------------------------------------------===//
// Copyright © 2026 Apple Inc. and the Containerization project authors.
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// https://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
//===----------------------------------------------------------------------===//
import Foundation
/// On-disk record of state `BridgeManager.create()` modified, used by
/// `delete()` to restore the host. Stored at
/// `/run/containerization/bridge-<name>.state` (tmpfs — gone after host
/// reboot, which is fine because reboot already clears `ip_forward` and
/// the bridge link itself).
struct BridgeState: Codable, Equatable {
/// Whether `create()` programmed NAT (iptables MASQUERADE/FORWARD +
/// `ip_forward`). When `false`, the only thing `create()` did was bring
/// the bridge up — `delete()` only needs to remove the link, not roll
/// back NAT. State files predating this field are decoded as
/// `natEnabled = true` for back-compat.
let natEnabled: Bool
/// Value of `/proc/sys/net/ipv4/ip_forward` read at the *first*
/// `create()` call. Preserved across re-runs so `delete()` can restore
/// the host's true original value. Only set when `natEnabled`.
let prevIpForward: String?
/// Egress interface that `create()` used in the iptables rules — passed
/// explicitly by the caller, or auto-detected from `/proc/net/route`.
/// Only set when `natEnabled`. Recorded for debug / observability and
/// to scope the FORWARD rule's `-o` clause; rule removal is keyed off
/// subnet, bridge name, and egress.
let egressInterface: String?
init(natEnabled: Bool, prevIpForward: String? = nil, egressInterface: String? = nil) {
self.natEnabled = natEnabled
self.prevIpForward = prevIpForward
self.egressInterface = egressInterface
}
enum CodingKeys: String, CodingKey {
case natEnabled
case prevIpForward
case egressInterface
}
init(from decoder: Decoder) throws {
let container = try decoder.container(keyedBy: CodingKeys.self)
// Default natEnabled to true when missing so files written by older
// versions (which always programmed NAT) still describe themselves
// accurately — delete() will roll back ip_forward / iptables.
self.natEnabled = try container.decodeIfPresent(Bool.self, forKey: .natEnabled) ?? true
self.prevIpForward = try container.decodeIfPresent(String.self, forKey: .prevIpForward)
self.egressInterface = try container.decodeIfPresent(String.self, forKey: .egressInterface)
}
func encode() throws -> Data {
let encoder = JSONEncoder()
encoder.outputFormatting = [.prettyPrinted, .sortedKeys]
return try encoder.encode(self)
}
static func decode(_ data: Data) throws -> BridgeState {
try JSONDecoder().decode(BridgeState.self, from: data)
}
}