fleet/orbit
Juan Fernandez 6939af045d
Fleet desktop should use lightweight endpoint for getting failing policies count (#8159)
Fleet desktop should use lightweight endpoint for getting failing policies count
2022-10-12 17:13:43 -03:00
..
changes Orbit: Add retries to launchctl bootstrap to fix issue with MDM push (#8187) 2022-10-12 15:59:01 -03:00
cmd Fleet desktop should use lightweight endpoint for getting failing policies count (#8159) 2022-10-12 17:13:43 -03:00
docs Update go-tuf to v0.5.0 (bis) (#8112) 2022-10-07 17:03:39 -03:00
pkg Orbit: Add retries to launchctl bootstrap to fix issue with MDM push (#8187) 2022-10-12 15:59:01 -03:00
tools Update notarization to use notarytool (#7962) 2022-09-27 08:25:42 -07:00
.gitattributes Add 'orbit/' from commit 'ab3047bb39f1e2be331d1ff18b4eb768619033c4' 2021-08-04 16:58:25 -03:00
.gitignore Add 'orbit/' from commit 'ab3047bb39f1e2be331d1ff18b4eb768619033c4' 2021-08-04 16:58:25 -03:00
.gon.hcl Build universal macOS binaries for Orbit (#6208) 2022-06-13 19:43:47 -03:00
.goreleaser.yml Update notarization to use notarytool (#7962) 2022-09-27 08:25:42 -07:00
CHANGELOG.md Prepare for Orbit 1.1.0 (#7315) 2022-08-19 08:27:50 -07:00
LICENSE Add 'orbit/' from commit 'ab3047bb39f1e2be331d1ff18b4eb768619033c4' 2021-08-04 16:58:25 -03:00
README.md Add handling for Apple Team ID in Notarization (#7991) 2022-10-04 09:48:21 -07:00

Fleet logo, landscape, dark text, transparent background

Orbit osquery

Orbit is an osquery runtime and autoupdater. With Orbit, it's easy to deploy osquery, manage configurations, and stay up to date. Orbit eases the deployment of osquery connected with a Fleet server, and is a (near) drop-in replacement for osquery in a variety of deployment scenarios.

Orbit is the recommended agent for Fleet. But Orbit can be used with or without Fleet, and Fleet can be used with or without Orbit.

Documentation

Try Orbit

With fleetctl preview already running:

# With fleetctl in your $PATH
# Generate a macOS installer pointed at your local Fleet
fleetctl package --type=pkg --fleet-url=localhost:8412 --insecure --enroll-secret=YOUR_FLEET_ENROLL_SECRET_HERE

With fleetctl preview running, you can find your Fleet enroll secret by selecting the "Add new host" button on the Hosts page in the Fleet UI.

An installer configured to point at your Fleet instance has now been generated.

Now run that installer (double click, on a Mac) to enroll your own computer as a host in Fleet. Refresh after several seconds (≈30s), and you should now see your local computer as a new host in Fleet.

Bugs

To report a bug or request a feature, click here.

Capabilities

Capability Status
Secure autoupdate for osquery
Secure autoupdate for Orbit
Configurable update channels
Full osquery flag customization
Package tooling for macOS .pkg
Package tooling for Linux .deb
Package tooling for Linux .rpm
Package tooling for Windows .msi
Manage/update osquery extensions 🔜
Manage cgroups for Linux performance 🔜

Usage

General information and flag documentation can be accessed by running orbit --help.

Permissions

Orbit generally expects root permissions to be able to create and access it's working files.

To get root level permissions:

macOS/Linux

Prefix orbit commands with sudo (sudo orbit ...) or run in a root shell.

Windows

Run Powershell or cmd.exe with "Run as administrator" and start orbit commands from that shell.

Osquery shell

Run an osqueryi shell with orbit osqueryi or orbit shell.

Connect to a Fleet server

Use the --fleet-url and --enroll-secret flags to connect to a Fleet server.

For example:

orbit --fleet-url=https://localhost:8080 --enroll-secret=the_secret_value

Use --fleet_certificate to provide a path to a certificate bundle when necessary for osquery to verify the authenticity of the Fleet server (typically when using a Windows client or self-signed certificates):

orbit --fleet-url=https://localhost:8080 --enroll-secret=the_secret_value --fleet-certificate=cert.pem

Add the --insecure flag for connections using otherwise invalid certificates:

orbit --fleet-url=https://localhost:8080 --enroll-secret=the_secret_value --insecure

Osquery flags

Orbit can be used as near drop-in replacement for osqueryd, enhancing standard osquery with autoupdate capabilities. Orbit passes through any options after -- directly to the osqueryd instance.

For example, the following would be a typical drop-in usage of Orbit:

orbit -- --flagfile=flags.txt

Packaging

Orbit, like standalone osquery, is typically deployed via OS-specific packages. Tooling is provided with this repository to generate installation packages.

Dependencies

Orbit currently supports building packages on macOS and Linux.

Before building packages, clone or download this repository and install Go.

Building Windows packages requires Docker to be installed.

Packaging support

  • macOS - .pkg package generation with (optional) Notarization and codesigning - Persistence via launchd.

  • Linux - .deb (Debian, Ubuntu, etc.) & .rpm (RHEL, CentOS, etc.) package generation - Persistence via systemd.

  • Windows - .msi package generation - Persistence via Services.

Building packages

Use fleetctl package to run the packaging tools.

The only required parameter is --type, use one of deb, rpm, pkg, or msi.

Configure osquery to connect to a Fleet (or other TLS) server with the --fleet-url and --enroll-secret flags.

A minimal invocation for communicating with Fleet:

fleetctl package --type deb --fleet-url=fleet.example.com --enroll-secret=notsosecret

This will build a .deb package configured to communicate with a Fleet server at fleet.example.com using the enroll secret notsosecret.

When the Fleet server uses a self-signed (or otherwise invalid) TLS certificate, package with the --insecure or --fleet-certificate options.

See fleetctl package for the full range of packaging options.

Update channels

Orbit uses the concept of "update channels" to determine the version of Orbit, osquery, and any extensions (extension support coming soon) to run. This concept is modeled from the common versioning convention for Docker containers.

Configure update channels for Orbit and osqueryd with the --orbit-channel and --osqueryd-channel flags when packaging.

Channel Versions
4 4.x.x
4.6 4.6.x
4.6.0 4.6.0

Additionally stable and edge are special channel names. The stable channel will provide the most recent osquery version that Fleet deems to be stable. When a new version of osquery is released, it is added to the edge channel for beta testing. Fleet then provides input to the osquery TSC based on testing. After the version is declared stable by the osquery TSC, Fleet will promote the version to stable ASAP.

macOS signing & Notarization

Orbit's packager can automate the codesigning and Notarization steps to allow the resulting package to generate packages that appear "trusted" when install on macOS hosts. Signing & notarization are supported only on macOS hosts.

For signing, a "Developer ID Installer" certificate must be available on the build machine (generation instructions). Use security find-identity -v to verify the existence of this certificate and make note of the identifier provided in the left column.

For Notarization, valid App Store Connect credentials must be available on the build machine. Set these in the environment variables AC_USERNAME and AC_PASSWORD. It is common to configure this via app-specific passwords. Some organizations (notably those with Apple Enterprise Developer Accounts) may also need to specify AC_TEAM_ID. This value can be found on the Apple Developer "Membership" page under "Team ID".

Build a signed and notarized macOS package with an invocation like the following:

AC_USERNAME=zach@example.com AC_PASSWORD=llpk-sije-kjlz-jdzw fleetctl package --type=pkg --fleet-url=fleet.example.com --enroll-secret=63SBzTT+2UyW --sign-identity 3D7260BF99539C6E80A94835A8921A988F4E6498 --notarize

This process may take several minutes to complete as the Notarization process completes on Apple's servers.

After successful notarization, the generated "ticket" is automatically stapled to the package.

Orbit Osquery Result and Status Logs

If the logger_path configuration is set to filesystem, Orbit will store osquery's "result" and "status" logs to the following directories:

  • Windows: C:\Program Files\Orbit\osquery_log
  • macOS: /opt/orbit/osquery_log
  • Linux: /opt/orbit/osquery_log

Orbit Development

Run Orbit From Source

To execute orbit from source directly, run the following command:

go run github.com/fleetdm/fleet/v4/orbit/cmd/orbit \
    --dev-mode \
    --disable-updates \
    --root-dir /tmp/orbit \
    --fleet-url https://localhost:8080 \
    --insecure \
    --enroll-secret Pz3zC0NMDdZfb3FtqiLgwoexItojrYh/ \
    -- --verbose

Or, using a flagfile.txt for osqueryd:

go run github.com/fleetdm/fleet/v4/orbit/cmd/orbit \
    --dev-mode \
    --disable-updates \
    --root-dir /tmp/orbit \
    -- --flagfile=flagfile.txt --verbose
Generate Installer Packages from Orbit Source

The fleetctl package command generates installers by fetching the targets/executables from a TUF repository. To generate an installer that contains an Orbit built from source you need to setup a local TUF repository. The following document explains how you can generate a TUF repository, and installers that use it tools/tuf/test.

Troubleshooting

Logs

Orbit captures and streams osqueryd's stdout/stderr into its own stdout/stderr output. Following are the destination of logs for each platform (to access such locations the user will need administrative permissions on the host):

  • Linux: Orbit and osqueryd stdout/stderr output is sent to syslog (/var/log/syslog on Debian systems and /var/log/messages on CentOS).
  • macOS: /private/var/log/orbit/orbit.std{out|err}.log.
  • Windows: C:\Windows\system32\config\systemprofile\AppData\Local\FleetDM\Orbit\Logs\orbit-osquery.log (the log file is rotated).

Debug

You can use the --debug option in fleetctl package to generate installers in "debug mode". Such mode increases the verbosity of logging for orbit and osqueryd (log DEBUG level).

Uninstall

Windows

Use the "Add or remove programs" dialog to remove Orbit.

Linux

Uninstall the package with the corresponding package manager:

  • Ubuntu
sudo apt remove fleet-osquery -y
  • CentOS
sudo rpm -e fleet-osquery-X.Y.Z.x86_64

macOS

Run the cleanup script.

FAQs

How does Orbit compare with Kolide Launcher?

Orbit is inspired by the success of Kolide Launcher, and approaches a similar problem domain with new strategies informed by the challenges encountered in real world deployments. Orbit does not share any code with Launcher.

  • Both Orbit and Launcher use The Update Framework specification for managing updates. Orbit utilizes the official go-tuf library, while Launcher has it's own implementation of the specification.
  • Orbit can be deployed as a (near) drop-in replacement for osquery, supporting full customization of the osquery flags. Launcher heavily manages the osquery flags making deployment outside of Fleet or Kolide's SaaS difficult.
  • Orbit prefers the battle-tested plugins of osquery. Orbit uses the built-in logging, configuration, and live query plugins, while Launcher uses custom implementations.
  • Orbit prefers the built-in osquery remote APIs. Launcher utilizes a custom gRPC API that has led to issues with character encoding, load balancers/proxies, and request size limits.
  • Orbit encourages use of the osquery performance Watchdog, while Launcher disables the Watchdog.

Additionally, Orbit aims to tackle problems out of scope for Launcher:

  • Configure updates via release channels, providing more granular control over agent versioning.
  • Support for deploying and updating osquery extensions (🔜).
  • Manage osquery versions and startup flags from a remote (Fleet) server (🔜).
  • Further control of osquery performance via cgroups (🔜).

Is Orbit Free?

Yes! Orbit is licensed under an MIT license and all uses are encouraged.

How does orbit update osquery? And how do the stable and edge channels get triggered to update osquery on a self hosted Fleet instance?

Orbit uses a configurable update server. We expect that many folks will just use the update server we manage (similar to what Kolide does with Launcher's update server). We are also offering tooling for self-managing an update server as part of Fleet Premium (the subscription offering).

Community

Chat

Please join us in the #fleet channel on osquery Slack.

Banner featuring a futuristic cloud city with the Fleet logo