Commit Graph

5310 Commits

Author SHA1 Message Date
widberg
e62ec85444 [Table sanity check] startup_items (#5864) 2019-10-05 19:14:33 -04:00
widberg
a81688809a [Table sanity check] npm_packages (#5857) 2019-10-05 10:30:52 -04:00
adhamehab
657932cd2c Upgrade Python tools to Python3 (#5846) 2019-10-05 10:30:10 -04:00
Stefano Bonicatti
8de035ba94 Improve error reporting from extension manager (#5860)
Change the message that is logged when a required extension is not
loaded or found from "Extension not autoloaded: <extension id>" to
"Required extension not found or not loaded: <extension id>".

Change the message that is logged when the extension manager has an
error happening during startup from "Cannot start extension manager:
<error>" to "An error occurred during extension manager startup: <error>"

Add the possibility of startExtensionManager returning with an error
if the Dispatcher failed to properly add the ExtensionManagerWatcher
or ExtensionManagerRunner.

Fallback to logging the startExtensionManager error message with a
severity of INFO only if extensions are required to be disabled.

Add tests for starting the extension manager with a nonexistent
socket path and a nonexistent required extension.

Issue osquery/osquery#5679
2019-10-04 15:44:54 -04:00
William Woodruff
a9b23807b2 darwin/firewall: Fixes for alf_exceptions, make alf_services an alias for sharing_preferences (#5378) 2019-10-04 15:42:10 -04:00
William Woodruff
06dd05cd33 (Windows) New table: connectivity (#5500) 2019-10-04 15:18:15 -04:00
seph
ba81289baf Documentation around process-auditing (#5852) 2019-10-04 16:47:28 +02:00
Stefano Bonicatti
f2007c7057 Temporarily disable Buck tests on Linux (#5856)
Buck compiles tests in Debug mode even if supposedly told otherwise,
this exhausts disk space available on the CI and makes the step always fail.
2019-10-03 21:26:34 -04:00
Teddy Reed
92e7b9033d
fuzzing: Restore simple libFuzzer-based config fuzzing (#5844)
This defines a new CMake option: OSQUERY_FUZZ, which appends compiler
and linker flags for libFuzzer to be effective.

There is one example harness that will fuzz config parsing.
2019-10-02 18:09:35 -04:00
Teddy Reed
0f3ad48b77
bug: Use RecursiveMutex and additional read locking on getEventSubscriber (#5841) 2019-10-02 01:02:24 -04:00
Stefano Bonicatti
457150c94c CMake: Improve submodule patching system (#5850)
Keep patched source in the build directory instead of the source.

A new variable with the format OSQUERY_<submodule name>_ROOT_DIR
is set to the directory of where the submodule is, in case it's patched.

A new option PATCH has been added to importSourceModule
to let the patching system know that the submodule has to be patched
and which is the main submodule folder.
2019-10-01 17:47:10 -04:00
Teddy Reed
52171f5676
azure/macos: Fix for brew/ant install failing (#5845) 2019-09-30 11:35:27 -04:00
Teddy Reed
54859ace98
tests: Enable RocksDB plugin tests (#5832) 2019-09-27 08:26:53 -04:00
grrrrrrrrrr
31e6dfdfeb Fix make rpm script to not break because of symlinks (#5780)
Signed-off-by: grant <grantseltzer@gmail.com>
2019-09-26 07:32:21 -04:00
Stefano Bonicatti
dd575f93f4 Add a test for the format_check script (#5835)
The test modifies the source code, appending "\n\n" at the end of each .cpp files.

Then runs the format_check target and verifies if the list of files to be formatted,
identified by the script, are the same ones previously modified.
2019-09-25 23:35:43 -04:00
Zachary Wasserman
fe284506ac Fix typo in ValidationMap type name (#5837) 2019-09-25 23:35:15 -04:00
Teddy Reed
e5599c01f3
packaging: Fix up make_osx_package to work for version 4+ (#5827) 2019-09-25 23:00:01 -04:00
Teddy Reed
bb25075599
linux: Add --build-id linker option (#5823) 2019-09-25 15:20:22 -04:00
Stefano Bonicatti
6f3063bef7 Specify PATH when calling format_check if using the custom toolchain (#5834)
The script would not find clang-format or it would use the system one,
which it shouldn't.
2019-09-24 19:17:55 -04:00
Zachary Wasserman
2a6ddd62ea Implementation of windows_security_products table (#5479)
Provides information about the security products registered on a Windows
system.
2019-09-23 17:44:31 -04:00
Zachary Wasserman
9a2304aa57 Update Windows build instructions (#5820)
Co-Authored-By: Stefano Bonicatti <smjert@gmail.com>
2019-09-23 17:41:11 -04:00
Teddy Reed
835ae84635
CPack: Linux package nitpicks and docs (#5822)
This fixes the license for RPMs, sets the homepage for DEBs, and sets
the package revision correctly.
2019-09-23 17:39:27 -04:00
Nick Anderson
789f70f2d9 deploy: updating osquery --install to wrap binary path and flagfile (#5824) 2019-09-23 17:38:20 -04:00
Teddy Reed
9134c7a6d1
format: Fix auto-formatting and format checking (#5830) 2019-09-23 17:32:06 -04:00
Tomohito Nakayama
553ab52b38 Fix error with implicitly-deleted default constructor of glob_t (#5828) 2019-09-22 01:03:46 -04:00
Zachary Wasserman
33f7c6fc3f Prune Vagrant boxes and fix AWS support (#5819)
- Remove Vagrant boxes provided by individual users and not well-known organizations.
- Use osquery/aws-dummy box for AWS support.
- Fix AWS startup when used without VPC and subnet.
2019-09-21 21:02:12 -04:00
Teddy Reed
bbec01d5fa
Revert "Remove deprecated macOS package generator (#5808)" (#5821)
This reverts commit 54289cd3d4.
2019-09-21 19:02:38 -04:00
seph
8e678847c2 Fix MSI Service Error handling
When ErrorControl is set to `critical`, a failure to start osquery results in a system reboot. Instead, this should be set to `normal` where it is logged and the startup proceeds.

Upstream docs are Docs are http://wixtoolset.org/documentation/manual/v3/xsd/wix/serviceinstall.html

This was fixed in https://github.com/osquery/osquery/pull/5467 and seems to have gotten lost.
2019-09-19 12:32:35 -04:00
Zachary Wasserman
010949cc4e Suppress Boost warnings about newer compiler (#5816) 2019-09-19 01:19:26 +02:00
Zachary Wasserman
5cec1f4331
Upgrade SQLite to 3.29.0 on macOS and Windows (#5810)
Mitigates recent CVEs in SQLite. It was already this version on Linux.

Establish a pattern for migrating source dependency builds to macOS and Windows.
2019-09-18 15:49:27 -07:00
Alessandro Gario
65aca42e5f
CMake: Add CentOS to the RPM-based distributions (#5809) 2019-09-16 21:19:39 +02:00
Alessandro Gario
54289cd3d4
Remove deprecated macOS package generator (#5808) 2019-09-16 17:03:36 +02:00
seph
4f9f63a667 Update CHANGELOG for 4.0.2 (#5803) 2019-09-12 18:34:44 -04:00
Stefano Bonicatti
57f9916473 Patch environment file path in initd and systemd scripts during DEB packaging (#5802)
Also add a check to systemd script to create and empty config file,
if this is missing.

Co-authored-by: seph <seph@directionless.org>
2019-09-12 18:02:23 -04:00
Alessandro Gario
b3a9342783
CMake: The AWS library was not correctly enabling OpenSSL support (#5799) 2019-09-12 20:01:46 +02:00
Stefano Bonicatti
1463d0a76e Add make to be installed among the other packages on Linux (#5784)
Also use --no-install-recommends to avoid installing unneeded packages.
2019-09-12 13:24:09 -04:00
Teddy Reed
516c0e4563
rocksdb: Remove use of OptimizeForSmallDB in rocksdb plugin (#5797)
This fixes the crash in #5793.

The fix was attempted in a31d758 but it did not include the existing plugin implementation.
2019-09-12 13:22:56 -04:00
Nick Anderson
11d3ff476a deploy: updating msi build script (#5794)
Summary: This adds a few minor updates to the MSI build function. First
it keeps build artifacts located in `build/msi` for ease of access.
Further it updates component referneces to be x64 compatible. Finally it
updates a few path references to reflect the new repo layout, as well as
changes a few references for author and ownership information to be
osquery.

Test Plan: Will update with sample MSI builds for Cmake.
2019-09-12 13:13:17 -04:00
seph
83a9ecfad8 Fix the website download link schemas
We use this tool to generate a PR to the website. However, the download links are broken. This is because they need `platform` and not `url`. I don't know the history of the change here, but empirically we need it.

Relates to:
* https://github.com/osquery/osquery-site/pull/88
* https://github.com/osquery/osquery-site/pull/148
2019-09-11 14:18:53 -04:00
Nick Anderson
492fb79390
deploy: update windows choco scripts to migrate service to Program Files (#5790) 2019-09-11 08:24:17 -07:00
Alessandro Gario
15ddbfb472
Buck: Update version to 4.0.1 (#5786) 2019-09-10 03:13:44 +02:00
Stefano Bonicatti
66601db099 Fix OpenSSL build when no system ar is installed (#5782)
OpenSSL should use the ar binary provided by the custom toolchain.
Also updated the docker image to avoid installing binutils and hiding the
issue.
2019-09-09 19:19:20 -04:00
Alessandro Gario
bbdb491b6b
docs: Add the Coverity scan build status (#5783) 2019-09-09 22:18:59 +02:00
Stefano Bonicatti
c34ef2aaa3
Fix MSI installed service missing quotes on flagfile argument (#5778) 2019-09-09 18:33:48 +02:00
Teddy Reed
f4bd3e1630
deployment: Add Mozilla CA certificate store 2019-08-28 (#5773)
* deployment: Add Mozilla CA certificate store 2019-08-28

This is the cacerts file that was once proviced by the OpenSSL Homebrew
formula. The osquery packages in 3.x and previous provided this store as
the default / fallback.

The hash can be corroborated via:
https://curl.haxx.se/ca/cacert.pem.sha256

38b6230aa4bee062cd34ee0ff6da173250899642b1937fc130896290b6bd91e3

* install certs.pem directly from source
2019-09-08 17:42:01 -04:00
Teddy Reed
be28d9c8de
libraries: Add patch to thrift to ignore EINTR (#5776) 2019-09-08 17:41:26 -04:00
Mike Myers
802e667d85 Readthedocs cleanup (#5767)
* Update HTTP links to HTTPS links, point to current URIs, update test-running steps.
* Clarify a minor missing cd step in the shell commands; minor format fixes.
* Add a note about how to isolate individual unit tests, using GTEST_FILTER.
* Drop first-person voice in docs/wiki/deployment/debugging.md.
* Document that osqueryd -S == osqueryi.
* Add new build steps for Linux using the custom toolchain.

Co-Authored-By: seph <github@directionless.org>
2019-09-08 11:59:18 -04:00
Alessandro Gario
c83e70f91f
Intel ME table refactor (#5476)
Reimplement the intel_me_info table, adding support for all the
three available query protocols.
2019-09-08 10:26:56 +02:00
Teddy Reed
e72ae6b48f
cpack: Only use CMAKE_SET_DESTDIR for TGZ generator (#5772) 2019-09-07 18:16:19 -04:00
Teddy Reed
1b0edf5ba4
cpack: Apply existing Linux package conventions (#5770) 2019-09-07 15:53:20 -04:00